[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:59:29.441874   430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.190:44469
I20260709 12:59:29.443324   430 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:59:29.444401   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:29.464061   437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:29.464296   436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:29.467847   439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:30.692165   438 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 12:59:30.692282   430 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:59:30.696732   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:30.696962   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:30.697115   430 hybrid_clock.cc:648] HybridClock initialized: now 1783601970697098 us; error 0 us; skew 500 ppm
I20260709 12:59:30.697903   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:30.704821   430 webserver.cc:533] Webserver started at http://127.0.107.190:44283/ using document root <none> and password file <none>
I20260709 12:59:30.705657   430 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:30.705847   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:30.706254   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:30.711975   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/master-0-root/instance:
uuid: "f5d091f801d24993a07d0730bfa9542b"
format_stamp: "Formatted at 2026-07-09 12:59:30 on dist-test-slave-th5x"
I20260709 12:59:30.719890   430 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:59:30.724824   445 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:30.725917   430 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:59:30.726198   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/master-0-root
uuid: "f5d091f801d24993a07d0730bfa9542b"
format_stamp: "Formatted at 2026-07-09 12:59:30 on dist-test-slave-th5x"
I20260709 12:59:30.726481   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:30.789216   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:30.790741   430 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:59:30.791159   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:30.872346   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.190:44469
I20260709 12:59:30.872409   496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.190:44469 every 8 connection(s)
I20260709 12:59:30.881083   497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:30.903359   497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b: Bootstrap starting.
I20260709 12:59:30.909858   497 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:30.912425   497 log.cc:826] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b: Log is configured to *not* fsync() on all Append() calls
I20260709 12:59:30.917459   497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b: No bootstrap required, opened a new log
I20260709 12:59:30.939270   497 raft_consensus.cc:359] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5d091f801d24993a07d0730bfa9542b" member_type: VOTER }
I20260709 12:59:30.939874   497 raft_consensus.cc:385] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:30.940083   497 raft_consensus.cc:740] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d091f801d24993a07d0730bfa9542b, State: Initialized, Role: FOLLOWER
I20260709 12:59:30.940892   497 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5d091f801d24993a07d0730bfa9542b" member_type: VOTER }
I20260709 12:59:30.941354   497 raft_consensus.cc:399] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:30.941593   497 raft_consensus.cc:493] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:30.941888   497 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.946048   497 raft_consensus.cc:515] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5d091f801d24993a07d0730bfa9542b" member_type: VOTER }
I20260709 12:59:30.946818   497 leader_election.cc:304] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5d091f801d24993a07d0730bfa9542b; no voters: 
I20260709 12:59:30.948923   497 leader_election.cc:290] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:30.949446   500 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:30.952248   500 raft_consensus.cc:697] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [term 1 LEADER]: Becoming Leader. State: Replica: f5d091f801d24993a07d0730bfa9542b, State: Running, Role: LEADER
I20260709 12:59:30.953284   500 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5d091f801d24993a07d0730bfa9542b" member_type: VOTER }
I20260709 12:59:30.953864   497 sys_catalog.cc:565] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:30.965847   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5d091f801d24993a07d0730bfa9542b. Latest consensus state: current_term: 1 leader_uuid: "f5d091f801d24993a07d0730bfa9542b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5d091f801d24993a07d0730bfa9542b" member_type: VOTER } }
I20260709 12:59:30.965899   501 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5d091f801d24993a07d0730bfa9542b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5d091f801d24993a07d0730bfa9542b" member_type: VOTER } }
I20260709 12:59:30.966876   501 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:30.968377   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:30.971460   509 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:30.984329   509 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:30.986626   430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:31.004585   509 catalog_manager.cc:1383] Generated new cluster ID: 414ba11179174a6897d52d9907b5879f
I20260709 12:59:31.004899   509 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:31.025866   509 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:31.028070   509 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:31.049196   509 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b: Generated new TSK 0
I20260709 12:59:31.050434   509 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:31.117969   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:31.127033   519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:31.129261   520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:31.133255   522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:31.133533   430 server_base.cc:1061] running on GCE node
I20260709 12:59:31.134652   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:31.134927   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:31.135128   430 hybrid_clock.cc:648] HybridClock initialized: now 1783601971135108 us; error 0 us; skew 500 ppm
I20260709 12:59:31.135972   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:31.140340   430 webserver.cc:533] Webserver started at http://127.0.107.129:43473/ using document root <none> and password file <none>
I20260709 12:59:31.141029   430 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:31.141283   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:31.141613   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:31.143126   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-0-root/instance:
uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
format_stamp: "Formatted at 2026-07-09 12:59:31 on dist-test-slave-th5x"
I20260709 12:59:31.150548   430 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:59:31.155845   527 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:31.156718   430 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:59:31.157078   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-0-root
uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
format_stamp: "Formatted at 2026-07-09 12:59:31 on dist-test-slave-th5x"
I20260709 12:59:31.157441   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:31.176842   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:31.178560   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:31.181735   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:31.187024   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:31.187335   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:31.187682   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:31.187904   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:31.297848   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.129:35251
I20260709 12:59:31.297955   589 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.129:35251 every 8 connection(s)
I20260709 12:59:31.306058   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:31.317288   594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:31.318718   595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:31.331609   430 server_base.cc:1061] running on GCE node
W20260709 12:59:31.333271   597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:31.334336   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:31.334578   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:31.334760   430 hybrid_clock.cc:648] HybridClock initialized: now 1783601971334736 us; error 0 us; skew 500 ppm
I20260709 12:59:31.335326   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:31.339277   430 webserver.cc:533] Webserver started at http://127.0.107.130:40891/ using document root <none> and password file <none>
I20260709 12:59:31.339833   430 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:31.340055   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:31.340343   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:31.341501   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-1-root/instance:
uuid: "febfd6ab8383479fbed5591c1f163f8a"
format_stamp: "Formatted at 2026-07-09 12:59:31 on dist-test-slave-th5x"
I20260709 12:59:31.345077   590 heartbeater.cc:344] Connected to a master server at 127.0.107.190:44469
I20260709 12:59:31.345556   590 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:31.346850   590 heartbeater.cc:507] Master 127.0.107.190:44469 requested a full tablet report, sending...
I20260709 12:59:31.348587   430 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:59:31.350445   462 ts_manager.cc:194] Registered new tserver with Master: 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251)
I20260709 12:59:31.354007   462 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46394
I20260709 12:59:31.354137   602 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:31.355137   430 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:59:31.355472   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-1-root
uuid: "febfd6ab8383479fbed5591c1f163f8a"
format_stamp: "Formatted at 2026-07-09 12:59:31 on dist-test-slave-th5x"
I20260709 12:59:31.355824   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:31.371750   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:31.373050   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:31.375097   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:31.378242   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:31.378458   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:31.378710   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:31.378880   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:31.477932   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.130:43829
I20260709 12:59:31.478232   664 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.130:43829 every 8 connection(s)
I20260709 12:59:31.486402   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:31.493177   668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:31.495380   669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:31.503368   665 heartbeater.cc:344] Connected to a master server at 127.0.107.190:44469
I20260709 12:59:31.503914   665 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:31.505267   665 heartbeater.cc:507] Master 127.0.107.190:44469 requested a full tablet report, sending...
I20260709 12:59:31.508226   462 ts_manager.cc:194] Registered new tserver with Master: febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
W20260709 12:59:31.510064   671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:31.510516   462 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46406
I20260709 12:59:31.510633   430 server_base.cc:1061] running on GCE node
I20260709 12:59:31.511655   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:31.511898   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:31.512096   430 hybrid_clock.cc:648] HybridClock initialized: now 1783601971512077 us; error 0 us; skew 500 ppm
I20260709 12:59:31.512650   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:31.515457   430 webserver.cc:533] Webserver started at http://127.0.107.131:37807/ using document root <none> and password file <none>
I20260709 12:59:31.515949   430 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:31.516165   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:31.516443   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:31.517449   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-2-root/instance:
uuid: "fe56c01ed8bd493fb16386bc7788d12d"
format_stamp: "Formatted at 2026-07-09 12:59:31 on dist-test-slave-th5x"
I20260709 12:59:31.521965   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:59:31.525513   676 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:31.526535   430 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:59:31.526819   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-2-root
uuid: "fe56c01ed8bd493fb16386bc7788d12d"
format_stamp: "Formatted at 2026-07-09 12:59:31 on dist-test-slave-th5x"
I20260709 12:59:31.527102   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601969268282-430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:31.555400   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:31.556897   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:31.558401   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:31.560823   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:31.561002   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:31.561287   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:31.561447   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:31.660609   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.131:35453
I20260709 12:59:31.660759   738 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.131:35453 every 8 connection(s)
I20260709 12:59:31.682337   739 heartbeater.cc:344] Connected to a master server at 127.0.107.190:44469
I20260709 12:59:31.682749   739 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:31.683717   739 heartbeater.cc:507] Master 127.0.107.190:44469 requested a full tablet report, sending...
I20260709 12:59:31.685964   462 ts_manager.cc:194] Registered new tserver with Master: fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:31.686136   430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019478058s
I20260709 12:59:31.687717   462 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46418
I20260709 12:59:31.739307   462 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46434:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:31.743369   462 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:31.865336   553 tablet_service.cc:1511] Processing CreateTablet for tablet 9180566ec79941fa8b6dad86794f0cef (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:31.867504   552 tablet_service.cc:1511] Processing CreateTablet for tablet 3452ab3dbfc1464899a830ac4a4acf4e (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:31.868678   551 tablet_service.cc:1511] Processing CreateTablet for tablet a90536cc45b24877817ac362df08ed23 (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:31.872830   555 tablet_service.cc:1511] Processing CreateTablet for tablet 08689662ab824b2986eea00921bba052 (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:31.873427   554 tablet_service.cc:1511] Processing CreateTablet for tablet 7adb65f8c6f14f3cba488babb397ed19 (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:31.875805   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3452ab3dbfc1464899a830ac4a4acf4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.876426   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90536cc45b24877817ac362df08ed23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.879855   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7adb65f8c6f14f3cba488babb397ed19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.882378   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08689662ab824b2986eea00921bba052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.874003   550 tablet_service.cc:1511] Processing CreateTablet for tablet eab57531d0314db387a141a8180a111e (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:31.886498   549 tablet_service.cc:1511] Processing CreateTablet for tablet b785b9dc055f42ac812e2bc285203aca (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:31.890473   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9180566ec79941fa8b6dad86794f0cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.891448   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab57531d0314db387a141a8180a111e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.897163   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b785b9dc055f42ac812e2bc285203aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.898022   704 tablet_service.cc:1511] Processing CreateTablet for tablet 08689662ab824b2986eea00921bba052 (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:31.903184   701 tablet_service.cc:1511] Processing CreateTablet for tablet 3452ab3dbfc1464899a830ac4a4acf4e (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:31.906857   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3452ab3dbfc1464899a830ac4a4acf4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.914290   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08689662ab824b2986eea00921bba052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.907754   703 tablet_service.cc:1511] Processing CreateTablet for tablet 7adb65f8c6f14f3cba488babb397ed19 (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:31.923085   548 tablet_service.cc:1511] Processing CreateTablet for tablet f7ce4b08ecc2415ca8c110f159c093f5 (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:31.924997   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ce4b08ecc2415ca8c110f159c093f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.914762   702 tablet_service.cc:1511] Processing CreateTablet for tablet 9180566ec79941fa8b6dad86794f0cef (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:31.930578   698 tablet_service.cc:1511] Processing CreateTablet for tablet b785b9dc055f42ac812e2bc285203aca (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:31.933374   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7adb65f8c6f14f3cba488babb397ed19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.917930   700 tablet_service.cc:1511] Processing CreateTablet for tablet a90536cc45b24877817ac362df08ed23 (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:31.935911   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9180566ec79941fa8b6dad86794f0cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.930572   699 tablet_service.cc:1511] Processing CreateTablet for tablet eab57531d0314db387a141a8180a111e (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:31.943599   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab57531d0314db387a141a8180a111e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.943508   697 tablet_service.cc:1511] Processing CreateTablet for tablet f7ce4b08ecc2415ca8c110f159c093f5 (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:31.949687   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b785b9dc055f42ac812e2bc285203aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.953979   547 tablet_service.cc:1511] Processing CreateTablet for tablet b2b25c52e9e5442a9b21789e2640ad7d (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:31.962275   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90536cc45b24877817ac362df08ed23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.963773   547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b25c52e9e5442a9b21789e2640ad7d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:31.985888   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:31.996068   697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ce4b08ecc2415ca8c110f159c093f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:31.997888   696 tablet_service.cc:1511] Processing CreateTablet for tablet b2b25c52e9e5442a9b21789e2640ad7d (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:32.000012   757 tablet_bootstrap.cc:492] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a: Bootstrap starting.
I20260709 12:59:32.019440   696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b25c52e9e5442a9b21789e2640ad7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.110213   627 tablet_service.cc:1511] Processing CreateTablet for tablet 3452ab3dbfc1464899a830ac4a4acf4e (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:32.113750   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3452ab3dbfc1464899a830ac4a4acf4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.118193   624 tablet_service.cc:1511] Processing CreateTablet for tablet b785b9dc055f42ac812e2bc285203aca (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:32.119015   630 tablet_service.cc:1511] Processing CreateTablet for tablet 08689662ab824b2986eea00921bba052 (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:32.122547   628 tablet_service.cc:1511] Processing CreateTablet for tablet 9180566ec79941fa8b6dad86794f0cef (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:32.127564   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b785b9dc055f42ac812e2bc285203aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.126268   626 tablet_service.cc:1511] Processing CreateTablet for tablet a90536cc45b24877817ac362df08ed23 (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:32.130455   629 tablet_service.cc:1511] Processing CreateTablet for tablet 7adb65f8c6f14f3cba488babb397ed19 (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:32.135646   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08689662ab824b2986eea00921bba052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.137249   622 tablet_service.cc:1511] Processing CreateTablet for tablet b2b25c52e9e5442a9b21789e2640ad7d (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:32.141975   623 tablet_service.cc:1511] Processing CreateTablet for tablet f7ce4b08ecc2415ca8c110f159c093f5 (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:32.123987   625 tablet_service.cc:1511] Processing CreateTablet for tablet eab57531d0314db387a141a8180a111e (DEFAULT_TABLE table=test-workload [id=eedbc769c617497f995e55e685fcfd79]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:32.146493   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7adb65f8c6f14f3cba488babb397ed19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.148077   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90536cc45b24877817ac362df08ed23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.150053   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9180566ec79941fa8b6dad86794f0cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.152616   758 tablet_bootstrap.cc:492] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d: Bootstrap starting.
I20260709 12:59:32.156483   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab57531d0314db387a141a8180a111e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.158838   622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b25c52e9e5442a9b21789e2640ad7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.161664   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ce4b08ecc2415ca8c110f159c093f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:32.161799   757 tablet_bootstrap.cc:654] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.218832   758 tablet_bootstrap.cc:654] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.245877   759 tablet_bootstrap.cc:492] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a: Bootstrap starting.
I20260709 12:59:32.259550   758 tablet_bootstrap.cc:492] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d: No bootstrap required, opened a new log
I20260709 12:59:32.260071   758 ts_tablet_manager.cc:1403] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.013s
I20260709 12:59:32.260145   759 tablet_bootstrap.cc:654] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.262048   757 tablet_bootstrap.cc:492] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a: No bootstrap required, opened a new log
I20260709 12:59:32.262481   757 ts_tablet_manager.cc:1403] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent bootstrapping tablet: real 0.265s	user 0.016s	sys 0.009s
I20260709 12:59:32.265717   757 raft_consensus.cc:359] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.266556   757 raft_consensus.cc:385] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.266849   757 raft_consensus.cc:740] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.267589   757 consensus_queue.cc:260] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.267319   758 raft_consensus.cc:359] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.268595   758 raft_consensus.cc:385] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.268991   758 raft_consensus.cc:740] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.269817   758 consensus_queue.cc:260] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.272708   759 tablet_bootstrap.cc:492] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a: No bootstrap required, opened a new log
I20260709 12:59:32.273402   759 ts_tablet_manager.cc:1403] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.009s
I20260709 12:59:32.276897   759 raft_consensus.cc:359] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.277983   759 raft_consensus.cc:385] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.278434   759 raft_consensus.cc:740] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.279335   759 consensus_queue.cc:260] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.282578   590 heartbeater.cc:499] Master 127.0.107.190:44469 was elected leader, sending a full tablet report...
I20260709 12:59:32.282611   757 ts_tablet_manager.cc:1434] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.005s
I20260709 12:59:32.284111   757 tablet_bootstrap.cc:492] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a: Bootstrap starting.
I20260709 12:59:32.290867   757 tablet_bootstrap.cc:654] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:32.307793   591 tablet.cc:2406] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:59:32.309937   665 heartbeater.cc:499] Master 127.0.107.190:44469 was elected leader, sending a full tablet report...
I20260709 12:59:32.311180   759 ts_tablet_manager.cc:1434] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.005s
I20260709 12:59:32.312287   759 tablet_bootstrap.cc:492] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a: Bootstrap starting.
I20260709 12:59:32.313032   757 tablet_bootstrap.cc:492] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a: No bootstrap required, opened a new log
I20260709 12:59:32.313803   757 ts_tablet_manager.cc:1403] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.004s
I20260709 12:59:32.316684   757 raft_consensus.cc:359] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.317370   757 raft_consensus.cc:385] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.317687   757 raft_consensus.cc:740] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.318434   757 consensus_queue.cc:260] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.320186   739 heartbeater.cc:499] Master 127.0.107.190:44469 was elected leader, sending a full tablet report...
I20260709 12:59:32.321419   757 ts_tablet_manager.cc:1434] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:59:32.322299   757 tablet_bootstrap.cc:492] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a: Bootstrap starting.
I20260709 12:59:32.325522   758 ts_tablet_manager.cc:1434] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d: Time spent starting tablet: real 0.065s	user 0.022s	sys 0.027s
I20260709 12:59:32.326467   758 tablet_bootstrap.cc:492] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d: Bootstrap starting.
I20260709 12:59:32.327061   763 raft_consensus.cc:493] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.327535   763 raft_consensus.cc:515] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.330415   763 leader_election.cc:290] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
I20260709 12:59:32.334017   757 tablet_bootstrap.cc:654] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.334599   758 tablet_bootstrap.cc:654] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.338398   759 tablet_bootstrap.cc:654] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.378072   759 tablet_bootstrap.cc:492] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a: No bootstrap required, opened a new log
I20260709 12:59:32.378665   759 ts_tablet_manager.cc:1403] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.004s
I20260709 12:59:32.379051   757 tablet_bootstrap.cc:492] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a: No bootstrap required, opened a new log
I20260709 12:59:32.380157   758 tablet_bootstrap.cc:492] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d: No bootstrap required, opened a new log
I20260709 12:59:32.379927   757 ts_tablet_manager.cc:1403] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.026s
I20260709 12:59:32.383955   759 raft_consensus.cc:359] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.384871   759 raft_consensus.cc:385] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.385195   759 raft_consensus.cc:740] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.385299   758 ts_tablet_manager.cc:1403] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d: Time spent bootstrapping tablet: real 0.059s	user 0.021s	sys 0.018s
I20260709 12:59:32.390583   757 raft_consensus.cc:359] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.390962   758 raft_consensus.cc:359] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.391912   757 raft_consensus.cc:385] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.391966   758 raft_consensus.cc:385] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.392326   757 raft_consensus.cc:740] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.392371   758 raft_consensus.cc:740] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.393529   758 consensus_queue.cc:260] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.393841   757 consensus_queue.cc:260] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.396265   757 ts_tablet_manager.cc:1434] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:59:32.397333   757 tablet_bootstrap.cc:492] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a: Bootstrap starting.
I20260709 12:59:32.388945   759 consensus_queue.cc:260] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.399076   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" is_pre_election: true
I20260709 12:59:32.400787   759 ts_tablet_manager.cc:1434] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:59:32.402305   764 raft_consensus.cc:493] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.402765   764 raft_consensus.cc:515] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.404845   758 ts_tablet_manager.cc:1434] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:59:32.405764   758 tablet_bootstrap.cc:492] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d: Bootstrap starting.
I20260709 12:59:32.405867   764 leader_election.cc:290] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:32.407434   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a" is_pre_election: true
I20260709 12:59:32.413256   640 raft_consensus.cc:2468] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 0.
I20260709 12:59:32.420851   759 tablet_bootstrap.cc:492] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a: Bootstrap starting.
W20260709 12:59:32.432902   677 leader_election.cc:343] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.433871   677 leader_election.cc:304] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 8b3d23f60d6746e5b52fc799f964bf7a
I20260709 12:59:32.437322   757 tablet_bootstrap.cc:654] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.440886   763 raft_consensus.cc:2804] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.441260   763 raft_consensus.cc:493] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.442395   763 raft_consensus.cc:3060] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.446545   759 tablet_bootstrap.cc:654] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.454375   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a" is_pre_election: true
I20260709 12:59:32.450069   758 tablet_bootstrap.cc:654] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:32.457783   528 leader_election.cc:343] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.458976   765 raft_consensus.cc:493] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.459515   765 raft_consensus.cc:515] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.463689   765 leader_election.cc:290] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:32.473651   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d" is_pre_election: true
I20260709 12:59:32.475951   763 raft_consensus.cc:515] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
W20260709 12:59:32.478039   531 leader_election.cc:343] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.479323   531 leader_election.cc:304] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a; no voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a
I20260709 12:59:32.480702   764 raft_consensus.cc:2749] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.494108   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:32.494359   763 leader_election.cc:290] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
I20260709 12:59:32.495919   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:32.496569   640 raft_consensus.cc:3060] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:32.500385   677 leader_election.cc:343] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.502630   759 tablet_bootstrap.cc:492] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a: No bootstrap required, opened a new log
I20260709 12:59:32.503137   759 ts_tablet_manager.cc:1403] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.007s
I20260709 12:59:32.506570   759 raft_consensus.cc:359] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.507263   759 raft_consensus.cc:385] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.507443   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08689662ab824b2986eea00921bba052" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d" is_pre_election: true
I20260709 12:59:32.507570   759 raft_consensus.cc:740] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.508100   714 raft_consensus.cc:2468] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 0.
I20260709 12:59:32.508548   759 consensus_queue.cc:260] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.509420   606 leader_election.cc:304] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:32.510206   765 raft_consensus.cc:2804] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.510569   765 raft_consensus.cc:493] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.511184   765 raft_consensus.cc:3060] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.513880   640 raft_consensus.cc:2468] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 1.
I20260709 12:59:32.515139   677 leader_election.cc:304] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 8b3d23f60d6746e5b52fc799f964bf7a
I20260709 12:59:32.516433   763 raft_consensus.cc:2804] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:32.516189   759 ts_tablet_manager.cc:1434] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:59:32.519764   759 tablet_bootstrap.cc:492] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a: Bootstrap starting.
I20260709 12:59:32.519863   757 tablet_bootstrap.cc:492] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a: No bootstrap required, opened a new log
I20260709 12:59:32.520283   757 ts_tablet_manager.cc:1403] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent bootstrapping tablet: real 0.123s	user 0.024s	sys 0.009s
I20260709 12:59:32.522817   765 raft_consensus.cc:515] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.526280   765 leader_election.cc:290] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:32.526558   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08689662ab824b2986eea00921bba052" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:32.526758   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08689662ab824b2986eea00921bba052" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" is_pre_election: true
I20260709 12:59:32.527163   714 raft_consensus.cc:3060] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.527297   565 raft_consensus.cc:2468] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 0.
I20260709 12:59:32.528028   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08689662ab824b2986eea00921bba052" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:32.531773   564 raft_consensus.cc:3060] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.532612   758 tablet_bootstrap.cc:492] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d: No bootstrap required, opened a new log
I20260709 12:59:32.533092   758 ts_tablet_manager.cc:1403] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d: Time spent bootstrapping tablet: real 0.128s	user 0.010s	sys 0.010s
I20260709 12:59:32.540112   758 raft_consensus.cc:359] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.541168   759 tablet_bootstrap.cc:654] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.543486   763 raft_consensus.cc:697] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Becoming Leader. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Running, Role: LEADER
I20260709 12:59:32.543720   714 raft_consensus.cc:2468] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 1.
I20260709 12:59:32.544139   758 raft_consensus.cc:385] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.544559   758 raft_consensus.cc:740] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.544993   606 leader_election.cc:304] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:32.544574   763 consensus_queue.cc:237] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.545758   765 raft_consensus.cc:2804] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:32.546511   564 raft_consensus.cc:2468] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 1.
I20260709 12:59:32.545364   758 consensus_queue.cc:260] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.549314   757 raft_consensus.cc:359] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.550626   757 raft_consensus.cc:385] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.551352   757 raft_consensus.cc:740] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.552073   757 consensus_queue.cc:260] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.553643   758 ts_tablet_manager.cc:1434] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:59:32.555590   758 tablet_bootstrap.cc:492] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d: Bootstrap starting.
I20260709 12:59:32.557431   757 ts_tablet_manager.cc:1434] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.003s
I20260709 12:59:32.561398   765 raft_consensus.cc:697] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Becoming Leader. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:32.563779   765 consensus_queue.cc:237] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.569286   758 tablet_bootstrap.cc:654] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.573987   759 tablet_bootstrap.cc:492] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a: No bootstrap required, opened a new log
I20260709 12:59:32.574411   759 ts_tablet_manager.cc:1403] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.000s
I20260709 12:59:32.577384   759 raft_consensus.cc:359] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.578456   759 raft_consensus.cc:385] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.579294   759 raft_consensus.cc:740] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.578511   460 catalog_manager.cc:5697] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a reported cstate change: term changed from 0 to 1, leader changed from <none> to febfd6ab8383479fbed5591c1f163f8a (127.0.107.130). New cstate: current_term: 1 leader_uuid: "febfd6ab8383479fbed5591c1f163f8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:32.580238   759 consensus_queue.cc:260] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.569276   757 tablet_bootstrap.cc:492] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a: Bootstrap starting.
I20260709 12:59:32.586076   759 ts_tablet_manager.cc:1434] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:59:32.585832   461 catalog_manager.cc:5697] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d reported cstate change: term changed from 0 to 1, leader changed from <none> to fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "fe56c01ed8bd493fb16386bc7788d12d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.587154   759 tablet_bootstrap.cc:492] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a: Bootstrap starting.
I20260709 12:59:32.597132   759 tablet_bootstrap.cc:654] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.600481   757 tablet_bootstrap.cc:654] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.609346   758 tablet_bootstrap.cc:492] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d: No bootstrap required, opened a new log
I20260709 12:59:32.609982   758 ts_tablet_manager.cc:1403] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.010s
I20260709 12:59:32.613638   758 raft_consensus.cc:359] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.614612   758 raft_consensus.cc:385] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.615000   758 raft_consensus.cc:740] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.619555   757 tablet_bootstrap.cc:492] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a: No bootstrap required, opened a new log
I20260709 12:59:32.620061   757 ts_tablet_manager.cc:1403] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.015s
I20260709 12:59:32.624650   757 raft_consensus.cc:359] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.625368   757 raft_consensus.cc:385] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.625675   757 raft_consensus.cc:740] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.626349   757 consensus_queue.cc:260] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.628489   757 ts_tablet_manager.cc:1434] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:59:32.629526   757 tablet_bootstrap.cc:492] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a: Bootstrap starting.
I20260709 12:59:32.631045   759 tablet_bootstrap.cc:492] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a: No bootstrap required, opened a new log
I20260709 12:59:32.631569   759 ts_tablet_manager.cc:1403] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.008s
I20260709 12:59:32.634207   758 consensus_queue.cc:260] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.636497   764 raft_consensus.cc:493] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.636566   759 raft_consensus.cc:359] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.637012   764 raft_consensus.cc:515] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.637440   759 raft_consensus.cc:385] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.638875   764 leader_election.cc:290] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:32.640009   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90536cc45b24877817ac362df08ed23" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a" is_pre_election: true
I20260709 12:59:32.640491   758 ts_tablet_manager.cc:1434] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 12:59:32.641412   758 tablet_bootstrap.cc:492] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d: Bootstrap starting.
I20260709 12:59:32.637742   759 raft_consensus.cc:740] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.642102   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90536cc45b24877817ac362df08ed23" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d" is_pre_election: true
W20260709 12:59:32.642366   528 leader_election.cc:343] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.642462   759 consensus_queue.cc:260] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
W20260709 12:59:32.643580   531 leader_election.cc:343] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.644416   531 leader_election.cc:304] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a; no voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a
I20260709 12:59:32.648643   757 tablet_bootstrap.cc:654] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.649048   764 raft_consensus.cc:2749] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:32.652940   759 ts_tablet_manager.cc:1434] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:59:32.653942   759 tablet_bootstrap.cc:492] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a: Bootstrap starting.
I20260709 12:59:32.662680   757 tablet_bootstrap.cc:492] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a: No bootstrap required, opened a new log
I20260709 12:59:32.663323   757 ts_tablet_manager.cc:1403] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.014s
I20260709 12:59:32.666575   759 tablet_bootstrap.cc:654] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.666162   757 raft_consensus.cc:359] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.667565   757 raft_consensus.cc:385] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.667930   757 raft_consensus.cc:740] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.668728   757 consensus_queue.cc:260] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.670586   758 tablet_bootstrap.cc:654] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.672976   757 ts_tablet_manager.cc:1434] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:59:32.674225   757 tablet_bootstrap.cc:492] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a: Bootstrap starting.
I20260709 12:59:32.682646   757 tablet_bootstrap.cc:654] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.686637   759 tablet_bootstrap.cc:492] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a: No bootstrap required, opened a new log
I20260709 12:59:32.687970   759 ts_tablet_manager.cc:1403] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 12:59:32.689440   758 tablet_bootstrap.cc:492] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d: No bootstrap required, opened a new log
I20260709 12:59:32.689987   758 ts_tablet_manager.cc:1403] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.006s
I20260709 12:59:32.691325   759 raft_consensus.cc:359] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.692564   759 raft_consensus.cc:385] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.692842   759 raft_consensus.cc:740] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.692765   758 raft_consensus.cc:359] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.693706   758 raft_consensus.cc:385] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.694069   758 raft_consensus.cc:740] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.693802   759 consensus_queue.cc:260] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.694869   758 consensus_queue.cc:260] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.696593   759 ts_tablet_manager.cc:1434] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:59:32.697073   758 ts_tablet_manager.cc:1434] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:32.698006   759 tablet_bootstrap.cc:492] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a: Bootstrap starting.
I20260709 12:59:32.699405   758 tablet_bootstrap.cc:492] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d: Bootstrap starting.
I20260709 12:59:32.709596   757 tablet_bootstrap.cc:492] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a: No bootstrap required, opened a new log
I20260709 12:59:32.710086   757 ts_tablet_manager.cc:1403] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.009s
I20260709 12:59:32.713502   759 tablet_bootstrap.cc:654] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.715634   757 raft_consensus.cc:359] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.716656   757 raft_consensus.cc:385] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.717036   757 raft_consensus.cc:740] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.718757   757 consensus_queue.cc:260] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.733614   757 ts_tablet_manager.cc:1434] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.005s
I20260709 12:59:32.737385   757 tablet_bootstrap.cc:492] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a: Bootstrap starting.
I20260709 12:59:32.737640   758 tablet_bootstrap.cc:654] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.740681   759 tablet_bootstrap.cc:492] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a: No bootstrap required, opened a new log
I20260709 12:59:32.741689   759 ts_tablet_manager.cc:1403] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.008s
I20260709 12:59:32.748035   759 raft_consensus.cc:359] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.748793   759 raft_consensus.cc:385] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.749527   759 raft_consensus.cc:740] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.750423   759 consensus_queue.cc:260] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.752331   757 tablet_bootstrap.cc:654] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.761372   759 ts_tablet_manager.cc:1434] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 12:59:32.762468   759 tablet_bootstrap.cc:492] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a: Bootstrap starting.
I20260709 12:59:32.763434   757 tablet_bootstrap.cc:492] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a: No bootstrap required, opened a new log
I20260709 12:59:32.763895   757 ts_tablet_manager.cc:1403] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.005s
I20260709 12:59:32.766427   765 raft_consensus.cc:493] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.766889   765 raft_consensus.cc:515] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.767143   757 raft_consensus.cc:359] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.767864   757 raft_consensus.cc:385] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.768146   757 raft_consensus.cc:740] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.768972   765 leader_election.cc:290] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:32.768836   757 consensus_queue.cc:260] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.768965   759 tablet_bootstrap.cc:654] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.770135   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" is_pre_election: true
I20260709 12:59:32.770783   564 raft_consensus.cc:2468] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 0.
I20260709 12:59:32.771641   757 ts_tablet_manager.cc:1434] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:59:32.772265   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d" is_pre_election: true
I20260709 12:59:32.772552   757 tablet_bootstrap.cc:492] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a: Bootstrap starting.
W20260709 12:59:32.773772   606 leader_election.cc:343] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.775172   758 tablet_bootstrap.cc:492] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d: No bootstrap required, opened a new log
I20260709 12:59:32.774966   603 leader_election.cc:304] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a; no voters: fe56c01ed8bd493fb16386bc7788d12d
I20260709 12:59:32.784476   758 ts_tablet_manager.cc:1403] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.002s
I20260709 12:59:32.784617   765 raft_consensus.cc:2804] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.784962   765 raft_consensus.cc:493] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.785388   765 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.782037   757 tablet_bootstrap.cc:654] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.790076   758 raft_consensus.cc:359] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.790771   758 raft_consensus.cc:385] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.791105   758 raft_consensus.cc:740] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.791849   758 consensus_queue.cc:260] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.794216   758 ts_tablet_manager.cc:1434] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:59:32.794508   759 tablet_bootstrap.cc:492] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a: No bootstrap required, opened a new log
I20260709 12:59:32.794917   759 ts_tablet_manager.cc:1403] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.005s
I20260709 12:59:32.795220   758 tablet_bootstrap.cc:492] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d: Bootstrap starting.
I20260709 12:59:32.797359   759 raft_consensus.cc:359] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.798027   759 raft_consensus.cc:385] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.798295   759 raft_consensus.cc:740] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.799553   759 consensus_queue.cc:260] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.801632   759 ts_tablet_manager.cc:1434] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:59:32.802716   759 tablet_bootstrap.cc:492] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a: Bootstrap starting.
I20260709 12:59:32.803081   758 tablet_bootstrap.cc:654] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.809563   759 tablet_bootstrap.cc:654] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.817499   758 tablet_bootstrap.cc:492] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d: No bootstrap required, opened a new log
I20260709 12:59:32.818130   758 ts_tablet_manager.cc:1403] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260709 12:59:32.821699   758 raft_consensus.cc:359] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.822414   758 raft_consensus.cc:385] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.824013   759 tablet_bootstrap.cc:492] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a: No bootstrap required, opened a new log
I20260709 12:59:32.824433   759 ts_tablet_manager.cc:1403] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 12:59:32.824852   763 raft_consensus.cc:493] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.825312   763 raft_consensus.cc:515] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.825779   757 tablet_bootstrap.cc:492] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a: No bootstrap required, opened a new log
I20260709 12:59:32.826210   757 ts_tablet_manager.cc:1403] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.004s
I20260709 12:59:32.827308   759 raft_consensus.cc:359] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.827962   759 raft_consensus.cc:385] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.828205   759 raft_consensus.cc:740] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.828675   764 raft_consensus.cc:493] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.828823   759 consensus_queue.cc:260] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.829304   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90536cc45b24877817ac362df08ed23" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a" is_pre_election: true
I20260709 12:59:32.829181   764 raft_consensus.cc:515] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.829913   640 raft_consensus.cc:2468] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 0.
I20260709 12:59:32.830765   759 ts_tablet_manager.cc:1434] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:59:32.831187   764 leader_election.cc:290] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:32.831501   757 raft_consensus.cc:359] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.831707   677 leader_election.cc:304] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:32.832157   757 raft_consensus.cc:385] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:32.828583   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90536cc45b24877817ac362df08ed23" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" is_pre_election: true
I20260709 12:59:32.832432   757 raft_consensus.cc:740] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.832711   781 raft_consensus.cc:2804] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.832757   564 raft_consensus.cc:2468] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 0.
I20260709 12:59:32.822731   758 raft_consensus.cc:740] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Initialized, Role: FOLLOWER
I20260709 12:59:32.833146   781 raft_consensus.cc:493] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.833614   781 raft_consensus.cc:3060] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.833907   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab57531d0314db387a141a8180a111e" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d" is_pre_election: true
I20260709 12:59:32.833837   758 consensus_queue.cc:260] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
W20260709 12:59:32.835050   531 leader_election.cc:343] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.833104   757 consensus_queue.cc:260] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.827160   763 leader_election.cc:290] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
I20260709 12:59:32.837365   757 ts_tablet_manager.cc:1434] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:59:32.838066   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab57531d0314db387a141a8180a111e" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a" is_pre_election: true
I20260709 12:59:32.838655   640 raft_consensus.cc:2468] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 0.
I20260709 12:59:32.839493   758 ts_tablet_manager.cc:1434] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.001s
I20260709 12:59:32.839720   528 leader_election.cc:304] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a; no voters: fe56c01ed8bd493fb16386bc7788d12d
I20260709 12:59:32.840425   758 tablet_bootstrap.cc:492] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d: Bootstrap starting.
I20260709 12:59:32.840529   764 raft_consensus.cc:2804] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.840905   764 raft_consensus.cc:493] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.841605   764 raft_consensus.cc:3060] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.850735   782 raft_consensus.cc:493] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.851702   782 raft_consensus.cc:515] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.855614   765 raft_consensus.cc:515] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.857806   782 leader_election.cc:290] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:32.858067   765 leader_election.cc:290] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:32.860018   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ce4b08ecc2415ca8c110f159c093f5" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" is_pre_election: true
I20260709 12:59:32.858462   781 raft_consensus.cc:515] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.860652   564 raft_consensus.cc:2468] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 0.
I20260709 12:59:32.861379   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:32.862480   781 leader_election.cc:290] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
I20260709 12:59:32.863205   565 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.863387   603 leader_election.cc:304] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:32.863718   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ce4b08ecc2415ca8c110f159c093f5" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d" is_pre_election: true
I20260709 12:59:32.864346   714 raft_consensus.cc:2468] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 0.
I20260709 12:59:32.864357   765 raft_consensus.cc:2804] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.865701   765 raft_consensus.cc:493] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.866386   765 raft_consensus.cc:3060] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.866338   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90536cc45b24877817ac362df08ed23" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:32.867233   640 raft_consensus.cc:3060] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.865492   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90536cc45b24877817ac362df08ed23" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:32.866231   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:32.870474   713 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.861740   764 raft_consensus.cc:515] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.869577   758 tablet_bootstrap.cc:654] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:32.870085   564 raft_consensus.cc:3060] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.876423   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab57531d0314db387a141a8180a111e" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:32.877600   639 raft_consensus.cc:3060] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.877728   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab57531d0314db387a141a8180a111e" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
W20260709 12:59:32.880614   531 leader_election.cc:343] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:32.875577   764 leader_election.cc:290] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 election: Requested vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:32.893203   713 raft_consensus.cc:2468] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 1.
I20260709 12:59:32.893760   640 raft_consensus.cc:2468] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 1.
I20260709 12:59:32.894529   606 leader_election.cc:304] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:32.895676   782 raft_consensus.cc:2804] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:32.896445   639 raft_consensus.cc:2468] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 1.
I20260709 12:59:32.900887   677 leader_election.cc:304] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:32.901887   528 leader_election.cc:304] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a; no voters: fe56c01ed8bd493fb16386bc7788d12d
I20260709 12:59:32.903398   781 raft_consensus.cc:2804] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:32.899151   764 raft_consensus.cc:493] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.904326   781 raft_consensus.cc:697] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Becoming Leader. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Running, Role: LEADER
I20260709 12:59:32.901813   765 raft_consensus.cc:515] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.905464   781 consensus_queue.cc:237] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.904560   764 raft_consensus.cc:515] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.907222   564 raft_consensus.cc:2468] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 1.
I20260709 12:59:32.903472   565 raft_consensus.cc:2468] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 1.
I20260709 12:59:32.910365   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ce4b08ecc2415ca8c110f159c093f5" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:32.911042   713 raft_consensus.cc:3060] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.911553   765 leader_election.cc:290] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:32.914029   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b25c52e9e5442a9b21789e2640ad7d" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a" is_pre_election: true
I20260709 12:59:32.913038   764 leader_election.cc:290] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:32.914915   640 raft_consensus.cc:2468] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 0.
I20260709 12:59:32.918870   528 leader_election.cc:304] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:32.928810   782 raft_consensus.cc:697] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Becoming Leader. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:32.929853   782 consensus_queue.cc:237] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.915098   764 raft_consensus.cc:2804] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:32.931102   713 raft_consensus.cc:2468] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 1.
I20260709 12:59:32.932554   805 raft_consensus.cc:2804] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:32.936595   805 raft_consensus.cc:493] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.935824   459 catalog_manager.cc:5697] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d reported cstate change: term changed from 0 to 1, leader changed from <none> to fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "fe56c01ed8bd493fb16386bc7788d12d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.936985   805 raft_consensus.cc:3060] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.934958   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ce4b08ecc2415ca8c110f159c093f5" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:32.937918   565 raft_consensus.cc:3060] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:32.934983   758 tablet_bootstrap.cc:492] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d: No bootstrap required, opened a new log
I20260709 12:59:32.943114   758 ts_tablet_manager.cc:1403] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.015s
I20260709 12:59:32.944209   764 raft_consensus.cc:697] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Becoming Leader. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:32.936867   606 leader_election.cc:304] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:32.934273   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b25c52e9e5442a9b21789e2640ad7d" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d" is_pre_election: true
I20260709 12:59:32.954157   807 raft_consensus.cc:2804] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:32.963610   807 raft_consensus.cc:697] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Becoming Leader. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:32.964560   807 consensus_queue.cc:237] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.965404   805 raft_consensus.cc:515] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:32.980804   565 raft_consensus.cc:2468] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 1.
I20260709 12:59:32.945286   764 consensus_queue.cc:237] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.001246   805 leader_election.cc:290] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 election: Requested vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:33.002696   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b25c52e9e5442a9b21789e2640ad7d" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:33.003170   639 raft_consensus.cc:3060] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.004691   805 raft_consensus.cc:493] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:33.004961   531 leader_election.cc:343] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.005200   805 raft_consensus.cc:515] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.007684   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b25c52e9e5442a9b21789e2640ad7d" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:33.008982   758 raft_consensus.cc:359] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
W20260709 12:59:33.009143   531 leader_election.cc:343] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:33.009441   758 raft_consensus.cc:385] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.009727   758 raft_consensus.cc:740] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Initialized, Role: FOLLOWER
I20260709 12:59:33.010216   758 consensus_queue.cc:260] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.014379   804 raft_consensus.cc:493] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.018949   804 raft_consensus.cc:515] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.020659   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b785b9dc055f42ac812e2bc285203aca" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a" is_pre_election: true
I20260709 12:59:33.021306   640 raft_consensus.cc:2468] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 0.
I20260709 12:59:33.022167   758 ts_tablet_manager.cc:1434] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d: Time spent starting tablet: real 0.078s	user 0.024s	sys 0.020s
I20260709 12:59:33.022084   809 raft_consensus.cc:493] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.023204   758 tablet_bootstrap.cc:492] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d: Bootstrap starting.
I20260709 12:59:33.022744   809 raft_consensus.cc:515] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.023487   528 leader_election.cc:304] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a; no voters: 
W20260709 12:59:33.029407   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:33.032475   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" is_pre_election: true
I20260709 12:59:33.033154   564 raft_consensus.cc:2468] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 0.
I20260709 12:59:33.033417   639 raft_consensus.cc:2468] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 1.
I20260709 12:59:33.034668   528 leader_election.cc:304] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a; no voters: fe56c01ed8bd493fb16386bc7788d12d
I20260709 12:59:33.034428   677 leader_election.cc:304] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, fe56c01ed8bd493fb16386bc7788d12d; no voters: 
I20260709 12:59:33.035841   781 raft_consensus.cc:2804] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.036227   781 raft_consensus.cc:493] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.036552   781 raft_consensus.cc:3060] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.036824   804 leader_election.cc:290] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
I20260709 12:59:33.038075   565 raft_consensus.cc:3060] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.042050   782 raft_consensus.cc:493] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.041400   461 catalog_manager.cc:5697] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a reported cstate change: term changed from 0 to 1, leader changed from <none> to febfd6ab8383479fbed5591c1f163f8a (127.0.107.130). New cstate: current_term: 1 leader_uuid: "febfd6ab8383479fbed5591c1f163f8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.042598   782 raft_consensus.cc:515] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.038079   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a" is_pre_election: true
I20260709 12:59:33.044453   781 raft_consensus.cc:515] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.045033   639 raft_consensus.cc:2468] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 0.
I20260709 12:59:33.046368   781 leader_election.cc:290] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
I20260709 12:59:33.046710   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" is_pre_election: true
I20260709 12:59:33.046118   460 catalog_manager.cc:5697] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129). New cstate: current_term: 1 leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.047294   564 raft_consensus.cc:2468] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 0.
I20260709 12:59:33.048394   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d" is_pre_election: true
I20260709 12:59:33.048851   603 leader_election.cc:304] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:33.049228   714 raft_consensus.cc:2393] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate febfd6ab8383479fbed5591c1f163f8a in current term 1: Already voted for candidate fe56c01ed8bd493fb16386bc7788d12d in this term.
I20260709 12:59:33.047394   764 raft_consensus.cc:2804] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:33.049831   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:33.050422   764 raft_consensus.cc:493] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.050654   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:33.051273   640 raft_consensus.cc:3060] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.050680   564 raft_consensus.cc:3060] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.053726   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b785b9dc055f42ac812e2bc285203aca" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d" is_pre_election: true
I20260709 12:59:33.054311   713 raft_consensus.cc:2468] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 0.
I20260709 12:59:33.051167   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a" is_pre_election: true
I20260709 12:59:33.044476   758 tablet_bootstrap.cc:654] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:33.057381   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d" is_pre_election: true
I20260709 12:59:33.059067   714 raft_consensus.cc:2393] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b3d23f60d6746e5b52fc799f964bf7a in current term 1: Already voted for candidate fe56c01ed8bd493fb16386bc7788d12d in this term.
I20260709 12:59:33.061635   531 leader_election.cc:304] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a; no voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a
I20260709 12:59:33.047056   811 raft_consensus.cc:2804] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.063060   807 consensus_queue.cc:1048] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.065382   640 raft_consensus.cc:2468] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 1.
I20260709 12:59:33.050828   764 raft_consensus.cc:3060] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.067209   564 raft_consensus.cc:2468] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 1.
I20260709 12:59:33.067512   782 leader_election.cc:290] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:33.067595   765 raft_consensus.cc:2764] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:59:33.072575   677 leader_election.cc:304] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:33.073385   781 raft_consensus.cc:2804] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.073983   781 raft_consensus.cc:697] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Becoming Leader. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Running, Role: LEADER
I20260709 12:59:33.075758   781 consensus_queue.cc:237] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.073719   809 leader_election.cc:290] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:33.078784   805 leader_election.cc:290] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:33.078930   764 raft_consensus.cc:515] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.082267   758 tablet_bootstrap.cc:492] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d: No bootstrap required, opened a new log
I20260709 12:59:33.082871   758 ts_tablet_manager.cc:1403] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.004s
I20260709 12:59:33.086210   764 leader_election.cc:290] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 election: Requested vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:33.085603   809 raft_consensus.cc:2749] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:33.090039   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b785b9dc055f42ac812e2bc285203aca" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:33.090585   640 raft_consensus.cc:3060] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.096974   462 catalog_manager.cc:5697] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a reported cstate change: term changed from 0 to 1, leader changed from <none> to febfd6ab8383479fbed5591c1f163f8a (127.0.107.130). New cstate: current_term: 1 leader_uuid: "febfd6ab8383479fbed5591c1f163f8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.102205   758 raft_consensus.cc:359] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.105129   758 raft_consensus.cc:385] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:33.105674   758 raft_consensus.cc:740] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Initialized, Role: FOLLOWER
W20260709 12:59:33.106353   531 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:35453, user_credentials={real_user=slave}} blocked reactor thread for 44792.8us
I20260709 12:59:33.106451   758 consensus_queue.cc:260] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.108695   781 consensus_queue.cc:1048] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:33.102800   640 raft_consensus.cc:2468] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 1.
I20260709 12:59:33.110240   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b785b9dc055f42ac812e2bc285203aca" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:33.110823   714 raft_consensus.cc:3060] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.105456   811 raft_consensus.cc:697] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Becoming Leader. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:33.110743   528 leader_election.cc:304] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:33.111048   460 catalog_manager.cc:5697] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d reported cstate change: term changed from 0 to 1, leader changed from <none> to fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "fe56c01ed8bd493fb16386bc7788d12d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.116592   815 raft_consensus.cc:2804] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:33.117137   815 raft_consensus.cc:697] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Becoming Leader. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:33.114007   811 consensus_queue.cc:237] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.121367   758 ts_tablet_manager.cc:1434] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.003s
I20260709 12:59:33.118876   815 consensus_queue.cc:237] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.125975   714 raft_consensus.cc:2468] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 1.
I20260709 12:59:33.139016   763 raft_consensus.cc:493] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.139592   763 raft_consensus.cc:515] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.141814   763 leader_election.cc:290] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
I20260709 12:59:33.145331   563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b25c52e9e5442a9b21789e2640ad7d" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" is_pre_election: true
I20260709 12:59:33.147523   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b25c52e9e5442a9b21789e2640ad7d" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a" is_pre_election: true
I20260709 12:59:33.147871   781 consensus_queue.cc:1048] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.148283   640 raft_consensus.cc:2393] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe56c01ed8bd493fb16386bc7788d12d in current term 1: Already voted for candidate 8b3d23f60d6746e5b52fc799f964bf7a in this term.
I20260709 12:59:33.149820   677 leader_election.cc:304] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d; no voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a
I20260709 12:59:33.150894   781 raft_consensus.cc:3060] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.157536   765 consensus_queue.cc:1048] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:33.159943   781 raft_consensus.cc:2749] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:33.188267   462 catalog_manager.cc:5697] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129). New cstate: current_term: 1 leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.212001   462 catalog_manager.cc:5697] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129). New cstate: current_term: 1 leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.263295   781 raft_consensus.cc:493] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.263899   781 raft_consensus.cc:515] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.265614   781 leader_election.cc:290] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
I20260709 12:59:33.266511   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab57531d0314db387a141a8180a111e" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" is_pre_election: true
I20260709 12:59:33.266762   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab57531d0314db387a141a8180a111e" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "febfd6ab8383479fbed5591c1f163f8a" is_pre_election: true
I20260709 12:59:33.267586   640 raft_consensus.cc:2393] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe56c01ed8bd493fb16386bc7788d12d in current term 1: Already voted for candidate 8b3d23f60d6746e5b52fc799f964bf7a in this term.
I20260709 12:59:33.268663   677 leader_election.cc:304] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d; no voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a
I20260709 12:59:33.269444   781 raft_consensus.cc:3060] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:33.274366   781 raft_consensus.cc:2749] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:33.313393   765 consensus_queue.cc:1048] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.327147   782 consensus_queue.cc:1048] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.341959   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08689662ab824b2986eea00921bba052"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
mode: GRACEFUL
new_leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:56988
I20260709 12:59:33.342643   640 raft_consensus.cc:606] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Received request to transfer leadership to TS 8b3d23f60d6746e5b52fc799f964bf7a
I20260709 12:59:33.358278   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19"
dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
mode: GRACEFUL
new_leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:40976
I20260709 12:59:33.358920   713 raft_consensus.cc:606] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Received request to transfer leadership to TS 8b3d23f60d6746e5b52fc799f964bf7a
I20260709 12:59:33.360787   832 consensus_queue.cc:1048] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.365473   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef"
dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
mode: GRACEFUL
new_leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:40976
I20260709 12:59:33.366120   713 raft_consensus.cc:606] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Received request to transfer leadership to TS 8b3d23f60d6746e5b52fc799f964bf7a
I20260709 12:59:33.374485   832 consensus_queue.cc:1048] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.375469   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
mode: GRACEFUL
new_leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:56988
I20260709 12:59:33.376029   640 raft_consensus.cc:606] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Received request to transfer leadership to TS 8b3d23f60d6746e5b52fc799f964bf7a
I20260709 12:59:33.386870   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a90536cc45b24877817ac362df08ed23"
dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
mode: GRACEFUL
new_leader_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:40976
I20260709 12:59:33.387531   714 raft_consensus.cc:606] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Received request to transfer leadership to TS febfd6ab8383479fbed5591c1f163f8a
I20260709 12:59:33.392844   811 consensus_queue.cc:1048] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.412901   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eab57531d0314db387a141a8180a111e"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
mode: GRACEFUL
new_leader_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:46674
I20260709 12:59:33.413424   564 raft_consensus.cc:606] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Received request to transfer leadership to TS febfd6ab8383479fbed5591c1f163f8a
I20260709 12:59:33.413985   811 consensus_queue.cc:1048] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.422268   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b785b9dc055f42ac812e2bc285203aca"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
mode: GRACEFUL
new_leader_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:46674
I20260709 12:59:33.422842   564 raft_consensus.cc:606] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Received request to transfer leadership to TS febfd6ab8383479fbed5591c1f163f8a
I20260709 12:59:33.433135   811 raft_consensus.cc:993] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a: : Instructing follower febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:33.433611   811 raft_consensus.cc:1081] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Signalling peer febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:33.434360   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2b25c52e9e5442a9b21789e2640ad7d"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
mode: GRACEFUL
new_leader_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
 from {username='slave'} at 127.0.0.1:46674
I20260709 12:59:33.435017   564 raft_consensus.cc:606] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Received request to transfer leadership to TS fe56c01ed8bd493fb16386bc7788d12d
I20260709 12:59:33.435520   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eab57531d0314db387a141a8180a111e"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:59:33.436156   640 raft_consensus.cc:493] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.436556   640 raft_consensus.cc:3060] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.442108   640 raft_consensus.cc:515] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.445322   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab57531d0314db387a141a8180a111e" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:33.445642   640 leader_election.cc:290] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 2 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:33.445914   565 raft_consensus.cc:3055] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:33.446286   565 raft_consensus.cc:740] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:33.446870   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab57531d0314db387a141a8180a111e" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:33.447459   713 raft_consensus.cc:3060] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.447093   565 consensus_queue.cc:260] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.448525   565 raft_consensus.cc:3060] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.452286   781 consensus_queue.cc:1048] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.455134   713 raft_consensus.cc:2468] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 2.
I20260709 12:59:33.456310   565 raft_consensus.cc:2468] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 2.
I20260709 12:59:33.456691   606 leader_election.cc:304] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:33.458236   832 raft_consensus.cc:2804] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:33.458738   832 raft_consensus.cc:697] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 2 LEADER]: Becoming Leader. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:33.459566   832 consensus_queue.cc:237] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.467119   763 consensus_queue.cc:1048] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.473606   459 catalog_manager.cc:5697] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a reported cstate change: term changed from 1 to 2, leader changed from 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129) to febfd6ab8383479fbed5591c1f163f8a (127.0.107.130). New cstate: current_term: 2 leader_uuid: "febfd6ab8383479fbed5591c1f163f8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.479221   763 raft_consensus.cc:993] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d: : Instructing follower febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:33.479775   763 raft_consensus.cc:1081] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Signalling peer febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:33.481771   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a90536cc45b24877817ac362df08ed23"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:56964
I20260709 12:59:33.482296   640 raft_consensus.cc:493] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.482636   640 raft_consensus.cc:3060] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.488875   781 consensus_queue.cc:1048] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.490259   640 raft_consensus.cc:515] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.495816   640 leader_election.cc:290] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 2 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:33.496209   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90536cc45b24877817ac362df08ed23" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:33.496740   564 raft_consensus.cc:3060] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.501610   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90536cc45b24877817ac362df08ed23" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:33.502183   713 raft_consensus.cc:3055] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:33.502456   713 raft_consensus.cc:740] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Running, Role: LEADER
I20260709 12:59:33.503106   713 consensus_queue.cc:260] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.504652   713 raft_consensus.cc:3060] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.508037   811 consensus_queue.cc:1048] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.510393   713 raft_consensus.cc:2468] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 2.
I20260709 12:59:33.516546   606 leader_election.cc:304] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:33.517349   832 raft_consensus.cc:2804] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:33.517831   832 raft_consensus.cc:697] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 2 LEADER]: Becoming Leader. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:33.518071   804 consensus_queue.cc:1048] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:33.518649   832 consensus_queue.cc:237] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.527539   564 raft_consensus.cc:2468] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 2.
I20260709 12:59:33.537531   817 consensus_queue.cc:1048] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.550525   804 raft_consensus.cc:993] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d: : Instructing follower 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:33.550961   804 raft_consensus.cc:1081] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Signalling peer 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:33.555932   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:46664
I20260709 12:59:33.556667   564 raft_consensus.cc:493] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.557139   564 raft_consensus.cc:3060] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.565913   564 raft_consensus.cc:515] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.571871   817 consensus_queue.cc:1048] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.573876   809 consensus_queue.cc:1048] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:33.576236   564 leader_election.cc:290] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 2 election: Requested vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:33.580147   809 raft_consensus.cc:993] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a: : Instructing follower fe56c01ed8bd493fb16386bc7788d12d to start an election
I20260709 12:59:33.580559   809 raft_consensus.cc:1081] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Signalling peer fe56c01ed8bd493fb16386bc7788d12d to start an election
I20260709 12:59:33.579902   459 catalog_manager.cc:5697] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a reported cstate change: term changed from 1 to 2, leader changed from fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131) to febfd6ab8383479fbed5591c1f163f8a (127.0.107.130). New cstate: current_term: 2 leader_uuid: "febfd6ab8383479fbed5591c1f163f8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.581624   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:33.582170   714 raft_consensus.cc:3055] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:33.582203   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:33.582571   714 raft_consensus.cc:740] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Running, Role: LEADER
I20260709 12:59:33.582792   640 raft_consensus.cc:3060] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.583340   714 consensus_queue.cc:260] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.585341   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2b25c52e9e5442a9b21789e2640ad7d"
dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
 from {username='slave'} at 127.0.0.1:40962
I20260709 12:59:33.585891   712 raft_consensus.cc:493] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.586228   712 raft_consensus.cc:3060] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.589370   640 raft_consensus.cc:2468] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 2.
I20260709 12:59:33.590579   528 leader_election.cc:304] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:33.590032   714 raft_consensus.cc:3060] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.591583   764 raft_consensus.cc:2804] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:33.592065   764 raft_consensus.cc:697] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Becoming Leader. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:33.592837   764 consensus_queue.cc:237] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.598579   714 raft_consensus.cc:2468] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 2.
I20260709 12:59:33.598497   712 raft_consensus.cc:515] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.601652   462 catalog_manager.cc:5697] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a reported cstate change: term changed from 1 to 2, leader changed from fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131) to 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129). New cstate: current_term: 2 leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.607271   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b25c52e9e5442a9b21789e2640ad7d" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:33.607934   640 raft_consensus.cc:3060] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.610740   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b25c52e9e5442a9b21789e2640ad7d" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:33.611308   564 raft_consensus.cc:3055] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:33.611624   564 raft_consensus.cc:740] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:33.612331   564 consensus_queue.cc:260] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.613359   564 raft_consensus.cc:3060] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.615034   712 leader_election.cc:290] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 2 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
I20260709 12:59:33.652526   640 raft_consensus.cc:2468] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 2.
I20260709 12:59:33.654666   677 leader_election.cc:304] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:33.655545   781 raft_consensus.cc:2804] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:33.656003   781 raft_consensus.cc:697] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 2 LEADER]: Becoming Leader. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Running, Role: LEADER
I20260709 12:59:33.656782   781 consensus_queue.cc:237] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.657609   564 raft_consensus.cc:2468] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 2.
I20260709 12:59:33.661435   809 raft_consensus.cc:993] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a: : Instructing follower febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:33.661980   817 raft_consensus.cc:1081] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Signalling peer febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:33.675103   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b785b9dc055f42ac812e2bc285203aca"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:59:33.675799   640 raft_consensus.cc:493] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.675321   459 catalog_manager.cc:5697] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d reported cstate change: term changed from 1 to 2, leader changed from 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129) to fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131). New cstate: current_term: 2 leader_uuid: "fe56c01ed8bd493fb16386bc7788d12d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.676265   640 raft_consensus.cc:3060] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.683822   640 raft_consensus.cc:515] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.687685   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b785b9dc055f42ac812e2bc285203aca" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:33.688057   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b785b9dc055f42ac812e2bc285203aca" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:33.688303   564 raft_consensus.cc:3055] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:33.689014   564 raft_consensus.cc:740] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:33.689035   713 raft_consensus.cc:3060] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.689801   564 consensus_queue.cc:260] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.690886   564 raft_consensus.cc:3060] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.692118   782 raft_consensus.cc:993] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a: : Instructing follower 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:33.692739   782 raft_consensus.cc:1081] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Signalling peer 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:33.694923   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08689662ab824b2986eea00921bba052"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:46668
I20260709 12:59:33.695463   565 raft_consensus.cc:493] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.695796   565 raft_consensus.cc:3060] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.696851   713 raft_consensus.cc:2468] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 2.
I20260709 12:59:33.697962   640 leader_election.cc:290] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 2 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:33.698290   606 leader_election.cc:304] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:33.697628   564 raft_consensus.cc:2468] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 2.
I20260709 12:59:33.699493   832 raft_consensus.cc:2804] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:33.699971   832 raft_consensus.cc:697] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [term 2 LEADER]: Becoming Leader. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:33.700745   832 consensus_queue.cc:237] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.703562   565 raft_consensus.cc:515] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.706192   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08689662ab824b2986eea00921bba052" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:33.706755   640 raft_consensus.cc:3055] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:33.707108   565 leader_election.cc:290] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 2 election: Requested vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:33.707108   640 raft_consensus.cc:740] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:33.706633   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08689662ab824b2986eea00921bba052" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:33.708112   713 raft_consensus.cc:3060] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.709599   459 catalog_manager.cc:5697] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a reported cstate change: term changed from 1 to 2, leader changed from 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129) to febfd6ab8383479fbed5591c1f163f8a (127.0.107.130). New cstate: current_term: 2 leader_uuid: "febfd6ab8383479fbed5591c1f163f8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.712049   640 consensus_queue.cc:260] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.713271   640 raft_consensus.cc:3060] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.714119   713 raft_consensus.cc:2468] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 2.
I20260709 12:59:33.715291   531 leader_election.cc:304] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, fe56c01ed8bd493fb16386bc7788d12d; no voters: 
I20260709 12:59:33.716157   809 raft_consensus.cc:2804] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:33.716728   809 raft_consensus.cc:697] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Becoming Leader. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:33.717500   809 consensus_queue.cc:237] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.720835   640 raft_consensus.cc:2468] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 2.
I20260709 12:59:33.725103   459 catalog_manager.cc:5697] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a reported cstate change: term changed from 1 to 2, leader changed from febfd6ab8383479fbed5591c1f163f8a (127.0.107.130) to 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129). New cstate: current_term: 2 leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.741142   763 raft_consensus.cc:993] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d: : Instructing follower 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:33.741559   781 raft_consensus.cc:1081] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Signalling peer 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:33.742930   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:46664
I20260709 12:59:33.743342   565 raft_consensus.cc:493] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.743677   565 raft_consensus.cc:3060] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.747893   565 raft_consensus.cc:515] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.749773   565 leader_election.cc:290] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 2 election: Requested vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:33.750728   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:33.751091   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:33.751307   640 raft_consensus.cc:3060] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.751704   713 raft_consensus.cc:3055] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:33.751989   713 raft_consensus.cc:740] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Running, Role: LEADER
I20260709 12:59:33.752651   713 consensus_queue.cc:260] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.753494   713 raft_consensus.cc:3060] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.757727   640 raft_consensus.cc:2468] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 2.
I20260709 12:59:33.758631   713 raft_consensus.cc:2468] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 2.
I20260709 12:59:33.758806   528 leader_election.cc:304] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:33.759696   809 raft_consensus.cc:2804] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:33.760160   809 raft_consensus.cc:697] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Becoming Leader. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:33.760916   809 consensus_queue.cc:237] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.768515   459 catalog_manager.cc:5697] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a reported cstate change: term changed from 1 to 2, leader changed from fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131) to 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129). New cstate: current_term: 2 leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.871369   765 raft_consensus.cc:993] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a: : Instructing follower 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:33.871887   832 raft_consensus.cc:1081] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Signalling peer 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:33.873533   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:46668
I20260709 12:59:33.874084   565 raft_consensus.cc:493] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.874488   565 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.878806   565 raft_consensus.cc:515] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.880831   565 leader_election.cc:290] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 2 election: Requested vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:33.881738   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:33.881888   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:33.882313   640 raft_consensus.cc:3055] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:33.882441   713 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.882658   640 raft_consensus.cc:740] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:33.883592   640 consensus_queue.cc:260] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.884723   640 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.887708   713 raft_consensus.cc:2468] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 2.
I20260709 12:59:33.888846   531 leader_election.cc:304] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, fe56c01ed8bd493fb16386bc7788d12d; no voters: 
I20260709 12:59:33.889809   809 raft_consensus.cc:2804] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:33.890256   809 raft_consensus.cc:697] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Becoming Leader. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:33.891004   809 consensus_queue.cc:237] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:33.892234   640 raft_consensus.cc:2468] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 2.
I20260709 12:59:33.898485   459 catalog_manager.cc:5697] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a reported cstate change: term changed from 1 to 2, leader changed from febfd6ab8383479fbed5591c1f163f8a (127.0.107.130) to 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129). New cstate: current_term: 2 leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.899870   565 raft_consensus.cc:1275] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:33.901185   832 consensus_queue.cc:1048] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:33.911509   713 raft_consensus.cc:1275] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:33.912880   765 consensus_queue.cc:1048] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:33.929734   565 raft_consensus.cc:1275] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:33.931135   765 consensus_queue.cc:1048] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:33.938848   713 raft_consensus.cc:1275] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:33.940248   765 consensus_queue.cc:1048] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.045933   713 raft_consensus.cc:1275] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.047677   809 consensus_queue.cc:1048] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.060281   640 raft_consensus.cc:1275] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.061565   815 consensus_queue.cc:1048] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.145306   713 raft_consensus.cc:1275] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.146595   815 consensus_queue.cc:1048] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.154868   640 raft_consensus.cc:1275] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.156431   815 consensus_queue.cc:1048] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.205515   713 raft_consensus.cc:1275] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.206766   815 consensus_queue.cc:1048] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.217866   565 raft_consensus.cc:1275] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.218034   639 raft_consensus.cc:1275] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Refusing update from remote peer fe56c01ed8bd493fb16386bc7788d12d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.219321   765 consensus_queue.cc:1048] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.219982   640 raft_consensus.cc:1275] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.220955   781 consensus_queue.cc:1048] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.222167   817 consensus_queue.cc:1048] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.230547   564 raft_consensus.cc:1275] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Refusing update from remote peer fe56c01ed8bd493fb16386bc7788d12d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.232350   781 consensus_queue.cc:1048] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.239701   713 raft_consensus.cc:1275] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.240970   765 consensus_queue.cc:1048] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.391170   712 raft_consensus.cc:1275] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.392508   815 consensus_queue.cc:1048] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:34.401335   639 raft_consensus.cc:1275] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:34.402705   764 consensus_queue.cc:1048] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:36.468185   430 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:59:36.469018   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:36.490020   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
mode: GRACEFUL
new_leader_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
 from {username='slave'} at 127.0.0.1:46680
I20260709 12:59:36.490537   565 raft_consensus.cc:606] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Received request to transfer leadership to TS fe56c01ed8bd493fb16386bc7788d12d
I20260709 12:59:36.500183   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7ce4b08ecc2415ca8c110f159c093f5"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
mode: GRACEFUL
new_leader_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:59:36.500778   639 raft_consensus.cc:606] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Received request to transfer leadership to TS fe56c01ed8bd493fb16386bc7788d12d
I20260709 12:59:36.502651   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:36.503286   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:36.510100   817 raft_consensus.cc:993] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a: : Instructing follower fe56c01ed8bd493fb16386bc7788d12d to start an election
I20260709 12:59:36.510519   860 raft_consensus.cc:1081] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Signalling peer fe56c01ed8bd493fb16386bc7788d12d to start an election
I20260709 12:59:36.512012   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e"
dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
 from {username='slave'} at 127.0.0.1:40962
I20260709 12:59:36.512400   712 raft_consensus.cc:493] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:36.512645   712 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:36.517170   712 raft_consensus.cc:515] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:36.518878   712 leader_election.cc:290] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 3 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
I20260709 12:59:36.519394   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:36.519994   565 raft_consensus.cc:3055] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:36.519845   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:36.520371   565 raft_consensus.cc:740] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:36.520558   639 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:36.521118   565 consensus_queue.cc:260] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:36.521986   565 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:36.525926   639 raft_consensus.cc:2468] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 3.
I20260709 12:59:36.526568   861 raft_consensus.cc:993] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a: : Instructing follower fe56c01ed8bd493fb16386bc7788d12d to start an election
I20260709 12:59:36.527062   861 raft_consensus.cc:1081] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Signalling peer fe56c01ed8bd493fb16386bc7788d12d to start an election
I20260709 12:59:36.527143   677 leader_election.cc:304] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:36.527791   565 raft_consensus.cc:2468] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 3.
I20260709 12:59:36.527922   854 raft_consensus.cc:2804] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:36.528838   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7ce4b08ecc2415ca8c110f159c093f5"
dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
 from {username='slave'} at 127.0.0.1:40974
I20260709 12:59:36.529340   854 raft_consensus.cc:697] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 3 LEADER]: Becoming Leader. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Running, Role: LEADER
I20260709 12:59:36.529477   712 raft_consensus.cc:493] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:36.529897   712 raft_consensus.cc:3060] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:36.530099   854 consensus_queue.cc:237] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:36.534705   712 raft_consensus.cc:515] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:36.536542   712 leader_election.cc:290] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 2 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
I20260709 12:59:36.537292   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ce4b08ecc2415ca8c110f159c093f5" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:36.537701   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ce4b08ecc2415ca8c110f159c093f5" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:36.537935   565 raft_consensus.cc:3060] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:36.538465   639 raft_consensus.cc:3055] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:36.537966   459 catalog_manager.cc:5697] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d reported cstate change: term changed from 2 to 3, leader changed from 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129) to fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131). New cstate: current_term: 3 leader_uuid: "fe56c01ed8bd493fb16386bc7788d12d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.538838   639 raft_consensus.cc:740] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:36.539714   639 consensus_queue.cc:260] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:36.540943   639 raft_consensus.cc:3060] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:36.545075   565 raft_consensus.cc:2468] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 2.
I20260709 12:59:36.546289   677 leader_election.cc:304] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, fe56c01ed8bd493fb16386bc7788d12d; no voters: 
I20260709 12:59:36.547123   854 raft_consensus.cc:2804] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:36.547703   854 raft_consensus.cc:697] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 2 LEADER]: Becoming Leader. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Running, Role: LEADER
I20260709 12:59:36.548019   639 raft_consensus.cc:2468] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 2.
I20260709 12:59:36.548492   854 consensus_queue.cc:237] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:36.554824   459 catalog_manager.cc:5697] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d reported cstate change: term changed from 1 to 2, leader changed from febfd6ab8383479fbed5591c1f163f8a (127.0.107.130) to fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131). New cstate: current_term: 2 leader_uuid: "fe56c01ed8bd493fb16386bc7788d12d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.931365   639 raft_consensus.cc:1275] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Refusing update from remote peer fe56c01ed8bd493fb16386bc7788d12d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:36.932688   854 consensus_queue.cc:1048] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:36.942777   565 raft_consensus.cc:1275] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Refusing update from remote peer fe56c01ed8bd493fb16386bc7788d12d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:36.944605   854 consensus_queue.cc:1048] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:36.982775   639 raft_consensus.cc:1275] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Refusing update from remote peer fe56c01ed8bd493fb16386bc7788d12d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:36.984205   854 consensus_queue.cc:1048] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:36.993777   565 raft_consensus.cc:1275] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Refusing update from remote peer fe56c01ed8bd493fb16386bc7788d12d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:36.996593   854 consensus_queue.cc:1048] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:37.504172   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:37.513721   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08689662ab824b2986eea00921bba052"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
mode: GRACEFUL
new_leader_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:46674
I20260709 12:59:37.514298   565 raft_consensus.cc:606] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Received request to transfer leadership to TS febfd6ab8383479fbed5591c1f163f8a
I20260709 12:59:37.519017   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
mode: GRACEFUL
new_leader_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:46674
I20260709 12:59:37.519482   565 raft_consensus.cc:606] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Received request to transfer leadership to TS febfd6ab8383479fbed5591c1f163f8a
I20260709 12:59:37.523586   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
mode: GRACEFUL
new_leader_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:46674
I20260709 12:59:37.523994   565 raft_consensus.cc:606] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Received request to transfer leadership to TS febfd6ab8383479fbed5591c1f163f8a
I20260709 12:59:37.528936   712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e"
dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
mode: GRACEFUL
new_leader_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:40976
I20260709 12:59:37.529402   712 raft_consensus.cc:606] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 3 LEADER]: Received request to transfer leadership to TS febfd6ab8383479fbed5591c1f163f8a
I20260709 12:59:37.541123   712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7ce4b08ecc2415ca8c110f159c093f5"
dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
mode: GRACEFUL
new_leader_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:40976
I20260709 12:59:37.541563   712 raft_consensus.cc:606] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 2 LEADER]: Received request to transfer leadership to TS febfd6ab8383479fbed5591c1f163f8a
I20260709 12:59:37.562736   854 raft_consensus.cc:993] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d: : Instructing follower febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:37.563169   875 raft_consensus.cc:1081] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 2 LEADER]: Signalling peer febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:37.564502   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7ce4b08ecc2415ca8c110f159c093f5"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:56964
I20260709 12:59:37.565021   640 raft_consensus.cc:493] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:37.565349   640 raft_consensus.cc:3060] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.570528   640 raft_consensus.cc:515] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.572497   640 leader_election.cc:290] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 3 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:37.572839   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ce4b08ecc2415ca8c110f159c093f5" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:37.573068   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ce4b08ecc2415ca8c110f159c093f5" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:37.573473   565 raft_consensus.cc:3060] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.573654   712 raft_consensus.cc:3055] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:37.574035   712 raft_consensus.cc:740] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Running, Role: LEADER
I20260709 12:59:37.574887   712 consensus_queue.cc:260] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.576138   712 raft_consensus.cc:3060] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.579934   565 raft_consensus.cc:2468] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 3.
I20260709 12:59:37.581166   603 leader_election.cc:304] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:37.582003   861 raft_consensus.cc:2804] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:37.582870   712 raft_consensus.cc:2468] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 3.
I20260709 12:59:37.583086   861 raft_consensus.cc:697] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Becoming Leader. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:37.584056   861 consensus_queue.cc:237] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.590080   460 catalog_manager.cc:5697] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a reported cstate change: term changed from 2 to 3, leader changed from fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131) to febfd6ab8383479fbed5591c1f163f8a (127.0.107.130). New cstate: current_term: 3 leader_uuid: "febfd6ab8383479fbed5591c1f163f8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.607995   854 raft_consensus.cc:993] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d: : Instructing follower febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:37.608409   875 raft_consensus.cc:1081] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 3 LEADER]: Signalling peer febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:37.609776   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:56964
I20260709 12:59:37.610340   640 raft_consensus.cc:493] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:37.610595   640 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.614650   640 raft_consensus.cc:515] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.616026   640 leader_election.cc:290] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 4 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:37.616923   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:37.617026   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:37.617416   565 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.617594   712 raft_consensus.cc:3055] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:37.617966   712 raft_consensus.cc:740] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Running, Role: LEADER
I20260709 12:59:37.618695   712 consensus_queue.cc:260] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.619776   712 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.622238   565 raft_consensus.cc:2468] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 4.
I20260709 12:59:37.623068   603 leader_election.cc:304] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:37.623708   861 raft_consensus.cc:2804] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:37.624120   861 raft_consensus.cc:697] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 4 LEADER]: Becoming Leader. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:37.624795   861 consensus_queue.cc:237] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.625267   712 raft_consensus.cc:2468] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 4.
I20260709 12:59:37.630901   460 catalog_manager.cc:5697] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a reported cstate change: term changed from 3 to 4, leader changed from fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131) to febfd6ab8383479fbed5591c1f163f8a (127.0.107.130). New cstate: current_term: 4 leader_uuid: "febfd6ab8383479fbed5591c1f163f8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.631654   883 raft_consensus.cc:993] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a: : Instructing follower febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:37.632184   860 raft_consensus.cc:1081] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Signalling peer febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:37.633608   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:59:37.634009   640 raft_consensus.cc:493] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:37.634303   640 raft_consensus.cc:3060] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.638875   640 raft_consensus.cc:515] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.640264   640 leader_election.cc:290] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 3 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:37.641057   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:37.641517   565 raft_consensus.cc:3055] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:37.641466   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7adb65f8c6f14f3cba488babb397ed19" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:37.641841   565 raft_consensus.cc:740] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:37.642130   712 raft_consensus.cc:3060] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.642534   565 consensus_queue.cc:260] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.643335   565 raft_consensus.cc:3060] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.646569   712 raft_consensus.cc:2468] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 3.
I20260709 12:59:37.646972   565 raft_consensus.cc:2468] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 3.
I20260709 12:59:37.647534   606 leader_election.cc:304] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:37.648274   861 raft_consensus.cc:2804] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:37.648690   861 raft_consensus.cc:697] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Becoming Leader. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:37.649418   861 consensus_queue.cc:237] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.655166   460 catalog_manager.cc:5697] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a reported cstate change: term changed from 2 to 3, leader changed from 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129) to febfd6ab8383479fbed5591c1f163f8a (127.0.107.130). New cstate: current_term: 3 leader_uuid: "febfd6ab8383479fbed5591c1f163f8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.688402   883 raft_consensus.cc:993] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a: : Instructing follower febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:37.688767   860 raft_consensus.cc:1081] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Signalling peer febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:37.690059   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:59:37.690500   640 raft_consensus.cc:493] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:37.690776   640 raft_consensus.cc:3060] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.694725   640 raft_consensus.cc:515] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.696197   640 leader_election.cc:290] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 3 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:37.697026   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:37.697405   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:37.697604   565 raft_consensus.cc:3055] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:37.697948   565 raft_consensus.cc:740] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:37.698014   712 raft_consensus.cc:3060] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.698764   565 consensus_queue.cc:260] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.699976   565 raft_consensus.cc:3060] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.704900   712 raft_consensus.cc:2468] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 3.
I20260709 12:59:37.706099   606 leader_election.cc:304] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:37.706280   565 raft_consensus.cc:2468] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 3.
I20260709 12:59:37.706970   861 raft_consensus.cc:2804] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:37.707500   861 raft_consensus.cc:697] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Becoming Leader. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:37.708214   861 consensus_queue.cc:237] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.714674   460 catalog_manager.cc:5697] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a reported cstate change: term changed from 2 to 3, leader changed from 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129) to febfd6ab8383479fbed5591c1f163f8a (127.0.107.130). New cstate: current_term: 3 leader_uuid: "febfd6ab8383479fbed5591c1f163f8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.747854   883 raft_consensus.cc:993] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a: : Instructing follower febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:37.748247   860 raft_consensus.cc:1081] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Signalling peer febfd6ab8383479fbed5591c1f163f8a to start an election
I20260709 12:59:37.749490   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08689662ab824b2986eea00921bba052"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
 from {username='slave'} at 127.0.0.1:56980
I20260709 12:59:37.749933   640 raft_consensus.cc:493] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:37.750198   640 raft_consensus.cc:3060] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.753927   640 raft_consensus.cc:515] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.755242   640 leader_election.cc:290] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 3 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:37.756176   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08689662ab824b2986eea00921bba052" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:37.756198   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08689662ab824b2986eea00921bba052" candidate_uuid: "febfd6ab8383479fbed5591c1f163f8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:37.756783   565 raft_consensus.cc:3055] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:37.756916   712 raft_consensus.cc:3060] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.757045   565 raft_consensus.cc:740] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:37.757761   565 consensus_queue.cc:260] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.758562   565 raft_consensus.cc:3060] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.761742   712 raft_consensus.cc:2468] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 3.
I20260709 12:59:37.762683   565 raft_consensus.cc:2468] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate febfd6ab8383479fbed5591c1f163f8a in term 3.
I20260709 12:59:37.762642   606 leader_election.cc:304] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fe56c01ed8bd493fb16386bc7788d12d, febfd6ab8383479fbed5591c1f163f8a; no voters: 
I20260709 12:59:37.763595   861 raft_consensus.cc:2804] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:37.764045   861 raft_consensus.cc:697] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Becoming Leader. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:37.764711   861 consensus_queue.cc:237] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:37.770951   460 catalog_manager.cc:5697] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a reported cstate change: term changed from 2 to 3, leader changed from 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129) to febfd6ab8383479fbed5591c1f163f8a (127.0.107.130). New cstate: current_term: 3 leader_uuid: "febfd6ab8383479fbed5591c1f163f8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.041637   712 raft_consensus.cc:1275] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:38.042809   713 raft_consensus.cc:1275] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 4 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:38.043053   861 consensus_queue.cc:1048] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:38.044343   861 consensus_queue.cc:1048] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:38.062834   565 raft_consensus.cc:1275] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:38.064841   892 consensus_queue.cc:1048] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:38.065342   565 raft_consensus.cc:1275] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 4 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:38.067494   892 consensus_queue.cc:1048] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:38.113907   565 raft_consensus.cc:1275] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:38.115056   892 consensus_queue.cc:1048] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:38.123145   714 raft_consensus.cc:1275] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:38.124652   892 consensus_queue.cc:1048] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:38.143602   714 raft_consensus.cc:1275] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:38.144961   892 consensus_queue.cc:1048] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:38.154515   565 raft_consensus.cc:1275] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:38.156136   887 consensus_queue.cc:1048] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:38.190713   714 raft_consensus.cc:1275] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:38.192126   887 consensus_queue.cc:1048] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:38.202133   565 raft_consensus.cc:1275] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Refusing update from remote peer febfd6ab8383479fbed5591c1f163f8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:38.203325   887 consensus_queue.cc:1048] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:40.545691   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:40.553094   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08689662ab824b2986eea00921bba052"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
mode: GRACEFUL
new_leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:59:40.553751   640 raft_consensus.cc:606] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Received request to transfer leadership to TS 8b3d23f60d6746e5b52fc799f964bf7a
I20260709 12:59:40.556586   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
mode: GRACEFUL
new_leader_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:59:40.557032   640 raft_consensus.cc:606] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 4 LEADER]: Received request to transfer leadership to TS fe56c01ed8bd493fb16386bc7788d12d
I20260709 12:59:40.559669   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
mode: GRACEFUL
new_leader_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:59:40.560106   640 raft_consensus.cc:606] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Received request to transfer leadership to TS fe56c01ed8bd493fb16386bc7788d12d
I20260709 12:59:40.562079   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a90536cc45b24877817ac362df08ed23"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
mode: GRACEFUL
new_leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:59:40.562489   640 raft_consensus.cc:606] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 2 LEADER]: Received request to transfer leadership to TS 8b3d23f60d6746e5b52fc799f964bf7a
I20260709 12:59:40.564558   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eab57531d0314db387a141a8180a111e"
dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
mode: GRACEFUL
new_leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:59:40.564960   640 raft_consensus.cc:606] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 2 LEADER]: Received request to transfer leadership to TS 8b3d23f60d6746e5b52fc799f964bf7a
I20260709 12:59:40.565886   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:40.566397   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:40.569200   904 raft_consensus.cc:993] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a: : Instructing follower 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:40.569694   887 raft_consensus.cc:1081] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 2 LEADER]: Signalling peer 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:40.571266   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eab57531d0314db387a141a8180a111e"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:46668
I20260709 12:59:40.571661   565 raft_consensus.cc:493] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:40.571916   565 raft_consensus.cc:3060] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.576531   565 raft_consensus.cc:515] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:40.578325   565 leader_election.cc:290] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 3 election: Requested vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:40.579295   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab57531d0314db387a141a8180a111e" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:40.579766   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab57531d0314db387a141a8180a111e" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:40.580091   640 raft_consensus.cc:3055] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:40.580317   714 raft_consensus.cc:3060] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.580410   640 raft_consensus.cc:740] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:40.581255   640 consensus_queue.cc:260] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:40.582511   640 raft_consensus.cc:3060] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.587370   714 raft_consensus.cc:2468] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 3.
I20260709 12:59:40.588881   531 leader_election.cc:304] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, fe56c01ed8bd493fb16386bc7788d12d; no voters: 
I20260709 12:59:40.589102   640 raft_consensus.cc:2468] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 3.
I20260709 12:59:40.590647   905 raft_consensus.cc:2804] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:40.591640   905 raft_consensus.cc:697] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 LEADER]: Becoming Leader. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:40.592592   905 consensus_queue.cc:237] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:40.600840   462 catalog_manager.cc:5697] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a reported cstate change: term changed from 2 to 3, leader changed from febfd6ab8383479fbed5591c1f163f8a (127.0.107.130) to 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129). New cstate: current_term: 3 leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:40.707270   904 raft_consensus.cc:993] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a: : Instructing follower 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:40.707698   887 raft_consensus.cc:1081] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Signalling peer 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:40.709124   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08689662ab824b2986eea00921bba052"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:46668
I20260709 12:59:40.709556   565 raft_consensus.cc:493] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:40.709777   565 raft_consensus.cc:3060] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.713747   565 raft_consensus.cc:515] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:40.715044   565 leader_election.cc:290] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 4 election: Requested vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:40.716056   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08689662ab824b2986eea00921bba052" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:40.716157   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08689662ab824b2986eea00921bba052" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:40.716588   640 raft_consensus.cc:3055] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:40.716785   714 raft_consensus.cc:3060] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.716885   640 raft_consensus.cc:740] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:40.717765   640 consensus_queue.cc:260] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:40.718549   640 raft_consensus.cc:3060] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.722334   714 raft_consensus.cc:2468] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 4.
I20260709 12:59:40.722517   640 raft_consensus.cc:2468] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 4.
I20260709 12:59:40.723603   531 leader_election.cc:304] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, fe56c01ed8bd493fb16386bc7788d12d; no voters: 
I20260709 12:59:40.724372   905 raft_consensus.cc:2804] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:40.724792   905 raft_consensus.cc:697] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 4 LEADER]: Becoming Leader. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:40.725796   905 consensus_queue.cc:237] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:40.732676   462 catalog_manager.cc:5697] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a reported cstate change: term changed from 3 to 4, leader changed from febfd6ab8383479fbed5591c1f163f8a (127.0.107.130) to 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129). New cstate: current_term: 4 leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:40.858489   904 raft_consensus.cc:993] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a: : Instructing follower 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:40.859115   887 raft_consensus.cc:1081] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 2 LEADER]: Signalling peer 8b3d23f60d6746e5b52fc799f964bf7a to start an election
I20260709 12:59:40.860635   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a90536cc45b24877817ac362df08ed23"
dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
 from {username='slave'} at 127.0.0.1:46668
I20260709 12:59:40.861020   565 raft_consensus.cc:493] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:40.861367   565 raft_consensus.cc:3060] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.865638   565 raft_consensus.cc:515] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:40.867444   565 leader_election.cc:290] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 3 election: Requested vote from peers febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829), fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131:35453)
I20260709 12:59:40.868239   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90536cc45b24877817ac362df08ed23" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:40.868461   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90536cc45b24877817ac362df08ed23" candidate_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
I20260709 12:59:40.868705   640 raft_consensus.cc:3055] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:40.869076   640 raft_consensus.cc:740] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:40.869089   714 raft_consensus.cc:3060] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.869861   640 consensus_queue.cc:260] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:40.870848   640 raft_consensus.cc:3060] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.873757   714 raft_consensus.cc:2468] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 3.
I20260709 12:59:40.874734   531 leader_election.cc:304] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, fe56c01ed8bd493fb16386bc7788d12d; no voters: 
I20260709 12:59:40.875145   640 raft_consensus.cc:2468] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b3d23f60d6746e5b52fc799f964bf7a in term 3.
I20260709 12:59:40.875476   905 raft_consensus.cc:2804] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:40.876005   905 raft_consensus.cc:697] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 LEADER]: Becoming Leader. State: Replica: 8b3d23f60d6746e5b52fc799f964bf7a, State: Running, Role: LEADER
I20260709 12:59:40.876726   905 consensus_queue.cc:237] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:40.882987   462 catalog_manager.cc:5697] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a reported cstate change: term changed from 2 to 3, leader changed from febfd6ab8383479fbed5591c1f163f8a (127.0.107.130) to 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129). New cstate: current_term: 3 leader_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:40.929688   904 raft_consensus.cc:993] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a: : Instructing follower fe56c01ed8bd493fb16386bc7788d12d to start an election
I20260709 12:59:40.930184   887 raft_consensus.cc:1081] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 4 LEADER]: Signalling peer fe56c01ed8bd493fb16386bc7788d12d to start an election
I20260709 12:59:40.931753   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e"
dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
 from {username='slave'} at 127.0.0.1:40974
I20260709 12:59:40.932214   714 raft_consensus.cc:493] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:40.932528   714 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.937130   714 raft_consensus.cc:515] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:40.939114   714 leader_election.cc:290] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 5 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
I20260709 12:59:40.939884   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:40.940464   565 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.940832   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3452ab3dbfc1464899a830ac4a4acf4e" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:40.941327   640 raft_consensus.cc:3055] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:40.941648   640 raft_consensus.cc:740] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:40.942425   640 consensus_queue.cc:260] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:40.943526   640 raft_consensus.cc:3060] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.946580   565 raft_consensus.cc:2468] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 5.
I20260709 12:59:40.947880   677 leader_election.cc:304] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, fe56c01ed8bd493fb16386bc7788d12d; no voters: 
I20260709 12:59:40.948768   854 raft_consensus.cc:2804] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:40.948813   640 raft_consensus.cc:2468] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 5.
I20260709 12:59:40.950102   854 raft_consensus.cc:697] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 5 LEADER]: Becoming Leader. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Running, Role: LEADER
I20260709 12:59:40.950793   854 consensus_queue.cc:237] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:40.959465   462 catalog_manager.cc:5697] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d reported cstate change: term changed from 4 to 5, leader changed from febfd6ab8383479fbed5591c1f163f8a (127.0.107.130) to fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131). New cstate: current_term: 5 leader_uuid: "fe56c01ed8bd493fb16386bc7788d12d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:41.045033   904 raft_consensus.cc:993] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a: : Instructing follower fe56c01ed8bd493fb16386bc7788d12d to start an election
I20260709 12:59:41.045571   887 raft_consensus.cc:1081] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Signalling peer fe56c01ed8bd493fb16386bc7788d12d to start an election
I20260709 12:59:41.046958   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef"
dest_uuid: "fe56c01ed8bd493fb16386bc7788d12d"
 from {username='slave'} at 127.0.0.1:40974
I20260709 12:59:41.047412   714 raft_consensus.cc:493] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:41.047734   714 raft_consensus.cc:3060] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.052100   714 raft_consensus.cc:515] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:41.053745   714 leader_election.cc:290] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 4 election: Requested vote from peers 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251), febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829)
I20260709 12:59:41.054575   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8b3d23f60d6746e5b52fc799f964bf7a"
I20260709 12:59:41.054929   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9180566ec79941fa8b6dad86794f0cef" candidate_uuid: "fe56c01ed8bd493fb16386bc7788d12d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "febfd6ab8383479fbed5591c1f163f8a"
I20260709 12:59:41.055104   565 raft_consensus.cc:3060] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.055444   640 raft_consensus.cc:3055] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:41.055742   640 raft_consensus.cc:740] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: febfd6ab8383479fbed5591c1f163f8a, State: Running, Role: LEADER
I20260709 12:59:41.056282   640 consensus_queue.cc:260] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:41.057042   640 raft_consensus.cc:3060] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.059511   565 raft_consensus.cc:2468] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 4.
I20260709 12:59:41.060456   677 leader_election.cc:304] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b3d23f60d6746e5b52fc799f964bf7a, fe56c01ed8bd493fb16386bc7788d12d; no voters: 
I20260709 12:59:41.061259   854 raft_consensus.cc:2804] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:41.061741   640 raft_consensus.cc:2468] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe56c01ed8bd493fb16386bc7788d12d in term 4.
I20260709 12:59:41.061748   854 raft_consensus.cc:697] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 4 LEADER]: Becoming Leader. State: Replica: fe56c01ed8bd493fb16386bc7788d12d, State: Running, Role: LEADER
I20260709 12:59:41.062911   714 raft_consensus.cc:1275] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:41.063295   854 consensus_queue.cc:237] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } }
I20260709 12:59:41.064093   905 consensus_queue.cc:1048] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:41.071147   462 catalog_manager.cc:5697] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d reported cstate change: term changed from 3 to 4, leader changed from febfd6ab8383479fbed5591c1f163f8a (127.0.107.130) to fe56c01ed8bd493fb16386bc7788d12d (127.0.107.131). New cstate: current_term: 4 leader_uuid: "fe56c01ed8bd493fb16386bc7788d12d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:41.081115   640 raft_consensus.cc:1275] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:41.082439   905 consensus_queue.cc:1048] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:41.151800   640 raft_consensus.cc:1275] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 4 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:41.152923   905 consensus_queue.cc:1048] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:41.163864   714 raft_consensus.cc:1275] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 4 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:41.165701   920 consensus_queue.cc:1048] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:41.293629   640 raft_consensus.cc:1275] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:41.294730   920 consensus_queue.cc:1048] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:41.303982   714 raft_consensus.cc:1275] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Refusing update from remote peer 8b3d23f60d6746e5b52fc799f964bf7a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:41.305882   905 consensus_queue.cc:1048] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe56c01ed8bd493fb16386bc7788d12d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 35453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:41.342789   640 raft_consensus.cc:1275] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 5 FOLLOWER]: Refusing update from remote peer fe56c01ed8bd493fb16386bc7788d12d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:41.344018   854 consensus_queue.cc:1048] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:41.352007   565 raft_consensus.cc:1275] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 5 FOLLOWER]: Refusing update from remote peer fe56c01ed8bd493fb16386bc7788d12d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:41.353808   914 consensus_queue.cc:1048] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:41.544960   640 raft_consensus.cc:1275] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 4 FOLLOWER]: Refusing update from remote peer fe56c01ed8bd493fb16386bc7788d12d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:41.546079   928 consensus_queue.cc:1048] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "febfd6ab8383479fbed5591c1f163f8a" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:41.556010   565 raft_consensus.cc:1275] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 4 FOLLOWER]: Refusing update from remote peer fe56c01ed8bd493fb16386bc7788d12d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:41.557463   928 consensus_queue.cc:1048] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b3d23f60d6746e5b52fc799f964bf7a" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 35251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:41.567188   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:41.572636   430 tablet_server.cc:179] TabletServer@127.0.107.129:0 shutting down...
I20260709 12:59:41.600812   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:41.601568   430 tablet_replica.cc:333] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a: stopping tablet replica
I20260709 12:59:41.602209   430 raft_consensus.cc:2243] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.602716   430 raft_consensus.cc:2272] T 9180566ec79941fa8b6dad86794f0cef P 8b3d23f60d6746e5b52fc799f964bf7a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.605341   430 tablet_replica.cc:333] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a: stopping tablet replica
I20260709 12:59:41.606024   430 raft_consensus.cc:2243] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.606487   430 raft_consensus.cc:2272] T f7ce4b08ecc2415ca8c110f159c093f5 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.608461   430 tablet_replica.cc:333] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a: stopping tablet replica
I20260709 12:59:41.609009   430 raft_consensus.cc:2243] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.609443   430 raft_consensus.cc:2272] T b2b25c52e9e5442a9b21789e2640ad7d P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.610970   430 tablet_replica.cc:333] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a: stopping tablet replica
I20260709 12:59:41.611529   430 raft_consensus.cc:2243] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.612053   430 raft_consensus.cc:2272] T b785b9dc055f42ac812e2bc285203aca P 8b3d23f60d6746e5b52fc799f964bf7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.613564   430 tablet_replica.cc:333] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a: stopping tablet replica
I20260709 12:59:41.614050   430 raft_consensus.cc:2243] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.614507   430 raft_consensus.cc:2272] T 7adb65f8c6f14f3cba488babb397ed19 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.616173   430 tablet_replica.cc:333] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a: stopping tablet replica
I20260709 12:59:41.616624   430 raft_consensus.cc:2243] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:41.617308   430 raft_consensus.cc:2272] T 08689662ab824b2986eea00921bba052 P 8b3d23f60d6746e5b52fc799f964bf7a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.619468   430 tablet_replica.cc:333] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a: stopping tablet replica
I20260709 12:59:41.619997   430 raft_consensus.cc:2243] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.620440   430 raft_consensus.cc:2272] T 3452ab3dbfc1464899a830ac4a4acf4e P 8b3d23f60d6746e5b52fc799f964bf7a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.622615   430 tablet_replica.cc:333] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a: stopping tablet replica
I20260709 12:59:41.623090   430 raft_consensus.cc:2243] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:41.623843   430 raft_consensus.cc:2272] T eab57531d0314db387a141a8180a111e P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.625912   430 tablet_replica.cc:333] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a: stopping tablet replica
I20260709 12:59:41.626579   430 raft_consensus.cc:2243] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:41.627345   430 raft_consensus.cc:2272] T a90536cc45b24877817ac362df08ed23 P 8b3d23f60d6746e5b52fc799f964bf7a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:41.725631   603 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.129:35251: connect: Connection refused (error 111)
I20260709 12:59:41.728196   430 tablet_server.cc:196] TabletServer@127.0.107.129:0 shutdown complete.
W20260709 12:59:41.730005   603 consensus_peers.cc:597] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a -> Peer 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251): Couldn't send request to peer 8b3d23f60d6746e5b52fc799f964bf7a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:35251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:41.730460   603 consensus_peers.cc:597] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a -> Peer 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251): Couldn't send request to peer 8b3d23f60d6746e5b52fc799f964bf7a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:35251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:41.747499   430 tablet_server.cc:179] TabletServer@127.0.107.130:0 shutting down...
W20260709 12:59:41.762496   603 consensus_peers.cc:597] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a -> Peer 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251): Couldn't send request to peer 8b3d23f60d6746e5b52fc799f964bf7a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:35251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:41.773250   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:41.773999   430 tablet_replica.cc:333] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a: stopping tablet replica
I20260709 12:59:41.774739   430 raft_consensus.cc:2243] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.775174   430 raft_consensus.cc:2272] T a90536cc45b24877817ac362df08ed23 P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:41.776651   677 consensus_peers.cc:597] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d -> Peer febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829): Couldn't send request to peer febfd6ab8383479fbed5591c1f163f8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:41.778012   430 tablet_replica.cc:333] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a: stopping tablet replica
I20260709 12:59:41.778590   430 raft_consensus.cc:2243] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:41.779493   430 raft_consensus.cc:2272] T f7ce4b08ecc2415ca8c110f159c093f5 P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.781281   430 tablet_replica.cc:333] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a: stopping tablet replica
I20260709 12:59:41.781807   430 raft_consensus.cc:2243] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.782207   430 raft_consensus.cc:2272] T eab57531d0314db387a141a8180a111e P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.784272   430 tablet_replica.cc:333] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a: stopping tablet replica
I20260709 12:59:41.784767   430 raft_consensus.cc:2243] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.785181   430 raft_consensus.cc:2272] T 3452ab3dbfc1464899a830ac4a4acf4e P febfd6ab8383479fbed5591c1f163f8a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.787233   430 tablet_replica.cc:333] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a: stopping tablet replica
I20260709 12:59:41.787801   430 raft_consensus.cc:2243] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.788168   430 raft_consensus.cc:2272] T 9180566ec79941fa8b6dad86794f0cef P febfd6ab8383479fbed5591c1f163f8a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.790132   430 tablet_replica.cc:333] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a: stopping tablet replica
I20260709 12:59:41.790596   430 raft_consensus.cc:2243] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:41.791298   430 raft_consensus.cc:2272] T b785b9dc055f42ac812e2bc285203aca P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.792927   430 tablet_replica.cc:333] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a: stopping tablet replica
I20260709 12:59:41.793447   430 raft_consensus.cc:2243] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.793884   430 raft_consensus.cc:2272] T b2b25c52e9e5442a9b21789e2640ad7d P febfd6ab8383479fbed5591c1f163f8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.796088   430 tablet_replica.cc:333] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a: stopping tablet replica
I20260709 12:59:41.796698   430 raft_consensus.cc:2243] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:41.797488   430 raft_consensus.cc:2272] T 7adb65f8c6f14f3cba488babb397ed19 P febfd6ab8383479fbed5591c1f163f8a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.799657   430 tablet_replica.cc:333] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a: stopping tablet replica
I20260709 12:59:41.800302   430 raft_consensus.cc:2243] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:59:41.800386   677 consensus_peers.cc:597] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d -> Peer 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251): Couldn't send request to peer 8b3d23f60d6746e5b52fc799f964bf7a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:35251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:41.800804   430 raft_consensus.cc:2272] T 08689662ab824b2986eea00921bba052 P febfd6ab8383479fbed5591c1f163f8a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.829228   430 tablet_server.cc:196] TabletServer@127.0.107.130:0 shutdown complete.
W20260709 12:59:41.837049   677 consensus_peers.cc:597] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d -> Peer febfd6ab8383479fbed5591c1f163f8a (127.0.107.130:43829): Couldn't send request to peer febfd6ab8383479fbed5591c1f163f8a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:43829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:41.844135   677 consensus_peers.cc:597] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d -> Peer 8b3d23f60d6746e5b52fc799f964bf7a (127.0.107.129:35251): Couldn't send request to peer 8b3d23f60d6746e5b52fc799f964bf7a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:35251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:41.849121   430 tablet_server.cc:179] TabletServer@127.0.107.131:0 shutting down...
I20260709 12:59:41.877895   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:41.878607   430 tablet_replica.cc:333] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d: stopping tablet replica
I20260709 12:59:41.879249   430 raft_consensus.cc:2243] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.879829   430 raft_consensus.cc:2272] T f7ce4b08ecc2415ca8c110f159c093f5 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.881479   430 tablet_replica.cc:333] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d: stopping tablet replica
I20260709 12:59:41.881968   430 raft_consensus.cc:2243] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.882369   430 raft_consensus.cc:2272] T eab57531d0314db387a141a8180a111e P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.884745   430 tablet_replica.cc:333] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d: stopping tablet replica
I20260709 12:59:41.885216   430 raft_consensus.cc:2243] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:59:41.885883   430 raft_consensus.cc:2272] T 3452ab3dbfc1464899a830ac4a4acf4e P fe56c01ed8bd493fb16386bc7788d12d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.887667   430 tablet_replica.cc:333] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d: stopping tablet replica
I20260709 12:59:41.888163   430 raft_consensus.cc:2243] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.888573   430 raft_consensus.cc:2272] T a90536cc45b24877817ac362df08ed23 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.890337   430 tablet_replica.cc:333] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d: stopping tablet replica
I20260709 12:59:41.890797   430 raft_consensus.cc:2243] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:41.891510   430 raft_consensus.cc:2272] T b2b25c52e9e5442a9b21789e2640ad7d P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.893021   430 tablet_replica.cc:333] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d: stopping tablet replica
I20260709 12:59:41.893554   430 raft_consensus.cc:2243] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.893937   430 raft_consensus.cc:2272] T b785b9dc055f42ac812e2bc285203aca P fe56c01ed8bd493fb16386bc7788d12d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.895514   430 tablet_replica.cc:333] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d: stopping tablet replica
I20260709 12:59:41.895956   430 raft_consensus.cc:2243] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.896363   430 raft_consensus.cc:2272] T 7adb65f8c6f14f3cba488babb397ed19 P fe56c01ed8bd493fb16386bc7788d12d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.897833   430 tablet_replica.cc:333] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d: stopping tablet replica
I20260709 12:59:41.898267   430 raft_consensus.cc:2243] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:41.898658   430 raft_consensus.cc:2272] T 08689662ab824b2986eea00921bba052 P fe56c01ed8bd493fb16386bc7788d12d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.900521   430 tablet_replica.cc:333] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d: stopping tablet replica
I20260709 12:59:41.900942   430 raft_consensus.cc:2243] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:41.901599   430 raft_consensus.cc:2272] T 9180566ec79941fa8b6dad86794f0cef P fe56c01ed8bd493fb16386bc7788d12d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:41.928683   430 tablet_server.cc:196] TabletServer@127.0.107.131:0 shutdown complete.
I20260709 12:59:41.945724   430 master.cc:562] Master@127.0.107.190:44469 shutting down...
I20260709 12:59:42.044557   517 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:59:42.170079   430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:42.170588   430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:42.170856   430 tablet_replica.cc:333] T 00000000000000000000000000000000 P f5d091f801d24993a07d0730bfa9542b: stopping tablet replica
I20260709 12:59:42.190097   430 master.cc:584] Master@127.0.107.190:44469 shutdown complete.
8b3d23f60d6746e5b52fc799f964bf7a  4
fe56c01ed8bd493fb16386bc7788d12d  1
febfd6ab8383479fbed5591c1f163f8a  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12794 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:59:42.233667   430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.190:40521
I20260709 12:59:42.234823   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:42.240630   936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:42.240672   937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:42.242224   430 server_base.cc:1061] running on GCE node
W20260709 12:59:42.242394   939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:42.243252   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:42.243489   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:42.243613   430 hybrid_clock.cc:648] HybridClock initialized: now 1783601982243601 us; error 0 us; skew 500 ppm
I20260709 12:59:42.244093   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:42.246624   430 webserver.cc:533] Webserver started at http://127.0.107.190:46593/ using document root <none> and password file <none>
I20260709 12:59:42.247113   430 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:42.247274   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:42.247747   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:42.248878   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/master-0-root/instance:
uuid: "82240dafe3dd4745b335ab015051359b"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-th5x"
I20260709 12:59:42.253360   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:59:42.256657   944 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.257520   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:59:42.257820   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/master-0-root
uuid: "82240dafe3dd4745b335ab015051359b"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-th5x"
I20260709 12:59:42.258077   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:42.279491   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:42.280721   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:42.319757   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.190:40521
I20260709 12:59:42.319983   995 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.190:40521 every 8 connection(s)
I20260709 12:59:42.323563   996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.332935   996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b: Bootstrap starting.
I20260709 12:59:42.337455   996 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.341599   996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b: No bootstrap required, opened a new log
I20260709 12:59:42.343587   996 raft_consensus.cc:359] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82240dafe3dd4745b335ab015051359b" member_type: VOTER }
I20260709 12:59:42.343936   996 raft_consensus.cc:385] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.344125   996 raft_consensus.cc:740] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82240dafe3dd4745b335ab015051359b, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.344592   996 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82240dafe3dd4745b335ab015051359b" member_type: VOTER }
I20260709 12:59:42.344973   996 raft_consensus.cc:399] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:42.345162   996 raft_consensus.cc:493] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:42.345376   996 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.349262   996 raft_consensus.cc:515] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82240dafe3dd4745b335ab015051359b" member_type: VOTER }
I20260709 12:59:42.349728   996 leader_election.cc:304] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82240dafe3dd4745b335ab015051359b; no voters: 
I20260709 12:59:42.350764   996 leader_election.cc:290] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:42.351135   999 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:42.352537   999 raft_consensus.cc:697] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [term 1 LEADER]: Becoming Leader. State: Replica: 82240dafe3dd4745b335ab015051359b, State: Running, Role: LEADER
I20260709 12:59:42.353251   999 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82240dafe3dd4745b335ab015051359b" member_type: VOTER }
I20260709 12:59:42.353674   996 sys_catalog.cc:565] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:42.357975  1000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82240dafe3dd4745b335ab015051359b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82240dafe3dd4745b335ab015051359b" member_type: VOTER } }
I20260709 12:59:42.358753  1000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:42.358413  1001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82240dafe3dd4745b335ab015051359b. Latest consensus state: current_term: 1 leader_uuid: "82240dafe3dd4745b335ab015051359b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82240dafe3dd4745b335ab015051359b" member_type: VOTER } }
I20260709 12:59:42.359369  1001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:42.364068  1006 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:42.369520  1006 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:42.371444   430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:42.378446  1006 catalog_manager.cc:1383] Generated new cluster ID: ad9ceb5cac8b4844bba7412c01316310
I20260709 12:59:42.378690  1006 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:42.394685  1006 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:42.395891  1006 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:42.407822  1006 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b: Generated new TSK 0
I20260709 12:59:42.408401  1006 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:42.437631   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:42.443395  1017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:42.444619  1018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:42.446579  1020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:42.447152   430 server_base.cc:1061] running on GCE node
I20260709 12:59:42.447932   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:42.448134   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:42.448299   430 hybrid_clock.cc:648] HybridClock initialized: now 1783601982448265 us; error 0 us; skew 500 ppm
I20260709 12:59:42.449056   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:42.451334   430 webserver.cc:533] Webserver started at http://127.0.107.129:41663/ using document root <none> and password file <none>
I20260709 12:59:42.451954   430 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:42.452159   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:42.452437   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:42.453553   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-0-root/instance:
uuid: "5d7e810263a74451bc21be0d1cca16f3"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-th5x"
I20260709 12:59:42.458051   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:59:42.461202  1025 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.461930   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:59:42.462214   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-0-root
uuid: "5d7e810263a74451bc21be0d1cca16f3"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-th5x"
I20260709 12:59:42.462499   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:42.473356   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:42.474571   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:42.476049   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:42.478554   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:42.478778   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.479046   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:42.479241   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.519008   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.129:33449
I20260709 12:59:42.519171  1087 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.129:33449 every 8 connection(s)
I20260709 12:59:42.524346   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:42.533106  1092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:42.533360  1093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:42.536828   430 server_base.cc:1061] running on GCE node
W20260709 12:59:42.537185  1095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:42.538308   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:42.538502   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:42.538726   430 hybrid_clock.cc:648] HybridClock initialized: now 1783601982538689 us; error 0 us; skew 500 ppm
I20260709 12:59:42.539430   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:42.539568  1088 heartbeater.cc:344] Connected to a master server at 127.0.107.190:40521
I20260709 12:59:42.540017  1088 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:42.540910  1088 heartbeater.cc:507] Master 127.0.107.190:40521 requested a full tablet report, sending...
I20260709 12:59:42.542007   430 webserver.cc:533] Webserver started at http://127.0.107.130:46221/ using document root <none> and password file <none>
I20260709 12:59:42.542644   430 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:42.542884   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:42.543197   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:42.543092   961 ts_manager.cc:194] Registered new tserver with Master: 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449)
I20260709 12:59:42.544763   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-1-root/instance:
uuid: "99ad2a1622404b68aa587cb8bba62294"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-th5x"
I20260709 12:59:42.545554   961 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59504
I20260709 12:59:42.549678   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:59:42.552924  1100 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.553689   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:59:42.554054   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-1-root
uuid: "99ad2a1622404b68aa587cb8bba62294"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-th5x"
I20260709 12:59:42.554368   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:42.593950   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:42.595193   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:42.596658   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:42.598753   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:42.598985   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.599222   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:42.599396   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.638464   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.130:41339
I20260709 12:59:42.638588  1162 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.130:41339 every 8 connection(s)
I20260709 12:59:42.643488   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:42.650930  1166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:42.652004  1167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:42.655654   430 server_base.cc:1061] running on GCE node
I20260709 12:59:42.655714  1163 heartbeater.cc:344] Connected to a master server at 127.0.107.190:40521
W20260709 12:59:42.656266  1169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:42.656323  1163 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:42.657275   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:59:42.657378  1163 heartbeater.cc:507] Master 127.0.107.190:40521 requested a full tablet report, sending...
W20260709 12:59:42.657472   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:42.657884   430 hybrid_clock.cc:648] HybridClock initialized: now 1783601982657862 us; error 0 us; skew 500 ppm
I20260709 12:59:42.658463   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:42.659713   961 ts_manager.cc:194] Registered new tserver with Master: 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:42.661000   430 webserver.cc:533] Webserver started at http://127.0.107.131:35603/ using document root <none> and password file <none>
I20260709 12:59:42.661383   961 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59520
I20260709 12:59:42.661509   430 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:42.661782   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:42.662045   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:42.663151   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-2-root/instance:
uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-th5x"
I20260709 12:59:42.667652   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:59:42.670554  1174 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.671284   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:59:42.671629   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-2-root
uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
format_stamp: "Formatted at 2026-07-09 12:59:42 on dist-test-slave-th5x"
I20260709 12:59:42.671912   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601969268282-430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:42.691339   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:42.692631   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:42.694290   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:42.696379   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:42.696596   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.696846   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:42.697029   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:42.739588   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.131:45601
I20260709 12:59:42.739665  1236 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.131:45601 every 8 connection(s)
I20260709 12:59:42.752993  1237 heartbeater.cc:344] Connected to a master server at 127.0.107.190:40521
I20260709 12:59:42.753371  1237 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:42.754084  1237 heartbeater.cc:507] Master 127.0.107.190:40521 requested a full tablet report, sending...
I20260709 12:59:42.756112   961 ts_manager.cc:194] Registered new tserver with Master: eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:42.756239   430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013674645s
I20260709 12:59:42.757431   961 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59526
I20260709 12:59:42.782090   961 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59530:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:42.784976   961 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:42.860980  1202 tablet_service.cc:1511] Processing CreateTablet for tablet fc635d4f8ae0487ea65c5110409936b9 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:42.862407  1202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc635d4f8ae0487ea65c5110409936b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.865245  1201 tablet_service.cc:1511] Processing CreateTablet for tablet e15c377eeba84ca8b66f64a82c06b7ca (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:42.866879  1201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e15c377eeba84ca8b66f64a82c06b7ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.873340  1200 tablet_service.cc:1511] Processing CreateTablet for tablet fd06b47b0f9c4051be4b9c4e927807a1 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:42.874647  1200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd06b47b0f9c4051be4b9c4e927807a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.876986  1053 tablet_service.cc:1511] Processing CreateTablet for tablet fc635d4f8ae0487ea65c5110409936b9 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:42.878259  1053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc635d4f8ae0487ea65c5110409936b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.885550  1052 tablet_service.cc:1511] Processing CreateTablet for tablet e15c377eeba84ca8b66f64a82c06b7ca (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:42.886861  1052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e15c377eeba84ca8b66f64a82c06b7ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.891757  1199 tablet_service.cc:1511] Processing CreateTablet for tablet b9684fbb252447e5bddb9393e414f44d (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:42.893103  1199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9684fbb252447e5bddb9393e414f44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.893491  1051 tablet_service.cc:1511] Processing CreateTablet for tablet fd06b47b0f9c4051be4b9c4e927807a1 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:42.894752  1051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd06b47b0f9c4051be4b9c4e927807a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.901181  1201 tablet_service.cc:1511] Processing CreateTablet for tablet 487478c6fb7b42e3937711a152196a3e (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:42.901345  1050 tablet_service.cc:1511] Processing CreateTablet for tablet b9684fbb252447e5bddb9393e414f44d (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:42.901717  1128 tablet_service.cc:1511] Processing CreateTablet for tablet fc635d4f8ae0487ea65c5110409936b9 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:42.902541  1201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 487478c6fb7b42e3937711a152196a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.902648  1050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9684fbb252447e5bddb9393e414f44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.902881  1128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc635d4f8ae0487ea65c5110409936b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.905442  1198 tablet_service.cc:1511] Processing CreateTablet for tablet 2e03e98af66142faaabbf0d004019bc9 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:42.906764  1198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e03e98af66142faaabbf0d004019bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.908201  1049 tablet_service.cc:1511] Processing CreateTablet for tablet 487478c6fb7b42e3937711a152196a3e (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:42.909550  1049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 487478c6fb7b42e3937711a152196a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.909430  1197 tablet_service.cc:1511] Processing CreateTablet for tablet fc8351b794944e2cb64d166f2fe4412d (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:42.912899  1197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8351b794944e2cb64d166f2fe4412d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.918589  1196 tablet_service.cc:1511] Processing CreateTablet for tablet 68268e4726754bbbb2a83694ce99b614 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:42.920502  1196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68268e4726754bbbb2a83694ce99b614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.923327  1048 tablet_service.cc:1511] Processing CreateTablet for tablet 2e03e98af66142faaabbf0d004019bc9 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:42.924770  1048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e03e98af66142faaabbf0d004019bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.924571  1195 tablet_service.cc:1511] Processing CreateTablet for tablet e5069694830e4c008c80b665f8b39663 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:42.926741  1195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5069694830e4c008c80b665f8b39663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.928978  1127 tablet_service.cc:1511] Processing CreateTablet for tablet e15c377eeba84ca8b66f64a82c06b7ca (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:42.929462  1126 tablet_service.cc:1511] Processing CreateTablet for tablet fd06b47b0f9c4051be4b9c4e927807a1 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:42.930295  1127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e15c377eeba84ca8b66f64a82c06b7ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.931663  1125 tablet_service.cc:1511] Processing CreateTablet for tablet b9684fbb252447e5bddb9393e414f44d (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:42.932924  1125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9684fbb252447e5bddb9393e414f44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.936633  1124 tablet_service.cc:1511] Processing CreateTablet for tablet 487478c6fb7b42e3937711a152196a3e (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:42.937924  1124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 487478c6fb7b42e3937711a152196a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.940614  1123 tablet_service.cc:1511] Processing CreateTablet for tablet 2e03e98af66142faaabbf0d004019bc9 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:42.941882  1123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e03e98af66142faaabbf0d004019bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.944402  1201 tablet_service.cc:1511] Processing CreateTablet for tablet 756e5db4632b4e6db5f7d6ff21909c7a (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:42.945706  1201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756e5db4632b4e6db5f7d6ff21909c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.946134  1121 tablet_service.cc:1511] Processing CreateTablet for tablet 68268e4726754bbbb2a83694ce99b614 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:42.944494  1122 tablet_service.cc:1511] Processing CreateTablet for tablet fc8351b794944e2cb64d166f2fe4412d (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:42.947405  1121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68268e4726754bbbb2a83694ce99b614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.948586  1120 tablet_service.cc:1511] Processing CreateTablet for tablet e5069694830e4c008c80b665f8b39663 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:42.956830  1120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5069694830e4c008c80b665f8b39663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.949797  1119 tablet_service.cc:1511] Processing CreateTablet for tablet 756e5db4632b4e6db5f7d6ff21909c7a (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:42.970055  1047 tablet_service.cc:1511] Processing CreateTablet for tablet fc8351b794944e2cb64d166f2fe4412d (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:42.971953  1047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8351b794944e2cb64d166f2fe4412d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.983754  1122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8351b794944e2cb64d166f2fe4412d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.984652  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756e5db4632b4e6db5f7d6ff21909c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:42.988137  1126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd06b47b0f9c4051be4b9c4e927807a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.028652  1052 tablet_service.cc:1511] Processing CreateTablet for tablet 68268e4726754bbbb2a83694ce99b614 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:43.029042  1046 tablet_service.cc:1511] Processing CreateTablet for tablet e5069694830e4c008c80b665f8b39663 (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:43.032202  1045 tablet_service.cc:1511] Processing CreateTablet for tablet 756e5db4632b4e6db5f7d6ff21909c7a (DEFAULT_TABLE table=test-workload [id=071fa3c1026747d8bd7d1c7ba158bada]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:43.046883  1252 tablet_bootstrap.cc:492] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Bootstrap starting.
I20260709 12:59:43.050005  1045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756e5db4632b4e6db5f7d6ff21909c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.050614  1254 tablet_bootstrap.cc:492] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294: Bootstrap starting.
I20260709 12:59:43.054821  1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5069694830e4c008c80b665f8b39663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.060124  1052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68268e4726754bbbb2a83694ce99b614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:43.060691  1252 tablet_bootstrap.cc:654] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.068213  1253 tablet_bootstrap.cc:492] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3: Bootstrap starting.
I20260709 12:59:43.087486  1254 tablet_bootstrap.cc:654] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.097271  1252 tablet_bootstrap.cc:492] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3: No bootstrap required, opened a new log
I20260709 12:59:43.100039  1252 ts_tablet_manager.cc:1403] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.018s
I20260709 12:59:43.098750  1253 tablet_bootstrap.cc:654] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.103013  1252 raft_consensus.cc:359] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } }
I20260709 12:59:43.104049  1252 raft_consensus.cc:385] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.104331  1252 raft_consensus.cc:740] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.105027  1252 consensus_queue.cc:260] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } }
I20260709 12:59:43.107024  1237 heartbeater.cc:499] Master 127.0.107.190:40521 was elected leader, sending a full tablet report...
I20260709 12:59:43.107499  1252 ts_tablet_manager.cc:1434] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:59:43.108445  1252 tablet_bootstrap.cc:492] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Bootstrap starting.
I20260709 12:59:43.108906  1254 tablet_bootstrap.cc:492] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294: No bootstrap required, opened a new log
I20260709 12:59:43.109401  1254 ts_tablet_manager.cc:1403] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.000s
I20260709 12:59:43.109768  1253 tablet_bootstrap.cc:492] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3: No bootstrap required, opened a new log
I20260709 12:59:43.110226  1253 ts_tablet_manager.cc:1403] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.005s
I20260709 12:59:43.112510  1254 raft_consensus.cc:359] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.112879  1253 raft_consensus.cc:359] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } }
I20260709 12:59:43.113276  1254 raft_consensus.cc:385] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.113516  1253 raft_consensus.cc:385] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.113696  1254 raft_consensus.cc:740] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.113852  1253 raft_consensus.cc:740] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.114635  1252 tablet_bootstrap.cc:654] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.114648  1254 consensus_queue.cc:260] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.114814  1253 consensus_queue.cc:260] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } }
I20260709 12:59:43.124248  1253 ts_tablet_manager.cc:1434] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.005s
I20260709 12:59:43.124634  1254 ts_tablet_manager.cc:1434] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:59:43.124979  1088 heartbeater.cc:499] Master 127.0.107.190:40521 was elected leader, sending a full tablet report...
I20260709 12:59:43.125582  1163 heartbeater.cc:499] Master 127.0.107.190:40521 was elected leader, sending a full tablet report...
I20260709 12:59:43.130093  1253 tablet_bootstrap.cc:492] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3: Bootstrap starting.
I20260709 12:59:43.130268  1254 tablet_bootstrap.cc:492] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294: Bootstrap starting.
I20260709 12:59:43.136179  1252 tablet_bootstrap.cc:492] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3: No bootstrap required, opened a new log
I20260709 12:59:43.136668  1252 ts_tablet_manager.cc:1403] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.015s
I20260709 12:59:43.137254  1253 tablet_bootstrap.cc:654] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.138681  1254 tablet_bootstrap.cc:654] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.139678  1252 raft_consensus.cc:359] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.140441  1252 raft_consensus.cc:385] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.140717  1252 raft_consensus.cc:740] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.141445  1252 consensus_queue.cc:260] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.143517  1252 ts_tablet_manager.cc:1434] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:59:43.144398  1252 tablet_bootstrap.cc:492] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3: Bootstrap starting.
I20260709 12:59:43.150127  1253 tablet_bootstrap.cc:492] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3: No bootstrap required, opened a new log
I20260709 12:59:43.150760  1253 ts_tablet_manager.cc:1403] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 12:59:43.151544  1252 tablet_bootstrap.cc:654] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.154121  1253 raft_consensus.cc:359] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.154896  1253 raft_consensus.cc:385] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.155200  1253 raft_consensus.cc:740] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.155469  1254 tablet_bootstrap.cc:492] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294: No bootstrap required, opened a new log
I20260709 12:59:43.155989  1254 ts_tablet_manager.cc:1403] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 12:59:43.155927  1253 consensus_queue.cc:260] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.158914  1253 ts_tablet_manager.cc:1434] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:59:43.159981  1253 tablet_bootstrap.cc:492] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3: Bootstrap starting.
I20260709 12:59:43.160159  1254 raft_consensus.cc:359] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } }
I20260709 12:59:43.160959  1254 raft_consensus.cc:385] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.161293  1254 raft_consensus.cc:740] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.162370  1254 consensus_queue.cc:260] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } }
I20260709 12:59:43.164891  1254 ts_tablet_manager.cc:1434] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:43.165920  1254 tablet_bootstrap.cc:492] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294: Bootstrap starting.
I20260709 12:59:43.167140  1253 tablet_bootstrap.cc:654] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.174837  1254 tablet_bootstrap.cc:654] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.176112  1252 tablet_bootstrap.cc:492] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3: No bootstrap required, opened a new log
I20260709 12:59:43.176599  1252 ts_tablet_manager.cc:1403] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.007s
I20260709 12:59:43.178663  1253 tablet_bootstrap.cc:492] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3: No bootstrap required, opened a new log
I20260709 12:59:43.179240  1253 ts_tablet_manager.cc:1403] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 12:59:43.179600  1252 raft_consensus.cc:359] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.180328  1252 raft_consensus.cc:385] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.180620  1252 raft_consensus.cc:740] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.181325  1252 consensus_queue.cc:260] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.183271  1252 ts_tablet_manager.cc:1434] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:59:43.183140  1253 raft_consensus.cc:359] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.184286  1252 tablet_bootstrap.cc:492] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3: Bootstrap starting.
I20260709 12:59:43.184238  1253 raft_consensus.cc:385] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.184952  1253 raft_consensus.cc:740] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.185899  1253 consensus_queue.cc:260] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.187676  1254 tablet_bootstrap.cc:492] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294: No bootstrap required, opened a new log
I20260709 12:59:43.188175  1254 ts_tablet_manager.cc:1403] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.000s
I20260709 12:59:43.188263  1253 ts_tablet_manager.cc:1434] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:43.189298  1253 tablet_bootstrap.cc:492] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3: Bootstrap starting.
I20260709 12:59:43.191481  1252 tablet_bootstrap.cc:654] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.191278  1254 raft_consensus.cc:359] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.192167  1254 raft_consensus.cc:385] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.192566  1254 raft_consensus.cc:740] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.193527  1254 consensus_queue.cc:260] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.195104  1259 raft_consensus.cc:493] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.195588  1259 raft_consensus.cc:515] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.196151  1254 ts_tablet_manager.cc:1434] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:43.197166  1254 tablet_bootstrap.cc:492] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294: Bootstrap starting.
I20260709 12:59:43.203627  1254 tablet_bootstrap.cc:654] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.204469  1259 leader_election.cc:290] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:43.209309  1253 tablet_bootstrap.cc:654] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.217696  1212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" is_pre_election: true
W20260709 12:59:43.219576  1027 leader_election.cc:343] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.223224  1254 tablet_bootstrap.cc:492] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294: No bootstrap required, opened a new log
I20260709 12:59:43.223773  1254 ts_tablet_manager.cc:1403] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.021s
I20260709 12:59:43.226686  1254 raft_consensus.cc:359] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.227468  1254 raft_consensus.cc:385] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.227779  1254 raft_consensus.cc:740] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.229271  1253 tablet_bootstrap.cc:492] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3: No bootstrap required, opened a new log
I20260709 12:59:43.229723  1253 ts_tablet_manager.cc:1403] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.005s
I20260709 12:59:43.229995  1252 tablet_bootstrap.cc:492] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3: No bootstrap required, opened a new log
I20260709 12:59:43.230533  1252 ts_tablet_manager.cc:1403] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.017s
I20260709 12:59:43.232545  1253 raft_consensus.cc:359] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.233284  1253 raft_consensus.cc:385] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.233608  1253 raft_consensus.cc:740] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.233390  1252 raft_consensus.cc:359] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.234290  1252 raft_consensus.cc:385] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.234652  1252 raft_consensus.cc:740] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.234440  1253 consensus_queue.cc:260] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.235574  1252 consensus_queue.cc:260] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.236994  1253 ts_tablet_manager.cc:1434] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:59:43.228518  1254 consensus_queue.cc:260] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.237951  1253 tablet_bootstrap.cc:492] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3: Bootstrap starting.
I20260709 12:59:43.239677  1252 ts_tablet_manager.cc:1434] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:59:43.239395  1138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294" is_pre_election: true
I20260709 12:59:43.240805  1252 tablet_bootstrap.cc:492] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3: Bootstrap starting.
I20260709 12:59:43.244717  1258 raft_consensus.cc:493] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.244867  1253 tablet_bootstrap.cc:654] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.245189  1258 raft_consensus.cc:515] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } }
I20260709 12:59:43.252131  1254 ts_tablet_manager.cc:1434] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
W20260709 12:59:43.252668  1026 leader_election.cc:343] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.253330  1258 leader_election.cc:290] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449)
I20260709 12:59:43.254194  1026 leader_election.cc:304] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3; no voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3
I20260709 12:59:43.256983  1254 tablet_bootstrap.cc:492] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294: Bootstrap starting.
I20260709 12:59:43.262693  1259 raft_consensus.cc:2749] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:43.270730  1254 tablet_bootstrap.cc:654] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.278354  1138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc635d4f8ae0487ea65c5110409936b9" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294" is_pre_election: true
I20260709 12:59:43.278932  1138 raft_consensus.cc:2468] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 0.
I20260709 12:59:43.280241  1175 leader_election.cc:304] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:43.281059  1258 raft_consensus.cc:2804] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.281358  1258 raft_consensus.cc:493] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.281651  1258 raft_consensus.cc:3060] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.281488  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc635d4f8ae0487ea65c5110409936b9" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3" is_pre_election: true
I20260709 12:59:43.282444  1063 raft_consensus.cc:2468] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 0.
I20260709 12:59:43.286085  1254 tablet_bootstrap.cc:492] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294: No bootstrap required, opened a new log
I20260709 12:59:43.286099  1260 raft_consensus.cc:493] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.287454  1254 ts_tablet_manager.cc:1403] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.009s
I20260709 12:59:43.287563  1260 raft_consensus.cc:515] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.289996  1252 tablet_bootstrap.cc:654] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.291723  1258 raft_consensus.cc:515] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } }
I20260709 12:59:43.295120  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc635d4f8ae0487ea65c5110409936b9" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:43.295810  1063 raft_consensus.cc:3060] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.297689  1254 raft_consensus.cc:359] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.300369  1254 raft_consensus.cc:385] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.301035  1260 leader_election.cc:290] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:43.304360  1258 leader_election.cc:290] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Requested vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449)
I20260709 12:59:43.305043  1258 raft_consensus.cc:493] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.305586  1258 raft_consensus.cc:515] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.307302  1260 raft_consensus.cc:493] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.308359  1260 raft_consensus.cc:515] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.308971  1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3" is_pre_election: true
W20260709 12:59:43.310534  1178 leader_election.cc:343] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.310678  1260 leader_election.cc:290] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:43.313261  1258 leader_election.cc:290] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:43.301079  1254 raft_consensus.cc:740] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.316654  1254 consensus_queue.cc:260] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.317842  1253 tablet_bootstrap.cc:492] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3: No bootstrap required, opened a new log
I20260709 12:59:43.318485  1253 ts_tablet_manager.cc:1403] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3: Time spent bootstrapping tablet: real 0.081s	user 0.038s	sys 0.039s
I20260709 12:59:43.319598  1254 ts_tablet_manager.cc:1434] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:59:43.320910  1254 tablet_bootstrap.cc:492] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294: Bootstrap starting.
I20260709 12:59:43.321584  1253 raft_consensus.cc:359] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.322290  1253 raft_consensus.cc:385] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.322680  1253 raft_consensus.cc:740] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.327350  1258 raft_consensus.cc:493] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.327841  1258 raft_consensus.cc:515] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.335201  1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15c377eeba84ca8b66f64a82c06b7ca" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3" is_pre_election: true
I20260709 12:59:43.335867  1062 raft_consensus.cc:2468] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 0.
I20260709 12:59:43.337572  1178 leader_election.cc:304] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:43.338954  1254 tablet_bootstrap.cc:654] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.339890  1258 leader_election.cc:290] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:43.340015  1275 raft_consensus.cc:2804] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.340430  1275 raft_consensus.cc:493] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.340835  1275 raft_consensus.cc:3060] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.341203  1138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc635d4f8ae0487ea65c5110409936b9" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:43.341790  1138 raft_consensus.cc:3060] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.340341  1253 consensus_queue.cc:260] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.343251  1252 tablet_bootstrap.cc:492] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3: No bootstrap required, opened a new log
I20260709 12:59:43.343842  1252 ts_tablet_manager.cc:1403] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent bootstrapping tablet: real 0.103s	user 0.017s	sys 0.000s
I20260709 12:59:43.345023  1253 ts_tablet_manager.cc:1434] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:59:43.346101  1253 tablet_bootstrap.cc:492] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3: Bootstrap starting.
I20260709 12:59:43.346580  1252 raft_consensus.cc:359] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.347288  1252 raft_consensus.cc:385] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.352020  1138 raft_consensus.cc:2468] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 1.
I20260709 12:59:43.353029  1063 raft_consensus.cc:2468] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 1.
I20260709 12:59:43.353295  1275 raft_consensus.cc:515] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.354965  1178 leader_election.cc:304] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:43.356864  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e03e98af66142faaabbf0d004019bc9" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3" is_pre_election: true
I20260709 12:59:43.357558  1063 raft_consensus.cc:2468] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 0.
I20260709 12:59:43.358726  1138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294" is_pre_election: true
I20260709 12:59:43.359337  1138 raft_consensus.cc:2468] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 0.
I20260709 12:59:43.359215  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3" is_pre_election: true
I20260709 12:59:43.360188  1104 leader_election.cc:304] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294; no voters: 
I20260709 12:59:43.361588  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15c377eeba84ca8b66f64a82c06b7ca" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294" is_pre_election: true
I20260709 12:59:43.362082  1260 raft_consensus.cc:2804] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.362229  1137 raft_consensus.cc:2468] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 0.
I20260709 12:59:43.362517  1260 raft_consensus.cc:493] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.362869  1253 tablet_bootstrap.cc:654] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.362879  1260 raft_consensus.cc:3060] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.363214  1258 raft_consensus.cc:2804] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.365231  1175 leader_election.cc:304] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 5d7e810263a74451bc21be0d1cca16f3
W20260709 12:59:43.365692  1009 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:43.348001  1252 raft_consensus.cc:740] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.367846  1252 consensus_queue.cc:260] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
W20260709 12:59:43.372045  1104 leader_election.cc:343] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.375095  1254 tablet_bootstrap.cc:492] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294: No bootstrap required, opened a new log
I20260709 12:59:43.375595  1254 ts_tablet_manager.cc:1403] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.004s
I20260709 12:59:43.376685  1252 ts_tablet_manager.cc:1434] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.004s
I20260709 12:59:43.377206  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15c377eeba84ca8b66f64a82c06b7ca" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:43.377880  1063 raft_consensus.cc:3060] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.378196  1275 leader_election.cc:290] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:43.378718  1275 raft_consensus.cc:2804] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.379070  1275 raft_consensus.cc:493] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.379397  1275 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.381063  1258 raft_consensus.cc:697] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Becoming Leader. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:43.382565  1258 consensus_queue.cc:237] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } }
I20260709 12:59:43.386826  1254 raft_consensus.cc:359] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.387604  1254 raft_consensus.cc:385] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.387908  1254 raft_consensus.cc:740] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.387986  1252 tablet_bootstrap.cc:492] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Bootstrap starting.
I20260709 12:59:43.388700  1254 consensus_queue.cc:260] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.391098  1138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15c377eeba84ca8b66f64a82c06b7ca" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:43.391945  1212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e03e98af66142faaabbf0d004019bc9" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" is_pre_election: true
I20260709 12:59:43.392477  1211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" is_pre_election: true
W20260709 12:59:43.393318  1102 leader_election.cc:343] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.394253  1254 ts_tablet_manager.cc:1434] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:59:43.395195  1254 tablet_bootstrap.cc:492] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294: Bootstrap starting.
I20260709 12:59:43.396762  1138 raft_consensus.cc:3060] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.400482  1252 tablet_bootstrap.cc:654] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.402362  1254 tablet_bootstrap.cc:654] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.406533  1253 tablet_bootstrap.cc:492] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3: No bootstrap required, opened a new log
I20260709 12:59:43.407749  1253 ts_tablet_manager.cc:1403] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.024s
I20260709 12:59:43.410701  1253 raft_consensus.cc:359] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.411511  1253 raft_consensus.cc:385] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.411916  1253 raft_consensus.cc:740] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.412837  1253 consensus_queue.cc:260] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.413017   961 catalog_manager.cc:5697] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:43.416159  1252 tablet_bootstrap.cc:492] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3: No bootstrap required, opened a new log
I20260709 12:59:43.416778  1252 ts_tablet_manager.cc:1403] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.012s
I20260709 12:59:43.419253  1253 ts_tablet_manager.cc:1434] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:59:43.420615  1253 tablet_bootstrap.cc:492] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3: Bootstrap starting.
I20260709 12:59:43.421068  1252 raft_consensus.cc:359] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.422065  1252 raft_consensus.cc:385] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.422453  1252 raft_consensus.cc:740] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.424125  1252 consensus_queue.cc:260] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.425243  1280 raft_consensus.cc:493] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.425676  1280 raft_consensus.cc:515] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.433133  1253 tablet_bootstrap.cc:654] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.435603  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294" is_pre_election: true
I20260709 12:59:43.438261  1252 ts_tablet_manager.cc:1434] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 12:59:43.437026  1137 raft_consensus.cc:2468] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 0.
I20260709 12:59:43.440699  1252 tablet_bootstrap.cc:492] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Bootstrap starting.
I20260709 12:59:43.436065  1280 leader_election.cc:290] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:43.438282  1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3" is_pre_election: true
I20260709 12:59:43.443356  1175 leader_election.cc:304] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:43.443744  1062 raft_consensus.cc:2468] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 0.
I20260709 12:59:43.444392  1280 raft_consensus.cc:2804] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.444725  1280 raft_consensus.cc:493] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.445773  1280 raft_consensus.cc:3060] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.446961  1254 tablet_bootstrap.cc:492] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294: No bootstrap required, opened a new log
I20260709 12:59:43.447510  1254 ts_tablet_manager.cc:1403] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.025s
I20260709 12:59:43.448310  1253 tablet_bootstrap.cc:492] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3: No bootstrap required, opened a new log
I20260709 12:59:43.448760  1253 ts_tablet_manager.cc:1403] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.005s
I20260709 12:59:43.450657  1254 raft_consensus.cc:359] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.451440  1254 raft_consensus.cc:385] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.451465  1253 raft_consensus.cc:359] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.451922  1254 raft_consensus.cc:740] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.452299  1253 raft_consensus.cc:385] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.452608  1253 raft_consensus.cc:740] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.453460  1275 raft_consensus.cc:515] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.453492  1253 consensus_queue.cc:260] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.455721  1253 ts_tablet_manager.cc:1434] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:59:43.455694  1275 leader_election.cc:290] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:43.456512  1211 raft_consensus.cc:2393] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ad2a1622404b68aa587cb8bba62294 in current term 1: Already voted for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in this term.
I20260709 12:59:43.456799  1253 tablet_bootstrap.cc:492] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3: Bootstrap starting.
I20260709 12:59:43.458684  1260 raft_consensus.cc:515] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.459968  1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:43.452831  1254 consensus_queue.cc:260] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.460582  1062 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.461477  1063 raft_consensus.cc:2468] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 1.
I20260709 12:59:43.462769  1254 ts_tablet_manager.cc:1434] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:59:43.463846  1253 tablet_bootstrap.cc:654] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.460839  1260 leader_election.cc:290] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:43.467072  1254 tablet_bootstrap.cc:492] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294: Bootstrap starting.
I20260709 12:59:43.468202  1102 leader_election.cc:304] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294; no voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3
I20260709 12:59:43.469108  1260 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.469544  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:43.471172  1259 raft_consensus.cc:493] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.471665  1259 raft_consensus.cc:515] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.474148  1211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e03e98af66142faaabbf0d004019bc9" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:43.476665  1259 leader_election.cc:290] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:43.474452  1254 tablet_bootstrap.cc:654] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.472708  1178 leader_election.cc:304] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:43.478356  1211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5069694830e4c008c80b665f8b39663" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" is_pre_election: true
I20260709 12:59:43.478497  1258 raft_consensus.cc:493] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.479151  1258 raft_consensus.cc:515] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.480912  1136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5069694830e4c008c80b665f8b39663" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294" is_pre_election: true
I20260709 12:59:43.481767  1258 leader_election.cc:290] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:43.482487  1258 raft_consensus.cc:2804] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.481791  1136 raft_consensus.cc:2468] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 0.
I20260709 12:59:43.475018  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e03e98af66142faaabbf0d004019bc9" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:43.486214  1063 raft_consensus.cc:3060] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.486490  1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd06b47b0f9c4051be4b9c4e927807a1" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3" is_pre_election: true
I20260709 12:59:43.487391  1061 raft_consensus.cc:2468] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 0.
I20260709 12:59:43.489228  1178 leader_election.cc:304] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:43.490406  1281 raft_consensus.cc:2804] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.490906  1281 raft_consensus.cc:493] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.491381  1281 raft_consensus.cc:3060] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:43.490927  1102 leader_election.cc:343] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.499718  1258 raft_consensus.cc:697] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Becoming Leader. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:43.500103  1136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd06b47b0f9c4051be4b9c4e927807a1" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294" is_pre_election: true
I20260709 12:59:43.500985  1258 consensus_queue.cc:237] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
W20260709 12:59:43.502074  1175 leader_election.cc:343] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:43.482803  1027 leader_election.cc:343] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.506237  1026 leader_election.cc:304] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294; no voters: eecae620ab1d4b5cbcc1e5f1d22b76b3
I20260709 12:59:43.509435  1259 raft_consensus.cc:2804] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.509850  1259 raft_consensus.cc:493] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.510216  1259 raft_consensus.cc:3060] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.523756  1253 tablet_bootstrap.cc:492] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3: No bootstrap required, opened a new log
I20260709 12:59:43.524228  1253 ts_tablet_manager.cc:1403] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3: Time spent bootstrapping tablet: real 0.068s	user 0.026s	sys 0.039s
I20260709 12:59:43.526721  1252 tablet_bootstrap.cc:654] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.526742  1253 raft_consensus.cc:359] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.527679  1253 raft_consensus.cc:385] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.528057  1253 raft_consensus.cc:740] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.528766  1253 consensus_queue.cc:260] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.534865  1253 ts_tablet_manager.cc:1434] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 12:59:43.534897  1252 tablet_bootstrap.cc:492] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3: No bootstrap required, opened a new log
I20260709 12:59:43.535624  1252 ts_tablet_manager.cc:1403] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.003s
I20260709 12:59:43.537500  1254 tablet_bootstrap.cc:492] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294: No bootstrap required, opened a new log
I20260709 12:59:43.536862  1253 tablet_bootstrap.cc:492] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3: Bootstrap starting.
I20260709 12:59:43.538030  1254 ts_tablet_manager.cc:1403] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294: Time spent bootstrapping tablet: real 0.071s	user 0.029s	sys 0.023s
I20260709 12:59:43.538493  1252 raft_consensus.cc:359] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.539213  1252 raft_consensus.cc:385] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.539515  1252 raft_consensus.cc:740] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.540345  1252 consensus_queue.cc:260] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.540824  1254 raft_consensus.cc:359] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.541561  1254 raft_consensus.cc:385] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.541873  1254 raft_consensus.cc:740] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.542738  1252 ts_tablet_manager.cc:1434] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:43.544045  1252 tablet_bootstrap.cc:492] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Bootstrap starting.
I20260709 12:59:43.544109  1254 consensus_queue.cc:260] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.546703  1254 ts_tablet_manager.cc:1434] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:59:43.546654  1062 raft_consensus.cc:2468] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 1.
I20260709 12:59:43.547379  1281 raft_consensus.cc:515] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.547996  1178 leader_election.cc:304] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:43.548450  1254 tablet_bootstrap.cc:492] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294: Bootstrap starting.
I20260709 12:59:43.548739  1258 raft_consensus.cc:2804] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.549206  1258 raft_consensus.cc:697] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Becoming Leader. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:43.549593  1281 leader_election.cc:290] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:43.550207  1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd06b47b0f9c4051be4b9c4e927807a1" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:43.550014  1258 consensus_queue.cc:237] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.550709  1138 raft_consensus.cc:2468] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 1.
I20260709 12:59:43.550770  1062 raft_consensus.cc:3060] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.550812  1136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd06b47b0f9c4051be4b9c4e927807a1" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:43.551573  1136 raft_consensus.cc:3060] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.555547  1252 tablet_bootstrap.cc:654] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.556384  1253 tablet_bootstrap.cc:654] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.558070  1254 tablet_bootstrap.cc:654] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.561620  1258 raft_consensus.cc:493] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.562261  1258 raft_consensus.cc:515] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.565819  1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3" is_pre_election: true
I20260709 12:59:43.566937  1252 tablet_bootstrap.cc:492] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3: No bootstrap required, opened a new log
I20260709 12:59:43.567502  1252 ts_tablet_manager.cc:1403] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.004s
W20260709 12:59:43.568398  1178 leader_election.cc:343] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.570173  1254 tablet_bootstrap.cc:492] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294: No bootstrap required, opened a new log
I20260709 12:59:43.570132  1252 raft_consensus.cc:359] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.570727  1254 ts_tablet_manager.cc:1403] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.006s
I20260709 12:59:43.570887  1252 raft_consensus.cc:385] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.572074  1258 leader_election.cc:290] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:43.571189  1252 raft_consensus.cc:740] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.573212  1138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294" is_pre_election: true
I20260709 12:59:43.573221  1252 consensus_queue.cc:260] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.574100  1253 tablet_bootstrap.cc:492] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3: No bootstrap required, opened a new log
I20260709 12:59:43.573652  1254 raft_consensus.cc:359] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.574560  1253 ts_tablet_manager.cc:1403] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.007s
I20260709 12:59:43.574540  1254 raft_consensus.cc:385] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.575006  1254 raft_consensus.cc:740] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.575585  1252 ts_tablet_manager.cc:1434] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:43.575706  1254 consensus_queue.cc:260] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.576432  1252 tablet_bootstrap.cc:492] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3: Bootstrap starting.
I20260709 12:59:43.576575  1138 raft_consensus.cc:2468] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 0.
I20260709 12:59:43.577833  1254 ts_tablet_manager.cc:1434] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:43.577596  1253 raft_consensus.cc:359] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.578240  1253 raft_consensus.cc:385] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.578497  1253 raft_consensus.cc:740] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.578850  1254 tablet_bootstrap.cc:492] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294: Bootstrap starting.
I20260709 12:59:43.579147  1253 consensus_queue.cc:260] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.579384  1175 leader_election.cc:304] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 5d7e810263a74451bc21be0d1cca16f3
I20260709 12:59:43.581050  1253 ts_tablet_manager.cc:1434] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:59:43.582094  1252 tablet_bootstrap.cc:654] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.582109  1253 tablet_bootstrap.cc:492] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3: Bootstrap starting.
I20260709 12:59:43.585359  1254 tablet_bootstrap.cc:654] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.588469  1253 tablet_bootstrap.cc:654] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.594396  1252 tablet_bootstrap.cc:492] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3: No bootstrap required, opened a new log
I20260709 12:59:43.594864  1252 ts_tablet_manager.cc:1403] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:59:43.596589  1254 tablet_bootstrap.cc:492] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294: No bootstrap required, opened a new log
I20260709 12:59:43.596993  1254 ts_tablet_manager.cc:1403] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 12:59:43.597388  1252 raft_consensus.cc:359] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.598071  1252 raft_consensus.cc:385] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.598310  1252 raft_consensus.cc:740] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.598819  1258 raft_consensus.cc:2804] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.599400  1285 raft_consensus.cc:493] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.599098  1252 consensus_queue.cc:260] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.599982  1258 raft_consensus.cc:493] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.600023  1285 raft_consensus.cc:515] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.600803  1258 raft_consensus.cc:3060] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.601552  1252 ts_tablet_manager.cc:1434] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:59:43.602602  1252 tablet_bootstrap.cc:492] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3: Bootstrap starting.
I20260709 12:59:43.603596  1211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756e5db4632b4e6db5f7d6ff21909c7a" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" is_pre_election: true
I20260709 12:59:43.603731  1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756e5db4632b4e6db5f7d6ff21909c7a" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3" is_pre_election: true
I20260709 12:59:43.604193  1211 raft_consensus.cc:2468] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 0.
I20260709 12:59:43.604533  1061 raft_consensus.cc:2468] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 0.
I20260709 12:59:43.605562  1102 leader_election.cc:304] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:43.606474  1285 leader_election.cc:290] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:43.606943  1285 raft_consensus.cc:2804] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.607327  1285 raft_consensus.cc:493] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.607658  1285 raft_consensus.cc:3060] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.608355  1252 tablet_bootstrap.cc:654] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.609526  1254 raft_consensus.cc:359] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.610225  1254 raft_consensus.cc:385] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.610473  1254 raft_consensus.cc:740] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.611241  1254 consensus_queue.cc:260] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.613917  1254 ts_tablet_manager.cc:1434] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:59:43.617072  1253 tablet_bootstrap.cc:492] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3: No bootstrap required, opened a new log
I20260709 12:59:43.617230  1252 tablet_bootstrap.cc:492] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3: No bootstrap required, opened a new log
I20260709 12:59:43.617537  1253 ts_tablet_manager.cc:1403] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.024s
I20260709 12:59:43.617681  1252 ts_tablet_manager.cc:1403] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:59:43.619907  1253 raft_consensus.cc:359] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.620440  1253 raft_consensus.cc:385] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.620229  1252 raft_consensus.cc:359] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.620676  1253 raft_consensus.cc:740] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.620832  1252 raft_consensus.cc:385] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.621130  1252 raft_consensus.cc:740] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.621410  1253 consensus_queue.cc:260] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.621639  1252 consensus_queue.cc:260] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.623025  1253 ts_tablet_manager.cc:1434] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:59:43.624135  1252 ts_tablet_manager.cc:1434] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:59:43.631688  1304 raft_consensus.cc:493] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.632311  1304 raft_consensus.cc:515] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.634271  1304 leader_election.cc:290] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:43.635026  1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8351b794944e2cb64d166f2fe4412d" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3" is_pre_election: true
I20260709 12:59:43.635222  1211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8351b794944e2cb64d166f2fe4412d" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" is_pre_election: true
I20260709 12:59:43.635587  1061 raft_consensus.cc:2468] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 0.
I20260709 12:59:43.635803  1211 raft_consensus.cc:2468] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 0.
I20260709 12:59:43.636646  1104 leader_election.cc:304] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294; no voters: 
I20260709 12:59:43.637271  1304 raft_consensus.cc:2804] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.637622  1304 raft_consensus.cc:493] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.637880  1304 raft_consensus.cc:3060] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.639724  1063 raft_consensus.cc:2468] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 1.
I20260709 12:59:43.639778  1260 raft_consensus.cc:2749] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:43.639775  1280 raft_consensus.cc:515] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.642067  1280 leader_election.cc:290] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:43.646314  1138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:43.646894  1138 raft_consensus.cc:3060] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.647562  1104 leader_election.cc:304] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294; no voters: eecae620ab1d4b5cbcc1e5f1d22b76b3
I20260709 12:59:43.647912  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:43.648370  1260 raft_consensus.cc:2804] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.648437  1063 raft_consensus.cc:3060] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.649911  1260 raft_consensus.cc:697] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Becoming Leader. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Running, Role: LEADER
I20260709 12:59:43.650671  1260 consensus_queue.cc:237] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.661339   961 catalog_manager.cc:5697] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:43.662684   961 catalog_manager.cc:5697] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:43.671967  1280 raft_consensus.cc:493] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.672554  1280 raft_consensus.cc:515] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.674228  1280 leader_election.cc:290] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:43.675112  1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5069694830e4c008c80b665f8b39663" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3" is_pre_election: true
I20260709 12:59:43.675374  1135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5069694830e4c008c80b665f8b39663" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294" is_pre_election: true
I20260709 12:59:43.675988  1135 raft_consensus.cc:2468] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 0.
I20260709 12:59:43.677109  1175 leader_election.cc:304] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:43.677734  1280 raft_consensus.cc:2804] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.678095  1280 raft_consensus.cc:493] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.678380  1280 raft_consensus.cc:3060] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.736893  1136 raft_consensus.cc:2468] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 1.
I20260709 12:59:43.736943  1258 raft_consensus.cc:515] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.741225  1258 leader_election.cc:290] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:43.736943  1259 raft_consensus.cc:515] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.744514  1259 leader_election.cc:290] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 1 election: Requested vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:43.744931  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:43.745527  1060 raft_consensus.cc:3060] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.749315  1136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5069694830e4c008c80b665f8b39663" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:43.749588  1175 leader_election.cc:304] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:43.749884  1136 raft_consensus.cc:3060] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.750710  1258 raft_consensus.cc:2804] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.751031  1135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:43.751205  1258 raft_consensus.cc:697] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Becoming Leader. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:43.751606  1211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5069694830e4c008c80b665f8b39663" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:43.752032  1258 consensus_queue.cc:237] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.751607  1135 raft_consensus.cc:3060] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.754392  1061 raft_consensus.cc:2393] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in current term 1: Already voted for candidate 5d7e810263a74451bc21be0d1cca16f3 in this term.
I20260709 12:59:43.764720   961 catalog_manager.cc:5697] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:43.789655  1258 raft_consensus.cc:493] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.790117  1258 raft_consensus.cc:515] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.791903  1258 leader_election.cc:290] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:43.793093  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e03e98af66142faaabbf0d004019bc9" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294" is_pre_election: true
I20260709 12:59:43.792969  1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e03e98af66142faaabbf0d004019bc9" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3" is_pre_election: true
I20260709 12:59:43.794014  1061 raft_consensus.cc:2393] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in current term 1: Already voted for candidate 99ad2a1622404b68aa587cb8bba62294 in this term.
I20260709 12:59:43.795130  1178 leader_election.cc:304] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294
I20260709 12:59:43.796182  1258 raft_consensus.cc:3060] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.839768  1060 raft_consensus.cc:2468] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 1.
I20260709 12:59:43.839783  1280 raft_consensus.cc:515] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.843510  1280 leader_election.cc:290] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:43.845192  1178 leader_election.cc:304] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:43.847019  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5069694830e4c008c80b665f8b39663" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:43.847859  1060 raft_consensus.cc:2393] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in current term 1: Already voted for candidate 5d7e810263a74451bc21be0d1cca16f3 in this term.
I20260709 12:59:43.848465  1211 raft_consensus.cc:2393] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d7e810263a74451bc21be0d1cca16f3 in current term 1: Already voted for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in this term.
I20260709 12:59:43.849081  1280 raft_consensus.cc:2804] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.849619  1280 raft_consensus.cc:697] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Becoming Leader. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:43.850426  1280 consensus_queue.cc:237] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.851070  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5069694830e4c008c80b665f8b39663" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:43.852841  1175 leader_election.cc:304] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294
I20260709 12:59:43.854103  1275 raft_consensus.cc:2749] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:43.855199  1285 raft_consensus.cc:515] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.857597  1285 leader_election.cc:290] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:43.858729  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756e5db4632b4e6db5f7d6ff21909c7a" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:43.858870  1211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756e5db4632b4e6db5f7d6ff21909c7a" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:43.859668  1211 raft_consensus.cc:3060] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.859565  1060 raft_consensus.cc:3060] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.861613   961 catalog_manager.cc:5697] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:43.918243  1280 consensus_queue.cc:1048] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:43.931167  1280 consensus_queue.cc:1048] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:43.943578  1258 raft_consensus.cc:2749] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:43.943888  1138 raft_consensus.cc:2468] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 1.
I20260709 12:59:43.944890  1062 raft_consensus.cc:2468] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 1.
I20260709 12:59:43.947532  1063 raft_consensus.cc:2468] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 1.
I20260709 12:59:43.948632  1135 raft_consensus.cc:2468] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 1.
I20260709 12:59:43.943563  1304 raft_consensus.cc:515] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.951685  1178 leader_election.cc:304] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:43.952051  1304 leader_election.cc:290] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:43.952693  1258 raft_consensus.cc:2804] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.953176  1258 raft_consensus.cc:697] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Becoming Leader. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:43.954147  1258 consensus_queue.cc:237] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:43.954752  1212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8351b794944e2cb64d166f2fe4412d" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:43.955312  1212 raft_consensus.cc:3060] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.955385  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8351b794944e2cb64d166f2fe4412d" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:43.956058  1063 raft_consensus.cc:3060] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.961678   961 catalog_manager.cc:5697] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "99ad2a1622404b68aa587cb8bba62294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:43.966619   960 catalog_manager.cc:5697] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:43.988531  1258 consensus_queue.cc:1048] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:43.999370  1258 consensus_queue.cc:1048] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.020583  1136 raft_consensus.cc:2468] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 1.
I20260709 12:59:44.020869  1063 raft_consensus.cc:2468] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 1.
I20260709 12:59:44.020584  1211 raft_consensus.cc:2468] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 1.
I20260709 12:59:44.022029  1026 leader_election.cc:304] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294; no voters: eecae620ab1d4b5cbcc1e5f1d22b76b3
I20260709 12:59:44.022897  1104 leader_election.cc:304] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294; no voters: 
I20260709 12:59:44.020583  1060 raft_consensus.cc:2468] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 1.
I20260709 12:59:44.023628  1259 raft_consensus.cc:2804] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:44.023768  1137 raft_consensus.cc:2468] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 1.
I20260709 12:59:44.024906  1304 raft_consensus.cc:2804] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:44.025435  1304 raft_consensus.cc:697] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Becoming Leader. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Running, Role: LEADER
I20260709 12:59:44.025537  1104 leader_election.cc:304] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294; no voters: 
I20260709 12:59:44.024480  1259 raft_consensus.cc:697] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 LEADER]: Becoming Leader. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:44.026611  1260 raft_consensus.cc:2804] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:44.026348  1304 consensus_queue.cc:237] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.027146  1260 raft_consensus.cc:697] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Becoming Leader. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Running, Role: LEADER
I20260709 12:59:44.026819  1259 consensus_queue.cc:237] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.028069  1260 consensus_queue.cc:237] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.035893  1258 consensus_queue.cc:1048] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:44.046583   961 catalog_manager.cc:5697] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "5d7e810263a74451bc21be0d1cca16f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.050583   960 catalog_manager.cc:5697] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "99ad2a1622404b68aa587cb8bba62294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.053314   960 catalog_manager.cc:5697] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "99ad2a1622404b68aa587cb8bba62294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.055980  1275 consensus_queue.cc:1048] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.117362  1212 raft_consensus.cc:2468] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 1.
I20260709 12:59:44.177258  1260 consensus_queue.cc:1048] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.187883  1260 consensus_queue.cc:1048] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.241721  1212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc635d4f8ae0487ea65c5110409936b9"
dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
mode: GRACEFUL
new_leader_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:34092
I20260709 12:59:44.242458  1212 raft_consensus.cc:606] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Received request to transfer leadership to TS 5d7e810263a74451bc21be0d1cca16f3
I20260709 12:59:44.248162  1212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e15c377eeba84ca8b66f64a82c06b7ca"
dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
mode: GRACEFUL
new_leader_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:34092
I20260709 12:59:44.248657  1212 raft_consensus.cc:606] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Received request to transfer leadership to TS 5d7e810263a74451bc21be0d1cca16f3
I20260709 12:59:44.253758  1212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd06b47b0f9c4051be4b9c4e927807a1"
dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
mode: GRACEFUL
new_leader_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:34092
I20260709 12:59:44.254395  1212 raft_consensus.cc:606] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Received request to transfer leadership to TS 5d7e810263a74451bc21be0d1cca16f3
I20260709 12:59:44.260324  1212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d"
dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
mode: GRACEFUL
new_leader_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:34092
I20260709 12:59:44.260811  1212 raft_consensus.cc:606] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Received request to transfer leadership to TS 5d7e810263a74451bc21be0d1cca16f3
I20260709 12:59:44.265828  1212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e"
dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
mode: GRACEFUL
new_leader_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:34092
I20260709 12:59:44.266499  1212 raft_consensus.cc:606] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Received request to transfer leadership to TS 5d7e810263a74451bc21be0d1cca16f3
I20260709 12:59:44.276449  1280 consensus_queue.cc:1048] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.276816  1212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614"
dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
mode: GRACEFUL
new_leader_uuid: "99ad2a1622404b68aa587cb8bba62294"
 from {username='slave'} at 127.0.0.1:34092
I20260709 12:59:44.277379  1212 raft_consensus.cc:606] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Received request to transfer leadership to TS 99ad2a1622404b68aa587cb8bba62294
I20260709 12:59:44.289588  1258 consensus_queue.cc:1048] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.296077  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5069694830e4c008c80b665f8b39663"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
mode: GRACEFUL
new_leader_uuid: "99ad2a1622404b68aa587cb8bba62294"
 from {username='slave'} at 127.0.0.1:47386
I20260709 12:59:44.296774  1060 raft_consensus.cc:606] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 LEADER]: Received request to transfer leadership to TS 99ad2a1622404b68aa587cb8bba62294
I20260709 12:59:44.302428  1258 consensus_queue.cc:1048] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.309633  1258 raft_consensus.cc:993] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3: : Instructing follower 99ad2a1622404b68aa587cb8bba62294 to start an election
I20260709 12:59:44.310077  1258 raft_consensus.cc:1081] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Signalling peer 99ad2a1622404b68aa587cb8bba62294 to start an election
I20260709 12:59:44.312100  1137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614"
dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
 from {username='slave'} at 127.0.0.1:49412
I20260709 12:59:44.312724  1137 raft_consensus.cc:493] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:44.313129  1137 raft_consensus.cc:3060] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.321209  1258 raft_consensus.cc:993] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3: : Instructing follower 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:44.321715  1280 raft_consensus.cc:1081] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Signalling peer 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:44.323148  1136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "756e5db4632b4e6db5f7d6ff21909c7a"
dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
mode: GRACEFUL
new_leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
 from {username='slave'} at 127.0.0.1:49428
I20260709 12:59:44.323794  1136 raft_consensus.cc:606] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Received request to transfer leadership to TS eecae620ab1d4b5cbcc1e5f1d22b76b3
I20260709 12:59:44.325484  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd06b47b0f9c4051be4b9c4e927807a1"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:47364
I20260709 12:59:44.326490  1060 raft_consensus.cc:493] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:44.326891  1060 raft_consensus.cc:3060] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.327455  1281 consensus_queue.cc:1048] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.365531  1281 raft_consensus.cc:993] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3: : Instructing follower 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:44.366034  1258 raft_consensus.cc:1081] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Signalling peer 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:44.367712  1063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc635d4f8ae0487ea65c5110409936b9"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:47364
I20260709 12:59:44.368804  1063 raft_consensus.cc:493] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:44.369194  1063 raft_consensus.cc:3060] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.393410  1060 raft_consensus.cc:515] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.393411  1137 raft_consensus.cc:515] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.396234  1060 leader_election.cc:290] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Requested vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:44.397315  1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:44.397681  1212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd06b47b0f9c4051be4b9c4e927807a1" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:44.397910  1062 raft_consensus.cc:3060] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.397945  1211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:44.398247  1212 raft_consensus.cc:3055] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.398633  1212 raft_consensus.cc:740] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:44.398667  1211 raft_consensus.cc:3055] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.399075  1211 raft_consensus.cc:740] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:44.399528  1212 consensus_queue.cc:260] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.399950  1211 consensus_queue.cc:260] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.400624  1212 raft_consensus.cc:3060] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.400974  1211 raft_consensus.cc:3060] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.407372  1212 raft_consensus.cc:2468] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:44.408174  1211 raft_consensus.cc:2468] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 2.
I20260709 12:59:44.408470  1137 leader_election.cc:290] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 2 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:44.409204  1027 leader_election.cc:304] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:44.409624  1102 leader_election.cc:304] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:44.410140  1259 raft_consensus.cc:2804] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.410375  1260 raft_consensus.cc:2804] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.408663  1063 raft_consensus.cc:515] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } }
I20260709 12:59:44.410617  1259 raft_consensus.cc:697] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Becoming Leader. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:44.410867  1260 raft_consensus.cc:697] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 2 LEADER]: Becoming Leader. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Running, Role: LEADER
I20260709 12:59:44.411279  1062 raft_consensus.cc:2468] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 2.
I20260709 12:59:44.411736  1260 consensus_queue.cc:237] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.412043  1259 consensus_queue.cc:237] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.413816  1211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc635d4f8ae0487ea65c5110409936b9" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:44.414388  1211 raft_consensus.cc:3055] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.414830  1211 raft_consensus.cc:740] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:44.414985  1136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd06b47b0f9c4051be4b9c4e927807a1" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:44.415750  1063 leader_election.cc:290] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Requested vote from peers eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:44.415580  1136 raft_consensus.cc:3060] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.416925  1211 consensus_queue.cc:260] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } }
I20260709 12:59:44.417531  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc635d4f8ae0487ea65c5110409936b9" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:44.418161  1211 raft_consensus.cc:3060] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.418172  1137 raft_consensus.cc:3060] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.421001  1260 consensus_queue.cc:1048] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.425837   960 catalog_manager.cc:5697] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 reported cstate change: term changed from 1 to 2, leader changed from eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131) to 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "99ad2a1622404b68aa587cb8bba62294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.428792  1136 raft_consensus.cc:2468] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:44.433197  1137 raft_consensus.cc:2468] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:44.433331  1211 raft_consensus.cc:2468] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:44.435563  1026 leader_election.cc:304] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294; no voters: 
I20260709 12:59:44.436370  1259 raft_consensus.cc:2804] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.436833  1259 raft_consensus.cc:697] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Becoming Leader. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:44.437623  1259 consensus_queue.cc:237] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } }
I20260709 12:59:44.438560  1304 consensus_queue.cc:1048] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.439488   961 catalog_manager.cc:5697] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 reported cstate change: term changed from 1 to 2, leader changed from eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131) to 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "5d7e810263a74451bc21be0d1cca16f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.445400  1281 raft_consensus.cc:993] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3: : Instructing follower 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:44.445880  1280 raft_consensus.cc:1081] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Signalling peer 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:44.448311  1063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:47364
I20260709 12:59:44.448874  1063 raft_consensus.cc:493] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:44.449186  1063 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.455271  1063 raft_consensus.cc:515] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.458819  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:44.459040  1212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:44.459364  1137 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.459544  1063 leader_election.cc:290] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Requested vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:44.459628  1212 raft_consensus.cc:3055] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.460228  1212 raft_consensus.cc:740] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:44.461385  1212 consensus_queue.cc:260] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.462698  1212 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.465759  1137 raft_consensus.cc:2468] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:44.465334   961 catalog_manager.cc:5697] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 reported cstate change: term changed from 1 to 2, leader changed from eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131) to 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "5d7e810263a74451bc21be0d1cca16f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:44.466840  1026 leader_election.cc:304] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294; no voters: 
I20260709 12:59:44.467557  1259 raft_consensus.cc:2804] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.468236  1259 raft_consensus.cc:697] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Becoming Leader. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:44.468924  1259 consensus_queue.cc:237] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.469403  1212 raft_consensus.cc:2468] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:44.478714  1259 consensus_queue.cc:1048] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.480744   959 catalog_manager.cc:5697] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 reported cstate change: term changed from 1 to 2, leader changed from eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131) to 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "5d7e810263a74451bc21be0d1cca16f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.488538  1259 raft_consensus.cc:993] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3: : Instructing follower 99ad2a1622404b68aa587cb8bba62294 to start an election
I20260709 12:59:44.488978  1259 raft_consensus.cc:1081] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 LEADER]: Signalling peer 99ad2a1622404b68aa587cb8bba62294 to start an election
I20260709 12:59:44.491094  1281 consensus_queue.cc:1048] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:44.492131  1136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5069694830e4c008c80b665f8b39663"
dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
 from {username='slave'} at 127.0.0.1:49400
I20260709 12:59:44.492888  1136 raft_consensus.cc:493] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:44.493245  1136 raft_consensus.cc:3060] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.495371  1296 consensus_queue.cc:1048] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.499540  1136 raft_consensus.cc:515] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.502166  1275 raft_consensus.cc:993] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3: : Instructing follower 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:44.502701  1275 raft_consensus.cc:1081] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Signalling peer 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:44.504835  1211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5069694830e4c008c80b665f8b39663" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:44.506073  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:47364
I20260709 12:59:44.507485  1060 raft_consensus.cc:493] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:44.507867  1060 raft_consensus.cc:3060] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.507916  1136 leader_election.cc:290] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 2 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:44.508850  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5069694830e4c008c80b665f8b39663" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:44.509462  1063 raft_consensus.cc:3055] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.509775  1063 raft_consensus.cc:740] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:44.510516  1063 consensus_queue.cc:260] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.512589  1275 consensus_queue.cc:1048] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.511595  1063 raft_consensus.cc:3060] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.521896  1060 raft_consensus.cc:515] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.524273  1060 leader_election.cc:290] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Requested vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:44.528152  1212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:44.528720  1212 raft_consensus.cc:3055] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.529047  1212 raft_consensus.cc:740] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:44.529850  1212 consensus_queue.cc:260] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.530817  1212 raft_consensus.cc:3060] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.531688  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:44.532392  1137 raft_consensus.cc:3060] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.534780  1304 consensus_queue.cc:1048] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.539440  1275 raft_consensus.cc:993] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3: : Instructing follower 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:44.539868  1275 raft_consensus.cc:1081] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Signalling peer 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:44.521879  1063 raft_consensus.cc:2468] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 2.
I20260709 12:59:44.542879  1212 raft_consensus.cc:2468] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:44.542894  1104 leader_election.cc:304] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294; no voters: eecae620ab1d4b5cbcc1e5f1d22b76b3
I20260709 12:59:44.543947  1304 raft_consensus.cc:2804] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.544288  1027 leader_election.cc:304] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:44.544420  1304 raft_consensus.cc:697] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 2 LEADER]: Becoming Leader. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Running, Role: LEADER
I20260709 12:59:44.545091  1259 raft_consensus.cc:2804] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.545674  1259 raft_consensus.cc:697] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Becoming Leader. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:44.545851  1304 consensus_queue.cc:237] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.546928  1259 consensus_queue.cc:237] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.549557  1137 raft_consensus.cc:2468] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:44.545710  1063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e15c377eeba84ca8b66f64a82c06b7ca"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:47364
I20260709 12:59:44.553427  1063 raft_consensus.cc:493] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:44.553787  1063 raft_consensus.cc:3060] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.557684  1306 raft_consensus.cc:993] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294: : Instructing follower eecae620ab1d4b5cbcc1e5f1d22b76b3 to start an election
I20260709 12:59:44.558096  1306 raft_consensus.cc:1081] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Signalling peer eecae620ab1d4b5cbcc1e5f1d22b76b3 to start an election
I20260709 12:59:44.561739  1063 raft_consensus.cc:515] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.562204   959 catalog_manager.cc:5697] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 reported cstate change: term changed from 1 to 2, leader changed from eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131) to 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "5d7e810263a74451bc21be0d1cca16f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.562669   960 catalog_manager.cc:5697] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 reported cstate change: term changed from 1 to 2, leader changed from 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129) to 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "99ad2a1622404b68aa587cb8bba62294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.564095  1063 leader_election.cc:290] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Requested vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:44.565479  1210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15c377eeba84ca8b66f64a82c06b7ca" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:44.566121  1210 raft_consensus.cc:3055] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.566466  1210 raft_consensus.cc:740] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:44.567137  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15c377eeba84ca8b66f64a82c06b7ca" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:44.567807  1137 raft_consensus.cc:3060] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.567387  1210 consensus_queue.cc:260] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.568514  1210 raft_consensus.cc:3060] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.569916  1260 consensus_queue.cc:1048] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.575800  1137 raft_consensus.cc:2468] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:44.576349  1210 raft_consensus.cc:2468] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:44.578979  1026 leader_election.cc:304] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294; no voters: 
I20260709 12:59:44.579897  1259 raft_consensus.cc:2804] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.565090  1211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "756e5db4632b4e6db5f7d6ff21909c7a"
dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
 from {username='slave'} at 127.0.0.1:34084
I20260709 12:59:44.580338  1259 raft_consensus.cc:697] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Becoming Leader. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:44.580508  1211 raft_consensus.cc:493] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:44.580941  1211 raft_consensus.cc:3060] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.581292  1259 consensus_queue.cc:237] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.586874  1211 raft_consensus.cc:515] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.592017  1211 leader_election.cc:290] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 2 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:44.592657  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756e5db4632b4e6db5f7d6ff21909c7a" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:44.593268  1060 raft_consensus.cc:3060] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.594202  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756e5db4632b4e6db5f7d6ff21909c7a" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:44.594762  1137 raft_consensus.cc:3055] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.595088  1137 raft_consensus.cc:740] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Running, Role: LEADER
I20260709 12:59:44.594538   961 catalog_manager.cc:5697] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 reported cstate change: term changed from 1 to 2, leader changed from eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131) to 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "5d7e810263a74451bc21be0d1cca16f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.596140  1137 consensus_queue.cc:260] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.597643  1137 raft_consensus.cc:3060] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.603221  1060 raft_consensus.cc:2468] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 2.
I20260709 12:59:44.604578  1178 leader_election.cc:304] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:44.605298  1137 raft_consensus.cc:2468] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 2.
I20260709 12:59:44.605369  1280 raft_consensus.cc:2804] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:44.605945  1280 raft_consensus.cc:697] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 LEADER]: Becoming Leader. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:44.606580  1280 consensus_queue.cc:237] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:44.613310   960 catalog_manager.cc:5697] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 reported cstate change: term changed from 1 to 2, leader changed from 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130) to eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131). New cstate: current_term: 2 leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:44.799786  1060 raft_consensus.cc:1275] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Refusing update from remote peer 99ad2a1622404b68aa587cb8bba62294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.801322  1306 consensus_queue.cc:1048] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:44.810173  1211 raft_consensus.cc:1275] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Refusing update from remote peer 99ad2a1622404b68aa587cb8bba62294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.812338  1260 consensus_queue.cc:1048] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:44.836057  1137 raft_consensus.cc:1275] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.837438  1259 consensus_queue.cc:1048] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:44.845695  1211 raft_consensus.cc:1275] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.847404  1342 consensus_queue.cc:1048] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:44.865726  1137 raft_consensus.cc:1275] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.867223  1342 consensus_queue.cc:1048] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:44.874722  1211 raft_consensus.cc:1275] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.876273  1259 consensus_queue.cc:1048] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:44.936019  1137 raft_consensus.cc:1275] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.937911  1259 consensus_queue.cc:1048] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:44.945896  1211 raft_consensus.cc:1275] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.947454  1259 consensus_queue.cc:1048] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:44.951591  1212 raft_consensus.cc:1275] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.953054  1342 consensus_queue.cc:1048] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:44.962033  1137 raft_consensus.cc:1275] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.963439  1259 consensus_queue.cc:1048] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:44.975018  1060 raft_consensus.cc:1275] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Refusing update from remote peer 99ad2a1622404b68aa587cb8bba62294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.976903  1304 consensus_queue.cc:1048] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:44.988433  1137 raft_consensus.cc:1275] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Refusing update from remote peer eecae620ab1d4b5cbcc1e5f1d22b76b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.990010  1211 raft_consensus.cc:3060] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.989985  1280 consensus_queue.cc:1048] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:44.996870  1212 raft_consensus.cc:1275] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.997694  1211 raft_consensus.cc:1275] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Refusing update from remote peer 99ad2a1622404b68aa587cb8bba62294: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:44.998517  1259 consensus_queue.cc:1048] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:44.999508  1304 consensus_queue.cc:1048] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:45.005692  1060 raft_consensus.cc:1275] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Refusing update from remote peer eecae620ab1d4b5cbcc1e5f1d22b76b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:45.007553  1280 consensus_queue.cc:1048] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:45.021656  1137 raft_consensus.cc:1275] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:45.024062  1342 consensus_queue.cc:1048] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:47.362957   430 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:59:47.363837   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:47.384181  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
mode: GRACEFUL
new_leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
 from {username='slave'} at 127.0.0.1:47396
I20260709 12:59:47.384712  1060 raft_consensus.cc:606] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Received request to transfer leadership to TS eecae620ab1d4b5cbcc1e5f1d22b76b3
I20260709 12:59:47.387108  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
mode: GRACEFUL
new_leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
 from {username='slave'} at 127.0.0.1:47396
I20260709 12:59:47.387602  1060 raft_consensus.cc:606] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Received request to transfer leadership to TS eecae620ab1d4b5cbcc1e5f1d22b76b3
I20260709 12:59:47.388514   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:47.388927   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:47.437645  1350 raft_consensus.cc:993] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3: : Instructing follower eecae620ab1d4b5cbcc1e5f1d22b76b3 to start an election
I20260709 12:59:47.438153  1259 raft_consensus.cc:1081] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Signalling peer eecae620ab1d4b5cbcc1e5f1d22b76b3 to start an election
I20260709 12:59:47.439805  1212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d"
dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
 from {username='slave'} at 127.0.0.1:34076
I20260709 12:59:47.440290  1212 raft_consensus.cc:493] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:47.440594  1212 raft_consensus.cc:3060] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.445010  1212 raft_consensus.cc:515] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:47.446565  1212 leader_election.cc:290] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 3 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:47.447609  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:47.447705  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:47.448127  1060 raft_consensus.cc:3055] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:47.448203  1137 raft_consensus.cc:3060] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.448434  1060 raft_consensus.cc:740] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:47.449191  1060 consensus_queue.cc:260] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:47.450165  1060 raft_consensus.cc:3060] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.453416  1137 raft_consensus.cc:2468] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 3.
I20260709 12:59:47.454614  1175 leader_election.cc:304] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:47.455444  1347 raft_consensus.cc:2804] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:47.456251  1060 raft_consensus.cc:2468] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 3.
I20260709 12:59:47.456683  1347 raft_consensus.cc:697] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 LEADER]: Becoming Leader. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:47.457597  1347 consensus_queue.cc:237] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:47.465458   958 catalog_manager.cc:5697] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 reported cstate change: term changed from 2 to 3, leader changed from 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129) to eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131). New cstate: current_term: 3 leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:47.743806  1350 raft_consensus.cc:993] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3: : Instructing follower eecae620ab1d4b5cbcc1e5f1d22b76b3 to start an election
I20260709 12:59:47.744225  1259 raft_consensus.cc:1081] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Signalling peer eecae620ab1d4b5cbcc1e5f1d22b76b3 to start an election
I20260709 12:59:47.745581  1212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e"
dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
 from {username='slave'} at 127.0.0.1:34076
I20260709 12:59:47.745992  1212 raft_consensus.cc:493] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:47.746237  1212 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.750916  1212 raft_consensus.cc:515] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:47.752452  1212 leader_election.cc:290] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 3 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:47.753324  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:47.753479  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:47.753862  1060 raft_consensus.cc:3055] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:47.754051  1137 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.754174  1060 raft_consensus.cc:740] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:47.754902  1060 consensus_queue.cc:260] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:47.755901  1060 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.758694  1137 raft_consensus.cc:2468] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 3.
I20260709 12:59:47.759668  1175 leader_election.cc:304] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:47.760536  1347 raft_consensus.cc:2804] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:47.760937  1347 raft_consensus.cc:697] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 LEADER]: Becoming Leader. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:47.761112  1060 raft_consensus.cc:2468] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 3.
I20260709 12:59:47.761714  1347 consensus_queue.cc:237] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:47.771634   958 catalog_manager.cc:5697] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 reported cstate change: term changed from 2 to 3, leader changed from 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129) to eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131). New cstate: current_term: 3 leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:47.903959  1137 raft_consensus.cc:1275] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Refusing update from remote peer eecae620ab1d4b5cbcc1e5f1d22b76b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:47.905112  1347 consensus_queue.cc:1048] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:47.915184  1060 raft_consensus.cc:1275] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Refusing update from remote peer eecae620ab1d4b5cbcc1e5f1d22b76b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:47.916801  1347 consensus_queue.cc:1048] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.206317  1063 raft_consensus.cc:1275] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Refusing update from remote peer eecae620ab1d4b5cbcc1e5f1d22b76b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:48.207619  1362 consensus_queue.cc:1048] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.215751  1137 raft_consensus.cc:1275] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Refusing update from remote peer eecae620ab1d4b5cbcc1e5f1d22b76b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:48.217133  1347 consensus_queue.cc:1048] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.389779   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:48.407809  1212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d"
dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
mode: GRACEFUL
new_leader_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:34092
I20260709 12:59:48.408411  1212 raft_consensus.cc:606] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 LEADER]: Received request to transfer leadership to TS 5d7e810263a74451bc21be0d1cca16f3
I20260709 12:59:48.413094  1212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e"
dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
mode: GRACEFUL
new_leader_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:34092
I20260709 12:59:48.413583  1212 raft_consensus.cc:606] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 LEADER]: Received request to transfer leadership to TS 5d7e810263a74451bc21be0d1cca16f3
I20260709 12:59:48.418378  1137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e03e98af66142faaabbf0d004019bc9"
dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
mode: GRACEFUL
new_leader_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:49428
I20260709 12:59:48.418905  1137 raft_consensus.cc:606] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Received request to transfer leadership to TS 5d7e810263a74451bc21be0d1cca16f3
I20260709 12:59:48.424831  1137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc8351b794944e2cb64d166f2fe4412d"
dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
mode: GRACEFUL
new_leader_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:49428
I20260709 12:59:48.425309  1137 raft_consensus.cc:606] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Received request to transfer leadership to TS 5d7e810263a74451bc21be0d1cca16f3
I20260709 12:59:48.430852  1137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614"
dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
mode: GRACEFUL
new_leader_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:49428
I20260709 12:59:48.431387  1137 raft_consensus.cc:606] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 2 LEADER]: Received request to transfer leadership to TS 5d7e810263a74451bc21be0d1cca16f3
I20260709 12:59:48.518520  1368 raft_consensus.cc:993] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294: : Instructing follower 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:48.518990  1349 raft_consensus.cc:1081] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Signalling peer 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:48.520480  1362 raft_consensus.cc:993] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3: : Instructing follower 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:48.520709  1063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e03e98af66142faaabbf0d004019bc9"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:47372
I20260709 12:59:48.520993  1347 raft_consensus.cc:1081] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 LEADER]: Signalling peer 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:48.521265  1063 raft_consensus.cc:493] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:48.521678  1063 raft_consensus.cc:3060] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.522644  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:47364
I20260709 12:59:48.523146  1060 raft_consensus.cc:493] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:48.523535  1060 raft_consensus.cc:3060] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.527316  1063 raft_consensus.cc:515] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.528671  1060 raft_consensus.cc:515] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.529464  1063 leader_election.cc:290] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Requested vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:48.529964  1137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e03e98af66142faaabbf0d004019bc9" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:48.530485  1212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e03e98af66142faaabbf0d004019bc9" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:48.530857  1137 raft_consensus.cc:3055] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:48.531075  1212 raft_consensus.cc:3060] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.531316  1137 raft_consensus.cc:740] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Running, Role: LEADER
I20260709 12:59:48.531536  1136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:48.532115  1136 raft_consensus.cc:3060] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.532269  1137 consensus_queue.cc:260] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.533509  1137 raft_consensus.cc:3060] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.535198  1212 raft_consensus.cc:2468] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:48.536320  1027 leader_election.cc:304] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:48.536693  1210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9684fbb252447e5bddb9393e414f44d" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:48.537122  1259 raft_consensus.cc:2804] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:48.537230  1210 raft_consensus.cc:3055] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:48.537823  1210 raft_consensus.cc:740] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:48.538707  1210 consensus_queue.cc:260] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.540061  1210 raft_consensus.cc:3060] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.539661  1136 raft_consensus.cc:2468] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 4.
I20260709 12:59:48.541021  1137 raft_consensus.cc:2468] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:48.537156  1060 leader_election.cc:290] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 4 election: Requested vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:48.542205  1026 leader_election.cc:304] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294; no voters: 
I20260709 12:59:48.543016  1259 raft_consensus.cc:697] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Becoming Leader. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:48.543929  1369 raft_consensus.cc:2804] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:48.544194  1259 consensus_queue.cc:237] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.545109  1369 raft_consensus.cc:697] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 4 LEADER]: Becoming Leader. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:48.545976  1369 consensus_queue.cc:237] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.547327  1210 raft_consensus.cc:2468] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 4.
I20260709 12:59:48.552938   958 catalog_manager.cc:5697] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 reported cstate change: term changed from 1 to 2, leader changed from 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130) to 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "5d7e810263a74451bc21be0d1cca16f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.567878   958 catalog_manager.cc:5697] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 reported cstate change: term changed from 3 to 4, leader changed from eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131) to 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129). New cstate: current_term: 4 leader_uuid: "5d7e810263a74451bc21be0d1cca16f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.696705  1362 raft_consensus.cc:993] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3: : Instructing follower 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:48.697162  1347 raft_consensus.cc:1081] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 LEADER]: Signalling peer 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:48.698612  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:47364
I20260709 12:59:48.699115  1060 raft_consensus.cc:493] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:48.699394  1060 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.704605  1060 raft_consensus.cc:515] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.706396  1060 leader_election.cc:290] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 4 election: Requested vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:48.707167  1136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:48.707533  1210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:48.707849  1136 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.708092  1210 raft_consensus.cc:3055] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:48.708447  1210 raft_consensus.cc:740] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:48.709158  1210 consensus_queue.cc:260] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.710095  1210 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.713593  1136 raft_consensus.cc:2468] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 4.
I20260709 12:59:48.714732  1026 leader_election.cc:304] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, 99ad2a1622404b68aa587cb8bba62294; no voters: 
I20260709 12:59:48.715157  1210 raft_consensus.cc:2468] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 4.
I20260709 12:59:48.715682  1259 raft_consensus.cc:2804] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:48.716078  1259 raft_consensus.cc:697] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 4 LEADER]: Becoming Leader. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:48.716794  1259 consensus_queue.cc:237] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.722937   958 catalog_manager.cc:5697] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 reported cstate change: term changed from 3 to 4, leader changed from eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131) to 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129). New cstate: current_term: 4 leader_uuid: "5d7e810263a74451bc21be0d1cca16f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.779083  1368 raft_consensus.cc:993] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294: : Instructing follower 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:48.779557  1349 raft_consensus.cc:1081] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Signalling peer 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:48.780969  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc8351b794944e2cb64d166f2fe4412d"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:47372
I20260709 12:59:48.781469  1060 raft_consensus.cc:493] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:48.781764  1060 raft_consensus.cc:3060] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.786088  1060 raft_consensus.cc:515] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.787535  1060 leader_election.cc:290] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Requested vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:48.788390  1136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8351b794944e2cb64d166f2fe4412d" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:48.788581  1210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8351b794944e2cb64d166f2fe4412d" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:48.789032  1136 raft_consensus.cc:3055] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:48.789080  1210 raft_consensus.cc:3060] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.789373  1136 raft_consensus.cc:740] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Running, Role: LEADER
I20260709 12:59:48.790083  1136 consensus_queue.cc:260] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.791014  1136 raft_consensus.cc:3060] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.794001  1210 raft_consensus.cc:2468] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:48.795147  1027 leader_election.cc:304] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:48.795837  1259 raft_consensus.cc:2804] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:48.796331  1259 raft_consensus.cc:697] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Becoming Leader. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:48.797118  1259 consensus_queue.cc:237] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.797600  1136 raft_consensus.cc:2468] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 2.
I20260709 12:59:48.803560   958 catalog_manager.cc:5697] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 reported cstate change: term changed from 1 to 2, leader changed from 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130) to 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "5d7e810263a74451bc21be0d1cca16f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.864964  1368 raft_consensus.cc:993] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294: : Instructing follower 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:48.865453  1349 raft_consensus.cc:1081] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 2 LEADER]: Signalling peer 5d7e810263a74451bc21be0d1cca16f3 to start an election
I20260709 12:59:48.866787  1060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
 from {username='slave'} at 127.0.0.1:47372
I20260709 12:59:48.867208  1060 raft_consensus.cc:493] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:48.867471  1060 raft_consensus.cc:3060] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.871253  1060 raft_consensus.cc:515] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.872709  1060 leader_election.cc:290] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 3 election: Requested vote from peers 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:48.873642  1136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:48.873972  1210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614" candidate_uuid: "5d7e810263a74451bc21be0d1cca16f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:48.874294  1136 raft_consensus.cc:3055] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:48.874540  1210 raft_consensus.cc:3060] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.874756  1136 raft_consensus.cc:740] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Running, Role: LEADER
I20260709 12:59:48.875622  1136 consensus_queue.cc:260] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.876662  1136 raft_consensus.cc:3060] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.880385  1210 raft_consensus.cc:2468] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 3.
I20260709 12:59:48.881474  1027 leader_election.cc:304] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d7e810263a74451bc21be0d1cca16f3, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:48.882181  1259 raft_consensus.cc:2804] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:48.882511  1136 raft_consensus.cc:2468] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d7e810263a74451bc21be0d1cca16f3 in term 3.
I20260709 12:59:48.882680  1259 raft_consensus.cc:697] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 3 LEADER]: Becoming Leader. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:48.883652  1259 consensus_queue.cc:237] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:48.890669   958 catalog_manager.cc:5697] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 reported cstate change: term changed from 2 to 3, leader changed from 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130) to 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129). New cstate: current_term: 3 leader_uuid: "5d7e810263a74451bc21be0d1cca16f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.940621  1136 raft_consensus.cc:1275] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 4 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:48.941781  1259 consensus_queue.cc:1048] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:48.951138  1210 raft_consensus.cc:1275] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 4 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:48.952801  1370 consensus_queue.cc:1048] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:49.061669  1210 raft_consensus.cc:1275] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:49.063165  1370 consensus_queue.cc:1048] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.066675  1136 raft_consensus.cc:1275] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:49.068001  1259 consensus_queue.cc:1048] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.236016  1210 raft_consensus.cc:1275] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:49.237349  1370 consensus_queue.cc:1048] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.245668  1136 raft_consensus.cc:1275] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:49.249678  1137 raft_consensus.cc:1275] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 4 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:49.250595  1385 consensus_queue.cc:1048] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:49.250973  1369 consensus_queue.cc:1048] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:49.263185  1210 raft_consensus.cc:1275] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 4 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:49.265218  1369 consensus_queue.cc:1048] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:49.371834  1136 raft_consensus.cc:1275] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:49.373065  1385 consensus_queue.cc:1048] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:49.382038  1212 raft_consensus.cc:1275] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Refusing update from remote peer 5d7e810263a74451bc21be0d1cca16f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:49.384131  1385 consensus_queue.cc:1048] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.440884   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:51.450814  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
mode: GRACEFUL
new_leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
 from {username='slave'} at 127.0.0.1:47396
I20260709 12:59:51.451567  1060 raft_consensus.cc:606] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 4 LEADER]: Received request to transfer leadership to TS eecae620ab1d4b5cbcc1e5f1d22b76b3
I20260709 12:59:51.454476  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
mode: GRACEFUL
new_leader_uuid: "99ad2a1622404b68aa587cb8bba62294"
 from {username='slave'} at 127.0.0.1:47396
I20260709 12:59:51.455000  1060 raft_consensus.cc:606] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 3 LEADER]: Received request to transfer leadership to TS 99ad2a1622404b68aa587cb8bba62294
I20260709 12:59:51.457293  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc8351b794944e2cb64d166f2fe4412d"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
mode: GRACEFUL
new_leader_uuid: "99ad2a1622404b68aa587cb8bba62294"
 from {username='slave'} at 127.0.0.1:47396
I20260709 12:59:51.457782  1060 raft_consensus.cc:606] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Received request to transfer leadership to TS 99ad2a1622404b68aa587cb8bba62294
I20260709 12:59:51.460098  1060 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd06b47b0f9c4051be4b9c4e927807a1"
dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
mode: GRACEFUL
new_leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
 from {username='slave'} at 127.0.0.1:47396
I20260709 12:59:51.460601  1060 raft_consensus.cc:606] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Received request to transfer leadership to TS eecae620ab1d4b5cbcc1e5f1d22b76b3
I20260709 12:59:51.461624   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:51.462086   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:51.520380  1393 raft_consensus.cc:993] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3: : Instructing follower eecae620ab1d4b5cbcc1e5f1d22b76b3 to start an election
I20260709 12:59:51.521013  1369 raft_consensus.cc:1081] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 4 LEADER]: Signalling peer eecae620ab1d4b5cbcc1e5f1d22b76b3 to start an election
I20260709 12:59:51.522593  1212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e"
dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
 from {username='slave'} at 127.0.0.1:34076
I20260709 12:59:51.523059  1212 raft_consensus.cc:493] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:51.523345  1212 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.528702  1212 raft_consensus.cc:515] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:51.530375  1212 leader_election.cc:290] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 5 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:51.531736  1136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:51.532080  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487478c6fb7b42e3937711a152196a3e" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:51.532509  1136 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.532557  1060 raft_consensus.cc:3055] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:51.533025  1060 raft_consensus.cc:740] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:51.533861  1060 consensus_queue.cc:260] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:51.535092  1060 raft_consensus.cc:3060] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.539403  1136 raft_consensus.cc:2468] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 5.
I20260709 12:59:51.540789  1175 leader_election.cc:304] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:51.541656  1347 raft_consensus.cc:2804] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:51.541754  1060 raft_consensus.cc:2468] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 5.
I20260709 12:59:51.542716  1347 raft_consensus.cc:697] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 5 LEADER]: Becoming Leader. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:51.543690  1347 consensus_queue.cc:237] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:51.550499   960 catalog_manager.cc:5697] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 reported cstate change: term changed from 4 to 5, leader changed from 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129) to eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131). New cstate: current_term: 5 leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:51.795050  1393 raft_consensus.cc:993] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3: : Instructing follower eecae620ab1d4b5cbcc1e5f1d22b76b3 to start an election
I20260709 12:59:51.795536  1393 raft_consensus.cc:1081] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Signalling peer eecae620ab1d4b5cbcc1e5f1d22b76b3 to start an election
I20260709 12:59:51.797327  1212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd06b47b0f9c4051be4b9c4e927807a1"
dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
 from {username='slave'} at 127.0.0.1:34076
I20260709 12:59:51.797709  1212 raft_consensus.cc:493] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:51.797941  1212 raft_consensus.cc:3060] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.802335  1212 raft_consensus.cc:515] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:51.803764  1212 leader_election.cc:290] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 3 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130:41339)
I20260709 12:59:51.804605  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd06b47b0f9c4051be4b9c4e927807a1" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:51.804792  1136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd06b47b0f9c4051be4b9c4e927807a1" candidate_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
I20260709 12:59:51.805100  1060 raft_consensus.cc:3055] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:51.805284  1136 raft_consensus.cc:3060] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.805465  1060 raft_consensus.cc:740] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:51.806190  1060 consensus_queue.cc:260] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:51.807113  1060 raft_consensus.cc:3060] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.809676  1136 raft_consensus.cc:2468] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 3.
I20260709 12:59:51.810684  1175 leader_election.cc:304] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:51.811623  1347 raft_consensus.cc:2804] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:51.812072  1347 raft_consensus.cc:697] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 LEADER]: Becoming Leader. State: Replica: eecae620ab1d4b5cbcc1e5f1d22b76b3, State: Running, Role: LEADER
I20260709 12:59:51.812836  1060 raft_consensus.cc:2468] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eecae620ab1d4b5cbcc1e5f1d22b76b3 in term 3.
I20260709 12:59:51.813117  1347 consensus_queue.cc:237] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:51.820675   960 catalog_manager.cc:5697] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 reported cstate change: term changed from 2 to 3, leader changed from 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129) to eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131). New cstate: current_term: 3 leader_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:51.869240  1369 raft_consensus.cc:993] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3: : Instructing follower 99ad2a1622404b68aa587cb8bba62294 to start an election
I20260709 12:59:51.869704  1369 raft_consensus.cc:1081] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Signalling peer 99ad2a1622404b68aa587cb8bba62294 to start an election
I20260709 12:59:51.871124  1136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc8351b794944e2cb64d166f2fe4412d"
dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
 from {username='slave'} at 127.0.0.1:49400
I20260709 12:59:51.871685  1136 raft_consensus.cc:493] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:51.871950  1136 raft_consensus.cc:3060] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.876320  1136 raft_consensus.cc:515] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:51.877748  1136 leader_election.cc:290] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 3 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:51.878620  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8351b794944e2cb64d166f2fe4412d" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:51.878829  1212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8351b794944e2cb64d166f2fe4412d" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:51.879086  1060 raft_consensus.cc:3055] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:51.879395  1212 raft_consensus.cc:3060] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.879392  1060 raft_consensus.cc:740] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:51.880285  1060 consensus_queue.cc:260] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:51.881187  1060 raft_consensus.cc:3060] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.884140  1212 raft_consensus.cc:2468] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 3.
I20260709 12:59:51.885447  1060 raft_consensus.cc:2468] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 3.
I20260709 12:59:51.885473  1102 leader_election.cc:304] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:51.886592  1392 raft_consensus.cc:2804] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:51.887945  1392 raft_consensus.cc:697] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 3 LEADER]: Becoming Leader. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Running, Role: LEADER
I20260709 12:59:51.888816  1392 consensus_queue.cc:237] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:51.895555   960 catalog_manager.cc:5697] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 reported cstate change: term changed from 2 to 3, leader changed from 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129) to 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130). New cstate: current_term: 3 leader_uuid: "99ad2a1622404b68aa587cb8bba62294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:51.979614  1393 raft_consensus.cc:993] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3: : Instructing follower 99ad2a1622404b68aa587cb8bba62294 to start an election
I20260709 12:59:51.980157  1369 raft_consensus.cc:1081] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 3 LEADER]: Signalling peer 99ad2a1622404b68aa587cb8bba62294 to start an election
I20260709 12:59:51.981642  1136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614"
dest_uuid: "99ad2a1622404b68aa587cb8bba62294"
 from {username='slave'} at 127.0.0.1:49400
I20260709 12:59:51.982128  1136 raft_consensus.cc:493] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:51.982414  1136 raft_consensus.cc:3060] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.986441  1136 raft_consensus.cc:515] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:51.987771  1136 leader_election.cc:290] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 4 election: Requested vote from peers 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449), eecae620ab1d4b5cbcc1e5f1d22b76b3 (127.0.107.131:45601)
I20260709 12:59:51.988588  1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5d7e810263a74451bc21be0d1cca16f3"
I20260709 12:59:51.988806  1212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68268e4726754bbbb2a83694ce99b614" candidate_uuid: "99ad2a1622404b68aa587cb8bba62294" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3"
I20260709 12:59:51.989066  1060 raft_consensus.cc:3055] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:51.989316  1212 raft_consensus.cc:3060] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.989396  1060 raft_consensus.cc:740] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d7e810263a74451bc21be0d1cca16f3, State: Running, Role: LEADER
I20260709 12:59:51.990239  1060 consensus_queue.cc:260] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:51.991083  1060 raft_consensus.cc:3060] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.994341  1212 raft_consensus.cc:2468] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 4.
I20260709 12:59:51.995290  1102 leader_election.cc:304] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ad2a1622404b68aa587cb8bba62294, eecae620ab1d4b5cbcc1e5f1d22b76b3; no voters: 
I20260709 12:59:51.995963  1060 raft_consensus.cc:2468] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ad2a1622404b68aa587cb8bba62294 in term 4.
I20260709 12:59:51.996240  1392 raft_consensus.cc:2804] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:51.996785  1392 raft_consensus.cc:697] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 4 LEADER]: Becoming Leader. State: Replica: 99ad2a1622404b68aa587cb8bba62294, State: Running, Role: LEADER
I20260709 12:59:51.997532  1392 consensus_queue.cc:237] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } }
I20260709 12:59:52.005084   960 catalog_manager.cc:5697] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 reported cstate change: term changed from 3 to 4, leader changed from 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129) to 99ad2a1622404b68aa587cb8bba62294 (127.0.107.130). New cstate: current_term: 4 leader_uuid: "99ad2a1622404b68aa587cb8bba62294" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:52.066044  1060 raft_consensus.cc:1275] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 5 FOLLOWER]: Refusing update from remote peer eecae620ab1d4b5cbcc1e5f1d22b76b3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:52.067305  1347 consensus_queue.cc:1048] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:52.082269  1136 raft_consensus.cc:1275] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 5 FOLLOWER]: Refusing update from remote peer eecae620ab1d4b5cbcc1e5f1d22b76b3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:52.083966  1406 consensus_queue.cc:1048] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:52.232460  1136 raft_consensus.cc:1275] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Refusing update from remote peer eecae620ab1d4b5cbcc1e5f1d22b76b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:52.233242  1060 raft_consensus.cc:1275] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Refusing update from remote peer eecae620ab1d4b5cbcc1e5f1d22b76b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:52.233665  1406 consensus_queue.cc:1048] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ad2a1622404b68aa587cb8bba62294" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 41339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:52.234607  1347 consensus_queue.cc:1048] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:52.272648  1060 raft_consensus.cc:1275] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Refusing update from remote peer 99ad2a1622404b68aa587cb8bba62294: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:52.273870  1392 consensus_queue.cc:1048] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:52.281577  1212 raft_consensus.cc:1275] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Refusing update from remote peer 99ad2a1622404b68aa587cb8bba62294: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:52.288188  1392 consensus_queue.cc:1048] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:52.404130  1212 raft_consensus.cc:1275] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 4 FOLLOWER]: Refusing update from remote peer 99ad2a1622404b68aa587cb8bba62294: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:52.405349  1401 consensus_queue.cc:1048] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eecae620ab1d4b5cbcc1e5f1d22b76b3" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:52.414971  1060 raft_consensus.cc:1275] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 4 FOLLOWER]: Refusing update from remote peer 99ad2a1622404b68aa587cb8bba62294: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:52.416442  1401 consensus_queue.cc:1048] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d7e810263a74451bc21be0d1cca16f3" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:52.462914   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:52.472086   430 tablet_server.cc:179] TabletServer@127.0.107.129:0 shutting down...
I20260709 12:59:52.504994   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:52.505991   430 tablet_replica.cc:333] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3: stopping tablet replica
I20260709 12:59:52.506800   430 raft_consensus.cc:2243] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.507316   430 raft_consensus.cc:2272] T 756e5db4632b4e6db5f7d6ff21909c7a P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.510039   430 tablet_replica.cc:333] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3: stopping tablet replica
I20260709 12:59:52.510857   430 raft_consensus.cc:2243] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.511493   430 raft_consensus.cc:2272] T fc8351b794944e2cb64d166f2fe4412d P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.513885   430 tablet_replica.cc:333] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3: stopping tablet replica
I20260709 12:59:52.514328   430 raft_consensus.cc:2243] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.514658   430 raft_consensus.cc:2272] T fd06b47b0f9c4051be4b9c4e927807a1 P 5d7e810263a74451bc21be0d1cca16f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.516657   430 tablet_replica.cc:333] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3: stopping tablet replica
I20260709 12:59:52.517110   430 raft_consensus.cc:2243] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.517483   430 raft_consensus.cc:2272] T e5069694830e4c008c80b665f8b39663 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.519066   430 tablet_replica.cc:333] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3: stopping tablet replica
I20260709 12:59:52.519564   430 raft_consensus.cc:2243] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.519907   430 raft_consensus.cc:2272] T 68268e4726754bbbb2a83694ce99b614 P 5d7e810263a74451bc21be0d1cca16f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.521667   430 tablet_replica.cc:333] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3: stopping tablet replica
I20260709 12:59:52.522100   430 raft_consensus.cc:2243] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:52.522771   430 raft_consensus.cc:2272] T 2e03e98af66142faaabbf0d004019bc9 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.524313   430 tablet_replica.cc:333] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3: stopping tablet replica
I20260709 12:59:52.524717   430 raft_consensus.cc:2243] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.525023   430 raft_consensus.cc:2272] T 487478c6fb7b42e3937711a152196a3e P 5d7e810263a74451bc21be0d1cca16f3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.526714   430 tablet_replica.cc:333] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3: stopping tablet replica
I20260709 12:59:52.527117   430 raft_consensus.cc:2243] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:52.527868   430 raft_consensus.cc:2272] T b9684fbb252447e5bddb9393e414f44d P 5d7e810263a74451bc21be0d1cca16f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.529415   430 tablet_replica.cc:333] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3: stopping tablet replica
I20260709 12:59:52.529832   430 raft_consensus.cc:2243] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:52.530431   430 raft_consensus.cc:2272] T e15c377eeba84ca8b66f64a82c06b7ca P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.532202   430 tablet_replica.cc:333] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3: stopping tablet replica
I20260709 12:59:52.532603   430 raft_consensus.cc:2243] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:52.533231   430 raft_consensus.cc:2272] T fc635d4f8ae0487ea65c5110409936b9 P 5d7e810263a74451bc21be0d1cca16f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.561980   430 tablet_server.cc:196] TabletServer@127.0.107.129:0 shutdown complete.
I20260709 12:59:52.580407   430 tablet_server.cc:179] TabletServer@127.0.107.130:0 shutting down...
I20260709 12:59:52.608520   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:52.609258   430 tablet_replica.cc:333] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294: stopping tablet replica
I20260709 12:59:52.610131   430 raft_consensus.cc:2243] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:52.611099   430 raft_consensus.cc:2272] T fc8351b794944e2cb64d166f2fe4412d P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.613219   430 tablet_replica.cc:333] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294: stopping tablet replica
I20260709 12:59:52.613641   430 raft_consensus.cc:2243] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.614038   430 raft_consensus.cc:2272] T fd06b47b0f9c4051be4b9c4e927807a1 P 99ad2a1622404b68aa587cb8bba62294 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.616076   430 tablet_replica.cc:333] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294: stopping tablet replica
I20260709 12:59:52.616539   430 raft_consensus.cc:2243] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.616886   430 raft_consensus.cc:2272] T 756e5db4632b4e6db5f7d6ff21909c7a P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.618422   430 tablet_replica.cc:333] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294: stopping tablet replica
I20260709 12:59:52.618857   430 raft_consensus.cc:2243] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:52.619565   430 raft_consensus.cc:2272] T e5069694830e4c008c80b665f8b39663 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.621145   430 tablet_replica.cc:333] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294: stopping tablet replica
I20260709 12:59:52.621559   430 raft_consensus.cc:2243] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.621934   430 raft_consensus.cc:2272] T 487478c6fb7b42e3937711a152196a3e P 99ad2a1622404b68aa587cb8bba62294 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.624015   430 tablet_replica.cc:333] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294: stopping tablet replica
I20260709 12:59:52.624469   430 raft_consensus.cc:2243] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.624827   430 raft_consensus.cc:2272] T b9684fbb252447e5bddb9393e414f44d P 99ad2a1622404b68aa587cb8bba62294 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.626330   430 tablet_replica.cc:333] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294: stopping tablet replica
I20260709 12:59:52.626722   430 raft_consensus.cc:2243] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.627079   430 raft_consensus.cc:2272] T e15c377eeba84ca8b66f64a82c06b7ca P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.628623   430 tablet_replica.cc:333] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294: stopping tablet replica
I20260709 12:59:52.629011   430 raft_consensus.cc:2243] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.629379   430 raft_consensus.cc:2272] T fc635d4f8ae0487ea65c5110409936b9 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.630764   430 tablet_replica.cc:333] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294: stopping tablet replica
I20260709 12:59:52.631151   430 raft_consensus.cc:2243] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:52.631837   430 raft_consensus.cc:2272] T 68268e4726754bbbb2a83694ce99b614 P 99ad2a1622404b68aa587cb8bba62294 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.633541   430 tablet_replica.cc:333] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294: stopping tablet replica
I20260709 12:59:52.633929   430 raft_consensus.cc:2243] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.634255   430 raft_consensus.cc:2272] T 2e03e98af66142faaabbf0d004019bc9 P 99ad2a1622404b68aa587cb8bba62294 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.663341   430 tablet_server.cc:196] TabletServer@127.0.107.130:0 shutdown complete.
I20260709 12:59:52.682466   430 tablet_server.cc:179] TabletServer@127.0.107.131:0 shutting down...
I20260709 12:59:52.706470   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:59:52.706514  1178 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.129:33449: connect: Connection refused (error 111) [suppressed 6 similar messages]
I20260709 12:59:52.707201   430 tablet_replica.cc:333] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3: stopping tablet replica
I20260709 12:59:52.707824   430 raft_consensus.cc:2243] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.708308   430 raft_consensus.cc:2272] T fc8351b794944e2cb64d166f2fe4412d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.710983   430 tablet_replica.cc:333] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3: stopping tablet replica
W20260709 12:59:52.710996  1178 consensus_peers.cc:597] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 -> Peer 5d7e810263a74451bc21be0d1cca16f3 (127.0.107.129:33449): Couldn't send request to peer 5d7e810263a74451bc21be0d1cca16f3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:33449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:52.711789   430 raft_consensus.cc:2243] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:52.712453   430 raft_consensus.cc:2272] T 756e5db4632b4e6db5f7d6ff21909c7a P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.713981   430 tablet_replica.cc:333] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3: stopping tablet replica
I20260709 12:59:52.714424   430 raft_consensus.cc:2243] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.714751   430 raft_consensus.cc:2272] T e5069694830e4c008c80b665f8b39663 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.716321   430 tablet_replica.cc:333] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3: stopping tablet replica
I20260709 12:59:52.716737   430 raft_consensus.cc:2243] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.717069   430 raft_consensus.cc:2272] T 2e03e98af66142faaabbf0d004019bc9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.718482   430 tablet_replica.cc:333] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3: stopping tablet replica
I20260709 12:59:52.718892   430 raft_consensus.cc:2243] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.719249   430 raft_consensus.cc:2272] T 68268e4726754bbbb2a83694ce99b614 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.721226   430 tablet_replica.cc:333] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3: stopping tablet replica
I20260709 12:59:52.721630   430 raft_consensus.cc:2243] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:59:52.722205   430 raft_consensus.cc:2272] T 487478c6fb7b42e3937711a152196a3e P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.723875   430 tablet_replica.cc:333] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3: stopping tablet replica
I20260709 12:59:52.724288   430 raft_consensus.cc:2243] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.724606   430 raft_consensus.cc:2272] T b9684fbb252447e5bddb9393e414f44d P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.725955   430 tablet_replica.cc:333] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3: stopping tablet replica
I20260709 12:59:52.726341   430 raft_consensus.cc:2243] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.726667   430 raft_consensus.cc:2272] T fc635d4f8ae0487ea65c5110409936b9 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.728266   430 tablet_replica.cc:333] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3: stopping tablet replica
I20260709 12:59:52.728641   430 raft_consensus.cc:2243] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:52.728972   430 raft_consensus.cc:2272] T e15c377eeba84ca8b66f64a82c06b7ca P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.730777   430 tablet_replica.cc:333] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3: stopping tablet replica
I20260709 12:59:52.731281   430 raft_consensus.cc:2243] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:52.731925   430 raft_consensus.cc:2272] T fd06b47b0f9c4051be4b9c4e927807a1 P eecae620ab1d4b5cbcc1e5f1d22b76b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.759334   430 tablet_server.cc:196] TabletServer@127.0.107.131:0 shutdown complete.
I20260709 12:59:52.776547   430 master.cc:562] Master@127.0.107.190:40521 shutting down...
I20260709 12:59:52.802063   430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:52.802608   430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:52.802949   430 tablet_replica.cc:333] T 00000000000000000000000000000000 P 82240dafe3dd4745b335ab015051359b: stopping tablet replica
I20260709 12:59:52.822798   430 master.cc:584] Master@127.0.107.190:40521 shutdown complete.
5d7e810263a74451bc21be0d1cca16f3  5
99ad2a1622404b68aa587cb8bba62294  4
eecae620ab1d4b5cbcc1e5f1d22b76b3  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10628 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:59:52.861948   430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.190:37205
I20260709 12:59:52.862991   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:52.869045  1422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:52.869059  1421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:52.869256  1424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:52.870900   430 server_base.cc:1061] running on GCE node
I20260709 12:59:52.871713   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:52.871889   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:52.872071   430 hybrid_clock.cc:648] HybridClock initialized: now 1783601992872057 us; error 0 us; skew 500 ppm
I20260709 12:59:52.872620   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:52.875003   430 webserver.cc:533] Webserver started at http://127.0.107.190:35001/ using document root <none> and password file <none>
I20260709 12:59:52.875517   430 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:52.875698   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:52.875993   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:52.877061   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/master-0-root/instance:
uuid: "ee9debc877d548cb9a1a1187cf0a2dcd"
format_stamp: "Formatted at 2026-07-09 12:59:52 on dist-test-slave-th5x"
I20260709 12:59:52.881234   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:59:52.884459  1429 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:52.885162   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:59:52.885454   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/master-0-root
uuid: "ee9debc877d548cb9a1a1187cf0a2dcd"
format_stamp: "Formatted at 2026-07-09 12:59:52 on dist-test-slave-th5x"
I20260709 12:59:52.885721   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:52.902733   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:52.904026   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:52.942893   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.190:37205
I20260709 12:59:52.942999  1480 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.190:37205 every 8 connection(s)
I20260709 12:59:52.946888  1481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:52.956401  1481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Bootstrap starting.
I20260709 12:59:52.960868  1481 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:52.964994  1481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: No bootstrap required, opened a new log
I20260709 12:59:52.967085  1481 raft_consensus.cc:359] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee9debc877d548cb9a1a1187cf0a2dcd" member_type: VOTER }
I20260709 12:59:52.967507  1481 raft_consensus.cc:385] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:52.967713  1481 raft_consensus.cc:740] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9debc877d548cb9a1a1187cf0a2dcd, State: Initialized, Role: FOLLOWER
I20260709 12:59:52.968286  1481 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee9debc877d548cb9a1a1187cf0a2dcd" member_type: VOTER }
I20260709 12:59:52.968704  1481 raft_consensus.cc:399] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:52.968890  1481 raft_consensus.cc:493] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:52.969115  1481 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:52.973116  1481 raft_consensus.cc:515] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee9debc877d548cb9a1a1187cf0a2dcd" member_type: VOTER }
I20260709 12:59:52.973668  1481 leader_election.cc:304] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee9debc877d548cb9a1a1187cf0a2dcd; no voters: 
I20260709 12:59:52.974730  1481 leader_election.cc:290] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:52.975039  1484 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:52.976327  1484 raft_consensus.cc:697] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [term 1 LEADER]: Becoming Leader. State: Replica: ee9debc877d548cb9a1a1187cf0a2dcd, State: Running, Role: LEADER
I20260709 12:59:52.976979  1484 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee9debc877d548cb9a1a1187cf0a2dcd" member_type: VOTER }
I20260709 12:59:52.977605  1481 sys_catalog.cc:565] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:52.981357  1485 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee9debc877d548cb9a1a1187cf0a2dcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee9debc877d548cb9a1a1187cf0a2dcd" member_type: VOTER } }
I20260709 12:59:52.982179  1485 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:52.981930  1486 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee9debc877d548cb9a1a1187cf0a2dcd. Latest consensus state: current_term: 1 leader_uuid: "ee9debc877d548cb9a1a1187cf0a2dcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee9debc877d548cb9a1a1187cf0a2dcd" member_type: VOTER } }
I20260709 12:59:52.982739  1486 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:52.989401  1491 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:52.994112  1491 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:52.995200   430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:53.003005  1491 catalog_manager.cc:1383] Generated new cluster ID: da34c09e95e647a5aac5fea49676c493
I20260709 12:59:53.003306  1491 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:53.027783  1491 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:53.029150  1491 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:53.042652  1491 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Generated new TSK 0
I20260709 12:59:53.043290  1491 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:53.062282   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:53.068447  1502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:53.069557  1503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:53.070883  1505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:53.071117   430 server_base.cc:1061] running on GCE node
I20260709 12:59:53.071997   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:53.072209   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:53.072397   430 hybrid_clock.cc:648] HybridClock initialized: now 1783601993072383 us; error 0 us; skew 500 ppm
I20260709 12:59:53.072955   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:53.075675   430 webserver.cc:533] Webserver started at http://127.0.107.129:36345/ using document root <none> and password file <none>
I20260709 12:59:53.076164   430 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:53.076365   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:53.076634   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:53.077732   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/instance:
uuid: "44c8c572048a40b1a5e71865068ed1bb"
format_stamp: "Formatted at 2026-07-09 12:59:53 on dist-test-slave-th5x"
I20260709 12:59:53.082226   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:59:53.085413  1510 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:53.086179   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:59:53.086512   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root
uuid: "44c8c572048a40b1a5e71865068ed1bb"
format_stamp: "Formatted at 2026-07-09 12:59:53 on dist-test-slave-th5x"
I20260709 12:59:53.086822   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:53.117568   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:53.118772   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:53.120231   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:53.122445   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:53.122663   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:53.122900   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:53.123086   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:53.162799   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.129:46597
I20260709 12:59:53.162891  1572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.129:46597 every 8 connection(s)
I20260709 12:59:53.167801   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:53.174501  1577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:53.175779  1578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:53.179032   430 server_base.cc:1061] running on GCE node
W20260709 12:59:53.179054  1580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:53.180553   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:53.180730   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:53.180871   430 hybrid_clock.cc:648] HybridClock initialized: now 1783601993180859 us; error 0 us; skew 500 ppm
I20260709 12:59:53.181349   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:53.184275   430 webserver.cc:533] Webserver started at http://127.0.107.130:38125/ using document root <none> and password file <none>
I20260709 12:59:53.184780   430 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:53.185055   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:53.185362   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:53.186187  1573 heartbeater.cc:344] Connected to a master server at 127.0.107.190:37205
I20260709 12:59:53.186563  1573 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:53.186641   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/instance:
uuid: "27308aae2ef347ccba1b27e7f6f04334"
format_stamp: "Formatted at 2026-07-09 12:59:53 on dist-test-slave-th5x"
I20260709 12:59:53.187336  1573 heartbeater.cc:507] Master 127.0.107.190:37205 requested a full tablet report, sending...
I20260709 12:59:53.189495  1446 ts_manager.cc:194] Registered new tserver with Master: 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 12:59:53.191208  1446 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52808
I20260709 12:59:53.191815   430 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:59:53.195288  1585 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:53.196183   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:59:53.196436   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root
uuid: "27308aae2ef347ccba1b27e7f6f04334"
format_stamp: "Formatted at 2026-07-09 12:59:53 on dist-test-slave-th5x"
I20260709 12:59:53.196668   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:53.212469   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:53.213584   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:53.214926   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:53.217110   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:53.217298   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:53.217587   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:53.217736   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:53.256894   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.130:46095
I20260709 12:59:53.256994  1647 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.130:46095 every 8 connection(s)
I20260709 12:59:53.261328   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:53.268431  1651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:53.270876  1652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:53.273819   430 server_base.cc:1061] running on GCE node
W20260709 12:59:53.274585  1654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:53.274771  1648 heartbeater.cc:344] Connected to a master server at 127.0.107.190:37205
I20260709 12:59:53.275204  1648 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:53.275610   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:53.275801   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:53.276024   430 hybrid_clock.cc:648] HybridClock initialized: now 1783601993275990 us; error 0 us; skew 500 ppm
I20260709 12:59:53.276041  1648 heartbeater.cc:507] Master 127.0.107.190:37205 requested a full tablet report, sending...
I20260709 12:59:53.276695   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:53.278060  1446 ts_manager.cc:194] Registered new tserver with Master: 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:53.279399   430 webserver.cc:533] Webserver started at http://127.0.107.131:44613/ using document root <none> and password file <none>
I20260709 12:59:53.279690  1446 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52824
I20260709 12:59:53.280025   430 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:53.280272   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:53.280541   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:53.282027   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/instance:
uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
format_stamp: "Formatted at 2026-07-09 12:59:53 on dist-test-slave-th5x"
I20260709 12:59:53.286381   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:59:53.289812  1659 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:53.290580   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:59:53.290865   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root
uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
format_stamp: "Formatted at 2026-07-09 12:59:53 on dist-test-slave-th5x"
I20260709 12:59:53.291175   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:53.314318   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:53.315573   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:53.317011   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:53.319154   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:53.319380   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:53.319640   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:53.319834   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:53.360685   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.131:43987
I20260709 12:59:53.360852  1721 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.131:43987 every 8 connection(s)
I20260709 12:59:53.374545  1722 heartbeater.cc:344] Connected to a master server at 127.0.107.190:37205
I20260709 12:59:53.374887  1722 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:53.375713  1722 heartbeater.cc:507] Master 127.0.107.190:37205 requested a full tablet report, sending...
I20260709 12:59:53.377712  1446 ts_manager.cc:194] Registered new tserver with Master: c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:53.378728   430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01469252s
I20260709 12:59:53.379506  1446 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52838
I20260709 12:59:53.406512  1446 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52844:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:53.412757  1446 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:53.615052  1686 tablet_service.cc:1511] Processing CreateTablet for tablet e4abaeaa789c4d7b9da036c18751f9b6 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:59:53.615052  1687 tablet_service.cc:1511] Processing CreateTablet for tablet 8b77299e14b04383b105cbae0697fbca (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:59:53.616639  1687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b77299e14b04383b105cbae0697fbca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.617273  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4abaeaa789c4d7b9da036c18751f9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.620890  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 1352a2bbd594477385f629ba7222a83f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:59:53.622195  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1352a2bbd594477385f629ba7222a83f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.625860  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 10a17adb150f4450b68adcffc1c3d655 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:59:53.627166  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a17adb150f4450b68adcffc1c3d655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.630657  1538 tablet_service.cc:1511] Processing CreateTablet for tablet 8b77299e14b04383b105cbae0697fbca (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:59:53.633247  1538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b77299e14b04383b105cbae0697fbca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.632969  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 1352a2bbd594477385f629ba7222a83f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:59:53.634227  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1352a2bbd594477385f629ba7222a83f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.631863  1537 tablet_service.cc:1511] Processing CreateTablet for tablet e4abaeaa789c4d7b9da036c18751f9b6 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:59:53.635628  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4abaeaa789c4d7b9da036c18751f9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.631862  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 10a17adb150f4450b68adcffc1c3d655 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:59:53.639484  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a17adb150f4450b68adcffc1c3d655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.640774  1737 tablet_bootstrap.cc:492] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:53.646749  1534 tablet_service.cc:1511] Processing CreateTablet for tablet c8493cdac98b4860b0ddbe729b652ee9 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:59:53.648167  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8493cdac98b4860b0ddbe729b652ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.649452  1686 tablet_service.cc:1511] Processing CreateTablet for tablet c8493cdac98b4860b0ddbe729b652ee9 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:59:53.650712  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8493cdac98b4860b0ddbe729b652ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.651953  1737 tablet_bootstrap.cc:654] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:53.658335  1533 tablet_service.cc:1511] Processing CreateTablet for tablet c033fce18c634feb995adf2f2422308c (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:59:53.659754  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c033fce18c634feb995adf2f2422308c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.662539  1532 tablet_service.cc:1511] Processing CreateTablet for tablet e60c013c7e324514aef1674561db1cc6 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:59:53.663921  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60c013c7e324514aef1674561db1cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.679873  1687 tablet_service.cc:1511] Processing CreateTablet for tablet c033fce18c634feb995adf2f2422308c (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:59:53.681190  1687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c033fce18c634feb995adf2f2422308c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.680928  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 94cdee269ec946a69f6c078885e844b0 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:59:53.682210  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cdee269ec946a69f6c078885e844b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.683068  1613 tablet_service.cc:1511] Processing CreateTablet for tablet 8b77299e14b04383b105cbae0697fbca (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:59:53.684368  1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b77299e14b04383b105cbae0697fbca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.684577  1612 tablet_service.cc:1511] Processing CreateTablet for tablet e4abaeaa789c4d7b9da036c18751f9b6 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:59:53.685984  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4abaeaa789c4d7b9da036c18751f9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.688311  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 1352a2bbd594477385f629ba7222a83f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:59:53.690176  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1352a2bbd594477385f629ba7222a83f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.692991  1609 tablet_service.cc:1511] Processing CreateTablet for tablet c8493cdac98b4860b0ddbe729b652ee9 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:59:53.697306  1607 tablet_service.cc:1511] Processing CreateTablet for tablet e60c013c7e324514aef1674561db1cc6 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:59:53.698670  1685 tablet_service.cc:1511] Processing CreateTablet for tablet e60c013c7e324514aef1674561db1cc6 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:59:53.700286  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60c013c7e324514aef1674561db1cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.700800  1608 tablet_service.cc:1511] Processing CreateTablet for tablet c033fce18c634feb995adf2f2422308c (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:59:53.703886  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 10a17adb150f4450b68adcffc1c3d655 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:59:53.694569  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8493cdac98b4860b0ddbe729b652ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.716734  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60c013c7e324514aef1674561db1cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.720001  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c033fce18c634feb995adf2f2422308c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.726931  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a17adb150f4450b68adcffc1c3d655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.733958  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 94cdee269ec946a69f6c078885e844b0 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:59:53.735327  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cdee269ec946a69f6c078885e844b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.741086  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 94cdee269ec946a69f6c078885e844b0 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:59:53.742338  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94cdee269ec946a69f6c078885e844b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.752791  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 8820554e3d9a4662b150408d84019889 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:59:53.754647  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8820554e3d9a4662b150408d84019889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.755529  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 8820554e3d9a4662b150408d84019889 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:59:53.756831  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8820554e3d9a4662b150408d84019889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.766798  1737 tablet_bootstrap.cc:492] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:53.767560  1737 ts_tablet_manager.cc:1403] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.017s
I20260709 12:59:53.772535  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 5886b3175b9d44069e5ba1077b09a28f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:59:53.775759  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5886b3175b9d44069e5ba1077b09a28f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.775355  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 5886b3175b9d44069e5ba1077b09a28f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:59:53.776834  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5886b3175b9d44069e5ba1077b09a28f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.779176  1737 raft_consensus.cc:359] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:53.780197  1737 raft_consensus.cc:385] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:53.780511  1737 raft_consensus.cc:740] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:53.781239  1737 consensus_queue.cc:260] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:53.785948  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 5886b3175b9d44069e5ba1077b09a28f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:59:53.788187  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5886b3175b9d44069e5ba1077b09a28f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.796032  1537 tablet_service.cc:1511] Processing CreateTablet for tablet ea89d024b77243d097fd08bd251c9d5e (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:59:53.797369  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea89d024b77243d097fd08bd251c9d5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.798784  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 8820554e3d9a4662b150408d84019889 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:59:53.800607  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8820554e3d9a4662b150408d84019889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.817931  1739 tablet_bootstrap.cc:492] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:53.829527  1737 ts_tablet_manager.cc:1434] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 12:59:53.830324  1722 heartbeater.cc:499] Master 127.0.107.190:37205 was elected leader, sending a full tablet report...
I20260709 12:59:53.830655  1737 tablet_bootstrap.cc:492] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:53.851570  1604 tablet_service.cc:1511] Processing CreateTablet for tablet ea89d024b77243d097fd08bd251c9d5e (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:59:53.852833  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea89d024b77243d097fd08bd251c9d5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.862082  1683 tablet_service.cc:1511] Processing CreateTablet for tablet ea89d024b77243d097fd08bd251c9d5e (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:59:53.863778  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 22659363e36446f9a1b47d2383b5621f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:59:53.864733  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea89d024b77243d097fd08bd251c9d5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.867105  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22659363e36446f9a1b47d2383b5621f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.865463  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 22659363e36446f9a1b47d2383b5621f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:59:53.877383  1737 tablet_bootstrap.cc:654] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:53.879647  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 489da014ead84cbe9a9b46b9196c3356 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:59:53.884526  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 489da014ead84cbe9a9b46b9196c3356 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:59:53.886610  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489da014ead84cbe9a9b46b9196c3356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.887395  1538 tablet_service.cc:1511] Processing CreateTablet for tablet 77eb0c0355254cf592e70feb5035e50f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:59:53.888036  1739 tablet_bootstrap.cc:654] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:53.888640  1538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77eb0c0355254cf592e70feb5035e50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.893730  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 77eb0c0355254cf592e70feb5035e50f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:59:53.895874  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22659363e36446f9a1b47d2383b5621f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.895993  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 22659363e36446f9a1b47d2383b5621f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:59:53.896231  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 11a34da7993e4fee9ff4fc1266a6af38 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:59:53.897255  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22659363e36446f9a1b47d2383b5621f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.897454  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a34da7993e4fee9ff4fc1266a6af38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.899998  1535 tablet_service.cc:1511] Processing CreateTablet for tablet debbced49eac4fa895623a8e492b9ce3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:59:53.901232  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debbced49eac4fa895623a8e492b9ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.905444  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 11a34da7993e4fee9ff4fc1266a6af38 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:59:53.907320  1680 tablet_service.cc:1511] Processing CreateTablet for tablet debbced49eac4fa895623a8e492b9ce3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:59:53.912868  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2ae0506db549df9409cfeceb2f3e3b (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:59:53.913859  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 11a34da7993e4fee9ff4fc1266a6af38 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:59:53.914012  1606 tablet_service.cc:1511] Processing CreateTablet for tablet debbced49eac4fa895623a8e492b9ce3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:59:53.915153  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a34da7993e4fee9ff4fc1266a6af38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.914264  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2ae0506db549df9409cfeceb2f3e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.916497  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debbced49eac4fa895623a8e492b9ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.917284  1740 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.917093  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2ae0506db549df9409cfeceb2f3e3b (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:59:53.917752  1740 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:53.918525  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2ae0506db549df9409cfeceb2f3e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.924113  1536 tablet_service.cc:1511] Processing CreateTablet for tablet a8819ed65aa948c9aa7a571bef50ca38 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:59:53.923668  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2ae0506db549df9409cfeceb2f3e3b (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:59:53.924770  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77eb0c0355254cf592e70feb5035e50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.926971  1605 tablet_service.cc:1511] Processing CreateTablet for tablet a8819ed65aa948c9aa7a571bef50ca38 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:59:53.928642  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8819ed65aa948c9aa7a571bef50ca38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.929153  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489da014ead84cbe9a9b46b9196c3356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.931746  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a34da7993e4fee9ff4fc1266a6af38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.882627  1687 tablet_service.cc:1511] Processing CreateTablet for tablet a8819ed65aa948c9aa7a571bef50ca38 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:59:53.944231  1741 tablet_bootstrap.cc:492] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:53.945384  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8819ed65aa948c9aa7a571bef50ca38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.945068  1607 tablet_service.cc:1511] Processing CreateTablet for tablet c3006951ad004b6b87217fff5303a9ab (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:59:53.945061  1531 tablet_service.cc:1511] Processing CreateTablet for tablet c3006951ad004b6b87217fff5303a9ab (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:59:53.947301  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3006951ad004b6b87217fff5303a9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.948339  1613 tablet_service.cc:1511] Processing CreateTablet for tablet 77eb0c0355254cf592e70feb5035e50f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:59:53.955582  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debbced49eac4fa895623a8e492b9ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.956414  1687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8819ed65aa948c9aa7a571bef50ca38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.957916  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2ae0506db549df9409cfeceb2f3e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.958870  1608 tablet_service.cc:1511] Processing CreateTablet for tablet 489da014ead84cbe9a9b46b9196c3356 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:59:53.939051  1740 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:53.980594  1737 tablet_bootstrap.cc:492] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:53.981135  1737 ts_tablet_manager.cc:1403] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.151s	user 0.012s	sys 0.006s
W20260709 12:59:53.989660  1494 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:53.990314  1679 tablet_service.cc:1511] Processing CreateTablet for tablet c3006951ad004b6b87217fff5303a9ab (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:59:53.991717  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3006951ad004b6b87217fff5303a9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:53.968789  1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77eb0c0355254cf592e70feb5035e50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.002872  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3006951ad004b6b87217fff5303a9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.002799  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 07ae750f29dc4aceb08544eb94e8e716 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:59:54.004227  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ae750f29dc4aceb08544eb94e8e716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.005558  1739 tablet_bootstrap.cc:492] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:54.006042  1739 ts_tablet_manager.cc:1403] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.188s	user 0.011s	sys 0.013s
I20260709 12:59:54.008049  1737 raft_consensus.cc:359] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } }
I20260709 12:59:54.008781  1737 raft_consensus.cc:385] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.014895  1741 tablet_bootstrap.cc:654] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.015663  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489da014ead84cbe9a9b46b9196c3356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.041460  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 07ae750f29dc4aceb08544eb94e8e716 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:59:54.043015  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ae750f29dc4aceb08544eb94e8e716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.009057  1737 raft_consensus.cc:740] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.049310  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 12:59:54.050940  1663 leader_election.cc:343] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:54.057055  1535 tablet_service.cc:1511] Processing CreateTablet for tablet a9e9b2c19f1f4f8a9f31fc7f721bf363 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:59:54.058351  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e9b2c19f1f4f8a9f31fc7f721bf363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.057055  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 07ae750f29dc4aceb08544eb94e8e716 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:59:54.064730  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ae750f29dc4aceb08544eb94e8e716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.075119  1739 raft_consensus.cc:359] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.075868  1739 raft_consensus.cc:385] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.076174  1739 raft_consensus.cc:740] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.076936  1739 consensus_queue.cc:260] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.076943  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 7a83a11e6c2348918b88fe74b7ee7361 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:59:54.080235  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a83a11e6c2348918b88fe74b7ee7361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.047886  1737 consensus_queue.cc:260] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } }
I20260709 12:59:54.094956  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 7a83a11e6c2348918b88fe74b7ee7361 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:59:54.096223  1737 ts_tablet_manager.cc:1434] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.115s	user 0.006s	sys 0.001s
I20260709 12:59:54.096254  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a83a11e6c2348918b88fe74b7ee7361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.098708  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 7a83a11e6c2348918b88fe74b7ee7361 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:59:54.100003  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a83a11e6c2348918b88fe74b7ee7361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.103639  1682 tablet_service.cc:1511] Processing CreateTablet for tablet a9e9b2c19f1f4f8a9f31fc7f721bf363 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:59:54.104934  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e9b2c19f1f4f8a9f31fc7f721bf363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.109869  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 58998217db5f42c08255f6a6a86b3dae (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:59:54.111161  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58998217db5f42c08255f6a6a86b3dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.097301  1737 tablet_bootstrap.cc:492] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:54.124961  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 58998217db5f42c08255f6a6a86b3dae (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:59:54.133193  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 33125bfca16d4902a09564d1eef1a47f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:59:54.134204  1741 tablet_bootstrap.cc:492] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:54.134606  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33125bfca16d4902a09564d1eef1a47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.134843  1741 ts_tablet_manager.cc:1403] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.260s	user 0.011s	sys 0.011s
I20260709 12:59:54.133569  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58998217db5f42c08255f6a6a86b3dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.141595  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 12:59:54.143265  1661 leader_election.cc:343] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:54.144004  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 12:59:54.143778  1613 tablet_service.cc:1511] Processing CreateTablet for tablet a9e9b2c19f1f4f8a9f31fc7f721bf363 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:59:54.145136  1740 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:54.145689  1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e9b2c19f1f4f8a9f31fc7f721bf363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.138870  1741 raft_consensus.cc:359] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.150183  1573 heartbeater.cc:499] Master 127.0.107.190:37205 was elected leader, sending a full tablet report...
I20260709 12:59:54.150576  1739 ts_tablet_manager.cc:1434] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.144s	user 0.022s	sys 0.017s
I20260709 12:59:54.150847  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 58998217db5f42c08255f6a6a86b3dae (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:59:54.151579  1739 tablet_bootstrap.cc:492] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:54.152093  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58998217db5f42c08255f6a6a86b3dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.157867  1739 tablet_bootstrap.cc:654] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.169414  1608 tablet_service.cc:1511] Processing CreateTablet for tablet 33125bfca16d4902a09564d1eef1a47f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:59:54.170831  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33125bfca16d4902a09564d1eef1a47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.171734  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 33125bfca16d4902a09564d1eef1a47f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:59:54.172937  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33125bfca16d4902a09564d1eef1a47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.149786  1741 raft_consensus.cc:385] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.175740  1741 raft_consensus.cc:740] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.177992  1741 consensus_queue.cc:260] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.179543  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5c9f43dc704dd09f6c603fa4ea346c (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:59:54.180858  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5c9f43dc704dd09f6c603fa4ea346c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.192795  1740 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.193332  1740 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } }
I20260709 12:59:54.195320  1740 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 12:59:54.196586  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5c9f43dc704dd09f6c603fa4ea346c (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:59:54.196885  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:54.200085  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5c9f43dc704dd09f6c603fa4ea346c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:54.200897  1661 leader_election.cc:343] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:54.197515  1737 tablet_bootstrap.cc:654] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.198418  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 12:59:54.202450  1663 leader_election.cc:343] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:54.202896  1663 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 12:59:54.203987  1740 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:54.210223  1739 tablet_bootstrap.cc:492] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:54.210685  1739 ts_tablet_manager.cc:1403] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.021s
I20260709 12:59:54.213435  1739 raft_consensus.cc:359] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.214140  1739 raft_consensus.cc:385] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.214438  1739 raft_consensus.cc:740] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.214802  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 953db44baef24f55a28e65ff051866d1 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:59:54.216409  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953db44baef24f55a28e65ff051866d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.219717  1737 tablet_bootstrap.cc:492] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:54.220201  1737 ts_tablet_manager.cc:1403] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.123s	user 0.007s	sys 0.008s
I20260709 12:59:54.220491  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5c9f43dc704dd09f6c603fa4ea346c (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:59:54.221776  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5c9f43dc704dd09f6c603fa4ea346c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.232440  1648 heartbeater.cc:499] Master 127.0.107.190:37205 was elected leader, sending a full tablet report...
I20260709 12:59:54.233881  1741 ts_tablet_manager.cc:1434] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.099s	user 0.020s	sys 0.000s
I20260709 12:59:54.235020  1741 tablet_bootstrap.cc:492] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:54.223057  1737 raft_consensus.cc:359] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.217397  1739 consensus_queue.cc:260] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.240679  1739 ts_tablet_manager.cc:1434] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.030s	user 0.001s	sys 0.006s
I20260709 12:59:54.241456  1739 tablet_bootstrap.cc:492] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:54.243569  1737 raft_consensus.cc:385] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.243996  1737 raft_consensus.cc:740] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.247017  1741 tablet_bootstrap.cc:654] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.252147  1737 consensus_queue.cc:260] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.254666  1737 ts_tablet_manager.cc:1434] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:59:54.255707  1737 tablet_bootstrap.cc:492] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:54.258466  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 435d66c2e8e14e73af7cc63b8ce93e2d (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:59:54.247861  1739 tablet_bootstrap.cc:654] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.261216  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 953db44baef24f55a28e65ff051866d1 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:59:54.262274  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435d66c2e8e14e73af7cc63b8ce93e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.262495  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953db44baef24f55a28e65ff051866d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.264806  1535 tablet_service.cc:1511] Processing CreateTablet for tablet cecec9af1f82495390a4640f3927241f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:59:54.265298  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 435d66c2e8e14e73af7cc63b8ce93e2d (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:59:54.266165  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cecec9af1f82495390a4640f3927241f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.266661  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435d66c2e8e14e73af7cc63b8ce93e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.275034  1739 tablet_bootstrap.cc:492] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:54.275635  1739 ts_tablet_manager.cc:1403] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.005s
I20260709 12:59:54.277423  1737 tablet_bootstrap.cc:654] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.284133  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 953db44baef24f55a28e65ff051866d1 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:59:54.285395  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953db44baef24f55a28e65ff051866d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.278712  1739 raft_consensus.cc:359] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.286090  1739 raft_consensus.cc:385] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.286469  1739 raft_consensus.cc:740] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.287391  1739 consensus_queue.cc:260] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.282881  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 435d66c2e8e14e73af7cc63b8ce93e2d (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:59:54.289907  1739 ts_tablet_manager.cc:1434] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 12:59:54.290124  1749 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.290817  1749 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.291935  1739 tablet_bootstrap.cc:492] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:54.294128  1749 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:54.299902  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd2e8876bc642db9518e484c47f1ac3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:59:54.300673  1741 tablet_bootstrap.cc:492] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:54.301142  1741 ts_tablet_manager.cc:1403] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.000s
I20260709 12:59:54.301221  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd2e8876bc642db9518e484c47f1ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.304603  1531 tablet_service.cc:1511] Processing CreateTablet for tablet e4ba9e8bda7e4019b703c785aae4f0a3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:59:54.305874  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ba9e8bda7e4019b703c785aae4f0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.306408  1741 raft_consensus.cc:359] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.307834  1741 raft_consensus.cc:385] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.308255  1741 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.309299  1741 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.321918  1741 ts_tablet_manager.cc:1434] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:59:54.322464  1737 tablet_bootstrap.cc:492] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:54.322868  1741 tablet_bootstrap.cc:492] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:54.322921  1737 ts_tablet_manager.cc:1403] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.000s
I20260709 12:59:54.323925  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba0a0cae5d54e9a85eed27fed785932 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:59:54.325767  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba0a0cae5d54e9a85eed27fed785932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.325878  1737 raft_consensus.cc:359] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.326750  1737 raft_consensus.cc:385] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.327059  1737 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.329207  1741 tablet_bootstrap.cc:654] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.338563  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435d66c2e8e14e73af7cc63b8ce93e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.340270  1608 tablet_service.cc:1511] Processing CreateTablet for tablet cecec9af1f82495390a4640f3927241f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:59:54.341557  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cecec9af1f82495390a4640f3927241f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.342615  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd2e8876bc642db9518e484c47f1ac3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:59:54.342730  1605 tablet_service.cc:1511] Processing CreateTablet for tablet e4ba9e8bda7e4019b703c785aae4f0a3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:59:54.344342  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd2e8876bc642db9518e484c47f1ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.345876  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ba9e8bda7e4019b703c785aae4f0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.360705  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba0a0cae5d54e9a85eed27fed785932 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:59:54.362555  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba0a0cae5d54e9a85eed27fed785932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.392527  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 7bd2e8876bc642db9518e484c47f1ac3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:59:54.393930  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd2e8876bc642db9518e484c47f1ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.394253  1747 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.394742  1747 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.392457  1680 tablet_service.cc:1511] Processing CreateTablet for tablet cecec9af1f82495390a4640f3927241f (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:59:54.396852  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cecec9af1f82495390a4640f3927241f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.397812  1747 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:54.407549  1747 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.408028  1747 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.409310  1739 tablet_bootstrap.cc:654] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.410120  1747 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:54.410838  1686 tablet_service.cc:1511] Processing CreateTablet for tablet e4ba9e8bda7e4019b703c785aae4f0a3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 12:59:54.411590  1431 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 54413us
I20260709 12:59:54.412135  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ba9e8bda7e4019b703c785aae4f0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.412668  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba0a0cae5d54e9a85eed27fed785932 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:59:54.413872  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba0a0cae5d54e9a85eed27fed785932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.400311  1737 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.439855  1747 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.440579  1737 ts_tablet_manager.cc:1434] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.117s	user 0.011s	sys 0.000s
I20260709 12:59:54.440364  1747 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.441552  1737 tablet_bootstrap.cc:492] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:54.441442  1535 tablet_service.cc:1511] Processing CreateTablet for tablet ba1f748970c74ef290462d25b2975815 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:59:54.442282  1747 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:54.442649  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1f748970c74ef290462d25b2975815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.446332  1741 tablet_bootstrap.cc:492] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:54.446808  1741 ts_tablet_manager.cc:1403] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.004s
I20260709 12:59:54.456269  1613 tablet_service.cc:1511] Processing CreateTablet for tablet ba1f748970c74ef290462d25b2975815 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:59:54.456451  1741 raft_consensus.cc:359] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.457175  1741 raft_consensus.cc:385] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.462514  1741 raft_consensus.cc:740] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.463563  1741 consensus_queue.cc:260] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.467908  1741 ts_tablet_manager.cc:1434] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.004s
I20260709 12:59:54.481154  1737 tablet_bootstrap.cc:654] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.486159  1679 tablet_service.cc:1511] Processing CreateTablet for tablet ba1f748970c74ef290462d25b2975815 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:59:54.488258  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1f748970c74ef290462d25b2975815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.497517  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 76479b4c97fc4172991dba87da2718fc (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:59:54.500125  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 162dcbb665f341d1ab765403c5c3a480 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:59:54.501116  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 162dcbb665f341d1ab765403c5c3a480 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:59:54.503069  1687 tablet_service.cc:1511] Processing CreateTablet for tablet 76479b4c97fc4172991dba87da2718fc (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:59:54.504284  1687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76479b4c97fc4172991dba87da2718fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.506541  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:54.507191  1697 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:54.501520  1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1f748970c74ef290462d25b2975815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.508808  1586 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:54.509646  1749 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:54.509999  1749 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.510326  1749 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:54.501149  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 76479b4c97fc4172991dba87da2718fc (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:59:54.512791  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76479b4c97fc4172991dba87da2718fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.527557  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162dcbb665f341d1ab765403c5c3a480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.549222  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 162dcbb665f341d1ab765403c5c3a480 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:59:54.550091  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162dcbb665f341d1ab765403c5c3a480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.550486  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162dcbb665f341d1ab765403c5c3a480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.551755  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76479b4c97fc4172991dba87da2718fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.555394  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:54.555712  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:54.556737  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:54.559495  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 12:59:54.559999  1514 leader_election.cc:343] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:54.560127  1548 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
W20260709 12:59:54.560791  1514 leader_election.cc:343] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:54.568841  1739 tablet_bootstrap.cc:492] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:54.569361  1739 ts_tablet_manager.cc:1403] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.278s	user 0.022s	sys 0.049s
I20260709 12:59:54.572220  1739 raft_consensus.cc:359] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.572880  1737 tablet_bootstrap.cc:492] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:54.572909  1739 raft_consensus.cc:385] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.573382  1737 ts_tablet_manager.cc:1403] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.132s	user 0.014s	sys 0.014s
I20260709 12:59:54.573486  1739 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.574537  1739 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.576537  1739 ts_tablet_manager.cc:1434] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:59:54.576390  1737 raft_consensus.cc:359] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.577137  1737 raft_consensus.cc:385] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.577346  1739 tablet_bootstrap.cc:492] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:54.577446  1737 raft_consensus.cc:740] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.578274  1737 consensus_queue.cc:260] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.583398  1739 tablet_bootstrap.cc:654] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.585038  1749 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.591164  1621 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 1: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 12:59:54.592227  1749 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:54.593472  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:54.594030  1697 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:54.596661  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 4b189117895a48d4b813cda9e276c524 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:59:54.598593  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b189117895a48d4b813cda9e276c524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.604189  1741 tablet_bootstrap.cc:492] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:54.608690  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:54.609387  1696 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 12:59:54.610265  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:54.610448  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:54.610904  1548 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:54.611126  1695 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 12:59:54.612267  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:54.613206  1737 ts_tablet_manager.cc:1434] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:59:54.618887  1737 tablet_bootstrap.cc:492] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:54.620345  1548 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:54.624197  1739 tablet_bootstrap.cc:492] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:54.626536  1739 ts_tablet_manager.cc:1403] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.021s
I20260709 12:59:54.627140  1697 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:54.628484  1586 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:54.629402  1749 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:54.632175  1737 tablet_bootstrap.cc:654] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.631808  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 4b189117895a48d4b813cda9e276c524 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:59:54.633651  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b189117895a48d4b813cda9e276c524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.639070  1741 tablet_bootstrap.cc:654] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.629413  1739 raft_consensus.cc:359] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.639976  1739 raft_consensus.cc:385] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.640412  1739 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.641626  1739 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.645155  1739 ts_tablet_manager.cc:1434] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:59:54.646345  1739 tablet_bootstrap.cc:492] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:54.646484  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 4b189117895a48d4b813cda9e276c524 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:59:54.647660  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b189117895a48d4b813cda9e276c524. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.648830  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:54.653508  1747 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:54.649480  1737 tablet_bootstrap.cc:492] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:54.652351  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 63fd709a0b0d464193cd5a7eac0f5955 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:59:54.654067  1747 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.654577  1747 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:54.654768  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63fd709a0b0d464193cd5a7eac0f5955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.658002  1737 ts_tablet_manager.cc:1403] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.039s	user 0.005s	sys 0.014s
I20260709 12:59:54.661015  1737 raft_consensus.cc:359] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.664740  1749 raft_consensus.cc:697] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 12:59:54.665401  1747 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.671720  1737 raft_consensus.cc:385] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.672109  1737 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.670537  1613 tablet_service.cc:1511] Processing CreateTablet for tablet 63fd709a0b0d464193cd5a7eac0f5955 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:59:54.653822  1511 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:54.672210  1749 consensus_queue.cc:237] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.670279  1739 tablet_bootstrap.cc:654] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.673969  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:54.675606  1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63fd709a0b0d464193cd5a7eac0f5955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.673719  1747 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:54.677482  1747 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:54.677977  1747 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.678438  1747 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:54.678922  1514 leader_election.cc:343] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:54.678960  1737 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.681260  1737 ts_tablet_manager.cc:1434] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.023s	user 0.000s	sys 0.005s
I20260709 12:59:54.690205  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 63fd709a0b0d464193cd5a7eac0f5955 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:59:54.693753  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63fd709a0b0d464193cd5a7eac0f5955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.696760  1747 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.697404  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5fdc87ebdd414ab8baa34e162bc8c4 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:59:54.698668  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5fdc87ebdd414ab8baa34e162bc8c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.698527  1446 catalog_manager.cc:5697] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:54.700321  1747 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:54.702576  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:54.704075  1739 tablet_bootstrap.cc:492] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:54.704650  1739 ts_tablet_manager.cc:1403] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.011s
W20260709 12:59:54.705355  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 51603.1us
I20260709 12:59:54.706116  1511 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:54.706931  1747 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:54.707971  1514 leader_election.cc:343] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:54.708774  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:54.709414  1697 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:54.709911  1739 raft_consensus.cc:359] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } }
I20260709 12:59:54.711024  1739 raft_consensus.cc:385] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.708885  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:54.711809  1694 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:54.718319  1697 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 12:59:54.719295  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:54.719967  1737 tablet_bootstrap.cc:492] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:54.720063  1747 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:54.720329  1739 raft_consensus.cc:740] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.720572  1747 raft_consensus.cc:697] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 12:59:54.721921  1747 consensus_queue.cc:237] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.723623  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5fdc87ebdd414ab8baa34e162bc8c4 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:59:54.724138  1741 tablet_bootstrap.cc:492] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:54.724735  1741 ts_tablet_manager.cc:1403] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.121s	user 0.009s	sys 0.004s
I20260709 12:59:54.724974  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5fdc87ebdd414ab8baa34e162bc8c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.720927  1694 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 12:59:54.726955  1739 consensus_queue.cc:260] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } }
I20260709 12:59:54.732682  1739 ts_tablet_manager.cc:1434] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.003s
I20260709 12:59:54.733592  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5fdc87ebdd414ab8baa34e162bc8c4 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:59:54.727509  1741 raft_consensus.cc:359] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.735133  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5fdc87ebdd414ab8baa34e162bc8c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.735281  1741 raft_consensus.cc:385] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.735661  1741 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.736529  1741 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.739923  1741 ts_tablet_manager.cc:1434] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:59:54.741032  1741 tablet_bootstrap.cc:492] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:54.735095  1739 tablet_bootstrap.cc:492] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:54.746311  1511 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:54.747370  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 738a15ae04514d49969f3624caa73f45 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:59:54.748224  1767 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:54.748651  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738a15ae04514d49969f3624caa73f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.749616  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 738a15ae04514d49969f3624caa73f45 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:59:54.750890  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738a15ae04514d49969f3624caa73f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.762297  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 738a15ae04514d49969f3624caa73f45 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:59:54.763468  1740 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.764127  1740 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.765738  1739 tablet_bootstrap.cc:654] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.770357  1740 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:54.771692  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738a15ae04514d49969f3624caa73f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.771790  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:54.772418  1621 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:54.773816  1663 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:54.773949  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:54.774632  1740 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:54.775074  1740 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.774811  1548 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:54.775477  1740 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:54.775486  1749 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.776831  1749 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.780757  1749 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:54.772612  1444 catalog_manager.cc:5697] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:54.783113  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:54.783629  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 12:59:54.785084  1587 leader_election.cc:343] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:54.785715  1586 leader_election.cc:343] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:54.786118  1586 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:54.787155  1749 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:54.784943  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 236ab34afb704d93bb2705d3aadbe163 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:59:54.788475  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236ab34afb704d93bb2705d3aadbe163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.790126  1613 tablet_service.cc:1511] Processing CreateTablet for tablet 236ab34afb704d93bb2705d3aadbe163 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:59:54.791675  1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236ab34afb704d93bb2705d3aadbe163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.792501  1687 tablet_service.cc:1511] Processing CreateTablet for tablet 236ab34afb704d93bb2705d3aadbe163 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:59:54.781840  1767 raft_consensus.cc:697] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 12:59:54.794137  1687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236ab34afb704d93bb2705d3aadbe163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.794975  1767 consensus_queue.cc:237] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.810839  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 42d9e3317d944e97b0f09db457e476f3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:59:54.811213  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 42d9e3317d944e97b0f09db457e476f3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:59:54.812613  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42d9e3317d944e97b0f09db457e476f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.816633  1741 tablet_bootstrap.cc:654] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.821780  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42d9e3317d944e97b0f09db457e476f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.826687  1737 tablet_bootstrap.cc:654] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:54.829432  1739 tablet_bootstrap.cc:492] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:54.828785  1740 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.833228  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 8a63558e47a84017a3a62f52bb8cb3eb (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:59:54.836655  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 42d9e3317d944e97b0f09db457e476f3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:59:54.838012  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42d9e3317d944e97b0f09db457e476f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.841749  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a63558e47a84017a3a62f52bb8cb3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.842140  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 8a63558e47a84017a3a62f52bb8cb3eb (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:59:54.842516  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 1af6b960277d47bd994134d20b77c59a (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:59:54.843377  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a63558e47a84017a3a62f52bb8cb3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.843734  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af6b960277d47bd994134d20b77c59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.844451  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 8a63558e47a84017a3a62f52bb8cb3eb (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:59:54.845642  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a63558e47a84017a3a62f52bb8cb3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.851576  1739 ts_tablet_manager.cc:1403] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.003s
I20260709 12:59:54.855101  1739 raft_consensus.cc:359] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.855880  1739 raft_consensus.cc:385] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.856165  1739 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.857075  1741 tablet_bootstrap.cc:492] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:54.857602  1741 ts_tablet_manager.cc:1403] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.000s
I20260709 12:59:54.859581  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 1af6b960277d47bd994134d20b77c59a (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:59:54.861903  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:54.862563  1548 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:54.863775  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:54.864388  1621 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:54.868811  1687 tablet_service.cc:1511] Processing CreateTablet for tablet 1af6b960277d47bd994134d20b77c59a (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:59:54.870304  1687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af6b960277d47bd994134d20b77c59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.873991  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 6891ecbb9d454fe98a0dfe359e3dfd71 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:59:54.876582  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af6b960277d47bd994134d20b77c59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.875298  1740 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:54.883978  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 6891ecbb9d454fe98a0dfe359e3dfd71 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:59:54.884150  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 6891ecbb9d454fe98a0dfe359e3dfd71 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:59:54.886123  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6891ecbb9d454fe98a0dfe359e3dfd71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.888372  1537 tablet_service.cc:1511] Processing CreateTablet for tablet d5f320525c0a40e79e76f607d8195977 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:59:54.888818  1548 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:54.889722  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f320525c0a40e79e76f607d8195977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.890725  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6891ecbb9d454fe98a0dfe359e3dfd71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.890587  1661 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:54.903606  1444 catalog_manager.cc:5697] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:54.904225  1610 tablet_service.cc:1511] Processing CreateTablet for tablet d5f320525c0a40e79e76f607d8195977 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:59:54.905162  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6891ecbb9d454fe98a0dfe359e3dfd71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.905797  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f320525c0a40e79e76f607d8195977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.909271  1621 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:54.916584  1741 raft_consensus.cc:359] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.917438  1741 raft_consensus.cc:385] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.917778  1741 raft_consensus.cc:740] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.918707  1741 consensus_queue.cc:260] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.918884  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 2a931eba8b604012a41ed982e7200b41 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:59:54.919253  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 2a931eba8b604012a41ed982e7200b41 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:59:54.920321  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a931eba8b604012a41ed982e7200b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.920434  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a931eba8b604012a41ed982e7200b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.930902  1741 ts_tablet_manager.cc:1434] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.004s
I20260709 12:59:54.932075  1741 tablet_bootstrap.cc:492] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:54.932739  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 75790e14e47a47d9b0c447e78725e905 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:59:54.879626  1739 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.936761  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75790e14e47a47d9b0c447e78725e905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.939858  1749 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.940439  1749 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.945256  1608 tablet_service.cc:1511] Processing CreateTablet for tablet 75790e14e47a47d9b0c447e78725e905 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:59:54.946492  1749 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:54.947180  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75790e14e47a47d9b0c447e78725e905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.923902  1740 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:54.950119  1739 ts_tablet_manager.cc:1434] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.001s
I20260709 12:59:54.953169  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0e70f76a194ff7ab05b64009ded3c5 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:59:54.942073  1737 tablet_bootstrap.cc:492] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:54.957706  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0e70f76a194ff7ab05b64009ded3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.958065  1749 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.958005  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:54.960391  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0e70f76a194ff7ab05b64009ded3c5 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:59:54.961629  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0e70f76a194ff7ab05b64009ded3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.967172  1749 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.969333  1749 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:54.972119  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 210a36eb12cf4ba2a2c5d8ffd07e37e9 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:59:54.973390  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 210a36eb12cf4ba2a2c5d8ffd07e37e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.976025  1739 tablet_bootstrap.cc:492] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:54.977075  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 12:59:54.978421  1587 leader_election.cc:343] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:54.980178  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 210a36eb12cf4ba2a2c5d8ffd07e37e9 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:59:54.981029  1737 ts_tablet_manager.cc:1403] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.261s	user 0.003s	sys 0.015s
I20260709 12:59:54.981534  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 210a36eb12cf4ba2a2c5d8ffd07e37e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.984579  1737 raft_consensus.cc:359] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.985777  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 89a432d1e3024e13a2d20229db9a8d85 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:59:54.987218  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a432d1e3024e13a2d20229db9a8d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:54.959020  1740 raft_consensus.cc:697] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 12:59:54.990195  1740 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:54.991964  1494 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:54.995689  1737 raft_consensus.cc:385] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:54.996089  1781 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.996126  1737 raft_consensus.cc:740] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:54.996592  1781 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:54.998781  1737 consensus_queue.cc:260] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.000312  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 12:59:55.001696  1663 leader_election.cc:343] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:55.002230  1781 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:55.014079  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 1cfabef9288d4d6ab7bbfaed954379e9 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:59:55.015602  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfabef9288d4d6ab7bbfaed954379e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.022864  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 1cfabef9288d4d6ab7bbfaed954379e9 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:59:55.024451  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfabef9288d4d6ab7bbfaed954379e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.026353  1613 tablet_service.cc:1511] Processing CreateTablet for tablet 89a432d1e3024e13a2d20229db9a8d85 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:59:55.031675  1767 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:55.032075  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 141594us
I20260709 12:59:55.039724  1767 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } }
I20260709 12:59:55.042874  1767 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:55.044068  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:55.045188  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:55.045794  1694 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 12:59:55.046258  1739 tablet_bootstrap.cc:654] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.046861  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 12:59:55.047613  1514 leader_election.cc:343] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:55.056175  1511 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:55.058144  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:55.063131  1694 raft_consensus.cc:2393] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 1: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 12:59:55.059537  1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a432d1e3024e13a2d20229db9a8d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.069180  1774 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.071224  1605 tablet_service.cc:1511] Processing CreateTablet for tablet a70c773fba6b40bfad053ffbcc4b9d86 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:59:55.071604  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:55.059932  1737 ts_tablet_manager.cc:1434] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.002s
I20260709 12:59:55.072919  1531 tablet_service.cc:1511] Processing CreateTablet for tablet a70c773fba6b40bfad053ffbcc4b9d86 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:59:55.059239  1767 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:55.078536  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70c773fba6b40bfad053ffbcc4b9d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.081333  1737 tablet_bootstrap.cc:492] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:55.085465  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 2a931eba8b604012a41ed982e7200b41 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:59:55.085603  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 75790e14e47a47d9b0c447e78725e905 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:59:55.086439  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 210a36eb12cf4ba2a2c5d8ffd07e37e9 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:59:55.086941  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a931eba8b604012a41ed982e7200b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.086567  1446 catalog_manager.cc:5697] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:55.088591  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 210a36eb12cf4ba2a2c5d8ffd07e37e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.089094  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 89a432d1e3024e13a2d20229db9a8d85 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:59:55.089751  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75790e14e47a47d9b0c447e78725e905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.090552  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a432d1e3024e13a2d20229db9a8d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.081800  1686 tablet_service.cc:1511] Processing CreateTablet for tablet d5f320525c0a40e79e76f607d8195977 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:59:55.078418  1774 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.083600  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70c773fba6b40bfad053ffbcc4b9d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.078536  1767 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.094419  1767 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:55.091150  1683 tablet_service.cc:1511] Processing CreateTablet for tablet a70c773fba6b40bfad053ffbcc4b9d86 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:59:55.094556  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 5e0e70f76a194ff7ab05b64009ded3c5 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:59:55.100792  1774 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:55.101178  1749 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:55.101681  1586 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:55.102430  1749 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:55.107779  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 1cfabef9288d4d6ab7bbfaed954379e9 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:59:55.108597  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:55.079731  1697 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
W20260709 12:59:55.110199  1514 leader_election.cc:343] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:55.110018  1767 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } }
I20260709 12:59:55.111780  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f320525c0a40e79e76f607d8195977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.113122  1767 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:55.115010  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cfabef9288d4d6ab7bbfaed954379e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.115798  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0e70f76a194ff7ab05b64009ded3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.115944  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:55.118201  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:55.118728  1694 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:55.119913  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70c773fba6b40bfad053ffbcc4b9d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.091892  1741 tablet_bootstrap.cc:654] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:55.128146  1514 leader_election.cc:343] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:55.129165  1537 tablet_service.cc:1511] Processing CreateTablet for tablet ba9457391f9c4971a27c4ef6fd3af809 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:59:55.130450  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9457391f9c4971a27c4ef6fd3af809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.134872  1694 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 12:59:55.135656  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 12:59:55.137071  1511 leader_election.cc:343] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:55.137487  1511 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:55.139530  1774 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:55.149816  1774 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.150346  1774 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:55.151842  1661 leader_election.cc:343] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:55.161929  1661 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 12:59:55.162168  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:55.162897  1621 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 12:59:55.163352  1586 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 12:59:55.164325  1514 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 12:59:55.163507  1740 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:55.164422  1764 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:55.165283  1747 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:55.165467  1764 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.165721  1747 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.165877  1764 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:55.165997  1737 tablet_bootstrap.cc:654] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.166173  1747 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:55.172806  1764 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.173957  1747 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.156814  1511 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:55.177342  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:55.177737  1749 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:55.178107  1621 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:55.178188  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:55.178210  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:55.181039  1747 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:55.181663  1747 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:55.187852  1747 raft_consensus.cc:697] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 12:59:55.187134  1587 leader_election.cc:343] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:55.161348  1774 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 12:59:55.188668  1511 leader_election.cc:343] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:55.189838  1747 consensus_queue.cc:237] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } }
I20260709 12:59:55.190471  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:55.191071  1697 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:55.192528  1607 tablet_service.cc:1511] Processing CreateTablet for tablet ba9457391f9c4971a27c4ef6fd3af809 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:59:55.193872  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9457391f9c4971a27c4ef6fd3af809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.200294  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:55.202054  1764 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:55.209811  1621 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 12:59:55.211359  1514 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 12:59:55.211241  1678 tablet_service.cc:1511] Processing CreateTablet for tablet ba9457391f9c4971a27c4ef6fd3af809 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:59:55.212433  1767 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:55.212829  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9457391f9c4971a27c4ef6fd3af809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.236783  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5408ceceb548a1a1cbe7d89f49c084 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:59:55.238503  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5408ceceb548a1a1cbe7d89f49c084. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:55.228116  1511 leader_election.cc:343] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:55.262748  1687 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5408ceceb548a1a1cbe7d89f49c084 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:59:55.263954  1687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5408ceceb548a1a1cbe7d89f49c084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.263582  1532 tablet_service.cc:1511] Processing CreateTablet for tablet effd69042c284e8386aafb50372a93b6 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:59:55.264371  1737 tablet_bootstrap.cc:492] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:55.265377  1737 ts_tablet_manager.cc:1403] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.184s	user 0.025s	sys 0.001s
I20260709 12:59:55.258555  1608 tablet_service.cc:1511] Processing CreateTablet for tablet effd69042c284e8386aafb50372a93b6 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:59:55.268322  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effd69042c284e8386aafb50372a93b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.272428  1737 raft_consensus.cc:359] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.273273  1737 raft_consensus.cc:385] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.275982  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effd69042c284e8386aafb50372a93b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.278527  1682 tablet_service.cc:1511] Processing CreateTablet for tablet effd69042c284e8386aafb50372a93b6 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:59:55.278980  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5408ceceb548a1a1cbe7d89f49c084 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:59:55.280584  1764 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:55.284265  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 3841c3258da84512aa1d5bec2bac5fe3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:59:55.273584  1737 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.286867  1739 tablet_bootstrap.cc:492] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:55.287290  1739 ts_tablet_manager.cc:1403] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.311s	user 0.009s	sys 0.012s
I20260709 12:59:55.288993  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5408ceceb548a1a1cbe7d89f49c084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.294504  1741 tablet_bootstrap.cc:492] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:55.295215  1741 ts_tablet_manager.cc:1403] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.363s	user 0.016s	sys 0.003s
I20260709 12:59:55.296769  1774 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:55.300251  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3841c3258da84512aa1d5bec2bac5fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.302044  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effd69042c284e8386aafb50372a93b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.313277  1737 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.298707  1741 raft_consensus.cc:359] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.341065  1737 ts_tablet_manager.cc:1434] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.002s
I20260709 12:59:55.342049  1737 tablet_bootstrap.cc:492] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:55.332422  1767 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 12:59:55.336753  1741 raft_consensus.cc:385] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.339881  1739 raft_consensus.cc:359] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.329491  1774 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:59:55.345455  1739 raft_consensus.cc:385] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.346724  1739 raft_consensus.cc:740] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.350214  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 75442f7324f24d4494f1ba99a64ed4ac (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:59:55.352172  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 3841c3258da84512aa1d5bec2bac5fe3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:59:55.354183  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 3841c3258da84512aa1d5bec2bac5fe3 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:59:55.354595  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 75442f7324f24d4494f1ba99a64ed4ac (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:59:55.356216  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75442f7324f24d4494f1ba99a64ed4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.357587  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3841c3258da84512aa1d5bec2bac5fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.359754  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75442f7324f24d4494f1ba99a64ed4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.344902  1741 raft_consensus.cc:740] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.361917  1741 consensus_queue.cc:260] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.364920  1741 ts_tablet_manager.cc:1434] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.004s
I20260709 12:59:55.365906  1741 tablet_bootstrap.cc:492] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:55.367830  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 181ed72be8c34c66b8d437212e73d0a9 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:59:55.367978  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 75442f7324f24d4494f1ba99a64ed4ac (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:59:55.368923  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181ed72be8c34c66b8d437212e73d0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.369498  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75442f7324f24d4494f1ba99a64ed4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.373677  1739 consensus_queue.cc:260] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.377424  1739 ts_tablet_manager.cc:1434] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.003s
I20260709 12:59:55.378294  1739 tablet_bootstrap.cc:492] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:55.392459  1623 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:55.399353  1774 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:55.401328  1741 tablet_bootstrap.cc:654] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.411471  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 181ed72be8c34c66b8d437212e73d0a9 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:59:55.412420  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181ed72be8c34c66b8d437212e73d0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.408881  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3841c3258da84512aa1d5bec2bac5fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.422917  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 18e6dd43c01541d3abf870473a28780a (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:59:55.424665  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 18e6dd43c01541d3abf870473a28780a (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:59:55.375545  1697 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:55.425046  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 71ae78eb08484929a4e2f3128c3b5f34 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:59:55.434430  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 71ae78eb08484929a4e2f3128c3b5f34 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:59:55.440172  1774 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.440677  1774 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.438658  1767 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.445223  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e6dd43c01541d3abf870473a28780a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.451861  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 71ae78eb08484929a4e2f3128c3b5f34 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:59:55.452551  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 181ed72be8c34c66b8d437212e73d0a9 (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:59:55.453174  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ae78eb08484929a4e2f3128c3b5f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.453258  1586 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 12:59:55.454403  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 18e6dd43c01541d3abf870473a28780a (DEFAULT_TABLE table=test-workload [id=c7ca422259724cef854945cea1ef66ae]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:59:55.454710  1749 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:55.455386  1749 raft_consensus.cc:697] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 12:59:55.456508  1749 consensus_queue.cc:237] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.455591  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e6dd43c01541d3abf870473a28780a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.463603  1774 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:55.465410  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:55.466362  1694 raft_consensus.cc:2393] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 1: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 12:59:55.480244  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181ed72be8c34c66b8d437212e73d0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.485272  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ae78eb08484929a4e2f3128c3b5f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.501072  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e6dd43c01541d3abf870473a28780a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.503264  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:55.504880  1739 tablet_bootstrap.cc:654] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.505084  1737 tablet_bootstrap.cc:654] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.508212  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:55.508486  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ae78eb08484929a4e2f3128c3b5f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:55.512568  1740 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.536074  1740 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.538326  1740 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:55.538935  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:55.540966  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:55.541715  1622 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 1: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 12:59:55.542904  1663 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 12:59:55.518343  1774 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:55.577358  1740 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:55.586870  1767 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:55.616029  1737 tablet_bootstrap.cc:492] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:55.616598  1737 ts_tablet_manager.cc:1403] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.275s	user 0.012s	sys 0.006s
I20260709 12:59:55.620036  1737 raft_consensus.cc:359] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.620754  1737 raft_consensus.cc:385] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.621057  1737 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.621768  1737 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:55.606756  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 63933.9us
I20260709 12:59:55.626783  1737 ts_tablet_manager.cc:1434] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:59:55.625583  1446 catalog_manager.cc:5697] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:55.631069  1446 catalog_manager.cc:5697] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:55.632929  1737 tablet_bootstrap.cc:492] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:55.643474  1737 tablet_bootstrap.cc:654] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.648418  1767 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:55.645099  1782 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:59:55.684931  1741 tablet_bootstrap.cc:492] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:55.685498  1741 ts_tablet_manager.cc:1403] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.320s	user 0.017s	sys 0.018s
I20260709 12:59:55.686677  1740 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:55.695158  1739 tablet_bootstrap.cc:492] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:55.694960  1740 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:55.695768  1739 ts_tablet_manager.cc:1403] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.318s	user 0.010s	sys 0.016s
I20260709 12:59:55.699481  1739 raft_consensus.cc:359] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.700428  1739 raft_consensus.cc:385] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.700768  1739 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
W20260709 12:59:55.702862  1803 log.cc:927] Time spent T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:59:55.702032  1739 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.706832  1739 ts_tablet_manager.cc:1434] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:59:55.708127  1739 tablet_bootstrap.cc:492] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:55.730232  1741 raft_consensus.cc:359] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.731359  1741 raft_consensus.cc:385] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:59:55.748579  1514 consensus_peers.cc:597] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:55.739933  1741 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.751582  1741 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.750895  1445 catalog_manager.cc:5697] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:55.759618  1741 ts_tablet_manager.cc:1434] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 12:59:55.760795  1741 tablet_bootstrap.cc:492] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:55.766748  1737 tablet_bootstrap.cc:492] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:55.767518  1737 ts_tablet_manager.cc:1403] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.030s
I20260709 12:59:55.769814  1739 tablet_bootstrap.cc:654] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.770484  1741 tablet_bootstrap.cc:654] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.770069  1737 raft_consensus.cc:359] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.775345  1737 raft_consensus.cc:385] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.775667  1737 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.776299  1737 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.778156  1737 ts_tablet_manager.cc:1434] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:59:55.778937  1737 tablet_bootstrap.cc:492] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:55.782720  1774 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:55.789173  1741 tablet_bootstrap.cc:492] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:55.790622  1739 tablet_bootstrap.cc:492] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:55.791134  1739 ts_tablet_manager.cc:1403] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.002s
I20260709 12:59:55.792551  1741 ts_tablet_manager.cc:1403] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.005s
I20260709 12:59:55.796459  1741 raft_consensus.cc:359] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.797153  1741 raft_consensus.cc:385] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.797418  1741 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.798151  1741 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.800410  1741 ts_tablet_manager.cc:1434] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:59:55.801632  1741 tablet_bootstrap.cc:492] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:55.807471  1741 tablet_bootstrap.cc:654] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.810860  1739 raft_consensus.cc:359] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.811784  1739 raft_consensus.cc:385] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.812130  1739 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.812948  1739 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.815294  1739 ts_tablet_manager.cc:1434] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:55.816285  1739 tablet_bootstrap.cc:492] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:55.822130  1739 tablet_bootstrap.cc:654] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.824841  1741 tablet_bootstrap.cc:492] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:55.825292  1741 ts_tablet_manager.cc:1403] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.012s
I20260709 12:59:55.827720  1741 raft_consensus.cc:359] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.828372  1741 raft_consensus.cc:385] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.828627  1741 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.829248  1741 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.831473  1741 ts_tablet_manager.cc:1434] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:59:55.832516  1741 tablet_bootstrap.cc:492] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:55.838516  1741 tablet_bootstrap.cc:654] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.844785  1739 tablet_bootstrap.cc:492] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:55.845314  1739 ts_tablet_manager.cc:1403] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.003s
I20260709 12:59:55.847970  1739 raft_consensus.cc:359] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.849117  1739 raft_consensus.cc:385] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.849437  1739 raft_consensus.cc:740] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.852222  1737 tablet_bootstrap.cc:654] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.850292  1739 consensus_queue.cc:260] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.857542  1739 ts_tablet_manager.cc:1434] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:59:55.858536  1739 tablet_bootstrap.cc:492] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:55.865024  1739 tablet_bootstrap.cc:654] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.874850  1774 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.875362  1774 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.877692  1774 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:55.879329  1737 tablet_bootstrap.cc:492] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:55.879274  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:55.879900  1737 ts_tablet_manager.cc:1403] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.101s	user 0.007s	sys 0.006s
W20260709 12:59:55.881947  1514 leader_election.cc:343] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:55.882246  1737 raft_consensus.cc:359] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.882880  1737 raft_consensus.cc:385] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.883122  1737 raft_consensus.cc:740] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.883569  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:55.884343  1739 tablet_bootstrap.cc:492] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:55.883944  1737 consensus_queue.cc:260] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.884932  1739 ts_tablet_manager.cc:1403] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.008s
W20260709 12:59:55.886049  1511 leader_election.cc:343] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:55.886929  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:55.888036  1774 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:55.888016  1739 raft_consensus.cc:359] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.889140  1739 raft_consensus.cc:385] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.889479  1739 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.889981  1741 tablet_bootstrap.cc:492] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:55.890404  1741 ts_tablet_manager.cc:1403] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.032s
I20260709 12:59:55.890439  1739 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.894130  1737 ts_tablet_manager.cc:1434] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:59:55.894560  1789 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:55.900106  1739 ts_tablet_manager.cc:1434] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:59:55.904069  1737 tablet_bootstrap.cc:492] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:55.904889  1741 raft_consensus.cc:359] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.905524  1741 raft_consensus.cc:385] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.905781  1741 raft_consensus.cc:740] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.906314  1739 tablet_bootstrap.cc:492] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:55.906414  1741 consensus_queue.cc:260] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.911110  1749 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.911376  1739 tablet_bootstrap.cc:654] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.911623  1749 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.914384  1737 tablet_bootstrap.cc:654] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.914474  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:55.915108  1548 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:55.915499  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:55.916311  1696 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:55.916797  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 12:59:55.917805  1764 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:55.918023  1749 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:55.918395  1789 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:55.920835  1764 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.921347  1764 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:55.921730  1739 tablet_bootstrap.cc:492] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:55.922155  1739 ts_tablet_manager.cc:1403] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.006s
I20260709 12:59:55.924837  1739 raft_consensus.cc:359] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.925674  1739 raft_consensus.cc:385] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.931342  1739 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.932247  1739 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.933254  1774 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.933679  1774 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.941921  1774 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:55.942898  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:55.943735  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 12:59:55.944262  1514 leader_election.cc:343] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:55.945240  1739 ts_tablet_manager.cc:1434] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:59:55.946143  1739 tablet_bootstrap.cc:492] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
W20260709 12:59:55.945217  1511 leader_election.cc:343] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:55.947223  1511 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:55.948369  1774 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:55.956800  1739 tablet_bootstrap.cc:654] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.957441  1741 ts_tablet_manager.cc:1434] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 12:59:55.958575  1741 tablet_bootstrap.cc:492] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:55.964594  1741 tablet_bootstrap.cc:654] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:55.966439  1749 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.967074  1749 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.969756  1749 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:55.971812  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:55.972631  1548 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:55.974591  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 12:59:55.976737  1737 tablet_bootstrap.cc:492] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:55.977329  1737 ts_tablet_manager.cc:1403] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.014s
I20260709 12:59:55.978387  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:55.979267  1696 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:55.980749  1737 raft_consensus.cc:359] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.981107  1749 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:55.981498  1737 raft_consensus.cc:385] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:55.981841  1749 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.981864  1737 raft_consensus.cc:740] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:55.982504  1749 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:55.983295  1737 consensus_queue.cc:260] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.984601  1764 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:55.986670  1764 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:55.986840  1739 tablet_bootstrap.cc:492] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:55.987404  1739 ts_tablet_manager.cc:1403] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.020s
I20260709 12:59:55.989156  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:55.989938  1737 ts_tablet_manager.cc:1434] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:59:55.989907  1548 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:55.990949  1737 tablet_bootstrap.cc:492] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:55.994966  1764 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:59:56.012833  1494 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:56.013433  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:56.019752  1696 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.024474  1827 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:56.027853  1739 raft_consensus.cc:359] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.028599  1739 raft_consensus.cc:385] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.028873  1739 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.029531  1739 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.031517  1739 ts_tablet_manager.cc:1434] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:59:56.032498  1739 tablet_bootstrap.cc:492] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:56.043458  1741 tablet_bootstrap.cc:492] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:56.044032  1741 ts_tablet_manager.cc:1403] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.086s	user 0.025s	sys 0.016s
I20260709 12:59:56.044786  1739 tablet_bootstrap.cc:654] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.045415  1737 tablet_bootstrap.cc:654] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.049654  1741 raft_consensus.cc:359] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } }
I20260709 12:59:56.050330  1741 raft_consensus.cc:385] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.055107  1741 raft_consensus.cc:740] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.055866  1741 consensus_queue.cc:260] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } }
I20260709 12:59:56.057803  1741 ts_tablet_manager.cc:1434] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:59:56.063349  1827 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.063858  1827 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } }
I20260709 12:59:56.067660  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:56.067904  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:56.068421  1741 tablet_bootstrap.cc:492] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:56.071910  1827 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 12:59:56.073573  1737 tablet_bootstrap.cc:492] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:56.074144  1737 ts_tablet_manager.cc:1403] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.013s
I20260709 12:59:56.075848  1741 tablet_bootstrap.cc:654] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.075104  1586 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:56.078742  1749 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.080641  1548 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:56.081573  1696 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:56.078251  1807 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.082995  1807 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.083526  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 12:59:56.078274  1737 raft_consensus.cc:359] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.084430  1737 raft_consensus.cc:385] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.084674  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:56.084872  1737 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.085290  1548 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.129781  1737 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.132275  1737 ts_tablet_manager.cc:1434] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.057s	user 0.014s	sys 0.022s
I20260709 12:59:56.114275  1739 tablet_bootstrap.cc:492] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:56.133019  1739 ts_tablet_manager.cc:1403] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.017s
I20260709 12:59:56.134943  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:56.135520  1696 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.135877  1739 raft_consensus.cc:359] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.136586  1739 raft_consensus.cc:385] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.136809  1739 raft_consensus.cc:740] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.137392  1739 consensus_queue.cc:260] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.139066  1739 ts_tablet_manager.cc:1434] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:59:56.091166  1764 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:56.142621  1739 tablet_bootstrap.cc:492] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:56.091823  1827 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:56.091595  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:56.147266  1622 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:56.086354  1807 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:56.087739  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:56.129037  1749 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:56.148669  1663 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.149354  1737 tablet_bootstrap.cc:492] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:56.148972  1547 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:56.151005  1827 raft_consensus.cc:697] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 12:59:56.151292  1807 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:56.153209  1807 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.153602  1807 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.156183  1827 consensus_queue.cc:237] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.160245  1737 tablet_bootstrap.cc:654] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.161391  1741 tablet_bootstrap.cc:492] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:56.161873  1741 ts_tablet_manager.cc:1403] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.094s	user 0.009s	sys 0.004s
I20260709 12:59:56.162555  1739 tablet_bootstrap.cc:654] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.165114  1741 raft_consensus.cc:359] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.166014  1741 raft_consensus.cc:385] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.166348  1741 raft_consensus.cc:740] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.167164  1741 consensus_queue.cc:260] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.170306  1806 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.170930  1806 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.175379  1741 ts_tablet_manager.cc:1434] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:59:56.176405  1741 tablet_bootstrap.cc:492] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:56.176666  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:56.177471  1547 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:56.178316  1737 tablet_bootstrap.cc:492] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:56.178745  1737 ts_tablet_manager.cc:1403] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.002s
I20260709 12:59:56.179257  1661 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.180421  1740 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:56.180858  1740 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.181277  1740 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.182206  1741 tablet_bootstrap.cc:654] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.183720  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:56.184330  1622 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:56.185727  1806 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:56.187150  1696 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:56.192212  1586 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.193174  1827 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:56.193619  1827 raft_consensus.cc:697] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 12:59:56.194427  1827 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.196096  1444 catalog_manager.cc:5697] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.201340  1737 raft_consensus.cc:359] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.202248  1737 raft_consensus.cc:385] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.202589  1737 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.203642  1737 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.211798  1833 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.212430  1833 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.214107  1737 ts_tablet_manager.cc:1434] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 12:59:56.215308  1737 tablet_bootstrap.cc:492] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:56.216732  1739 tablet_bootstrap.cc:492] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:56.217168  1739 ts_tablet_manager.cc:1403] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.012s
I20260709 12:59:56.218963  1833 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:56.205379  1548 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:56.227818  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:56.228400  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:56.228685  1696 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:56.229245  1547 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:56.232299  1586 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.233220  1833 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:56.233577  1833 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.233912  1833 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.234897  1739 raft_consensus.cc:359] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.235868  1739 raft_consensus.cc:385] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.236222  1739 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.237134  1739 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.240013  1741 tablet_bootstrap.cc:492] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:56.240438  1741 ts_tablet_manager.cc:1403] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.064s	user 0.004s	sys 0.020s
I20260709 12:59:56.241000  1739 ts_tablet_manager.cc:1434] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.004s
I20260709 12:59:56.242981  1737 tablet_bootstrap.cc:654] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.243556  1741 raft_consensus.cc:359] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.244318  1741 raft_consensus.cc:385] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.244626  1741 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.245563  1741 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.247768  1739 tablet_bootstrap.cc:492] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:56.248329  1741 ts_tablet_manager.cc:1434] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:59:56.249389  1741 tablet_bootstrap.cc:492] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:56.255079  1739 tablet_bootstrap.cc:654] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.255955  1741 tablet_bootstrap.cc:654] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.263132  1737 tablet_bootstrap.cc:492] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:56.263581  1737 ts_tablet_manager.cc:1403] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.005s
I20260709 12:59:56.266530  1737 raft_consensus.cc:359] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.267177  1737 raft_consensus.cc:385] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.267488  1737 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.268124  1737 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.268975  1741 tablet_bootstrap.cc:492] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:56.268482  1446 catalog_manager.cc:5697] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.269573  1741 ts_tablet_manager.cc:1403] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.005s
I20260709 12:59:56.268976  1739 tablet_bootstrap.cc:492] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:56.272114  1739 ts_tablet_manager.cc:1403] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.007s
I20260709 12:59:56.271729  1741 raft_consensus.cc:359] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.272804  1741 raft_consensus.cc:385] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.273057  1741 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.273515  1737 ts_tablet_manager.cc:1434] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.004s
I20260709 12:59:56.273676  1741 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.274358  1737 tablet_bootstrap.cc:492] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:56.274753  1739 raft_consensus.cc:359] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.275358  1739 raft_consensus.cc:385] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.275668  1741 ts_tablet_manager.cc:1434] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:59:56.276839  1741 tablet_bootstrap.cc:492] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:56.281599  1737 tablet_bootstrap.cc:654] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.275640  1739 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.283456  1739 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.289079  1741 tablet_bootstrap.cc:654] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.290338  1740 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.293330  1740 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:56.294322  1833 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.295847  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:56.298077  1739 ts_tablet_manager.cc:1434] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:59:56.299175  1739 tablet_bootstrap.cc:492] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:56.299440  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:56.300004  1548 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.296823  1622 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.308454  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:56.309083  1547 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.311681  1737 tablet_bootstrap.cc:492] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:56.315721  1833 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:56.317327  1740 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.317808  1740 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.320281  1737 ts_tablet_manager.cc:1403] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.010s
I20260709 12:59:56.321871  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:56.322746  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:56.323297  1696 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.323659  1737 raft_consensus.cc:359] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.324399  1737 raft_consensus.cc:385] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.324698  1737 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.324736  1774 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.325309  1774 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.325845  1737 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.326521  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:56.327135  1546 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:56.328336  1774 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:56.328433  1737 ts_tablet_manager.cc:1434] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 12:59:56.326136  1663 leader_election.cc:343] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:56.328927  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:56.329516  1623 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 12:59:56.329516  1661 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:56.324579  1740 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:56.330502  1806 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:56.330845  1806 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.330803  1514 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 12:59:56.331275  1806 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.332006  1789 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:56.332284  1789 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.332792  1789 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.334249  1741 tablet_bootstrap.cc:492] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:56.334466  1737 tablet_bootstrap.cc:492] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:56.333671  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:56.334666  1741 ts_tablet_manager.cc:1403] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.024s
W20260709 12:59:56.335811  1511 leader_election.cc:343] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:56.337095  1741 raft_consensus.cc:359] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.337771  1741 raft_consensus.cc:385] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.338068  1741 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.338716  1741 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.340185  1737 tablet_bootstrap.cc:654] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.340763  1741 ts_tablet_manager.cc:1434] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:59:56.342437  1741 tablet_bootstrap.cc:492] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:56.350358  1741 tablet_bootstrap.cc:654] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.350576  1774 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.353940  1739 tablet_bootstrap.cc:654] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.354859  1623 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.351212  1774 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.359938  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:56.361982  1774 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:56.363381  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 12:59:56.361729  1511 leader_election.cc:343] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:56.364789  1514 leader_election.cc:343] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:56.365149  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:56.365794  1774 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:56.367772  1737 tablet_bootstrap.cc:492] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:56.368263  1737 ts_tablet_manager.cc:1403] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.034s	user 0.030s	sys 0.000s
I20260709 12:59:56.369248  1741 tablet_bootstrap.cc:492] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:56.369675  1741 ts_tablet_manager.cc:1403] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.001s
I20260709 12:59:56.369792  1739 tablet_bootstrap.cc:492] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:56.369809  1774 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.370328  1739 ts_tablet_manager.cc:1403] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.004s
I20260709 12:59:56.370400  1774 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.370661  1737 raft_consensus.cc:359] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.371225  1737 raft_consensus.cc:385] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.371500  1737 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.372640  1774 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:56.372573  1741 raft_consensus.cc:359] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.373261  1741 raft_consensus.cc:385] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.373207  1739 raft_consensus.cc:359] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.373644  1741 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.373368  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:56.374140  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:56.373876  1737 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:56.374837  1514 leader_election.cc:343] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:56.375020  1697 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 12:59:56.374316  1741 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.376242  1511 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:56.376659  1737 ts_tablet_manager.cc:1434] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:56.377734  1741 ts_tablet_manager.cc:1434] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:59:56.373966  1739 raft_consensus.cc:385] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.378135  1737 tablet_bootstrap.cc:492] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:56.378304  1739 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.378547  1774 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:56.379005  1774 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.379528  1774 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.378971  1739 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.381227  1739 ts_tablet_manager.cc:1434] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:59:56.382243  1739 tablet_bootstrap.cc:492] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:56.382961  1741 tablet_bootstrap.cc:492] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:56.389065  1622 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:56.392055  1663 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.392978  1740 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:56.393239  1548 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:56.393005  1807 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.396327  1807 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:56.388751  1739 tablet_bootstrap.cc:654] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.398865  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:56.399606  1622 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.400560  1740 raft_consensus.cc:697] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 12:59:56.401645  1740 consensus_queue.cc:237] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.405138  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:56.405956  1548 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.420156  1739 tablet_bootstrap.cc:492] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:56.420970  1739 ts_tablet_manager.cc:1403] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.009s
I20260709 12:59:56.429193  1741 tablet_bootstrap.cc:654] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.432137  1737 tablet_bootstrap.cc:654] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.445211  1847 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.445719  1847 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.448187  1739 raft_consensus.cc:359] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.449658  1739 raft_consensus.cc:385] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.450915  1739 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.451732  1739 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.453717  1739 ts_tablet_manager.cc:1434] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.032s	user 0.002s	sys 0.004s
I20260709 12:59:56.454564  1739 tablet_bootstrap.cc:492] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:56.453824  1446 catalog_manager.cc:5697] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.464748  1739 tablet_bootstrap.cc:654] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.464768  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:56.466286  1621 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:56.466512  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:56.467180  1741 tablet_bootstrap.cc:492] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:56.467103  1546 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:56.467832  1741 ts_tablet_manager.cc:1403] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.002s
I20260709 12:59:56.467942  1663 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.461474  1847 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:56.469632  1847 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:56.470043  1847 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.470281  1847 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.472564  1741 raft_consensus.cc:359] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.473251  1741 raft_consensus.cc:385] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.473531  1741 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.473711  1740 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.474185  1740 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.474802  1739 tablet_bootstrap.cc:492] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:56.475224  1739 ts_tablet_manager.cc:1403] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.000s
I20260709 12:59:56.476159  1740 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:56.477927  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:56.478482  1621 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:56.478427  1739 raft_consensus.cc:359] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.474176  1741 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.479565  1739 raft_consensus.cc:385] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.481141  1739 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.481350  1741 ts_tablet_manager.cc:1434] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:59:56.479799  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:56.482339  1546 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:56.480547  1663 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.482126  1739 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.483240  1740 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:56.483659  1740 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.483995  1740 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.482339  1741 tablet_bootstrap.cc:492] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:56.485064  1739 ts_tablet_manager.cc:1434] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:59:56.485929  1739 tablet_bootstrap.cc:492] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:56.485957  1737 tablet_bootstrap.cc:492] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:56.486456  1737 ts_tablet_manager.cc:1403] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.022s
I20260709 12:59:56.488955  1737 raft_consensus.cc:359] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.489647  1737 raft_consensus.cc:385] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.489905  1737 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.490922  1741 tablet_bootstrap.cc:654] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.491380  1696 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:56.491752  1806 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.493544  1739 tablet_bootstrap.cc:654] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.494829  1806 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:56.495719  1586 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.496742  1827 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:56.497253  1827 raft_consensus.cc:697] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 12:59:56.498342  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:56.498944  1621 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.498489  1827 consensus_queue.cc:237] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.497305  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:56.503640  1546 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.505620  1622 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:56.507212  1663 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.508227  1806 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:56.509368  1806 raft_consensus.cc:697] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 12:59:56.510218  1806 consensus_queue.cc:237] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.513990  1547 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:56.515089  1621 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:56.515112  1740 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.515445  1847 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.490543  1737 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.519913  1847 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:56.521173  1737 ts_tablet_manager.cc:1434] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.003s
I20260709 12:59:56.521780  1741 tablet_bootstrap.cc:492] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:56.522357  1737 tablet_bootstrap.cc:492] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:56.522217  1741 ts_tablet_manager.cc:1403] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.005s
I20260709 12:59:56.527274  1740 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:56.543931  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:56.544965  1547 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.534575  1663 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.547171  1740 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:56.547659  1740 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 12:59:56.548439  1740 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.550539  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:56.551005  1621 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.554636  1739 tablet_bootstrap.cc:492] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:56.555143  1739 ts_tablet_manager.cc:1403] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.069s	user 0.030s	sys 0.012s
I20260709 12:59:56.557664  1739 raft_consensus.cc:359] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.559402  1739 raft_consensus.cc:385] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.559798  1739 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.560631  1739 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.557281  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:56.571324  1741 raft_consensus.cc:359] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.572266  1741 raft_consensus.cc:385] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.572654  1741 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.573460  1741 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.575269  1741 ts_tablet_manager.cc:1434] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 12:59:56.576090  1741 tablet_bootstrap.cc:492] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:56.579056  1444 catalog_manager.cc:5697] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.569693  1545 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.588564  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:56.589327  1623 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.592203  1833 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:56.594693  1446 catalog_manager.cc:5697] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.610800  1739 ts_tablet_manager.cc:1434] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.055s	user 0.023s	sys 0.015s
I20260709 12:59:56.606876  1833 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:59:56.612131  1739 tablet_bootstrap.cc:492] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:56.618232  1789 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.623977  1546 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:56.627616  1548 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:56.628407  1774 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.629599  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:56.630143  1622 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.630405  1774 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:56.632200  1621 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:56.634172  1789 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:56.635799  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:56.636375  1697 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.638159  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 12:59:56.639825  1514 leader_election.cc:343] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:56.643349  1663 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.643369  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:56.644168  1695 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.646203  1445 catalog_manager.cc:5697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.648397  1737 tablet_bootstrap.cc:654] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.653067  1740 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:56.666175  1741 tablet_bootstrap.cc:654] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.666021  1740 raft_consensus.cc:697] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 12:59:56.670122  1859 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.674752  1739 tablet_bootstrap.cc:654] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.670926  1859 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.682534  1764 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.683012  1764 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.685906  1764 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:56.686434  1859 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:56.687487  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:56.689572  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:56.681110  1740 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:56.691373  1514 leader_election.cc:343] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:56.692157  1586 leader_election.cc:343] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:56.697225  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:56.700117  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:56.700723  1546 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:56.703099  1764 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:56.706297  1587 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:56.707334  1764 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:56.707710  1764 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.708055  1764 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:56.709658  1511 leader_election.cc:343] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:56.710100  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:56.711467  1863 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:56.718227  1547 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:56.719694  1623 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:56.720826  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.721084  1697 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 12:59:56.721786  1806 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:56.722333  1806 raft_consensus.cc:697] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 12:59:56.723277  1806 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.728327  1737 tablet_bootstrap.cc:492] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:56.728940  1737 ts_tablet_manager.cc:1403] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.207s	user 0.015s	sys 0.002s
I20260709 12:59:56.732393  1511 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:56.733487  1859 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:56.733937  1859 raft_consensus.cc:697] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 12:59:56.734681  1859 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.748332  1749 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:56.748467  1446 catalog_manager.cc:5697] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.790601  1737 raft_consensus.cc:359] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.791800  1737 raft_consensus.cc:385] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.792264  1737 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.793294  1737 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.795188  1741 tablet_bootstrap.cc:492] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:56.795836  1741 ts_tablet_manager.cc:1403] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.220s	user 0.015s	sys 0.002s
I20260709 12:59:56.801594  1737 ts_tablet_manager.cc:1434] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.072s	user 0.020s	sys 0.000s
I20260709 12:59:56.802070  1739 tablet_bootstrap.cc:492] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:56.802503  1737 tablet_bootstrap.cc:492] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:56.802536  1739 ts_tablet_manager.cc:1403] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.191s	user 0.030s	sys 0.044s
I20260709 12:59:56.799324  1741 raft_consensus.cc:359] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.803992  1741 raft_consensus.cc:385] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.804193  1741 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.799451  1740 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.806515  1740 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.807665  1739 raft_consensus.cc:359] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.808334  1739 raft_consensus.cc:385] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.809312  1739 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.809855  1739 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.811054  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:56.811741  1546 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:56.811702  1741 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.809037  1740 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:56.813258  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:56.813829  1741 ts_tablet_manager.cc:1434] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:59:56.814551  1741 tablet_bootstrap.cc:492] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:56.813819  1623 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:56.818202  1739 ts_tablet_manager.cc:1434] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.002s
I20260709 12:59:56.819068  1739 tablet_bootstrap.cc:492] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:56.820950  1695 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 12:59:56.821014  1661 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.821777  1622 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 12:59:56.824771  1740 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:56.825147  1740 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.825484  1740 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.825516  1511 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:56.826678  1863 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:56.827135  1863 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 12:59:56.823645  1545 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:56.829325  1863 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.833287  1444 catalog_manager.cc:5697] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.841617  1741 tablet_bootstrap.cc:654] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.845496  1737 tablet_bootstrap.cc:654] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.848311  1445 catalog_manager.cc:5697] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:56.854034  1737 tablet_bootstrap.cc:492] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:56.854676  1737 ts_tablet_manager.cc:1403] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.000s
I20260709 12:59:56.854887  1739 tablet_bootstrap.cc:654] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.858614  1737 raft_consensus.cc:359] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.859556  1737 raft_consensus.cc:385] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.859907  1737 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.860775  1737 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.863628  1737 ts_tablet_manager.cc:1434] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.008s
I20260709 12:59:56.864890  1737 tablet_bootstrap.cc:492] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:56.878363  1739 tablet_bootstrap.cc:492] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:56.878937  1739 ts_tablet_manager.cc:1403] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.007s
I20260709 12:59:56.880517  1806 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:56.881705  1739 raft_consensus.cc:359] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.882349  1739 raft_consensus.cc:385] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.882622  1739 raft_consensus.cc:740] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.886372  1737 tablet_bootstrap.cc:654] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.883252  1739 consensus_queue.cc:260] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.888747  1863 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.889330  1863 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.890763  1806 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:56.892942  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 12:59:56.894775  1514 leader_election.cc:343] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:56.896126  1863 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:56.898303  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:56.898736  1737 tablet_bootstrap.cc:492] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:56.898919  1695 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 12:59:56.899173  1737 ts_tablet_manager.cc:1403] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.004s
I20260709 12:59:56.900188  1739 ts_tablet_manager.cc:1434] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:59:56.900269  1511 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:56.901453  1863 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:56.901834  1739 tablet_bootstrap.cc:492] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:56.901731  1737 raft_consensus.cc:359] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.902508  1737 raft_consensus.cc:385] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:56.901809  1863 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.902828  1737 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:56.902987  1863 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.903887  1737 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.906138  1737 ts_tablet_manager.cc:1434] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:56.907749  1737 tablet_bootstrap.cc:492] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:56.920296  1740 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.921471  1806 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:56.926100  1740 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:56.917788  1764 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:56.931031  1764 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:56.934578  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:56.935461  1623 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.937816  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:56.938455  1695 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:56.946672  1739 tablet_bootstrap.cc:654] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.950958  1737 tablet_bootstrap.cc:654] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:56.974992  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:56.975689  1545 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.014391  1749 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:57.053658  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:57.066630  1546 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.074219  1833 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.074903  1833 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.098067  1833 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.104343  1741 tablet_bootstrap.cc:492] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:57.104750  1741 ts_tablet_manager.cc:1403] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.290s	user 0.110s	sys 0.123s
I20260709 12:59:57.106505  1741 raft_consensus.cc:359] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.107035  1741 raft_consensus.cc:385] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.107304  1741 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.124854  1695 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:57.125298  1739 tablet_bootstrap.cc:492] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:57.220469  1741 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.221318  1739 ts_tablet_manager.cc:1403] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.320s	user 0.048s	sys 0.099s
I20260709 12:59:57.130066  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:57.222484  1741 ts_tablet_manager.cc:1434] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.117s	user 0.004s	sys 0.000s
I20260709 12:59:57.222857  1696 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:57.117865  1774 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.224148  1739 raft_consensus.cc:359] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.224802  1739 raft_consensus.cc:385] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.224562  1774 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.225092  1739 raft_consensus.cc:740] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.225706  1739 consensus_queue.cc:260] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.228540  1739 ts_tablet_manager.cc:1434] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:59:57.228430  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 12:59:57.129750  1494 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:57.135566  1807 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.100s
I20260709 12:59:57.228978  1789 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.236311  1789 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:57.236845  1514 leader_election.cc:343] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:57.238852  1623 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:57.240036  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:57.242519  1789 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.243675  1739 tablet_bootstrap.cc:492] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:57.243140  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 12:59:57.244855  1514 leader_election.cc:343] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:57.245330  1546 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:57.250108  1833 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:57.250589  1739 tablet_bootstrap.cc:654] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.250608  1833 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 12:59:57.251704  1833 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.255641  1663 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:57.256867  1740 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:57.257513  1586 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:57.257566  1740 raft_consensus.cc:697] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 12:59:57.258698  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:57.259330  1548 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:57.223366  1741 tablet_bootstrap.cc:492] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:57.258919  1740 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.265710  1886 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:57.266784  1741 tablet_bootstrap.cc:654] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.267921  1883 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:57.214191  1863 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.268303  1883 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.268646  1883 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.270027  1545 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:57.276166  1863 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.274565  1445 catalog_manager.cc:5697] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:57.278613  1863 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:57.287981  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:57.306114  1739 tablet_bootstrap.cc:492] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:57.306596  1739 ts_tablet_manager.cc:1403] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.063s	user 0.024s	sys 0.029s
I20260709 12:59:57.309569  1739 raft_consensus.cc:359] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.310343  1739 raft_consensus.cc:385] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.310659  1739 raft_consensus.cc:740] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.310109  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:57.314653  1739 consensus_queue.cc:260] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.284408  1883 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.317381  1739 ts_tablet_manager.cc:1434] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:59:57.318326  1621 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.285478  1886 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:57.288784  1446 catalog_manager.cc:5697] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:57.290675  1806 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:57.318360  1739 tablet_bootstrap.cc:492] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:57.291710  1737 tablet_bootstrap.cc:492] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:57.326691  1833 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.326944  1737 ts_tablet_manager.cc:1403] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.419s	user 0.034s	sys 0.024s
I20260709 12:59:57.327260  1833 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.329586  1833 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.296080  1740 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:57.332139  1883 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.332975  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 12:59:57.333775  1511 leader_election.cc:343] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:57.334216  1511 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:57.334414  1696 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.334908  1789 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:57.342655  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:57.263176  1774 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.347714  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:57.348212  1739 tablet_bootstrap.cc:654] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.348503  1697 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:57.331247  1737 raft_consensus.cc:359] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.353619  1737 raft_consensus.cc:385] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.355671  1737 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.356352  1445 catalog_manager.cc:5697] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:57.358951  1883 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:57.362861  1737 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.365772  1586 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:57.369449  1833 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:57.369863  1833 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.370118  1737 ts_tablet_manager.cc:1434] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:59:57.370251  1833 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.371584  1737 tablet_bootstrap.cc:492] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:57.388353  1696 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:57.398428  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:57.401250  1697 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.402657  1737 tablet_bootstrap.cc:654] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.397933  1886 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:57.408272  1586 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:57.409106  1883 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:57.409534  1883 raft_consensus.cc:697] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 12:59:57.410302  1883 consensus_queue.cc:237] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:57.416294  1514 leader_election.cc:343] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:57.418081  1774 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:57.423483  1833 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.426826  1741 tablet_bootstrap.cc:492] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:57.427291  1741 ts_tablet_manager.cc:1403] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.204s	user 0.043s	sys 0.065s
I20260709 12:59:57.427392  1621 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:59:57.427474  1833 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.429909  1847 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:57.431166  1741 raft_consensus.cc:359] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.431819  1741 raft_consensus.cc:385] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.432088  1741 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.434336  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:57.435094  1694 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.434888  1741 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.440343  1741 ts_tablet_manager.cc:1434] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:59:57.441175  1741 tablet_bootstrap.cc:492] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:57.442871  1694 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 12:59:57.443782  1774 consensus_queue.cc:1059] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:57.444706  1789 raft_consensus.cc:3055] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:57.445150  1789 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 12:59:57.445775  1511 leader_election.cc:343] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:57.445909  1789 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.446908  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:57.446210  1511 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:57.444725  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:57.447046  1789 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:57.448077  1547 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.434692  1697 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 12:59:57.449304  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:57.450340  1739 tablet_bootstrap.cc:492] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:57.450771  1739 ts_tablet_manager.cc:1403] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.133s	user 0.015s	sys 0.007s
I20260709 12:59:57.450924  1859 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:57.455345  1739 raft_consensus.cc:359] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.455998  1739 raft_consensus.cc:385] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.456261  1739 raft_consensus.cc:740] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.456825  1739 consensus_queue.cc:260] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.460188  1739 ts_tablet_manager.cc:1434] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:59:57.461050  1739 tablet_bootstrap.cc:492] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:57.443799  1586 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:57.471005  1883 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:57.472775  1444 catalog_manager.cc:5697] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:57.474479  1883 raft_consensus.cc:697] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 12:59:57.475807  1883 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.476639  1547 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:57.483067  1511 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:57.485944  1859 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:57.486654  1859 raft_consensus.cc:697] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 12:59:57.487932  1741 tablet_bootstrap.cc:654] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.487391  1859 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.489172  1893 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:59:57.494908  1739 tablet_bootstrap.cc:654] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.500377  1737 tablet_bootstrap.cc:492] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:57.500849  1737 ts_tablet_manager.cc:1403] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.130s	user 0.006s	sys 0.014s
I20260709 12:59:57.506901  1546 raft_consensus.cc:2410] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:59:57.508667  1737 raft_consensus.cc:359] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.509320  1737 raft_consensus.cc:385] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.509577  1737 raft_consensus.cc:740] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.510222  1737 consensus_queue.cc:260] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.518042  1445 catalog_manager.cc:5697] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 1 to 2, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:57.525264  1737 ts_tablet_manager.cc:1434] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 12:59:57.540905  1737 tablet_bootstrap.cc:492] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:57.539379  1883 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.549793  1886 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.548166  1883 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.550849  1886 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.558893  1886 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:57.560367  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:57.561883  1883 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 12:59:57.562126  1663 leader_election.cc:343] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:57.562939  1737 tablet_bootstrap.cc:654] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.563014  1859 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.563298  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:57.563512  1859 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.564416  1694 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 1: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 12:59:57.567188  1859 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.568539  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:57.568696  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 12:59:57.571535  1514 leader_election.cc:343] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:57.573880  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:57.574476  1546 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:57.574898  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:57.576087  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:57.576053  1587 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:57.578852  1883 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.580626  1886 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:57.581110  1886 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.581547  1886 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.593518  1886 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.594928  1883 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:57.596737  1511 leader_election.cc:343] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:57.597183  1511 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:57.597889  1859 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:57.601248  1741 tablet_bootstrap.cc:492] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:57.601706  1741 ts_tablet_manager.cc:1403] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.161s	user 0.024s	sys 0.056s
I20260709 12:59:57.602569  1739 tablet_bootstrap.cc:492] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:57.602942  1739 ts_tablet_manager.cc:1403] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.142s	user 0.011s	sys 0.043s
I20260709 12:59:57.608330  1741 raft_consensus.cc:359] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.609107  1741 raft_consensus.cc:385] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.609436  1741 raft_consensus.cc:740] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.608922  1739 raft_consensus.cc:359] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.609710  1737 tablet_bootstrap.cc:492] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:57.609979  1739 raft_consensus.cc:385] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.610174  1737 ts_tablet_manager.cc:1403] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.070s	user 0.006s	sys 0.005s
I20260709 12:59:57.610544  1739 raft_consensus.cc:740] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.610276  1741 consensus_queue.cc:260] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.611557  1739 consensus_queue.cc:260] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.612936  1741 ts_tablet_manager.cc:1434] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:59:57.613262  1737 raft_consensus.cc:359] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.613463  1886 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:57.613790  1737 raft_consensus.cc:385] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.613981  1737 raft_consensus.cc:740] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.614576  1741 tablet_bootstrap.cc:492] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:57.614684  1737 consensus_queue.cc:260] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.616689  1737 ts_tablet_manager.cc:1434] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:59:57.616631  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:57.617295  1622 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.617668  1737 tablet_bootstrap.cc:492] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:57.620673  1741 tablet_bootstrap.cc:654] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.622660  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:57.623687  1547 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.626111  1737 tablet_bootstrap.cc:654] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.630316  1547 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:57.631326  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:57.632133  1886 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:57.632699  1886 raft_consensus.cc:697] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 12:59:57.632167  1445 catalog_manager.cc:5697] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:57.633471  1886 consensus_queue.cc:237] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.641513  1737 tablet_bootstrap.cc:492] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:57.641925  1737 ts_tablet_manager.cc:1403] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.000s
I20260709 12:59:57.643282  1847 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.643913  1847 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.645944  1739 ts_tablet_manager.cc:1434] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.004s
I20260709 12:59:57.646152  1847 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:57.646835  1739 tablet_bootstrap.cc:492] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:57.648144  1741 tablet_bootstrap.cc:492] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:57.647900  1737 raft_consensus.cc:359] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.648626  1737 raft_consensus.cc:385] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.648712  1741 ts_tablet_manager.cc:1403] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.003s
I20260709 12:59:57.648985  1737 raft_consensus.cc:740] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.648968  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:57.649909  1737 consensus_queue.cc:260] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:57.651014  1663 leader_election.cc:343] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:57.652153  1737 ts_tablet_manager.cc:1434] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:59:57.652170  1741 raft_consensus.cc:359] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.652815  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:57.653239  1737 tablet_bootstrap.cc:492] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:57.653386  1741 raft_consensus.cc:385] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.653553  1546 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:57.653977  1741 raft_consensus.cc:740] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.654816  1741 consensus_queue.cc:260] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.655140  1661 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:57.656216  1847 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:57.656554  1847 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.657027  1847 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.658062  1622 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:57.660671  1737 tablet_bootstrap.cc:654] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.661113  1445 catalog_manager.cc:5697] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:57.662618  1741 ts_tablet_manager.cc:1434] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:59:57.665557  1741 tablet_bootstrap.cc:492] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:57.671737  1739 tablet_bootstrap.cc:654] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.672511  1741 tablet_bootstrap.cc:654] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.677302  1737 tablet_bootstrap.cc:492] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:57.677738  1737 ts_tablet_manager.cc:1403] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 12:59:57.680711  1737 raft_consensus.cc:359] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.681362  1737 raft_consensus.cc:385] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.681572  1847 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.681627  1737 raft_consensus.cc:740] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.690541  1847 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:57.690732  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:57.688735  1737 consensus_queue.cc:260] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:57.692215  1663 leader_election.cc:343] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:57.692713  1737 ts_tablet_manager.cc:1434] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:59:57.693795  1737 tablet_bootstrap.cc:492] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:57.696511  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:57.697160  1547 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.701975  1737 tablet_bootstrap.cc:654] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.702574  1739 tablet_bootstrap.cc:492] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:57.703018  1739 ts_tablet_manager.cc:1403] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.011s
I20260709 12:59:57.707839  1886 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:57.713750  1739 raft_consensus.cc:359] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.714422  1739 raft_consensus.cc:385] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.714685  1739 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.715281  1739 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.717598  1739 ts_tablet_manager.cc:1434] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:59:57.723160  1547 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:57.724400  1661 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:57.725561  1737 tablet_bootstrap.cc:492] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:57.725792  1886 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:57.726056  1737 ts_tablet_manager.cc:1403] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 12:59:57.728060  1739 tablet_bootstrap.cc:492] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:57.728796  1737 raft_consensus.cc:359] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.729476  1737 raft_consensus.cc:385] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.729771  1737 raft_consensus.cc:740] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.730472  1737 consensus_queue.cc:260] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.733007  1737 ts_tablet_manager.cc:1434] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:59:57.733887  1737 tablet_bootstrap.cc:492] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:57.727308  1886 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 12:59:57.734783  1886 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.735577  1741 tablet_bootstrap.cc:492] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:57.735996  1741 ts_tablet_manager.cc:1403] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.071s	user 0.028s	sys 0.013s
I20260709 12:59:57.739588  1741 raft_consensus.cc:359] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.740209  1741 raft_consensus.cc:385] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.740475  1741 raft_consensus.cc:740] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.740998  1737 tablet_bootstrap.cc:654] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.741104  1741 consensus_queue.cc:260] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.744913  1741 ts_tablet_manager.cc:1434] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:59:57.746052  1741 tablet_bootstrap.cc:492] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:57.746416  1739 tablet_bootstrap.cc:654] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.753777  1741 tablet_bootstrap.cc:654] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.761368  1847 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:57.765590  1739 tablet_bootstrap.cc:492] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:57.766062  1739 ts_tablet_manager.cc:1403] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.003s
I20260709 12:59:57.772040  1445 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:57.774699  1739 raft_consensus.cc:359] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.775388  1739 raft_consensus.cc:385] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.775679  1739 raft_consensus.cc:740] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.776268  1739 consensus_queue.cc:260] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.778213  1739 ts_tablet_manager.cc:1434] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:59:57.779249  1739 tablet_bootstrap.cc:492] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:57.783088  1883 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:57.797279  1739 tablet_bootstrap.cc:654] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.807762  1739 tablet_bootstrap.cc:492] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:57.808348  1739 ts_tablet_manager.cc:1403] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.005s
I20260709 12:59:57.811053  1739 raft_consensus.cc:359] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.811740  1739 raft_consensus.cc:385] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.812054  1739 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.816005  1737 tablet_bootstrap.cc:492] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:57.816504  1737 ts_tablet_manager.cc:1403] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.083s	user 0.022s	sys 0.047s
I20260709 12:59:57.820690  1883 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:57.819132  1737 raft_consensus.cc:359] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.825848  1859 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.826494  1859 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.829461  1859 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.828392  1739 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.834038  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:57.834702  1696 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 12:59:57.836254  1511 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:57.836511  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:57.838014  1789 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:57.838403  1789 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.838773  1789 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:57.840628  1514 leader_election.cc:343] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:57.825891  1737 raft_consensus.cc:385] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.843439  1737 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.843954  1739 ts_tablet_manager.cc:1434] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:59:57.846436  1739 tablet_bootstrap.cc:492] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:57.847069  1789 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.848987  1883 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.849442  1883 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.848696  1737 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.850306  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:57.856689  1737 ts_tablet_manager.cc:1434] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:59:57.856627  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:57.857594  1696 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:57.858036  1737 tablet_bootstrap.cc:492] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:57.859867  1789 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.859728  1586 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:57.860913  1833 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:57.861588  1833 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.862113  1833 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.863467  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:57.864342  1696 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.873425  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:57.874114  1548 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
W20260709 12:59:57.873454  1514 leader_election.cc:343] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:57.879140  1696 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 12:59:57.854902  1883 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.881760  1546 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:59:57.880666  1511 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:57.883594  1789 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:57.884275  1789 raft_consensus.cc:697] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 12:59:57.882140  1546 pending_rounds.cc:85] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 0
I20260709 12:59:57.886526  1546 pending_rounds.cc:107] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:59:57.886837  1546 raft_consensus.cc:2889] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:57.885063  1789 consensus_queue.cc:237] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.897385  1696 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:59:57.897990  1883 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:57.900971  1739 tablet_bootstrap.cc:654] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.900995  1883 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:57.906015  1833 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.912846  1444 catalog_manager.cc:5697] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:57.912402  1741 tablet_bootstrap.cc:492] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:57.914377  1741 ts_tablet_manager.cc:1403] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.169s	user 0.042s	sys 0.058s
I20260709 12:59:57.914703  1737 tablet_bootstrap.cc:654] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.915241  1833 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.920950  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:57.921586  1697 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.921238  1741 raft_consensus.cc:359] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.927625  1741 raft_consensus.cc:385] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.927759  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:57.928655  1883 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.928848  1547 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.929178  1883 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.931308  1883 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.935503  1547 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:57.935402  1883 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:57.936556  1741 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.936873  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:57.937222  1741 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.937587  1695 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:57.939337  1741 ts_tablet_manager.cc:1434] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.000s
I20260709 12:59:57.939270  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:57.940124  1548 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:57.937417  1587 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 12:59:57.940728  1741 tablet_bootstrap.cc:492] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:57.942826  1697 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:57.943296  1883 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:57.943586  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:57.948066  1882 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:57.949680  1882 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:57.950049  1882 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.950480  1882 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.950141  1741 tablet_bootstrap.cc:654] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:57.958979  1883 raft_consensus.cc:697] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 12:59:57.961252  1882 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.960222  1883 consensus_queue.cc:237] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.964227  1741 tablet_bootstrap.cc:492] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:57.964656  1741 ts_tablet_manager.cc:1403] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 12:59:57.967264  1741 raft_consensus.cc:359] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.967909  1741 raft_consensus.cc:385] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:57.968209  1741 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:57.968803  1741 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:57.969861  1882 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.970773  1741 ts_tablet_manager.cc:1434] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:59:57.971712  1741 tablet_bootstrap.cc:492] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:57.981933  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:57.982728  1548 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.990608  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:57.993914  1737 tablet_bootstrap.cc:492] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:57.994364  1737 ts_tablet_manager.cc:1403] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.137s	user 0.019s	sys 0.003s
I20260709 12:59:57.991240  1696 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:57.996591  1883 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.998440  1883 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.000576  1883 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:57.994869  1886 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.003327  1886 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.003621  1789 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.006426  1886 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:58.007334  1893 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.008441  1737 raft_consensus.cc:359] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.009330  1737 raft_consensus.cc:385] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.009660  1737 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.010483  1737 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.011121  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:58.012864  1696 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
W20260709 12:59:58.013121  1661 leader_election.cc:343] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.018864  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:58.019625  1546 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:58.024209  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:58.068101  1737 ts_tablet_manager.cc:1434] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 12:59:58.069351  1737 tablet_bootstrap.cc:492] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:58.067813  1833 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.084412  1859 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.093869  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:58.094167  1859 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.093940  1833 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.096624  1859 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:58.099943  1833 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:58.106235  1587 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 12:59:58.110242  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:58.107622  1882 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.111202  1882 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.111583  1882 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:58.115630  1514 leader_election.cc:343] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:58.115849  1934 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:59:58.115175  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:58.118022  1545 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 1: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 12:59:58.119427  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 12:59:58.123715  1663 leader_election.cc:343] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.124210  1663 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 12:59:58.125442  1739 tablet_bootstrap.cc:492] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:58.124996  1847 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:58.125808  1807 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:58.126044  1739 ts_tablet_manager.cc:1403] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.280s	user 0.067s	sys 0.085s
I20260709 12:59:58.132797  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:58.133406  1696 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
W20260709 12:59:58.140287  1586 leader_election.cc:343] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.136065  1882 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.146303  1882 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:58.148166  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:58.148829  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:58.149956  1893 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.150301  1893 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.151943  1893 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.137287  1833 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.156833  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:58.165562  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:58.161164  1546 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.172680  1806 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:58.161996  1833 raft_consensus.cc:697] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 12:59:58.191991  1739 raft_consensus.cc:359] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.192881  1739 raft_consensus.cc:385] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.193218  1739 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.193926  1739 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.194540  1548 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:58.196894  1859 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.197350  1859 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.216177  1546 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:58.219828  1741 tablet_bootstrap.cc:654] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.243345  1739 ts_tablet_manager.cc:1434] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.001s
I20260709 12:59:58.244709  1739 tablet_bootstrap.cc:492] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:58.248891  1859 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:58.255348  1774 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.261214  1737 tablet_bootstrap.cc:654] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.260618  1893 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.261479  1774 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.264918  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:58.254333  1586 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:58.240427  1833 consensus_queue.cc:237] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.283766  1774 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:58.290918  1893 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 12:59:58.286317  1586 leader_election.cc:343] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.279807  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:58.283129  1942 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.311961  1587 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:58.315649  1827 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.316128  1827 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 12:59:58.317207  1827 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.319530  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:58.320168  1696 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 12:59:58.321544  1739 tablet_bootstrap.cc:654] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:58.325618  1511 leader_election.cc:343] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.332088  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 12:59:58.332927  1514 leader_election.cc:343] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.335919  1514 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:58.333501  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:58.337224  1694 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.337946  1737 tablet_bootstrap.cc:492] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:58.338541  1737 ts_tablet_manager.cc:1403] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.269s	user 0.025s	sys 0.030s
I20260709 12:59:58.342849  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:58.342669  1737 raft_consensus.cc:359] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.343479  1737 raft_consensus.cc:385] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.343803  1737 raft_consensus.cc:740] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.344525  1944 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.346288  1944 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:58.346608  1494 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:58.349825  1737 consensus_queue.cc:260] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.351275  1944 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:58.353152  1859 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:58.355990  1741 tablet_bootstrap.cc:492] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:58.356436  1741 ts_tablet_manager.cc:1403] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.385s	user 0.008s	sys 0.022s
I20260709 12:59:58.358870  1741 raft_consensus.cc:359] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.362560  1741 raft_consensus.cc:385] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.362928  1741 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.360575  1737 ts_tablet_manager.cc:1434] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 12:59:58.364601  1737 tablet_bootstrap.cc:492] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
W20260709 12:59:58.371699  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 45143.7us
I20260709 12:59:58.371862  1741 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.372406  1511 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:58.374187  1789 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.374555  1789 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.374907  1789 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.374910  1893 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:58.376276  1739 tablet_bootstrap.cc:492] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:58.376691  1739 ts_tablet_manager.cc:1403] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.133s	user 0.008s	sys 0.009s
I20260709 12:59:58.379711  1741 ts_tablet_manager.cc:1434] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:59:58.380580  1741 tablet_bootstrap.cc:492] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:58.379608  1806 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:59:58.382043  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:58.385665  1696 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 12:59:58.386901  1511 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:58.389065  1859 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.389518  1859 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.389959  1859 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.397174  1694 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 12:59:58.400022  1789 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:58.380014  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 47141.1us
I20260709 12:59:58.401366  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:58.413086  1789 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:58.412705  1950 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.417675  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:58.418035  1942 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:58.418320  1694 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.421367  1859 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.442672  1950 raft_consensus.cc:697] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 12:59:58.443892  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:58.456954  1739 raft_consensus.cc:359] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.457826  1739 raft_consensus.cc:385] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.458176  1739 raft_consensus.cc:740] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.458860  1739 consensus_queue.cc:260] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.462661  1737 tablet_bootstrap.cc:654] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.456964  1807 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 12:59:58.461683  1514 leader_election.cc:343] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:58.472643  1514 leader_election.cc:343] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.468448  1950 consensus_queue.cc:237] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:58.476428  1514 leader_election.cc:343] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.481022  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:58.481499  1739 ts_tablet_manager.cc:1434] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.010s
I20260709 12:59:58.481753  1620 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.490804  1859 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:58.446702  1443 catalog_manager.cc:5697] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.498848  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:58.499504  1697 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.501319  1833 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.503751  1939 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:59:58.508752  1514 consensus_peers.cc:597] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:58.512825  1694 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 12:59:58.514328  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:58.517949  1511 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:58.521350  1741 tablet_bootstrap.cc:654] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.521893  1947 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.522380  1947 raft_consensus.cc:697] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 12:59:58.523170  1947 consensus_queue.cc:237] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:58.516598  1514 leader_election.cc:343] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.527012  1697 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 12:59:58.536312  1739 tablet_bootstrap.cc:492] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:58.543061  1511 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:58.545331  1789 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.547017  1789 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 12:59:58.547909  1789 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:58.577999  1953 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:59:58.609444  1620 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 12:59:58.609834  1741 tablet_bootstrap.cc:492] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:58.610423  1741 ts_tablet_manager.cc:1403] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.230s	user 0.025s	sys 0.019s
I20260709 12:59:58.611042  1739 tablet_bootstrap.cc:654] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.614099  1737 tablet_bootstrap.cc:492] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:58.614522  1737 ts_tablet_manager.cc:1403] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.250s	user 0.012s	sys 0.032s
I20260709 12:59:58.614380  1741 raft_consensus.cc:359] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.615826  1741 raft_consensus.cc:385] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.616209  1741 raft_consensus.cc:740] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.616855  1741 consensus_queue.cc:260] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.618933  1741 ts_tablet_manager.cc:1434] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 12:59:58.620143  1741 tablet_bootstrap.cc:492] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:58.635253  1741 tablet_bootstrap.cc:654] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.637255  1737 raft_consensus.cc:359] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.639093  1737 raft_consensus.cc:385] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.639454  1737 raft_consensus.cc:740] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.638785  1739 tablet_bootstrap.cc:492] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:58.640285  1739 ts_tablet_manager.cc:1403] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.004s
I20260709 12:59:58.640610  1737 consensus_queue.cc:260] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.642421  1741 tablet_bootstrap.cc:492] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:58.642917  1741 ts_tablet_manager.cc:1403] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.006s
I20260709 12:59:58.643957  1739 raft_consensus.cc:359] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.644366  1737 ts_tablet_manager.cc:1434] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 12:59:58.644614  1739 raft_consensus.cc:385] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.644886  1739 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.645620  1737 tablet_bootstrap.cc:492] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:58.645608  1739 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.645620  1741 raft_consensus.cc:359] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.646741  1741 raft_consensus.cc:385] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.647020  1741 raft_consensus.cc:740] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.647387  1847 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.647749  1739 ts_tablet_manager.cc:1434] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:59:58.647722  1741 consensus_queue.cc:260] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.647825  1847 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.648782  1739 tablet_bootstrap.cc:492] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:58.649881  1741 ts_tablet_manager.cc:1434] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:59:58.650699  1741 tablet_bootstrap.cc:492] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:58.651327  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 12:59:58.652632  1663 leader_election.cc:343] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.649914  1847 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:58.654487  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:58.655134  1547 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:58.655309  1739 tablet_bootstrap.cc:654] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.656337  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:58.657454  1741 tablet_bootstrap.cc:654] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.657878  1847 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.658017  1833 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.658288  1847 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.658710  1847 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.658572  1833 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.662056  1833 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:58.663892  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:58.664470  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:58.667779  1586 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:58.668524  1833 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:58.672501  1741 tablet_bootstrap.cc:492] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:58.672919  1741 ts_tablet_manager.cc:1403] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 12:59:58.677620  1741 raft_consensus.cc:359] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.678241  1741 raft_consensus.cc:385] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.678493  1741 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.679181  1741 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.667397  1847 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.697116  1737 tablet_bootstrap.cc:654] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.698374  1741 ts_tablet_manager.cc:1434] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:59:58.699110  1741 tablet_bootstrap.cc:492] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:58.700109  1444 catalog_manager.cc:5697] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.704114  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:58.703809  1444 catalog_manager.cc:5697] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.704671  1547 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.705631  1444 catalog_manager.cc:5697] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.708528  1741 tablet_bootstrap.cc:654] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.709002  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 12:59:58.710438  1663 leader_election.cc:343] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.711505  1847 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:58.712706  1547 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:58.716709  1737 tablet_bootstrap.cc:492] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:58.717274  1737 ts_tablet_manager.cc:1403] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.003s
I20260709 12:59:58.713150  1739 tablet_bootstrap.cc:492] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:58.719039  1741 tablet_bootstrap.cc:492] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:58.719085  1739 ts_tablet_manager.cc:1403] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.070s	user 0.028s	sys 0.025s
I20260709 12:59:58.719591  1741 ts_tablet_manager.cc:1403] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 12:59:58.721853  1737 raft_consensus.cc:359] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.722498  1737 raft_consensus.cc:385] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.722770  1737 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.722641  1739 raft_consensus.cc:359] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.722868  1741 raft_consensus.cc:359] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.723464  1739 raft_consensus.cc:385] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.723583  1741 raft_consensus.cc:385] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.723843  1739 raft_consensus.cc:740] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.723953  1741 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.723704  1737 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.724677  1741 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.724860  1739 consensus_queue.cc:260] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.726253  1737 ts_tablet_manager.cc:1434] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:59:58.726625  1741 ts_tablet_manager.cc:1434] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:58.727124  1833 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.727469  1741 tablet_bootstrap.cc:492] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:58.727766  1739 ts_tablet_manager.cc:1434] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:58.727581  1833 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.728754  1739 tablet_bootstrap.cc:492] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:58.729736  1833 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:58.731487  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:58.734649  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:58.737871  1741 tablet_bootstrap.cc:654] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.738173  1696 raft_consensus.cc:2393] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 1: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 12:59:58.739252  1739 tablet_bootstrap.cc:654] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.740298  1586 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:58.741657  1833 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.735808  1443 catalog_manager.cc:5697] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.749014  1741 tablet_bootstrap.cc:492] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:58.749461  1741 ts_tablet_manager.cc:1403] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 12:59:58.751513  1737 tablet_bootstrap.cc:492] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:58.766336  1741 raft_consensus.cc:359] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.767204  1741 raft_consensus.cc:385] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.767513  1741 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.754702  1443 catalog_manager.cc:5697] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.768224  1741 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.752063  1847 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.769340  1939 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:58.769932  1847 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.772424  1741 ts_tablet_manager.cc:1434] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.007s
I20260709 12:59:58.752854  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:58.773357  1741 tablet_bootstrap.cc:492] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:58.773367  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:58.775012  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:58.776015  1548 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
W20260709 12:59:58.775024  1663 leader_election.cc:343] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.779220  1807 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.779815  1807 raft_consensus.cc:697] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 12:59:58.780833  1807 consensus_queue.cc:237] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.785135  1741 tablet_bootstrap.cc:654] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.787667  1739 tablet_bootstrap.cc:492] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:58.788204  1739 ts_tablet_manager.cc:1403] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.060s	user 0.029s	sys 0.005s
I20260709 12:59:58.792773  1661 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 12:59:58.794440  1886 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.793040  1739 raft_consensus.cc:359] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.795580  1886 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.795996  1739 raft_consensus.cc:385] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.796322  1886 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.796464  1739 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.804931  1739 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.805954  1939 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.808291  1741 tablet_bootstrap.cc:492] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:58.808849  1741 ts_tablet_manager.cc:1403] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.006s
I20260709 12:59:58.808543  1939 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.806421  1942 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:58.811211  1939 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 12:59:58.811820  1586 consensus_peers.cc:597] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:58.813031  1942 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:58.813669  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:58.816380  1548 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:58.812579  1739 ts_tablet_manager.cc:1434] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:59:58.818141  1587 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 12:59:58.819244  1942 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.819768  1739 tablet_bootstrap.cc:492] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:58.819684  1942 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.820307  1942 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.824106  1741 raft_consensus.cc:359] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.824858  1741 raft_consensus.cc:385] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.825147  1741 raft_consensus.cc:740] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.827590  1741 consensus_queue.cc:260] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.830121  1741 ts_tablet_manager.cc:1434] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:59:58.830154  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:58.830503  1847 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:58.831620  1444 catalog_manager.cc:5697] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:58.750712  1833 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:58.837579  1586 leader_election.cc:343] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.837761  1886 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.846024  1741 tablet_bootstrap.cc:492] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:58.849167  1737 tablet_bootstrap.cc:654] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.853210  1620 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.856298  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:58.856962  1622 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.851253  1886 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:58.860839  1739 tablet_bootstrap.cc:654] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.864286  1807 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.864879  1807 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.868158  1807 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:58.868965  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:58.869284  1622 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:58.869874  1546 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:58.842494  1942 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.872330  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:58.877038  1548 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.880582  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:58.879879  1663 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:58.893783  1886 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.894317  1886 raft_consensus.cc:697] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 12:59:58.892616  1807 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:58.895008  1807 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.895452  1807 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.895226  1886 consensus_queue.cc:237] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.883268  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:58.920756  1548 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:58.925149  1737 tablet_bootstrap.cc:492] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:58.925688  1737 ts_tablet_manager.cc:1403] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.199s	user 0.018s	sys 0.012s
I20260709 12:59:58.928491  1737 raft_consensus.cc:359] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.929198  1737 raft_consensus.cc:385] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.929488  1737 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.930581  1737 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.931883  1741 tablet_bootstrap.cc:654] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.933125  1737 ts_tablet_manager.cc:1434] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:59:58.909927  1622 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 12:59:58.942211  1737 tablet_bootstrap.cc:492] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:58.942298  1739 tablet_bootstrap.cc:492] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:58.943063  1739 ts_tablet_manager.cc:1403] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.019s
I20260709 12:59:58.943987  1942 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:58.945253  1807 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.946600  1739 raft_consensus.cc:359] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.947075  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:58.947551  1739 raft_consensus.cc:385] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:58.947813  1548 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.947990  1739 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:58.947291  1807 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:58.958181  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:58.958264  1739 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:58.959440  1622 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.965744  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:58.966542  1547 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.973235  1547 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:58.976809  1622 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 12:59:58.982326  1620 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:58.982115  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:58.983176  1739 ts_tablet_manager.cc:1434] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.004s
I20260709 12:59:58.984879  1739 tablet_bootstrap.cc:492] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
W20260709 12:59:58.988771  1586 leader_election.cc:343] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:58.993369  1737 tablet_bootstrap.cc:654] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:58.993574  1663 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:58.994354  1548 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:58.995497  1807 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:58.997574  1807 raft_consensus.cc:697] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 12:59:58.998736  1807 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.003450  1741 tablet_bootstrap.cc:492] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:59.003927  1741 ts_tablet_manager.cc:1403] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.158s	user 0.017s	sys 0.011s
I20260709 12:59:59.012504  1444 catalog_manager.cc:5697] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.017230  1789 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:59.027496  1741 raft_consensus.cc:359] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.028473  1741 raft_consensus.cc:385] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.028854  1741 raft_consensus.cc:740] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.030656  1741 consensus_queue.cc:260] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.033389  1741 ts_tablet_manager.cc:1434] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 12:59:59.038313  1741 tablet_bootstrap.cc:492] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:59.046602  1741 tablet_bootstrap.cc:654] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.046854  1789 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:59.063850  1587 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:59.066224  1886 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.068200  1741 tablet_bootstrap.cc:492] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:59.071033  1883 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:59.071151  1741 ts_tablet_manager.cc:1403] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.003s
I20260709 12:59:59.070930  1886 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.071614  1883 raft_consensus.cc:697] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 12:59:59.072427  1883 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.075663  1741 raft_consensus.cc:359] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.076314  1789 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:59.076843  1741 raft_consensus.cc:385] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.077452  1741 raft_consensus.cc:740] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.078583  1741 consensus_queue.cc:260] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.080176  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:59.070205  1737 tablet_bootstrap.cc:492] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:59.080358  1886 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:59.081770  1737 ts_tablet_manager.cc:1403] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.140s	user 0.021s	sys 0.013s
I20260709 12:59:59.086022  1741 ts_tablet_manager.cc:1434] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:59:59.085429  1737 raft_consensus.cc:359] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.087054  1737 raft_consensus.cc:385] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.087739  1789 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.088871  1789 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.090281  1947 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:59.094394  1789 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:59.087694  1737 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.096446  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 12:59:59.100111  1511 leader_election.cc:343] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:59.099649  1445 catalog_manager.cc:5697] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.068774  1739 tablet_bootstrap.cc:654] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.104336  1737 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.106632  1737 ts_tablet_manager.cc:1434] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:59:59.107622  1737 tablet_bootstrap.cc:492] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:59.107740  1741 tablet_bootstrap.cc:492] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:59.113521  1741 tablet_bootstrap.cc:654] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.115945  1883 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.116428  1883 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.119052  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:59.082562  1444 catalog_manager.cc:5697] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.123703  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:59.144758  1789 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.145635  1789 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.180667  1942 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.181224  1942 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.251814  1789 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:59.261564  1886 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:59.283712  1847 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.284401  1847 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 12:59:59.292884  1514 leader_election.cc:343] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:59.293520  1514 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:59.295130  1947 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:59.274955  1883 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:59.336030  1737 tablet_bootstrap.cc:654] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.296669  1847 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:59.331833  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:59.367640  1739 tablet_bootstrap.cc:492] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:59.368196  1739 ts_tablet_manager.cc:1403] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.384s	user 0.013s	sys 0.002s
I20260709 12:59:59.333184  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:59.370568  1859 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:59.302760  1789 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.067s
I20260709 12:59:59.376539  1546 raft_consensus.cc:2393] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 1: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 12:59:59.377808  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:59.380208  1739 raft_consensus.cc:359] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.381145  1739 raft_consensus.cc:385] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.381495  1739 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.286475  1663 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 12:59:59.394052  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:59.394982  1942 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:59.397161  1739 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.399238  1739 ts_tablet_manager.cc:1434] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:59:59.400853  1741 tablet_bootstrap.cc:492] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 12:59:59.405051  1741 ts_tablet_manager.cc:1403] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.297s	user 0.021s	sys 0.001s
I20260709 12:59:59.407549  1741 raft_consensus.cc:359] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.408190  1741 raft_consensus.cc:385] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.408458  1741 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.409126  1741 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.410569  1741 ts_tablet_manager.cc:1434] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:59:59.413555  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:59.414417  1689 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 12:59:59.401579  1807 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:59.416811  1739 tablet_bootstrap.cc:492] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
W20260709 12:59:59.401650  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 115269us
W20260709 12:59:59.422273  1511 leader_election.cc:343] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:59.422605  1696 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.414512  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:59.411367  1741 tablet_bootstrap.cc:492] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:59.427803  1586 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:59.430056  1807 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:59.430527  1942 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:59.431115  1942 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 12:59:59.431813  1942 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:59.452831  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 81394.1us
I20260709 12:59:59.455844  1994 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.456444  1994 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.464212  1942 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.461200  1737 tablet_bootstrap.cc:492] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:59.465008  1994 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:59.465564  1737 ts_tablet_manager.cc:1403] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.358s	user 0.011s	sys 0.027s
I20260709 12:59:59.468878  1807 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:59.467947  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:59.466197  1942 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:59.468580  1741 tablet_bootstrap.cc:654] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.474483  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:59.476011  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:59.476279  1623 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.476392  1695 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.479461  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:59.480530  1617 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 12:59:59.485884  1693 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.468209  1994 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.490064  1994 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.485910  1695 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
W20260709 12:59:59.512626  1586 leader_election.cc:343] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:59.517405  1994 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:59.506536  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:59.533643  1543 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 12:59:59.548827  1692 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:59:59.553098  1737 raft_consensus.cc:359] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.553802  1739 tablet_bootstrap.cc:654] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.553938  1737 raft_consensus.cc:385] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.555737  1737 raft_consensus.cc:740] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.556411  1737 consensus_queue.cc:260] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.558451  1737 ts_tablet_manager.cc:1434] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.000s
I20260709 12:59:59.559231  1737 tablet_bootstrap.cc:492] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 12:59:59.564157  1587 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:59.570032  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:59.571497  1514 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:59.572328  1789 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:59.572747  1789 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.573985  1789 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.573954  1883 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:59.580432  1587 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:59.582274  1939 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:59.582381  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:59.595990  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:59.596249  1833 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:59.604295  1739 tablet_bootstrap.cc:492] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:59.604389  1586 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 12:59:59.604983  1739 ts_tablet_manager.cc:1403] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.188s	user 0.003s	sys 0.014s
I20260709 12:59:59.582134  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 12:59:59.592099  1939 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.611829  1942 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:59.618567  1847 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:59.621255  1942 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 12:59:59.621779  1847 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:59.616909  1939 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.639133  1739 raft_consensus.cc:359] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.640051  1739 raft_consensus.cc:385] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.640362  1739 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.641911  1739 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.622556  1942 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.653558  1739 ts_tablet_manager.cc:1434] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.005s
I20260709 12:59:59.654466  1739 tablet_bootstrap.cc:492] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 12:59:59.701380  2011 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:59:59.714046  1547 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
W20260709 12:59:59.722728  1586 leader_election.cc:343] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:59.723925  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 83719.1us
W20260709 12:59:59.727034  1494 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:59.731164  1587 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 12:59:59.733486  1620 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:59.794842  2015 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:59.795534  2015 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.796136  2015 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:59.809010  1859 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.815361  1859 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.817245  1739 tablet_bootstrap.cc:654] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.812321  1741 tablet_bootstrap.cc:492] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
W20260709 12:59:59.821156  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 90318.1us
I20260709 12:59:59.820307  2014 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:59.835139  2010 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.831113  2014 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 12:59:59.836704  2010 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.838502  2014 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.841638  2014 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.844521  2010 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:59.847750  1741 ts_tablet_manager.cc:1403] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.437s	user 0.024s	sys 0.008s
I20260709 12:59:59.847337  1737 tablet_bootstrap.cc:654] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.854261  1741 raft_consensus.cc:359] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.850513  1859 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:59.867035  1741 raft_consensus.cc:385] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.869796  1741 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.863090  1939 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.882437  1939 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:59.887760  1789 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.897881  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:59.901535  1741 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.907079  1546 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 1: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 12:59:59.908449  1996 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:59:59.909644  1741 ts_tablet_manager.cc:1434] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 12:59:59.917487  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:59.919983  1739 tablet_bootstrap.cc:492] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 12:59:59.920558  1739 ts_tablet_manager.cc:1403] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.266s	user 0.011s	sys 0.013s
I20260709 12:59:59.924224  1789 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:59.924861  1446 catalog_manager.cc:5697] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 1 to 2, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.938964  1741 tablet_bootstrap.cc:492] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 12:59:59.942540  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:59.947945  2022 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.951437  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 12:59:59.948729  2022 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.953994  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:59.967106  1694 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:59.967176  2021 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:59:59.970471  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 12:59:59.970798  1739 raft_consensus.cc:359] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.971679  1739 raft_consensus.cc:385] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:59.971789  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 12:59:59.972090  1739 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 12:59:59.972621  1618 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 1: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 12:59:59.972868  1739 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.975953  1737 tablet_bootstrap.cc:492] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 12:59:59.976500  1737 ts_tablet_manager.cc:1403] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.417s	user 0.015s	sys 0.015s
I20260709 12:59:59.978909  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 12:59:59.979357  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 12:59:59.979744  1546 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 1: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 12:59:59.967829  2015 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 12:59:59.989575  2019 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:59:59.993418  1622 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 1: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 12:59:59.994728  2015 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 12:59:59.996161  2022 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 12:59:59.996730  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 12:59:59.997354  1546 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.000198  1737 raft_consensus.cc:359] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.001024  1737 raft_consensus.cc:385] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.001327  1737 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.002075  1737 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.005331  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:00.008109  1886 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:00.008831  1546 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
W20260709 13:00:00.008903  1586 leader_election.cc:343] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.013876  1741 tablet_bootstrap.cc:654] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:59.987573  1694 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:00.017448  1587 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.018558  1739 ts_tablet_manager.cc:1434] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.098s	user 0.009s	sys 0.000s
I20260709 13:00:00.018483  1586 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:00.020012  1939 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:00.020211  1739 tablet_bootstrap.cc:492] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:00.020646  1939 raft_consensus.cc:697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:00.021593  1939 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.023880  1833 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:00.024406  1833 raft_consensus.cc:697] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:00.025403  1737 ts_tablet_manager.cc:1434] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:00:00.025228  1833 consensus_queue.cc:237] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.031402  1737 tablet_bootstrap.cc:492] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
W20260709 13:00:00.032850  1511 leader_election.cc:343] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:00.033142  1514 leader_election.cc:343] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:00.040025  1511 leader_election.cc:343] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.040740  1514 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.042289  2014 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:00.054224  1739 tablet_bootstrap.cc:654] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.054905  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:00.102588  1663 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:00.105084  1511 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.104403  2022 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:00.115125  1741 tablet_bootstrap.cc:492] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:00.115655  1741 ts_tablet_manager.cc:1403] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.177s	user 0.018s	sys 0.017s
W20260709 13:00:00.115512  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 78391us
I20260709 13:00:00.121105  2013 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:00.143867  1511 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.145169  2013 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:00.150490  1544 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:00.152374  1741 raft_consensus.cc:359] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.153146  1741 raft_consensus.cc:385] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.153429  1741 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.156656  1739 tablet_bootstrap.cc:492] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:00.157162  1739 ts_tablet_manager.cc:1403] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.137s	user 0.009s	sys 0.019s
I20260709 13:00:00.159153  1737 tablet_bootstrap.cc:654] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.161012  1741 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.163966  2015 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:00.166972  1741 ts_tablet_manager.cc:1434] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:00:00.168670  1741 tablet_bootstrap.cc:492] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:00.170859  2015 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.171434  2015 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.171972  1739 raft_consensus.cc:359] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.172875  1739 raft_consensus.cc:385] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.173141  1739 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.173993  2015 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.174813  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:00.175660  1544 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:00.176754  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:00.176976  1587 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:00.177436  1693 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:00.177861  1833 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:00.178259  1833 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.178642  1833 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.174010  1739 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.181401  1739 ts_tablet_manager.cc:1434] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:00:00.182525  1739 tablet_bootstrap.cc:492] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:00.191644  1739 tablet_bootstrap.cc:654] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.193553  1833 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.197393  1833 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.200399  1737 tablet_bootstrap.cc:492] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:00.201325  1737 ts_tablet_manager.cc:1403] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.170s	user 0.017s	sys 0.005s
I20260709 13:00:00.201892  1694 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:00.203042  1741 tablet_bootstrap.cc:654] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.204604  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:00.205395  2015 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:00.205036  1737 raft_consensus.cc:359] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.205226  1694 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.206549  1737 raft_consensus.cc:385] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.207201  1737 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.208364  1737 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.212292  1739 tablet_bootstrap.cc:492] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:00.212488  1737 ts_tablet_manager.cc:1434] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:00:00.212800  1739 ts_tablet_manager.cc:1403] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.006s
I20260709 13:00:00.213721  1737 tablet_bootstrap.cc:492] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:00.217890  1739 raft_consensus.cc:359] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.218608  1739 raft_consensus.cc:385] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.218886  1739 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.220199  2013 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.220656  2013 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.221735  1741 tablet_bootstrap.cc:492] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:00.222185  1741 ts_tablet_manager.cc:1403] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.010s
I20260709 13:00:00.222883  2013 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.224713  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:00.226058  1737 tablet_bootstrap.cc:654] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:00.226686  1511 leader_election.cc:343] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.219782  1739 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.229429  1739 ts_tablet_manager.cc:1434] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:00:00.230866  1739 tablet_bootstrap.cc:492] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:00.239494  1741 raft_consensus.cc:359] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.240794  1741 raft_consensus.cc:385] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.241075  1741 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.241847  1739 tablet_bootstrap.cc:654] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.241698  1741 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.251538  1741 ts_tablet_manager.cc:1434] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:00:00.252539  1739 tablet_bootstrap.cc:492] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:00.253055  1739 ts_tablet_manager.cc:1403] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.003s
I20260709 13:00:00.254824  1737 tablet_bootstrap.cc:492] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:00.255275  1737 ts_tablet_manager.cc:1403] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.007s
I20260709 13:00:00.255899  1739 raft_consensus.cc:359] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.256667  1739 raft_consensus.cc:385] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.256923  1739 raft_consensus.cc:740] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.257665  1739 consensus_queue.cc:260] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.258090  1737 raft_consensus.cc:359] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.259969  1737 raft_consensus.cc:385] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.268862  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:00.252594  1741 tablet_bootstrap.cc:492] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:00.273273  1737 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.273455  1544 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.274003  1737 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.265041  2013 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.275214  2013 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.278009  1694 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:00.278077  2013 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.265977  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:00.281798  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:00.282323  1620 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 13:00:00.282500  1586 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:00.283275  2015 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:00.264027  1444 catalog_manager.cc:5697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:00.283607  1514 leader_election.cc:343] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.283835  2015 raft_consensus.cc:697] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:00.284040  1514 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.279636  1741 tablet_bootstrap.cc:654] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.284521  2015 consensus_queue.cc:237] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.280020  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:00.286298  2013 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:00.287315  1511 leader_election.cc:343] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.287964  1514 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.280826  1737 ts_tablet_manager.cc:1434] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:00:00.281080  1544 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:00.261488  1739 ts_tablet_manager.cc:1434] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:00.289929  1739 tablet_bootstrap.cc:492] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:00.290295  2013 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:00.284535  1444 catalog_manager.cc:5697] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.291357  2011 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.291996  2011 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.294880  2011 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.290985  2013 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.299014  1737 tablet_bootstrap.cc:492] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:00.299062  2013 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.307825  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:00.308019  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:00.311784  1514 leader_election.cc:343] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:00.314347  1511 leader_election.cc:343] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.314911  1511 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.316205  2011 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:00.317528  1739 tablet_bootstrap.cc:654] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.321790  1737 tablet_bootstrap.cc:654] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.335500  1741 tablet_bootstrap.cc:492] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:00.335242  2013 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.335933  1741 ts_tablet_manager.cc:1403] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.040s
I20260709 13:00:00.338603  1741 raft_consensus.cc:359] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.339239  1741 raft_consensus.cc:385] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.339546  1741 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.340241  2019 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.340413  2013 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.340204  1741 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.340973  2019 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.342880  1741 ts_tablet_manager.cc:1434] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:00.343914  1741 tablet_bootstrap.cc:492] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:00.345564  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:00.346619  1544 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 1: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:00.348855  1741 tablet_bootstrap.cc:654] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.349793  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:00:00.351455  1511 leader_election.cc:343] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.353204  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:00.353749  1620 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.353917  2019 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:00.354704  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:00.357875  1663 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:00.358817  2019 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.361722  1620 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:00.362859  1514 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.364218  2013 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:00.364663  2013 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:00.365451  2013 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.367472  1741 tablet_bootstrap.cc:492] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:00.368067  1741 ts_tablet_manager.cc:1403] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:00:00.365471  1737 tablet_bootstrap.cc:492] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:00.372562  1737 ts_tablet_manager.cc:1403] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.074s	user 0.006s	sys 0.018s
I20260709 13:00:00.371552  1741 raft_consensus.cc:359] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.372910  1741 raft_consensus.cc:385] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.373324  1741 raft_consensus.cc:740] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.373898  1741 consensus_queue.cc:260] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.377678  2019 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:00.382437  1741 ts_tablet_manager.cc:1434] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.005s
I20260709 13:00:00.382951  1739 tablet_bootstrap.cc:492] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:00.383438  1741 tablet_bootstrap.cc:492] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:00.383443  1739 ts_tablet_manager.cc:1403] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.094s	user 0.021s	sys 0.012s
I20260709 13:00:00.392333  1741 tablet_bootstrap.cc:654] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.395390  1446 catalog_manager.cc:5697] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.397998  1737 raft_consensus.cc:359] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.398840  1737 raft_consensus.cc:385] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.399166  1737 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.387077  1739 raft_consensus.cc:359] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.402459  1739 raft_consensus.cc:385] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.402792  1739 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.399854  1737 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.404116  1739 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.406590  1739 ts_tablet_manager.cc:1434] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.003s
I20260709 13:00:00.408473  1737 ts_tablet_manager.cc:1434] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:00:00.408572  1444 catalog_manager.cc:5697] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.409721  1737 tablet_bootstrap.cc:492] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:00.412294  1739 tablet_bootstrap.cc:492] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:00.416356  1737 tablet_bootstrap.cc:654] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.420799  1739 tablet_bootstrap.cc:654] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.425830  1741 tablet_bootstrap.cc:492] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:00.426452  1741 ts_tablet_manager.cc:1403] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.008s
I20260709 13:00:00.429970  1741 raft_consensus.cc:359] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.430511  1737 tablet_bootstrap.cc:492] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:00.430636  1741 raft_consensus.cc:385] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.430964  1737 ts_tablet_manager.cc:1403] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:00:00.430922  1741 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.431715  1741 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.433698  1741 ts_tablet_manager.cc:1434] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:00.435250  1741 tablet_bootstrap.cc:492] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:00.436178  1739 tablet_bootstrap.cc:492] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:00.436607  1739 ts_tablet_manager.cc:1403] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.007s
I20260709 13:00:00.439047  1739 raft_consensus.cc:359] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.439724  1739 raft_consensus.cc:385] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.439934  2015 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.440903  1741 tablet_bootstrap.cc:654] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.441430  1737 raft_consensus.cc:359] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.442117  1737 raft_consensus.cc:385] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.442373  1737 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.439993  1739 raft_consensus.cc:740] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.443399  1739 consensus_queue.cc:260] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.440510  2015 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.451699  1739 ts_tablet_manager.cc:1434] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:00:00.452651  1882 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.452934  1739 tablet_bootstrap.cc:492] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:00.453166  1882 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.455327  1882 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.456053  1737 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.456364  1882 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.456707  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:00.457337  1694 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:00.457959  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:00.458509  1547 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:00.459501  1586 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:00.460412  1833 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.461297  1739 tablet_bootstrap.cc:654] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.461474  2015 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.461609  1882 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:00.462102  1882 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.462486  1882 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.463094  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:00.463703  1547 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:00.464108  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:00.465919  1586 leader_election.cc:343] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.468945  1737 ts_tablet_manager.cc:1434] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 13:00:00.470108  1737 tablet_bootstrap.cc:492] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:00.478688  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.479825  2015 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:00.480216  2015 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.480531  2015 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.484433  1882 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.492317  1882 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.496690  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:00.497507  1696 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.498791  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:00.499634  1544 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.493614  2015 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.506508  2013 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.506922  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:00.507503  1547 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.507160  2013 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.509862  2013 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.512339  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:00.513422  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:00.515607  1511 leader_election.cc:343] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.517356  1547 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
W20260709 13:00:00.518808  1514 leader_election.cc:343] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.519381  1514 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.520797  2013 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:00.524303  2015 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.525660  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:00.533867  1696 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:00.535087  2013 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.535591  2013 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.538362  2013 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.543565  1737 tablet_bootstrap.cc:654] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.530277  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:00:00.550653  1586 leader_election.cc:343] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.551570  2015 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:00.552071  2015 raft_consensus.cc:697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:00.552882  2015 consensus_queue.cc:237] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.554672  1586 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:00.555647  1883 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:00.556102  1883 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:00.556435  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:00.556869  1883 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:00.560186  1511 leader_election.cc:343] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.564055  1544 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:00.569669  1883 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.570322  1883 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.570797  1882 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.572043  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:00.572840  1883 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.574820  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:00.575645  1689 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:00.583559  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:00.585314  1883 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:00.585747  1883 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.586143  1883 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:00.587003  1514 leader_election.cc:343] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.587561  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.589190  2013 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:00.590770  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:00.591554  1544 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:00.611009  1882 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:00.629806  1741 tablet_bootstrap.cc:492] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:00.630270  1741 ts_tablet_manager.cc:1403] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.195s	user 0.045s	sys 0.052s
I20260709 13:00:00.632175  1737 tablet_bootstrap.cc:492] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:00.632668  1737 ts_tablet_manager.cc:1403] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.163s	user 0.015s	sys 0.001s
I20260709 13:00:00.633924  1741 raft_consensus.cc:359] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.634618  1741 raft_consensus.cc:385] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.634917  1741 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.635078  1739 tablet_bootstrap.cc:492] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:00.635639  1739 ts_tablet_manager.cc:1403] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.183s	user 0.060s	sys 0.055s
I20260709 13:00:00.635670  1741 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.636991  1883 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.637825  1741 ts_tablet_manager.cc:1434] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:00:00.638777  1741 tablet_bootstrap.cc:492] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:00.638821  1737 raft_consensus.cc:359] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.642863  1737 raft_consensus.cc:385] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.643146  1737 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.643394  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:00.644100  1696 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.640545  1444 catalog_manager.cc:5697] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.641079  1739 raft_consensus.cc:359] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.644994  1739 raft_consensus.cc:385] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.645241  1739 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.645527  1741 tablet_bootstrap.cc:654] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.645454  1444 catalog_manager.cc:5697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.645833  1739 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.647933  1739 ts_tablet_manager.cc:1434] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:00:00.648813  1739 tablet_bootstrap.cc:492] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:00.641330  1883 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.643802  1737 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.654785  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:00.655381  1547 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.657125  1739 tablet_bootstrap.cc:654] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.660167  1737 ts_tablet_manager.cc:1434] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:00:00.668960  1737 tablet_bootstrap.cc:492] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:00.702351  1737 tablet_bootstrap.cc:654] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.664424  1547 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:00.719849  1883 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.720664  1883 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.724123  1883 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.725732  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:00.726377  1695 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:00.727523  1586 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:00.735121  1883 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:00.735761  1883 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.736258  1883 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.742697  1696 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:00.749888  1739 tablet_bootstrap.cc:492] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:00.750392  1739 ts_tablet_manager.cc:1403] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.102s	user 0.021s	sys 0.019s
I20260709 13:00:00.753701  1739 raft_consensus.cc:359] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.755169  1739 raft_consensus.cc:385] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.755463  1739 raft_consensus.cc:740] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.756070  1739 consensus_queue.cc:260] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.758219  1739 ts_tablet_manager.cc:1434] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:00.758440  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:00.759199  1739 tablet_bootstrap.cc:492] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:00.759302  1544 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:00.763041  1695 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.770045  2014 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.770546  2014 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.773087  2014 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.776963  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:00.779551  1587 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:00.779855  1883 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.780514  1939 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:00.780977  1939 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:00.781769  1939 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.782850  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:00.783497  1739 tablet_bootstrap.cc:654] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.783504  1695 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.787874  1883 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.793737  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:00.795823  2014 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:00.796980  1695 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
W20260709 13:00:00.797293  1511 leader_election.cc:343] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.799081  2015 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.800668  1586 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:00.802079  1883 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:00.802976  1883 raft_consensus.cc:697] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:00.803267  1737 tablet_bootstrap.cc:492] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:00.803745  1737 ts_tablet_manager.cc:1403] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.028s
I20260709 13:00:00.806253  1737 raft_consensus.cc:359] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.806855  1737 raft_consensus.cc:385] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.807114  1737 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.807758  1737 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.808593  2015 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.809053  2015 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:00.809451  1514 leader_election.cc:343] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.810061  1514 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.811038  2014 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:00.811463  1737 ts_tablet_manager.cc:1434] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:00.812353  1737 tablet_bootstrap.cc:492] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:00.812693  2015 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.812990  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:00.813609  1883 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:00.814203  1586 leader_election.cc:343] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.815011  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:00.815675  1544 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.824648  1737 tablet_bootstrap.cc:654] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.827613  1444 catalog_manager.cc:5697] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.830716  1544 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:00.836194  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:00.844338  1741 tablet_bootstrap.cc:492] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:00.843658  1546 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:00.844903  1741 ts_tablet_manager.cc:1403] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.206s	user 0.058s	sys 0.061s
I20260709 13:00:00.848474  1741 raft_consensus.cc:359] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.849171  1741 raft_consensus.cc:385] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.849423  1741 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
W20260709 13:00:00.850044  1494 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:00.850011  1741 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.851333  1739 tablet_bootstrap.cc:492] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:00.851833  1739 ts_tablet_manager.cc:1403] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.005s
I20260709 13:00:00.856851  1741 ts_tablet_manager.cc:1434] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:00:00.857827  1741 tablet_bootstrap.cc:492] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:00.859696  1739 raft_consensus.cc:359] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.860460  1739 raft_consensus.cc:385] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.860772  1739 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.861582  1739 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.864517  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.866007  1741 tablet_bootstrap.cc:654] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.870786  1939 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:00.871237  1939 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.871686  1939 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.881928  2014 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:00.900288  1882 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:00.866256  1739 ts_tablet_manager.cc:1434] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:00:00.908766  1739 tablet_bootstrap.cc:492] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:00.897646  1443 catalog_manager.cc:5697] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.915846  1939 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.921213  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:00:00.922796  1586 leader_election.cc:343] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:00.928068  1939 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:00.941402  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:00.942047  1544 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.957880  1741 tablet_bootstrap.cc:492] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:00.959384  1741 ts_tablet_manager.cc:1403] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.102s	user 0.033s	sys 0.046s
I20260709 13:00:00.962116  1544 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:00.962908  1739 tablet_bootstrap.cc:654] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.963555  1741 raft_consensus.cc:359] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.965946  1741 raft_consensus.cc:385] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.966351  1741 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.967170  1741 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.964321  1737 tablet_bootstrap.cc:492] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:00.968449  1737 ts_tablet_manager.cc:1403] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.156s	user 0.032s	sys 0.025s
I20260709 13:00:00.970818  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:00.971971  1939 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:00.972698  1939 raft_consensus.cc:697] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:00.972551  1737 raft_consensus.cc:359] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.973874  1737 raft_consensus.cc:385] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.973979  1695 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:00.974216  1737 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.974102  1939 consensus_queue.cc:237] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.975155  1737 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.977210  1737 ts_tablet_manager.cc:1434] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:00.979252  1741 ts_tablet_manager.cc:1434] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:00:00.980852  1739 tablet_bootstrap.cc:492] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:00.980363  1737 tablet_bootstrap.cc:492] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:00.981294  1739 ts_tablet_manager.cc:1403] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.003s
I20260709 13:00:00.984259  1741 tablet_bootstrap.cc:492] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:00.988300  1739 raft_consensus.cc:359] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.989645  1739 raft_consensus.cc:385] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:00.989930  1739 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:00.990139  1833 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:00.988950  1883 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:00.992096  1739 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:00.994227  1737 tablet_bootstrap.cc:654] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:00.998780  1739 ts_tablet_manager.cc:1434] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:00:00.999895  1739 tablet_bootstrap.cc:492] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:00.997849  1741 tablet_bootstrap.cc:654] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.022251  2015 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.022724  2015 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.023536  1737 tablet_bootstrap.cc:492] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:01.024168  1737 ts_tablet_manager.cc:1403] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.003s
I20260709 13:00:01.024699  2015 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.026218  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:01.026852  1544 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:01.028064  1587 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:01.028829  1833 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:01.029135  1833 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.029425  1833 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.031602  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:01.032220  1694 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:01.036221  1737 raft_consensus.cc:359] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.036116  1833 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.036927  1737 raft_consensus.cc:385] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.037220  1737 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.037809  1737 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.039285  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:01.039913  1544 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.039734  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:01.039767  1737 ts_tablet_manager.cc:1434] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:00:01.041566  1694 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.031073  1443 catalog_manager.cc:5697] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.044181  1737 tablet_bootstrap.cc:492] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:01.048595  1544 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:01.052379  1587 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:01.052273  2015 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:01.054850  1939 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:01.055289  1739 tablet_bootstrap.cc:654] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.055404  1939 raft_consensus.cc:697] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:01.056370  1939 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.057027  1737 tablet_bootstrap.cc:654] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.066426  1741 tablet_bootstrap.cc:492] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:01.067250  1741 ts_tablet_manager.cc:1403] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.083s	user 0.028s	sys 0.010s
I20260709 13:00:01.085316  1737 tablet_bootstrap.cc:492] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:01.085866  1737 ts_tablet_manager.cc:1403] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.004s
I20260709 13:00:01.082233  1741 raft_consensus.cc:359] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.088474  1741 raft_consensus.cc:385] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.088822  1741 raft_consensus.cc:740] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.092288  1741 consensus_queue.cc:260] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.091663  1739 tablet_bootstrap.cc:492] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:01.095108  1739 ts_tablet_manager.cc:1403] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.018s
I20260709 13:00:01.097698  1739 raft_consensus.cc:359] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.098388  1739 raft_consensus.cc:385] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.098709  1739 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.099390  1739 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.093928  1737 raft_consensus.cc:359] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.100366  1737 raft_consensus.cc:385] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.100462  1741 ts_tablet_manager.cc:1434] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 13:00:01.100698  1737 raft_consensus.cc:740] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.101475  1741 tablet_bootstrap.cc:492] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:01.101655  1737 consensus_queue.cc:260] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.105039  1739 ts_tablet_manager.cc:1434] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:00:01.103292  1737 ts_tablet_manager.cc:1434] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:00:01.107386  1739 tablet_bootstrap.cc:492] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:01.107115  1443 catalog_manager.cc:5697] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.074395  1833 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.112344  1741 tablet_bootstrap.cc:654] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.113998  1737 tablet_bootstrap.cc:492] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:01.122042  2015 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.122571  2015 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.124660  2015 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.126205  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:01.127530  1586 leader_election.cc:343] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.127542  1741 tablet_bootstrap.cc:492] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:01.128216  1741 ts_tablet_manager.cc:1403] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.004s
I20260709 13:00:01.131474  1741 raft_consensus.cc:359] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.132175  1741 raft_consensus.cc:385] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.132429  1741 raft_consensus.cc:740] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.133072  1741 consensus_queue.cc:260] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.136188  1741 ts_tablet_manager.cc:1434] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:01.137238  1741 tablet_bootstrap.cc:492] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:01.137270  1694 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:01.138852  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:01.139453  2015 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:01.139470  1547 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:01.142006  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:01.143595  1741 tablet_bootstrap.cc:654] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.143923  1737 tablet_bootstrap.cc:654] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.147403  1739 tablet_bootstrap.cc:654] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.148429  2015 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:01.148977  2015 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.149416  2015 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.167191  1939 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.167723  1939 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.169580  1939 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.171541  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:01.173681  1586 leader_election.cc:343] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.178781  1741 tablet_bootstrap.cc:492] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:01.179280  1741 ts_tablet_manager.cc:1403] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.020s
I20260709 13:00:01.179311  1739 tablet_bootstrap.cc:492] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:01.179862  1739 ts_tablet_manager.cc:1403] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.009s
I20260709 13:00:01.181686  1739 raft_consensus.cc:359] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.182317  1739 raft_consensus.cc:385] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.182020  1741 raft_consensus.cc:359] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.182603  1739 raft_consensus.cc:740] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.182684  1741 raft_consensus.cc:385] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.183151  1741 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.183290  1739 consensus_queue.cc:260] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.183787  1741 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.185315  1739 ts_tablet_manager.cc:1434] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:00:01.186830  1739 tablet_bootstrap.cc:492] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:01.187216  1741 ts_tablet_manager.cc:1434] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:01.189105  1741 tablet_bootstrap.cc:492] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:01.193383  2015 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.194880  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:01.199484  1737 tablet_bootstrap.cc:492] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:01.199972  1737 ts_tablet_manager.cc:1403] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.000s
I20260709 13:00:01.199844  1547 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:01.195863  1741 tablet_bootstrap.cc:654] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.195658  1833 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:01.202548  2015 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.202477  1737 raft_consensus.cc:359] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.203153  1737 raft_consensus.cc:385] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.203467  1737 raft_consensus.cc:740] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.203486  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:01.204217  1737 consensus_queue.cc:260] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:01.204773  1586 leader_election.cc:343] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.206651  1737 ts_tablet_manager.cc:1434] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:01.207468  1587 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:01.208071  1737 tablet_bootstrap.cc:492] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:01.198622  1739 tablet_bootstrap.cc:654] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.215551  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:01.215798  1737 tablet_bootstrap.cc:654] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.216171  1547 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.220605  1833 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:01.220945  1833 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.221233  1833 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.228005  1737 tablet_bootstrap.cc:492] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:01.228567  1737 ts_tablet_manager.cc:1403] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.001s
I20260709 13:00:01.228483  1833 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.233027  1737 raft_consensus.cc:359] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.233247  1939 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:01.233778  1737 raft_consensus.cc:385] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.233942  1741 tablet_bootstrap.cc:492] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:01.234086  1737 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.234354  1741 ts_tablet_manager.cc:1403] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.003s
I20260709 13:00:01.235036  1833 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.234715  1737 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.236747  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:01.239478  1546 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.240777  1737 ts_tablet_manager.cc:1434] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:00:01.237026  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:01.236910  1741 raft_consensus.cc:359] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.243793  1741 raft_consensus.cc:385] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.244170  1741 raft_consensus.cc:740] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.244215  1882 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.244818  1882 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.245106  1741 consensus_queue.cc:260] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.246706  1882 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.248799  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:01.249188  1741 ts_tablet_manager.cc:1434] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:00:01.249393  1695 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
W20260709 13:00:01.249953  1586 leader_election.cc:343] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.250605  1586 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:01.252295  1741 tablet_bootstrap.cc:492] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:01.252466  1883 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:01.252805  1883 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.253095  1883 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.253795  1882 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:01.268283  1886 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.269398  1886 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.268512  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:01.262387  1883 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.275789  1737 tablet_bootstrap.cc:492] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:01.277069  1883 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.281077  1547 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:01.288255  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:01.276290  1545 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:01.294590  1883 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:01.298434  1883 raft_consensus.cc:697] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:01.299314  1883 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.292677  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:01.302345  1547 raft_consensus.cc:2393] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 1: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:01.297334  1886 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:01.294204  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:01.308132  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:01.308732  1548 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.309206  1546 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:01.311667  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:01.317628  1587 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:01.318717  1939 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:01.319196  1939 raft_consensus.cc:697] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:01.320156  1741 tablet_bootstrap.cc:654] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.320052  1939 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.329681  1548 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:01.315033  1689 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.325003  1739 tablet_bootstrap.cc:492] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:01.335740  1739 ts_tablet_manager.cc:1403] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.149s	user 0.011s	sys 0.022s
I20260709 13:00:01.338505  1739 raft_consensus.cc:359] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.339947  1587 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:01.340974  2015 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:01.341617  2015 raft_consensus.cc:697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:01.342450  2015 consensus_queue.cc:237] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.339224  1739 raft_consensus.cc:385] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.346287  1739 raft_consensus.cc:740] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.346436  1741 tablet_bootstrap.cc:492] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:01.347239  1741 ts_tablet_manager.cc:1403] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.011s
I20260709 13:00:01.350075  1741 raft_consensus.cc:359] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.350637  1741 raft_consensus.cc:385] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.350864  1741 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.351656  1741 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.351768  1689 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:01.353322  1741 ts_tablet_manager.cc:1434] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:00:01.354204  1741 tablet_bootstrap.cc:492] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:01.356788  1739 consensus_queue.cc:260] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.358898  1739 ts_tablet_manager.cc:1434] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 13:00:01.359977  1739 tablet_bootstrap.cc:492] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:01.360070  1741 tablet_bootstrap.cc:654] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.363359  2015 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.363852  2015 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.366044  2015 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.366753  1737 tablet_bootstrap.cc:654] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.367661  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:01.338752  1661 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:01.373669  1886 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.375290  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:01.375855  1587 leader_election.cc:343] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.365525  1443 catalog_manager.cc:5697] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.375905  1694 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:01.382455  1586 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:01.384177  1939 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:01.383836  1883 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:01.384591  1939 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.384970  1939 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.387817  1737 tablet_bootstrap.cc:492] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:01.388302  1737 ts_tablet_manager.cc:1403] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.000s
I20260709 13:00:01.390379  1886 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:01.394418  1939 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.400079  1939 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.401932  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:01.402529  1695 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.402889  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:00:01.404279  1587 leader_election.cc:343] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.391120  1737 raft_consensus.cc:359] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.404806  1737 raft_consensus.cc:385] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.405059  1737 raft_consensus.cc:740] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.392234  1741 tablet_bootstrap.cc:492] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:01.391475  1443 catalog_manager.cc:5697] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.405689  1737 consensus_queue.cc:260] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.407389  1443 catalog_manager.cc:5697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.406272  1741 ts_tablet_manager.cc:1403] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.018s
I20260709 13:00:01.396488  1739 tablet_bootstrap.cc:654] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.414280  1741 raft_consensus.cc:359] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.414925  1741 raft_consensus.cc:385] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.415199  1741 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.415814  1741 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.417527  1737 ts_tablet_manager.cc:1434] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:00:01.418603  1737 tablet_bootstrap.cc:492] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:01.421617  1741 ts_tablet_manager.cc:1434] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:00:01.422664  1741 tablet_bootstrap.cc:492] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:01.422874  2013 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.424281  2013 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.427028  2013 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.438508  1695 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:01.429100  1886 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.440714  1886 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.428937  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:01.432516  2014 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.450941  1886 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:01.451048  2014 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.439350  1737 tablet_bootstrap.cc:654] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.428771  1741 tablet_bootstrap.cc:654] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.450310  2015 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:01.448390  1586 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:01.454718  2015 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:01.455193  2015 raft_consensus.cc:697] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:01.453261  2014 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.453316  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:01.457340  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:01.457875  1514 leader_election.cc:343] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.457957  1620 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
W20260709 13:00:01.460547  1511 leader_election.cc:343] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.461133  1511 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:01.460264  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:01.461892  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:01.461971  1545 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
I20260709 13:00:01.462209  1663 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:01.462359  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:01.462525  1623 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 13:00:01.462970  1695 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 13:00:01.463294  2013 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:01.464390  1886 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:01.464481  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:01.464836  1886 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.465199  1886 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.462985  2015 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.466250  2068 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:01.466857  2068 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.467208  2068 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.472049  1886 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.474001  1886 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:01.475734  1739 tablet_bootstrap.cc:492] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:01.476379  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:01.477098  1739 ts_tablet_manager.cc:1403] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.117s	user 0.022s	sys 0.022s
I20260709 13:00:01.481194  1737 tablet_bootstrap.cc:492] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:01.481612  1737 ts_tablet_manager.cc:1403] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.000s
I20260709 13:00:01.482913  1882 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.483349  1882 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.485431  1882 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.487107  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:01.487854  1623 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.485172  1739 raft_consensus.cc:359] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.488822  1737 raft_consensus.cc:359] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.491321  1739 raft_consensus.cc:385] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.492396  1737 raft_consensus.cc:385] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.496855  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:01.495864  1444 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.501348  1623 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
W20260709 13:00:01.499580  1587 leader_election.cc:343] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.492738  1741 tablet_bootstrap.cc:492] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:01.502767  1741 ts_tablet_manager.cc:1403] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.080s	user 0.020s	sys 0.003s
I20260709 13:00:01.502647  1663 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:01.503638  2093 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:01.504215  2093 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:01.498340  1737 raft_consensus.cc:740] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.505642  1737 consensus_queue.cc:260] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.505164  2093 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.496737  1739 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.507460  1737 ts_tablet_manager.cc:1434] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 13:00:01.508311  1739 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.509644  1737 tablet_bootstrap.cc:492] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:01.510993  1739 ts_tablet_manager.cc:1434] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:00:01.512009  1739 tablet_bootstrap.cc:492] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:01.508442  1741 raft_consensus.cc:359] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.516371  1741 raft_consensus.cc:385] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.516657  1741 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.517352  1741 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.518150  1739 tablet_bootstrap.cc:654] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.520597  1741 ts_tablet_manager.cc:1434] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 13:00:01.523804  1737 tablet_bootstrap.cc:654] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.524895  1741 tablet_bootstrap.cc:492] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:01.494200  2068 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.533695  2013 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.534339  1739 tablet_bootstrap.cc:492] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:01.534238  2013 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.534802  1739 ts_tablet_manager.cc:1403] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.011s
I20260709 13:00:01.536255  2013 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.537282  1739 raft_consensus.cc:359] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.538121  1739 raft_consensus.cc:385] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.538380  1739 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.538892  1741 tablet_bootstrap.cc:654] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.539804  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:01.535341  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:01.538985  1739 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.544049  1739 ts_tablet_manager.cc:1434] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:00:01.544888  1739 tablet_bootstrap.cc:492] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
W20260709 13:00:01.546337  1511 leader_election.cc:343] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.548101  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:01.548863  1623 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 13:00:01.549991  1514 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:01.550402  1739 tablet_bootstrap.cc:654] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.551025  2013 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:01.551376  2013 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.551709  2013 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.552197  1737 tablet_bootstrap.cc:492] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:01.552627  1737 ts_tablet_manager.cc:1403] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.008s
I20260709 13:00:01.555178  1737 raft_consensus.cc:359] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.555857  1737 raft_consensus.cc:385] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.556123  1737 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.557204  1548 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 1: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:01.556936  1737 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.559033  1737 ts_tablet_manager.cc:1434] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:01.560066  1737 tablet_bootstrap.cc:492] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:01.564625  2013 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.566874  2068 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.575757  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:01.576557  1623 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 1: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:01.587585  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:01.588193  1623 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.589224  1737 tablet_bootstrap.cc:654] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.589931  1443 catalog_manager.cc:5697] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:01.600806  1737 tablet_bootstrap.cc:492] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:01.601279  1737 ts_tablet_manager.cc:1403] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 13:00:01.608415  1623 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:01.608660  1739 tablet_bootstrap.cc:492] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:01.611521  1739 ts_tablet_manager.cc:1403] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.003s
W20260709 13:00:01.612757  1586 leader_election.cc:343] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.613392  1586 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:01.610667  2013 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.614909  1939 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:01.615769  1514 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:01.614109  1739 raft_consensus.cc:359] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.618147  1739 raft_consensus.cc:385] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.618611  1739 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.620519  1739 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.619243  2068 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:01.622550  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:01.624491  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:01.629858  2068 raft_consensus.cc:697] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:01.631906  1886 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.632603  1886 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.635433  1511 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:01.637005  1511 leader_election.cc:343] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.636677  1886 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:01.637303  2014 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:01.641597  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:01.641464  1737 raft_consensus.cc:359] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.642576  1737 raft_consensus.cc:385] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.642935  1737 raft_consensus.cc:740] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.645525  1739 ts_tablet_manager.cc:1434] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:00:01.631357  2068 consensus_queue.cc:237] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.667261  1737 consensus_queue.cc:260] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.647662  2015 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:01.650315  2019 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.668361  2019 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.668901  1737 ts_tablet_manager.cc:1434] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 13:00:01.669858  1737 tablet_bootstrap.cc:492] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:01.670275  2019 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:01.660101  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:01.671463  1548 raft_consensus.cc:2393] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 1: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:01.672755  1741 tablet_bootstrap.cc:492] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:01.673506  1741 ts_tablet_manager.cc:1403] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.152s	user 0.017s	sys 0.031s
I20260709 13:00:01.677215  2015 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:00:01.698807  1739 tablet_bootstrap.cc:492] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:01.699800  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:01.705935  1548 raft_consensus.cc:2393] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 1: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:01.700145  1741 raft_consensus.cc:359] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.702080  2068 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.707053  2068 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.709076  2068 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.709937  1741 raft_consensus.cc:385] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.710247  1741 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.710932  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:01.710880  1741 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.712013  1623 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 13:00:01.713073  1741 ts_tablet_manager.cc:1434] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:00:01.713204  1663 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:01.713608  1514 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:01.713955  1886 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.714125  1741 tablet_bootstrap.cc:492] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:01.714757  2013 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:01.715122  2013 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.715451  2013 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.718510  1737 tablet_bootstrap.cc:654] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.722724  1883 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:01.725872  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:01.729244  2013 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.729725  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:01.731670  1663 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:00:01.731463  1511 leader_election.cc:343] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.734839  2022 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.740377  1833 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:01.741453  1886 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:01.744932  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:01.745731  1623 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.754135  1623 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:01.753621  1443 catalog_manager.cc:5697] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.755860  1514 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:01.756656  2068 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:01.757225  1739 tablet_bootstrap.cc:654] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.759811  2013 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.751240  2022 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:01.757231  2068 raft_consensus.cc:697] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:01.767733  1833 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:01.768400  2068 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.773789  2116 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:01.765218  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:01.776283  1883 consensus_queue.cc:1048] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:01.780081  1883 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.780642  1833 consensus_queue.cc:1048] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:01.781425  1511 leader_election.cc:343] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.780560  1883 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.789446  1883 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.790203  1741 tablet_bootstrap.cc:654] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.796427  1737 tablet_bootstrap.cc:492] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:01.797176  1737 ts_tablet_manager.cc:1403] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.128s	user 0.004s	sys 0.014s
I20260709 13:00:01.795360  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:01.811095  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:01.811893  1543 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:01.820856  1587 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:01.821552  1883 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:01.822636  1883 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.823263  1883 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:01.853948  2118 log.cc:927] Time spent T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:00:01.865787  1739 tablet_bootstrap.cc:492] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:01.866353  1739 ts_tablet_manager.cc:1403] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.200s	user 0.015s	sys 0.007s
I20260709 13:00:01.867543  1446 catalog_manager.cc:5697] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.881587  1737 raft_consensus.cc:359] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.882808  1886 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.884219  1737 raft_consensus.cc:385] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.884539  1737 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.884387  1886 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.885161  1737 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.885944  1883 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.895854  1886 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:01.896416  1692 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:01.897657  1883 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.902508  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:01.902513  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:01.906077  1663 leader_election.cc:343] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.910140  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:01.910444  1739 raft_consensus.cc:359] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.911259  1548 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.912775  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:01.913331  1739 raft_consensus.cc:385] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.913659  1739 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.913937  1741 tablet_bootstrap.cc:492] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:01.914389  1741 ts_tablet_manager.cc:1403] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.200s	user 0.010s	sys 0.010s
I20260709 13:00:01.914319  1739 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.915060  1882 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:01.917250  2068 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.918118  1548 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:01.917764  2068 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.920274  2022 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.920969  2068 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:01.921710  2022 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.924216  1587 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:01.925060  1882 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:01.925648  1882 raft_consensus.cc:697] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:01.926678  1882 consensus_queue.cc:237] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.928841  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:01.929167  2022 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:01.931013  1739 ts_tablet_manager.cc:1434] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.003s
I20260709 13:00:01.931005  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:01.932075  1739 tablet_bootstrap.cc:492] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
W20260709 13:00:01.932560  1663 leader_election.cc:343] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.935092  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:01.936013  1694 raft_consensus.cc:2393] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 1: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:01.940217  1739 tablet_bootstrap.cc:654] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:01.944164  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:01.944842  1543 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 0.
W20260709 13:00:01.939064  1661 leader_election.cc:343] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:01.946460  1661 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:01.947615  2022 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:01.947809  1511 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:01.948700  2068 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.956662  1741 raft_consensus.cc:359] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.957617  1741 raft_consensus.cc:385] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:01.957893  1741 raft_consensus.cc:740] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:01.958550  1741 consensus_queue.cc:260] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.963928  1737 ts_tablet_manager.cc:1434] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.166s	user 0.007s	sys 0.005s
I20260709 13:00:01.969192  2014 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.000576  1741 ts_tablet_manager.cc:1434] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 13:00:01.999850  2014 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:01.976938  1661 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:01.964839  2068 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:02.004683  1886 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:02.005187  1886 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.005565  1886 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:01.999851  1737 tablet_bootstrap.cc:492] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:01.984112  1939 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:02.013366  2068 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.013967  2068 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.016199  2068 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:02.018767  2014 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:02.047827  1737 tablet_bootstrap.cc:654] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:02.003093  1741 tablet_bootstrap.cc:492] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:02.064128  1886 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.074146  1886 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:02.088387  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:02.093920  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:02.094533  1623 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 13:00:02.097276  1886 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:00:02.098641  1514 leader_election.cc:343] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:02.106475  1514 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:02.107188  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:02.107796  1623 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:02.122877  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:02.123905  1547 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:02.141325  2116 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:02.145202  1547 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:02.155153  1741 tablet_bootstrap.cc:654] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:02.147185  1886 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:02.156522  1623 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:02.158248  1739 tablet_bootstrap.cc:492] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:02.158679  1739 ts_tablet_manager.cc:1403] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.227s	user 0.053s	sys 0.070s
W20260709 13:00:02.152720  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 45377.4us
I20260709 13:00:02.152973  2102 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:02.168987  2102 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.177441  2102 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:02.197189  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:02.201936  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:02.202275  2137 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:02.202783  2137 raft_consensus.cc:697] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:02.203575  2137 consensus_queue.cc:237] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.210656  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:02.210879  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 50979.4us
I20260709 13:00:02.213207  1739 raft_consensus.cc:359] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.214392  1739 raft_consensus.cc:385] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:02.214756  1739 raft_consensus.cc:740] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:02.219971  1739 consensus_queue.cc:260] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:02.229628  1494 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:02.232270  1741 tablet_bootstrap.cc:492] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:02.232321  1737 tablet_bootstrap.cc:492] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:02.232784  1741 ts_tablet_manager.cc:1403] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.230s	user 0.023s	sys 0.020s
I20260709 13:00:02.232889  1737 ts_tablet_manager.cc:1403] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.233s	user 0.015s	sys 0.019s
W20260709 13:00:02.261960  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 44662.9us
W20260709 13:00:02.263223  1511 leader_election.cc:343] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:02.266688  1511 leader_election.cc:343] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:02.267334  1511 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:02.259130  2068 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:00:02.266395  1737 raft_consensus.cc:359] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.277190  1737 raft_consensus.cc:385] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:02.277565  1737 raft_consensus.cc:740] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:02.273690  2102 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.283061  2102 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:02.284847  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:02.285126  1737 consensus_queue.cc:260] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.285557  1623 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:02.287622  1739 ts_tablet_manager.cc:1434] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.129s	user 0.020s	sys 0.030s
I20260709 13:00:02.289033  1737 ts_tablet_manager.cc:1434] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 13:00:02.278920  2140 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:02.291929  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:02.326262  1444 catalog_manager.cc:5697] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:02.297468  1623 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:02.302657  1739 tablet_bootstrap.cc:492] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:02.307298  1443 catalog_manager.cc:5697] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 0 to 1, leader changed from <none> to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:02.313726  1574 tablet.cc:2406] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:00:02.392271  1737 tablet_bootstrap.cc:492] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
W20260709 13:00:02.408546  1511 leader_election.cc:343] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:02.411127  1741 raft_consensus.cc:359] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:02.411677  1511 consensus_peers.cc:597] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:02.411921  1741 raft_consensus.cc:385] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:02.412251  1741 raft_consensus.cc:740] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:02.412884  1741 consensus_queue.cc:260] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.415351  1514 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:02.411142  1737 tablet_bootstrap.cc:654] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:02.425215  1739 tablet_bootstrap.cc:654] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:02.408432  1693 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:02.433374  2141 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:02.433956  2141 raft_consensus.cc:697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:02.435400  2141 consensus_queue.cc:237] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.451527  1696 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:02.481087  1741 ts_tablet_manager.cc:1434] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.248s	user 0.011s	sys 0.013s
I20260709 13:00:02.490109  1741 tablet_bootstrap.cc:492] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:02.494766  2013 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:00:02.514810  2132 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.547909  1741 tablet_bootstrap.cc:654] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:02.556416  2132 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.565132  1833 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:02.592525  1739 tablet_bootstrap.cc:492] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:02.596300  1739 ts_tablet_manager.cc:1403] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.299s	user 0.022s	sys 0.017s
I20260709 13:00:02.600257  2132 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:02.603579  1737 tablet_bootstrap.cc:492] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:02.604992  1737 ts_tablet_manager.cc:1403] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.213s	user 0.014s	sys 0.012s
I20260709 13:00:02.606057  2022 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.613044  2132 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:00:02.617759  1737 raft_consensus.cc:359] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.617755  2022 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.618809  1737 raft_consensus.cc:385] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:02.619208  1737 raft_consensus.cc:740] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:02.621793  1737 consensus_queue.cc:260] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.622360  2022 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:00:02.629200  2146 log.cc:927] Time spent T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:00:02.652320  1737 ts_tablet_manager.cc:1434] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:00:02.661720  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:02.661509  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:02.666752  1737 tablet_bootstrap.cc:492] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:02.664615  1688 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 13:00:02.669286  1511 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:02.673926  1739 raft_consensus.cc:359] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.676931  1739 raft_consensus.cc:385] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:02.677320  1739 raft_consensus.cc:740] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
W20260709 13:00:02.680968  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 58629.5us
I20260709 13:00:02.684087  1739 consensus_queue.cc:260] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.685990  1883 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:02.682519  2013 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:02.696050  2013 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.713954  2013 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:02.771596  1739 ts_tablet_manager.cc:1434] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.175s	user 0.010s	sys 0.002s
I20260709 13:00:02.772876  1739 tablet_bootstrap.cc:492] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:02.838874  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:02.842003  1741 tablet_bootstrap.cc:492] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:02.842640  1741 ts_tablet_manager.cc:1403] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.358s	user 0.037s	sys 0.024s
I20260709 13:00:02.849740  1737 tablet_bootstrap.cc:654] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:02.862738  1739 tablet_bootstrap.cc:654] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:02.868930  2155 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.873615  1741 raft_consensus.cc:359] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.875079  1741 raft_consensus.cc:385] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:02.875386  1741 raft_consensus.cc:740] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:02.876150  1741 consensus_queue.cc:260] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.873080  2155 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.880213  2155 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:02.884732  1741 ts_tablet_manager.cc:1434] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.042s	user 0.000s	sys 0.008s
I20260709 13:00:02.886628  2013 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.887909  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:02.890846  1614 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 13:00:02.892046  2013 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:02.906349  1883 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.906924  1883 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:02.910471  1883 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:02.934619  1663 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:02.932471  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:02.937202  1444 catalog_manager.cc:5697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:02.948621  1741 tablet_bootstrap.cc:492] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:02.950363  1737 tablet_bootstrap.cc:492] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:02.950901  1737 ts_tablet_manager.cc:1403] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.287s	user 0.013s	sys 0.004s
I20260709 13:00:02.951496  2022 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:02.956738  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:02.932560  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:02.960412  1690 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:02.931656  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:02.961896  1689 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:02.964478  1886 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:02.942575  1614 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:02.973176  1587 leader_election.cc:343] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:02.983208  2022 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:02.991199  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:02.996137  1542 raft_consensus.cc:2393] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 1: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:03.035246  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:03.035953  1694 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:03.043897  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 47460.3us
I20260709 13:00:03.117069  1737 raft_consensus.cc:359] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.118662  1737 raft_consensus.cc:385] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:03.119853  1737 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:03.122195  1737 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.129142  1694 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:03.151777  1737 ts_tablet_manager.cc:1434] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.201s	user 0.010s	sys 0.008s
I20260709 13:00:03.094161  1614 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:03.143111  1586 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:03.163282  1511 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:03.176339  1586 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:03.179524  1737 tablet_bootstrap.cc:492] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:03.173640  2141 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:03.205196  1737 tablet_bootstrap.cc:654] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:03.184002  2116 raft_consensus.cc:2764] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:00:03.192869  1939 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:03.221975  1739 tablet_bootstrap.cc:492] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:03.222692  1739 ts_tablet_manager.cc:1403] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.450s	user 0.026s	sys 0.028s
I20260709 13:00:03.213861  2141 raft_consensus.cc:697] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:03.219208  1939 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.255929  2169 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.256700  2169 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.251253  1939 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:03.273499  2163 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:00:03.297387  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:03.311813  1737 tablet_bootstrap.cc:492] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:03.312577  1737 ts_tablet_manager.cc:1403] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.154s	user 0.024s	sys 0.028s
I20260709 13:00:03.308322  2169 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:03.291504  2141 consensus_queue.cc:237] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.347158  1741 tablet_bootstrap.cc:654] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:03.361140  1737 raft_consensus.cc:359] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.362157  1737 raft_consensus.cc:385] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:03.362465  1737 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:03.369380  1737 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.406421  1739 raft_consensus.cc:359] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.408876  1739 raft_consensus.cc:385] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:03.409190  1737 ts_tablet_manager.cc:1434] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.002s
I20260709 13:00:03.409206  1739 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:03.411556  1739 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:03.414382  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 49832.1us
I20260709 13:00:03.423650  1739 ts_tablet_manager.cc:1434] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.200s	user 0.015s	sys 0.000s
I20260709 13:00:03.456192  2171 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:03.463081  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 45176.4us
W20260709 13:00:03.475873  2181 log.cc:927] Time spent T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:00:03.491281  2182 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:03.496279  2180 log.cc:927] Time spent T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:00:03.491880  2182 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.472424  2171 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.507187  2182 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:03.508308  1939 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.510315  1939 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:03.511642  2171 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:03.512864  2157 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.513441  2157 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.516147  2157 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:03.516961  1739 tablet_bootstrap.cc:492] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb: Bootstrap starting.
I20260709 13:00:03.509217  1741 tablet_bootstrap.cc:492] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:03.520428  1741 ts_tablet_manager.cc:1403] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.572s	user 0.016s	sys 0.013s
I20260709 13:00:03.522143  1737 tablet_bootstrap.cc:492] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:03.523620  1741 raft_consensus.cc:359] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.524317  1741 raft_consensus.cc:385] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:03.524786  1741 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:03.525909  1741 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.536641  1739 tablet_bootstrap.cc:654] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:03.536964  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:03.540616  1695 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:03.545017  1741 ts_tablet_manager.cc:1434] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:00:03.546134  1741 tablet_bootstrap.cc:492] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:03.549891  1695 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:03.539148  1737 tablet_bootstrap.cc:654] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:03.552182  1741 tablet_bootstrap.cc:654] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:03.557227  1586 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:03.558934  1882 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:03.559585  1882 raft_consensus.cc:697] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:03.560624  1882 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.561672  1739 tablet_bootstrap.cc:492] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb: No bootstrap required, opened a new log
I20260709 13:00:03.562482  1739 ts_tablet_manager.cc:1403] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.005s
I20260709 13:00:03.562517  1737 tablet_bootstrap.cc:492] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:03.563297  1737 ts_tablet_manager.cc:1403] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.002s
I20260709 13:00:03.567679  1739 raft_consensus.cc:359] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.568869  1739 raft_consensus.cc:385] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:03.569434  1739 raft_consensus.cc:740] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Initialized, Role: FOLLOWER
I20260709 13:00:03.570274  1739 consensus_queue.cc:260] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.573541  1739 ts_tablet_manager.cc:1434] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:00:03.574782  1737 raft_consensus.cc:359] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.575601  1737 raft_consensus.cc:385] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:03.575865  1737 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:03.576474  1737 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.578154  1737 ts_tablet_manager.cc:1434] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:00:03.580669  1741 tablet_bootstrap.cc:492] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:03.582387  1741 ts_tablet_manager.cc:1403] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.002s
I20260709 13:00:03.590076  1741 raft_consensus.cc:359] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.591714  1741 raft_consensus.cc:385] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:03.592093  1741 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:03.593683  1737 tablet_bootstrap.cc:492] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:03.593839  1695 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:03.593963  2171 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:03.597813  1741 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.608006  1688 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:03.609611  1737 tablet_bootstrap.cc:654] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:03.612856  1741 ts_tablet_manager.cc:1434] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 13:00:03.614809  1741 tablet_bootstrap.cc:492] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: Bootstrap starting.
I20260709 13:00:03.621160  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:03.621873  1617 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 13:00:03.621937  1741 tablet_bootstrap.cc:654] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:03.626487  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:03.627249  1697 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 0.
I20260709 13:00:03.629123  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:03.630685  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:03.657085  2182 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.657838  2182 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.664634  2182 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:03.672091  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:03.692625  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:03.693488  1544 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:03.725386  1494 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:03.727151  1443 catalog_manager.cc:5697] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:03.733192  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:03.737213  2155 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.737257  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:03.738379  2155 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.740201  1544 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:03.742205  2155 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:03.743046  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:03.744676  1586 leader_election.cc:343] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:03.745429  1514 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:00:03.746838  1514 leader_election.cc:343] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:03.747267  2133 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:03.747701  2133 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.748055  2133 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:03.749444  1737 tablet_bootstrap.cc:492] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:03.749936  1737 ts_tablet_manager.cc:1403] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.156s	user 0.047s	sys 0.046s
I20260709 13:00:03.755810  2133 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.757741  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:03.758057  1741 tablet_bootstrap.cc:492] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: No bootstrap required, opened a new log
I20260709 13:00:03.758682  1689 raft_consensus.cc:2393] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 1: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:03.758723  1741 ts_tablet_manager.cc:1403] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: Time spent bootstrapping tablet: real 0.144s	user 0.048s	sys 0.075s
I20260709 13:00:03.761843  1663 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:03.763326  2188 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:03.764232  2133 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:03.761631  1741 raft_consensus.cc:359] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.764936  1741 raft_consensus.cc:385] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:03.765287  1741 raft_consensus.cc:740] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Initialized, Role: FOLLOWER
I20260709 13:00:03.757203  1737 raft_consensus.cc:359] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.766201  1737 raft_consensus.cc:385] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:03.766716  1737 raft_consensus.cc:740] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:03.766577  1741 consensus_queue.cc:260] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.769212  1741 ts_tablet_manager.cc:1434] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:00:03.778208  1663 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:03.780731  2019 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:03.778895  1737 consensus_queue.cc:260] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.786255  1737 ts_tablet_manager.cc:1434] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:00:03.786239  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:03.787577  1737 tablet_bootstrap.cc:492] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Bootstrap starting.
I20260709 13:00:03.788149  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:03.788787  1615 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:03.794445  1511 leader_election.cc:343] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:03.794963  1511 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:03.796119  1737 tablet_bootstrap.cc:654] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:03.797704  2014 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:03.799918  1615 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:03.809885  2171 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:03.814112  2014 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:03.821429  1511 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:03.822209  2014 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:03.831732  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:03.832405  1540 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:03.835834  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:03.836444  1689 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:03.851135  1689 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:03.859493  1511 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:03.864823  2014 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:03.865417  2014 raft_consensus.cc:697] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:03.867203  2014 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.883750  2174 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.884447  2174 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.889523  2174 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:03.899123  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:03.903044  1689 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:03.914083  1586 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:03.914872  2155 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:03.915233  2155 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.915565  2155 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:03.917255  1587 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:03.919396  1833 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:03.919883  1833 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.921046  1833 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:03.932180  1833 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.932430  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:03.933164  1540 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 0.
I20260709 13:00:03.934944  1833 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:03.936129  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:00:03.937373  1586 leader_election.cc:343] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:03.951155  1737 tablet_bootstrap.cc:492] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: No bootstrap required, opened a new log
I20260709 13:00:03.951311  2155 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.952296  1737 ts_tablet_manager.cc:1403] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent bootstrapping tablet: real 0.165s	user 0.047s	sys 0.071s
I20260709 13:00:03.955500  2155 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:03.955225  1737 raft_consensus.cc:359] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.955974  1737 raft_consensus.cc:385] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:03.956815  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:03.957917  1695 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:03.961470  1737 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Initialized, Role: FOLLOWER
I20260709 13:00:03.962405  1737 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.964669  1737 ts_tablet_manager.cc:1434] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:00:03.961781  1446 catalog_manager.cc:5697] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:03.969374  1446 catalog_manager.cc:5697] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:03.977321  1695 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:03.978623  1586 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:03.980156  1833 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:03.980962  1833 raft_consensus.cc:697] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:03.982013  1833 consensus_queue.cc:237] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:03.990587  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:03.991155  1544 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:03.994714  2182 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:04.013746  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:04.014724  1540 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:04.012518  1544 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:04.032932  1540 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:04.050566  1833 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:04.057924  1444 catalog_manager.cc:5697] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.063354  1587 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:04.065330  2174 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:04.065833  2174 raft_consensus.cc:697] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:04.066912  2174 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:04.094738  2172 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:00:04.147352  1446 catalog_manager.cc:5697] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.271499  2171 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:04.287632  2171 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:04.370688  2019 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.371253  2019 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:04.374789  2019 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:04.374929  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:04.376103  1542 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 1: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:04.376312  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:04.377907  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:04.378839  2019 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:04.389021  2019 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:04.460453  2172 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:04.487975  2172 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:04.491595  2155 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:04.514060  2155 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:05.664882   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:05.703236  2225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:05.705096  2223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:05.705153  2222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:05.705812   430 server_base.cc:1061] running on GCE node
I20260709 13:00:05.711524   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:05.711829   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:05.712071   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602005712043 us; error 0 us; skew 500 ppm
I20260709 13:00:05.713330   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:05.719636   430 webserver.cc:533] Webserver started at http://127.0.107.132:42467/ using document root <none> and password file <none>
I20260709 13:00:05.720352   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:05.720544   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:05.720824   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:05.722285   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-3-root/instance:
uuid: "e37b8013aec24431a6672a857806329e"
format_stamp: "Formatted at 2026-07-09 13:00:05 on dist-test-slave-th5x"
I20260709 13:00:05.728407   430 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:00:05.735098  2230 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:05.736280   430 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.002s
I20260709 13:00:05.737125   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-3-root
uuid: "e37b8013aec24431a6672a857806329e"
format_stamp: "Formatted at 2026-07-09 13:00:05 on dist-test-slave-th5x"
I20260709 13:00:05.738061   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:05.787894   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:05.798465   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:05.816049   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:05.820724   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:05.821014   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:05.821339   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:05.821592   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:06.110392   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.132:39517
I20260709 13:00:06.111069  2296 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.132:39517 every 8 connection(s)
I20260709 13:00:06.121315   430 auto_leader_rebalancer-test.cc:384] add a tserver: e37b8013aec24431a6672a857806329e
I20260709 13:00:06.146430  2297 heartbeater.cc:344] Connected to a master server at 127.0.107.190:37205
I20260709 13:00:06.147501  2297 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:06.148370  2297 heartbeater.cc:507] Master 127.0.107.190:37205 requested a full tablet report, sending...
I20260709 13:00:06.150846  1443 ts_manager.cc:194] Registered new tserver with Master: e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:06.152400  1443 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33072
I20260709 13:00:07.021638  1691 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:07.031343  1618 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:07.033331  1544 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:07.034970  2249 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:07.037104  2305 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:07.056732  1662 consensus_peers.cc:597] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 76479b4c97fc4172991dba87da2718fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:07.059962  1544 raft_consensus.cc:2955] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:07.057773  2305 raft_consensus.cc:2955] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:07.063028  1618 raft_consensus.cc:2955] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:07.094951  1443 catalog_manager.cc:5697] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:07.155503  2297 heartbeater.cc:499] Master 127.0.107.190:37205 was elected leader, sending a full tablet report...
I20260709 13:00:07.156831  1617 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:07.169407  1689 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:07.172209  1544 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:07.171308  2248 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:00:07.174497  2312 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:07.205304  2246 raft_consensus.cc:2955] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:07.206861  1689 raft_consensus.cc:2955] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
W20260709 13:00:07.211997  1588 consensus_peers.cc:597] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75790e14e47a47d9b0c447e78725e905. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:07.220726  1544 raft_consensus.cc:2955] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:07.231016  1618 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:07.231318  1444 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:07.253993  1588 consensus_peers.cc:597] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 236ab34afb704d93bb2705d3aadbe163. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:07.270855  1689 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:07.272624  2248 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:07.273859  1544 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:07.280076  2246 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:07.296448  2312 raft_consensus.cc:2955] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:07.300092  1689 raft_consensus.cc:2955] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:07.304057  1542 raft_consensus.cc:2955] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:07.334167  1444 catalog_manager.cc:5697] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:07.335206  1691 consensus_queue.cc:237] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:07.363933  1617 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:07.364310  1662 consensus_peers.cc:597] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: debbced49eac4fa895623a8e492b9ce3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:07.365994  2019 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:07.377679  1542 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:07.379714  2305 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:07.388773  2305 raft_consensus.cc:2955] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:07.394323  1617 raft_consensus.cc:2955] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:07.403079  1542 raft_consensus.cc:2955] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:07.412386  1444 catalog_manager.cc:5697] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:07.559540  2328 ts_tablet_manager.cc:933] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:07.567520  2328 tablet_copy_client.cc:323] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.131:43987
I20260709 13:00:07.618567  1707 tablet_copy_service.cc:140] P c20847a6dcea4c2a9cbaf35a2171e33d: Received BeginTabletCopySession request for tablet 76479b4c97fc4172991dba87da2718fc from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:58526)
I20260709 13:00:07.619297  1707 tablet_copy_service.cc:161] P c20847a6dcea4c2a9cbaf35a2171e33d: Beginning new tablet copy session on tablet 76479b4c97fc4172991dba87da2718fc from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:58526: session id = e37b8013aec24431a6672a857806329e-76479b4c97fc4172991dba87da2718fc
I20260709 13:00:07.634755  2332 ts_tablet_manager.cc:933] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:07.639400  1707 tablet_copy_source_session.cc:215] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:07.641654  2332 tablet_copy_client.cc:323] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:00:07.648535  2328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76479b4c97fc4172991dba87da2718fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.674706  1633 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 75790e14e47a47d9b0c447e78725e905 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:00:07.675480  1633 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 75790e14e47a47d9b0c447e78725e905 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-75790e14e47a47d9b0c447e78725e905
I20260709 13:00:07.678551  2328 tablet_copy_client.cc:806] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:07.679389  2328 tablet_copy_client.cc:670] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:07.689014  2328 tablet_copy_client.cc:538] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:07.693328  2334 ts_tablet_manager.cc:933] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:07.700022  1633 tablet_copy_source_session.cc:215] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:07.710927  2332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75790e14e47a47d9b0c447e78725e905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.714462  2328 tablet_bootstrap.cc:492] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:07.716356  2334 tablet_copy_client.cc:323] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:00:07.718740  1633 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 236ab34afb704d93bb2705d3aadbe163 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:00:07.719337  1633 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 236ab34afb704d93bb2705d3aadbe163 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-236ab34afb704d93bb2705d3aadbe163
I20260709 13:00:07.729187  1633 tablet_copy_source_session.cc:215] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:07.736685  2334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236ab34afb704d93bb2705d3aadbe163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.776968  2332 tablet_copy_client.cc:806] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:07.782145  2332 tablet_copy_client.cc:670] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:07.801621  2332 tablet_copy_client.cc:538] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:07.824170  2328 tablet_bootstrap.cc:492] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:07.826100  2328 tablet_bootstrap.cc:492] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:07.826565  2334 tablet_copy_client.cc:806] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:07.832842  2334 tablet_copy_client.cc:670] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:07.826896  2328 ts_tablet_manager.cc:1403] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.113s	user 0.032s	sys 0.028s
I20260709 13:00:07.815282  2332 tablet_bootstrap.cc:492] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:07.845314  2328 raft_consensus.cc:359] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:07.846652  2328 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:07.847388  2328 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:07.855581  2334 tablet_copy_client.cc:538] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:07.880270  2328 ts_tablet_manager.cc:1434] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.003s
I20260709 13:00:07.881984  2334 tablet_bootstrap.cc:492] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:07.909161  2332 tablet_bootstrap.cc:492] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:07.910485  2332 tablet_bootstrap.cc:492] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:07.912518  1707 tablet_copy_service.cc:342] P c20847a6dcea4c2a9cbaf35a2171e33d: Request end of tablet copy session e37b8013aec24431a6672a857806329e-76479b4c97fc4172991dba87da2718fc received from {username='slave'} at 127.0.0.1:58526
I20260709 13:00:07.913022  2332 ts_tablet_manager.cc:1403] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.015s
I20260709 13:00:07.913182  1707 tablet_copy_service.cc:434] P c20847a6dcea4c2a9cbaf35a2171e33d: ending tablet copy session e37b8013aec24431a6672a857806329e-76479b4c97fc4172991dba87da2718fc on tablet 76479b4c97fc4172991dba87da2718fc with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:07.919193  2332 raft_consensus.cc:359] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:07.921041  2332 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:07.922752  2332 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:07.925155  2334 tablet_bootstrap.cc:492] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:07.926133  2334 tablet_bootstrap.cc:492] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:07.926298  2332 ts_tablet_manager.cc:1434] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:00:07.926818  2334 ts_tablet_manager.cc:1403] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.008s
I20260709 13:00:07.928431  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-75790e14e47a47d9b0c447e78725e905 received from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:07.928937  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-75790e14e47a47d9b0c447e78725e905 on tablet 75790e14e47a47d9b0c447e78725e905 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:07.931329  2338 ts_tablet_manager.cc:933] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:07.930619  2334 raft_consensus.cc:359] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:07.937836  2334 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:07.938771  2334 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:07.942821  2334 ts_tablet_manager.cc:1434] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:00:07.946210  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-236ab34afb704d93bb2705d3aadbe163 received from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:07.946678  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-236ab34afb704d93bb2705d3aadbe163 on tablet 236ab34afb704d93bb2705d3aadbe163 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:07.950592  2338 tablet_copy_client.cc:323] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.131:43987
I20260709 13:00:07.953140  1707 tablet_copy_service.cc:140] P c20847a6dcea4c2a9cbaf35a2171e33d: Received BeginTabletCopySession request for tablet debbced49eac4fa895623a8e492b9ce3 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:58526)
I20260709 13:00:07.953771  1707 tablet_copy_service.cc:161] P c20847a6dcea4c2a9cbaf35a2171e33d: Beginning new tablet copy session on tablet debbced49eac4fa895623a8e492b9ce3 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:58526: session id = e37b8013aec24431a6672a857806329e-debbced49eac4fa895623a8e492b9ce3
I20260709 13:00:07.973618  1707 tablet_copy_source_session.cc:215] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:07.977586  2338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debbced49eac4fa895623a8e492b9ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.991976  2272 raft_consensus.cc:1217] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:08.000676  2338 tablet_copy_client.cc:806] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:08.001318  2338 tablet_copy_client.cc:670] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:08.009645  2338 tablet_copy_client.cc:538] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:08.022172  2338 tablet_bootstrap.cc:492] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:08.050315  2338 tablet_bootstrap.cc:492] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:08.051358  2338 tablet_bootstrap.cc:492] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:08.052203  2338 ts_tablet_manager.cc:1403] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.030s	user 0.028s	sys 0.001s
I20260709 13:00:08.055627  2338 raft_consensus.cc:359] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:08.056555  2338 raft_consensus.cc:740] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:08.057255  2338 consensus_queue.cc:260] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:08.059291  2338 ts_tablet_manager.cc:1434] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:00:08.062004  1707 tablet_copy_service.cc:342] P c20847a6dcea4c2a9cbaf35a2171e33d: Request end of tablet copy session e37b8013aec24431a6672a857806329e-debbced49eac4fa895623a8e492b9ce3 received from {username='slave'} at 127.0.0.1:58526
I20260709 13:00:08.062484  1707 tablet_copy_service.cc:434] P c20847a6dcea4c2a9cbaf35a2171e33d: ending tablet copy session e37b8013aec24431a6672a857806329e-debbced49eac4fa895623a8e492b9ce3 on tablet debbced49eac4fa895623a8e492b9ce3 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:08.114257  2272 raft_consensus.cc:1217] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:08.192188  2272 raft_consensus.cc:1217] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:08.256373  2272 raft_consensus.cc:1217] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:08.408679  2343 raft_consensus.cc:1064] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:08.411289  2343 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:08.419077  2272 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.420326  1544 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.420977  1617 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.420809  2343 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.422390  2019 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.423270  2249 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:08.469851  2019 raft_consensus.cc:2955] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.473316  2272 raft_consensus.cc:2955] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.510100  1443 catalog_manager.cc:5697] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.518988  1617 raft_consensus.cc:2955] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:00:08.528417  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 54908.9us
I20260709 13:00:08.567931  1544 raft_consensus.cc:2955] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.610996  1689 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:08.621649  1542 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:08.621652  2272 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:08.623091  2343 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:08.624894  2249 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:08.633947  2019 raft_consensus.cc:2955] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.641960  2272 raft_consensus.cc:2955] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.658514  1444 catalog_manager.cc:5697] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.662367  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 76479b4c97fc4172991dba87da2718fc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:08.664804  1544 raft_consensus.cc:2955] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.686663  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet 76479b4c97fc4172991dba87da2718fc with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34170
I20260709 13:00:08.689850  2352 raft_consensus.cc:1064] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:08.692479  2352 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:08.707809  2272 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.709877  2312 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:08.718521  2352 raft_consensus.cc:1064] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:08.721441  1689 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.721112  2352 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:08.723429  1544 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.728276  2246 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.729192  2312 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:08.739903  2271 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.742137  2312 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:08.755201  1691 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.755600  2356 tablet_replica.cc:333] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:00:08.756716  2356 raft_consensus.cc:2243] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.757009  1540 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.758596  2356 raft_consensus.cc:2272] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.766285  2359 raft_consensus.cc:2955] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.757628  2246 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:00:08.769232  1689 raft_consensus.cc:2955] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.781037  2356 ts_tablet_manager.cc:1916] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:08.781685  2246 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:08.783986  2352 raft_consensus.cc:2955] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.788779  2249 raft_consensus.cc:1064] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:08.788344  1691 raft_consensus.cc:2955] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.793404  2249 consensus_queue.cc:237] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:08.800547  1443 catalog_manager.cc:5697] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.830257  1544 raft_consensus.cc:2955] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.841166  2272 raft_consensus.cc:2955] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.845078  2271 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.848467  2019 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.851567  1617 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.858435  1547 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.858780  1540 raft_consensus.cc:2955] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.860594  2356 ts_tablet_manager.cc:1929] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:08.861333  2356 log.cc:1199] T 76479b4c97fc4172991dba87da2718fc P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/76479b4c97fc4172991dba87da2718fc
I20260709 13:00:08.864183  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet 76479b4c97fc4172991dba87da2718fc (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:08.864806  2019 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.864471  2271 raft_consensus.cc:2955] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.870030  2019 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.872596  1443 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.959631  2019 raft_consensus.cc:2955] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.963613  1615 raft_consensus.cc:2955] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.964303  1618 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:08.983565  2270 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:08.985592  2323 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:08.991451  1547 raft_consensus.cc:2955] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:08.998726  2323 raft_consensus.cc:2955] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:09.002257  1689 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:09.002417  2271 raft_consensus.cc:2955] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:09.006201  2312 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:09.016211  1689 raft_consensus.cc:2955] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:09.020255  2270 raft_consensus.cc:2955] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:09.083691  1446 catalog_manager.cc:5697] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:09.091141  1443 catalog_manager.cc:5697] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:09.104278  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 236ab34afb704d93bb2705d3aadbe163 with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35688
I20260709 13:00:09.115283  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 236ab34afb704d93bb2705d3aadbe163 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:09.156783  2370 tablet_replica.cc:333] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:00:09.157719  2370 raft_consensus.cc:2243] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:09.158520  2370 raft_consensus.cc:2272] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:09.164026  2370 ts_tablet_manager.cc:1916] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:09.169808  1691 consensus_queue.cc:237] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:09.178428  2270 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:09.180449  2369 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:09.186076  2370 ts_tablet_manager.cc:1929] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:09.186985  2370 log.cc:1199] T 236ab34afb704d93bb2705d3aadbe163 P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/236ab34afb704d93bb2705d3aadbe163
I20260709 13:00:09.190066  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet 236ab34afb704d93bb2705d3aadbe163 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:09.197216  2354 raft_consensus.cc:2955] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:09.208529  2270 raft_consensus.cc:2955] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:09.210973  1618 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:09.225445  2343 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:09.259280  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet debbced49eac4fa895623a8e492b9ce3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:09.262528  1444 catalog_manager.cc:5697] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:09.270165  1622 raft_consensus.cc:2955] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:09.286255  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet debbced49eac4fa895623a8e492b9ce3 with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35688
I20260709 13:00:09.287665  2370 tablet_replica.cc:333] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:00:09.288620  2370 raft_consensus.cc:2243] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:09.289866  2370 raft_consensus.cc:2272] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:09.265178  1618 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:09.297168  2370 ts_tablet_manager.cc:1916] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:09.310298  2270 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:09.312281  1544 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:09.313946  2371 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:09.321305  2312 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:09.329506  2312 raft_consensus.cc:2955] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:09.334707  1544 raft_consensus.cc:2955] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:09.340198  2270 raft_consensus.cc:2955] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:09.347504  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 75790e14e47a47d9b0c447e78725e905 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:09.355443  2370 ts_tablet_manager.cc:1929] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:09.356027  2370 log.cc:1199] T debbced49eac4fa895623a8e492b9ce3 P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/debbced49eac4fa895623a8e492b9ce3
I20260709 13:00:09.359186  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet debbced49eac4fa895623a8e492b9ce3 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:09.372577  1444 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:09.388816  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 75790e14e47a47d9b0c447e78725e905 with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39234
I20260709 13:00:09.396682  2372 tablet_replica.cc:333] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:00:09.397848  2372 raft_consensus.cc:2243] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:09.399672  2372 raft_consensus.cc:2272] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:09.405915  2372 ts_tablet_manager.cc:1916] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:09.420609  2372 ts_tablet_manager.cc:1929] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:09.421034  2372 log.cc:1199] T 75790e14e47a47d9b0c447e78725e905 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/75790e14e47a47d9b0c447e78725e905
I20260709 13:00:09.422362  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet 75790e14e47a47d9b0c447e78725e905 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:10.505347  1622 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:00:10.515055  1588 consensus_peers.cc:597] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5f320525c0a40e79e76f607d8195977. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:10.516912  1542 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:10.518417  1691 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:10.519085  2371 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:10.520939  2246 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:10.530198  2246 raft_consensus.cc:2955] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:10.535895  1689 raft_consensus.cc:2955] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:10.542166  1542 raft_consensus.cc:2955] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:10.556963  1446 catalog_manager.cc:5697] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.620729  1542 consensus_queue.cc:237] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:10.647158  1689 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:10.655714  1623 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:10.655390  2375 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:10.666337  2376 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:10.725325  2376 raft_consensus.cc:2955] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:10.727120  1689 raft_consensus.cc:2955] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
W20260709 13:00:10.734483  1513 consensus_peers.cc:597] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 435d66c2e8e14e73af7cc63b8ce93e2d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:10.750211  1623 raft_consensus.cc:2955] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:10.755200  1444 catalog_manager.cc:5697] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:10.789660  1622 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:00:10.809782  1588 consensus_peers.cc:597] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7bd2e8876bc642db9518e484c47f1ac3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:10.810621  1692 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:10.816038  2312 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:10.840646  1542 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:10.846797  2371 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:10.854081  2374 raft_consensus.cc:2955] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:10.857735  1692 raft_consensus.cc:2955] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:10.867295  1542 raft_consensus.cc:2955] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:10.873252  1689 consensus_queue.cc:237] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:10.878105  1444 catalog_manager.cc:5697] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 3, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 2 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:10.900488  1662 consensus_peers.cc:597] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea89d024b77243d097fd08bd251c9d5e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:10.906464  1548 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:10.908396  2343 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:10.909425  1622 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:10.913313  2354 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:10.935098  2354 raft_consensus.cc:2955] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:10.937954  1540 raft_consensus.cc:2955] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:10.950115  1622 raft_consensus.cc:2955] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:10.969823  1446 catalog_manager.cc:5697] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:10.997573  2405 ts_tablet_manager.cc:933] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:11.014814  2405 tablet_copy_client.cc:323] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:00:11.020008  1633 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet d5f320525c0a40e79e76f607d8195977 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:00:11.020656  1633 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet d5f320525c0a40e79e76f607d8195977 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-d5f320525c0a40e79e76f607d8195977
I20260709 13:00:11.029104  1633 tablet_copy_source_session.cc:215] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:11.034106  2405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f320525c0a40e79e76f607d8195977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.059620  2405 tablet_copy_client.cc:806] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:11.060357  2405 tablet_copy_client.cc:670] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:11.065160  2405 tablet_copy_client.cc:538] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:11.078354  2405 tablet_bootstrap.cc:492] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:11.122669  2405 tablet_bootstrap.cc:492] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:11.132596  2405 tablet_bootstrap.cc:492] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:11.133723  2405 ts_tablet_manager.cc:1403] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.009s
I20260709 13:00:11.139998  2408 ts_tablet_manager.cc:933] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:00:11.139367  2405 raft_consensus.cc:359] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:11.141004  2405 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:11.141800  2405 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:11.148499  2405 ts_tablet_manager.cc:1434] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:00:11.150329  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-d5f320525c0a40e79e76f607d8195977 received from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:11.150810  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-d5f320525c0a40e79e76f607d8195977 on tablet d5f320525c0a40e79e76f607d8195977 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:11.158892  2408 tablet_copy_client.cc:323] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.129:46597
I20260709 13:00:11.199870  1558 tablet_copy_service.cc:140] P 44c8c572048a40b1a5e71865068ed1bb: Received BeginTabletCopySession request for tablet 435d66c2e8e14e73af7cc63b8ce93e2d from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:53718)
I20260709 13:00:11.200536  1558 tablet_copy_service.cc:161] P 44c8c572048a40b1a5e71865068ed1bb: Beginning new tablet copy session on tablet 435d66c2e8e14e73af7cc63b8ce93e2d from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:53718: session id = e37b8013aec24431a6672a857806329e-435d66c2e8e14e73af7cc63b8ce93e2d
I20260709 13:00:11.205876  2405 ts_tablet_manager.cc:933] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:11.208571  2405 tablet_copy_client.cc:323] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:00:11.209702  1558 tablet_copy_source_session.cc:215] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:11.210213  1633 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 7bd2e8876bc642db9518e484c47f1ac3 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:00:11.210798  1633 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 7bd2e8876bc642db9518e484c47f1ac3 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-7bd2e8876bc642db9518e484c47f1ac3
I20260709 13:00:11.214712  2408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435d66c2e8e14e73af7cc63b8ce93e2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.218084  1633 tablet_copy_source_session.cc:215] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:11.221513  2405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bd2e8876bc642db9518e484c47f1ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.242110  2408 tablet_copy_client.cc:806] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:11.245631  2408 tablet_copy_client.cc:670] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:11.248957  2405 tablet_copy_client.cc:806] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:11.249650  2405 tablet_copy_client.cc:670] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:11.250525  2408 tablet_copy_client.cc:538] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:11.254148  2405 tablet_copy_client.cc:538] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:11.260226  2408 tablet_bootstrap.cc:492] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:11.270074  2405 tablet_bootstrap.cc:492] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:11.293181  2408 tablet_bootstrap.cc:492] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:11.294646  2408 tablet_bootstrap.cc:492] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:11.295469  2408 ts_tablet_manager.cc:1403] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.010s
I20260709 13:00:11.300503  2408 raft_consensus.cc:359] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:11.301828  2408 raft_consensus.cc:740] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:11.302803  2408 consensus_queue.cc:260] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:11.306332  2408 ts_tablet_manager.cc:1434] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:00:11.309834  1558 tablet_copy_service.cc:342] P 44c8c572048a40b1a5e71865068ed1bb: Request end of tablet copy session e37b8013aec24431a6672a857806329e-435d66c2e8e14e73af7cc63b8ce93e2d received from {username='slave'} at 127.0.0.1:53718
I20260709 13:00:11.310312  1558 tablet_copy_service.cc:434] P 44c8c572048a40b1a5e71865068ed1bb: ending tablet copy session e37b8013aec24431a6672a857806329e-435d66c2e8e14e73af7cc63b8ce93e2d on tablet 435d66c2e8e14e73af7cc63b8ce93e2d with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:11.322767  2405 tablet_bootstrap.cc:492] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:11.323668  2405 tablet_bootstrap.cc:492] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:11.324687  2405 ts_tablet_manager.cc:1403] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.017s
I20260709 13:00:11.330911  2405 raft_consensus.cc:359] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:11.332034  2405 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:11.332747  2405 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:11.336356  2405 ts_tablet_manager.cc:1434] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:00:11.338217  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-7bd2e8876bc642db9518e484c47f1ac3 received from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:11.338608  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-7bd2e8876bc642db9518e484c47f1ac3 on tablet 7bd2e8876bc642db9518e484c47f1ac3 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:11.501698  2405 ts_tablet_manager.cc:933] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:11.508930  2405 tablet_copy_client.cc:323] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.131:43987
I20260709 13:00:11.514158  1707 tablet_copy_service.cc:140] P c20847a6dcea4c2a9cbaf35a2171e33d: Received BeginTabletCopySession request for tablet ea89d024b77243d097fd08bd251c9d5e from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:58526)
I20260709 13:00:11.514717  1707 tablet_copy_service.cc:161] P c20847a6dcea4c2a9cbaf35a2171e33d: Beginning new tablet copy session on tablet ea89d024b77243d097fd08bd251c9d5e from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:58526: session id = e37b8013aec24431a6672a857806329e-ea89d024b77243d097fd08bd251c9d5e
I20260709 13:00:11.523588  1707 tablet_copy_source_session.cc:215] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:11.526680  2405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea89d024b77243d097fd08bd251c9d5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:11.561340  2405 tablet_copy_client.cc:806] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:11.562001  2405 tablet_copy_client.cc:670] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:11.565634  2405 tablet_copy_client.cc:538] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:11.573400  2405 tablet_bootstrap.cc:492] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:11.597563  2405 tablet_bootstrap.cc:492] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:11.599507  2405 tablet_bootstrap.cc:492] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:11.600502  2405 ts_tablet_manager.cc:1403] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.008s
I20260709 13:00:11.603658  2405 raft_consensus.cc:359] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:11.604509  2405 raft_consensus.cc:740] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:11.605546  2405 consensus_queue.cc:260] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:11.606909  2270 raft_consensus.cc:1217] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:11.608168  2405 ts_tablet_manager.cc:1434] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:00:11.611397  1707 tablet_copy_service.cc:342] P c20847a6dcea4c2a9cbaf35a2171e33d: Request end of tablet copy session e37b8013aec24431a6672a857806329e-ea89d024b77243d097fd08bd251c9d5e received from {username='slave'} at 127.0.0.1:58526
I20260709 13:00:11.611873  1707 tablet_copy_service.cc:434] P c20847a6dcea4c2a9cbaf35a2171e33d: ending tablet copy session e37b8013aec24431a6672a857806329e-ea89d024b77243d097fd08bd251c9d5e on tablet ea89d024b77243d097fd08bd251c9d5e with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:11.668730  2270 raft_consensus.cc:1217] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:11.766215  2270 raft_consensus.cc:1217] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:00:12.178009  2271 raft_consensus.cc:1217] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:00:12.191978  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 58127.9us
W20260709 13:00:12.372337  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 190852us
I20260709 13:00:12.373391  2375 raft_consensus.cc:1064] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:12.378505  2397 raft_consensus.cc:1064] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:12.403446  2375 consensus_queue.cc:237] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:12.405601  2397 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:12.418220  2427 raft_consensus.cc:1064] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:12.423302  2427 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:12.460485  2271 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:12.461997  2395 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:12.470853  2271 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:12.472461  2397 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:12.479308  1616 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:12.483952  2272 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 2 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:12.486121  2397 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:12.500223  2376 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:12.507513  1690 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:12.517587  1540 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:12.520387  1540 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:12.534070  1690 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:12.534546  1697 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:12.537289  2431 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:12.538501  2376 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:12.539105  2427 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:12.544173  2427 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:12.547187  2431 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:12.560753  2395 raft_consensus.cc:2955] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.565667  2397 raft_consensus.cc:2955] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.578544  1616 raft_consensus.cc:2955] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.582158  2426 raft_consensus.cc:2955] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.585155  1693 raft_consensus.cc:2955] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.589779  1689 raft_consensus.cc:2955] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.597107  2270 raft_consensus.cc:2955] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.619445  1445 catalog_manager.cc:5697] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.632454  2270 raft_consensus.cc:2955] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.642491  1689 raft_consensus.cc:2955] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.614159  1444 catalog_manager.cc:5697] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index 3 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.647727  1443 catalog_manager.cc:5697] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.649547  2271 raft_consensus.cc:2955] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.661849  1548 raft_consensus.cc:2955] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.661633  1544 raft_consensus.cc:2955] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.732054  1614 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:12.737260  2417 raft_consensus.cc:1064] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:12.739136  1616 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:12.743783  1542 consensus_queue.cc:237] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:12.752791  2417 consensus_queue.cc:237] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:12.766748  2271 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:12.768523  2420 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:12.772467  1548 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:12.775336  2270 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:12.776117  2272 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:12.776594  1548 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:12.777943  2431 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:12.778609  1544 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:12.778820  2438 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:12.780699  2438 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:12.781179  2272 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:12.782840  2422 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:12.784287  1691 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:12.787431  2375 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:12.788573  1616 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:12.800076  2423 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:12.800140  2375 raft_consensus.cc:2955] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.801298  1691 raft_consensus.cc:2955] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.802927  2424 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:12.806638  2432 raft_consensus.cc:2955] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.811535  2246 raft_consensus.cc:2955] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.811550  2371 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:00:12.820511  2269 raft_consensus.cc:2955] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.815034  2272 raft_consensus.cc:2955] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.828780  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 435d66c2e8e14e73af7cc63b8ce93e2d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:12.838748  2268 raft_consensus.cc:2955] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.848742  1540 raft_consensus.cc:2955] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.854228  1446 catalog_manager.cc:5697] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.862552  1542 raft_consensus.cc:2955] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.874637  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d5f320525c0a40e79e76f607d8195977 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:12.908414  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7bd2e8876bc642db9518e484c47f1ac3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:12.920518  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet 435d66c2e8e14e73af7cc63b8ce93e2d with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34170
I20260709 13:00:12.925069  2455 tablet_replica.cc:333] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:00:12.926688  2455 raft_consensus.cc:2243] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:12.928083  2455 raft_consensus.cc:2272] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:12.929230  1444 catalog_manager.cc:5697] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.937008  1542 raft_consensus.cc:2955] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.936475  2403 raft_consensus.cc:2955] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.944835  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet d5f320525c0a40e79e76f607d8195977 with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39234
I20260709 13:00:12.952682  2456 tablet_replica.cc:333] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:00:12.954893  2456 raft_consensus.cc:2243] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:12.950068  1446 catalog_manager.cc:5697] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 4 to 5, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 2 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.965341  1617 raft_consensus.cc:2955] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:12.986706  2455 ts_tablet_manager.cc:1916] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:12.956655  2456 raft_consensus.cc:2272] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:12.988118  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bd2e8876bc642db9518e484c47f1ac3 with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:39234
I20260709 13:00:13.004209  2269 raft_consensus.cc:2955] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:13.001011  1446 catalog_manager.cc:5697] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:13.045934  2455 ts_tablet_manager.cc:1929] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:13.047015  2455 log.cc:1199] T 435d66c2e8e14e73af7cc63b8ce93e2d P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/435d66c2e8e14e73af7cc63b8ce93e2d
I20260709 13:00:13.048846  2456 ts_tablet_manager.cc:1916] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:13.049015  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet 435d66c2e8e14e73af7cc63b8ce93e2d (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:13.072162  2456 ts_tablet_manager.cc:1929] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:13.072669  2456 log.cc:1199] T d5f320525c0a40e79e76f607d8195977 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/d5f320525c0a40e79e76f607d8195977
I20260709 13:00:13.076666  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet d5f320525c0a40e79e76f607d8195977 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:13.079541  2456 tablet_replica.cc:333] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:00:13.080924  2456 raft_consensus.cc:2243] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.081858  2456 raft_consensus.cc:2272] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.081516  1691 consensus_queue.cc:237] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:13.085767  2456 ts_tablet_manager.cc:1916] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:13.089116  2269 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:13.089780  1547 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:13.091189  2438 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:13.094458  2403 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:13.100126  2429 raft_consensus.cc:2955] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:13.107450  2456 ts_tablet_manager.cc:1929] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:13.108686  2269 raft_consensus.cc:2955] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:13.108685  1547 raft_consensus.cc:2955] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:13.108026  2456 log.cc:1199] T 7bd2e8876bc642db9518e484c47f1ac3 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/7bd2e8876bc642db9518e484c47f1ac3
I20260709 13:00:13.116053  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet 7bd2e8876bc642db9518e484c47f1ac3 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:13.127118  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ea89d024b77243d097fd08bd251c9d5e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:13.129726  1443 catalog_manager.cc:5697] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:13.146096  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet ea89d024b77243d097fd08bd251c9d5e with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34170
I20260709 13:00:13.147083  2455 tablet_replica.cc:333] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:00:13.148288  2455 raft_consensus.cc:2243] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:13.149072  2455 raft_consensus.cc:2272] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:13.157428  2455 ts_tablet_manager.cc:1916] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:13.176591  2455 ts_tablet_manager.cc:1929] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:13.176939  2455 log.cc:1199] T ea89d024b77243d097fd08bd251c9d5e P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/ea89d024b77243d097fd08bd251c9d5e
I20260709 13:00:13.178288  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet ea89d024b77243d097fd08bd251c9d5e (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
W20260709 13:00:13.190174  1718 debug-util.cc:398] Leaking SignalData structure 0x7b080010e2e0 after lost signal to thread 433
W20260709 13:00:13.191677  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6060 after lost signal to thread 1480
W20260709 13:00:13.192997  1718 debug-util.cc:398] Leaking SignalData structure 0x7b0800225460 after lost signal to thread 1572
W20260709 13:00:13.194029  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08002bae20 after lost signal to thread 1647
W20260709 13:00:13.195235  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe700 after lost signal to thread 1721
W20260709 13:00:13.196539  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08002f54a0 after lost signal to thread 2296
I20260709 13:00:14.287532  1617 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:14.298231  1693 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:14.298650  1588 consensus_peers.cc:597] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 162dcbb665f341d1ab765403c5c3a480. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:14.300531  2424 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:14.311998  1540 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:14.315552  2431 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:14.316921  2424 raft_consensus.cc:2955] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.320227  1689 raft_consensus.cc:2955] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.344791  1617 consensus_queue.cc:237] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:14.335987  1540 raft_consensus.cc:2955] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.349550  1444 catalog_manager.cc:5697] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
W20260709 13:00:14.407051  1588 consensus_peers.cc:597] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58998217db5f42c08255f6a6a86b3dae. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:14.418764  1689 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:14.420439  2431 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:14.426009  1540 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:14.430377  2431 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:14.445497  2462 raft_consensus.cc:2955] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.465212  1689 raft_consensus.cc:2955] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.470527  1548 raft_consensus.cc:2955] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.502768  1443 catalog_manager.cc:5697] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.506702  1542 consensus_queue.cc:237] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:00:14.534970  1513 consensus_peers.cc:597] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4abaeaa789c4d7b9da036c18751f9b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:14.539466  1617 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:14.541900  2376 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:14.551692  1693 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:14.558050  2375 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:14.570276  2457 raft_consensus.cc:2955] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.572024  1616 raft_consensus.cc:2955] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.588303  1542 consensus_queue.cc:237] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:14.602064  1445 catalog_manager.cc:5697] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:14.609095  1513 consensus_peers.cc:597] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a70c773fba6b40bfad053ffbcc4b9d86. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:14.613718  1693 raft_consensus.cc:2955] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.621850  1617 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:14.626329  2375 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:14.638649  1689 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:14.640604  2375 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:14.665897  2376 raft_consensus.cc:2955] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.672091  1616 raft_consensus.cc:2955] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.713611  1689 raft_consensus.cc:2955] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.748292  1445 catalog_manager.cc:5697] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:14.859174  2480 ts_tablet_manager.cc:933] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:14.861502  2480 tablet_copy_client.cc:323] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:00:14.863855  1633 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 162dcbb665f341d1ab765403c5c3a480 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:00:14.864933  1633 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 162dcbb665f341d1ab765403c5c3a480 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-162dcbb665f341d1ab765403c5c3a480
I20260709 13:00:14.880182  1633 tablet_copy_source_session.cc:215] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:14.886379  2480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162dcbb665f341d1ab765403c5c3a480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.906235  2480 tablet_copy_client.cc:806] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:14.907552  2480 tablet_copy_client.cc:670] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:14.915953  2480 tablet_copy_client.cc:538] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:14.930631  2480 tablet_bootstrap.cc:492] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:14.975081  2480 tablet_bootstrap.cc:492] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:14.976249  2480 tablet_bootstrap.cc:492] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:14.977051  2480 ts_tablet_manager.cc:1403] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.019s
I20260709 13:00:14.985666  2480 raft_consensus.cc:359] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:14.986740  2483 ts_tablet_manager.cc:933] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:00:14.987193  2480 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:14.988178  2480 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:14.999969  2480 ts_tablet_manager.cc:1434] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 13:00:15.003698  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-162dcbb665f341d1ab765403c5c3a480 received from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:15.004257  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-162dcbb665f341d1ab765403c5c3a480 on tablet 162dcbb665f341d1ab765403c5c3a480 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:15.008387  2480 ts_tablet_manager.cc:933] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:15.028614  2480 tablet_copy_client.cc:323] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:00:15.032713  1633 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 58998217db5f42c08255f6a6a86b3dae from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:00:15.033317  1633 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 58998217db5f42c08255f6a6a86b3dae from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-58998217db5f42c08255f6a6a86b3dae
I20260709 13:00:15.050216  1633 tablet_copy_source_session.cc:215] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:15.055379  2480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58998217db5f42c08255f6a6a86b3dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:15.107797  2480 tablet_copy_client.cc:806] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:15.108704  2480 tablet_copy_client.cc:670] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:15.123556  2480 tablet_copy_client.cc:538] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:15.131837  2483 tablet_copy_client.cc:323] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.129:46597
I20260709 13:00:15.134855  2480 tablet_bootstrap.cc:492] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:15.137511  1558 tablet_copy_service.cc:140] P 44c8c572048a40b1a5e71865068ed1bb: Received BeginTabletCopySession request for tablet e4abaeaa789c4d7b9da036c18751f9b6 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:53718)
I20260709 13:00:15.138116  1558 tablet_copy_service.cc:161] P 44c8c572048a40b1a5e71865068ed1bb: Beginning new tablet copy session on tablet e4abaeaa789c4d7b9da036c18751f9b6 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:53718: session id = e37b8013aec24431a6672a857806329e-e4abaeaa789c4d7b9da036c18751f9b6
I20260709 13:00:15.152994  1558 tablet_copy_source_session.cc:215] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:15.135178  2486 ts_tablet_manager.cc:933] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:00:15.169102  2483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4abaeaa789c4d7b9da036c18751f9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:15.183252  2486 tablet_copy_client.cc:323] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.129:46597
I20260709 13:00:15.188457  1558 tablet_copy_service.cc:140] P 44c8c572048a40b1a5e71865068ed1bb: Received BeginTabletCopySession request for tablet a70c773fba6b40bfad053ffbcc4b9d86 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:53718)
I20260709 13:00:15.189073  1558 tablet_copy_service.cc:161] P 44c8c572048a40b1a5e71865068ed1bb: Beginning new tablet copy session on tablet a70c773fba6b40bfad053ffbcc4b9d86 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:53718: session id = e37b8013aec24431a6672a857806329e-a70c773fba6b40bfad053ffbcc4b9d86
I20260709 13:00:15.214480  1558 tablet_copy_source_session.cc:215] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:15.218670  2486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70c773fba6b40bfad053ffbcc4b9d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:15.232215  2483 tablet_copy_client.cc:806] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:15.232928  2483 tablet_copy_client.cc:670] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:15.236724  2480 tablet_bootstrap.cc:492] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:15.237289  2483 tablet_copy_client.cc:538] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:15.254117  2480 tablet_bootstrap.cc:492] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:15.255287  2480 ts_tablet_manager.cc:1403] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.121s	user 0.017s	sys 0.018s
I20260709 13:00:15.265937  2483 tablet_bootstrap.cc:492] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:15.267385  2486 tablet_copy_client.cc:806] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:15.270702  2486 tablet_copy_client.cc:670] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:15.272506  2480 raft_consensus.cc:359] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:15.273447  2480 raft_consensus.cc:740] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:15.274820  2486 tablet_copy_client.cc:538] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:15.274272  2480 consensus_queue.cc:260] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:15.282161  2480 ts_tablet_manager.cc:1434] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:00:15.286995  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-58998217db5f42c08255f6a6a86b3dae received from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:15.287500  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-58998217db5f42c08255f6a6a86b3dae on tablet 58998217db5f42c08255f6a6a86b3dae with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:15.326193  2486 tablet_bootstrap.cc:492] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:15.328301  2269 raft_consensus.cc:1217] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:15.396047  2269 raft_consensus.cc:1217] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:15.400250  2486 tablet_bootstrap.cc:492] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:15.402045  2486 tablet_bootstrap.cc:492] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:15.402945  2486 ts_tablet_manager.cc:1403] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.077s	user 0.030s	sys 0.002s
I20260709 13:00:15.407580  2486 raft_consensus.cc:359] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:15.409113  2486 raft_consensus.cc:740] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:15.410339  2486 consensus_queue.cc:260] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:15.414566  2486 ts_tablet_manager.cc:1434] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:00:15.417286  1558 tablet_copy_service.cc:342] P 44c8c572048a40b1a5e71865068ed1bb: Request end of tablet copy session e37b8013aec24431a6672a857806329e-a70c773fba6b40bfad053ffbcc4b9d86 received from {username='slave'} at 127.0.0.1:53718
I20260709 13:00:15.418200  1558 tablet_copy_service.cc:434] P 44c8c572048a40b1a5e71865068ed1bb: ending tablet copy session e37b8013aec24431a6672a857806329e-a70c773fba6b40bfad053ffbcc4b9d86 on tablet a70c773fba6b40bfad053ffbcc4b9d86 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:15.455745  2483 tablet_bootstrap.cc:492] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:15.464347  2483 tablet_bootstrap.cc:492] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:15.465329  2483 ts_tablet_manager.cc:1403] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.200s	user 0.013s	sys 0.016s
I20260709 13:00:15.471207  2483 raft_consensus.cc:359] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:15.472766  2483 raft_consensus.cc:740] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:15.473519  2483 consensus_queue.cc:260] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:15.490343  2483 ts_tablet_manager.cc:1434] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.009s
I20260709 13:00:15.500551  1558 tablet_copy_service.cc:342] P 44c8c572048a40b1a5e71865068ed1bb: Request end of tablet copy session e37b8013aec24431a6672a857806329e-e4abaeaa789c4d7b9da036c18751f9b6 received from {username='slave'} at 127.0.0.1:53718
I20260709 13:00:15.501060  1558 tablet_copy_service.cc:434] P 44c8c572048a40b1a5e71865068ed1bb: ending tablet copy session e37b8013aec24431a6672a857806329e-e4abaeaa789c4d7b9da036c18751f9b6 on tablet e4abaeaa789c4d7b9da036c18751f9b6 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:15.553674  2269 raft_consensus.cc:1217] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:15.578984  2269 raft_consensus.cc:1217] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:15.891855  2424 raft_consensus.cc:1064] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:15.895985  2479 raft_consensus.cc:1064] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:15.895776  2424 consensus_queue.cc:237] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:15.902784  2479 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:15.919441  2272 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:15.926270  2432 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:15.973809  2375 raft_consensus.cc:1064] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:15.977053  2375 consensus_queue.cc:237] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:16.002154  1691 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:16.096115  1547 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:16.121683  2503 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:16.143306  2497 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:00:16.157156  2268 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:16.160239  2457 raft_consensus.cc:1064] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:16.194100  2268 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:16.198596  2499 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:16.213989  1542 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:16.228197  1689 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:00:16.230664  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 110344us
I20260709 13:00:16.236894  2500 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:16.228129  2503 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:00:16.232421  2457 consensus_queue.cc:237] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:16.249558  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 112566us
I20260709 13:00:16.254719  2508 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:16.289556  1693 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:16.295027  2509 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:00:16.340207  2272 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:16.340570  1690 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:16.341725  1617 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:16.344270  1619 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:16.350862  2518 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:16.352957  2376 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:16.372157  2376 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:16.378522  2520 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
I20260709 13:00:16.399797  2499 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:16.440253  2457 raft_consensus.cc:2955] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.464602  2501 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:16.467631  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 51561.3us
I20260709 13:00:16.472359  1697 raft_consensus.cc:2955] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.476616  2272 raft_consensus.cc:2955] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.483946  2503 raft_consensus.cc:2955] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.511118  1693 raft_consensus.cc:2955] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.520339  1443 catalog_manager.cc:5697] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:16.540730  1548 raft_consensus.cc:2955] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.578766  2498 raft_consensus.cc:2955] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.582224  1542 raft_consensus.cc:2955] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.590361  2457 raft_consensus.cc:2955] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.599392  2268 raft_consensus.cc:2955] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.608438  1697 raft_consensus.cc:2955] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.692121  1444 catalog_manager.cc:5697] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:16.690147  2272 raft_consensus.cc:2955] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.731673  2270 raft_consensus.cc:2955] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:00:16.830914  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 165777us
I20260709 13:00:16.833473  1618 raft_consensus.cc:2955] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.852517  1697 raft_consensus.cc:2955] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.871393  1617 raft_consensus.cc:2955] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.962492  1444 catalog_manager.cc:5697] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.964738  1444 catalog_manager.cc:5697] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:16.953151  1617 consensus_queue.cc:237] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:17.040611  2272 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:17.043279  2509 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:17.045007  1547 consensus_queue.cc:237] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:17.049672  1542 consensus_queue.cc:237] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:17.056325  1690 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:17.060825  2509 raft_consensus.cc:2955] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.066969  2270 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:17.065872  2272 raft_consensus.cc:2955] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.067343  2432 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:17.068854  2457 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:17.073800  1697 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:17.089448  2499 raft_consensus.cc:2955] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.085695  1691 raft_consensus.cc:2955] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.109617  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 58998217db5f42c08255f6a6a86b3dae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:17.109941  1617 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:17.112066  2270 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:17.111728  2268 raft_consensus.cc:2955] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.114161  2517 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:17.118862  2513 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:17.130728  2513 raft_consensus.cc:2955] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.133123  2270 raft_consensus.cc:2955] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.146701  2518 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:17.151772  1615 raft_consensus.cc:2955] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.154246  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a70c773fba6b40bfad053ffbcc4b9d86 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:17.155784  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e4abaeaa789c4d7b9da036c18751f9b6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:17.164335  1690 raft_consensus.cc:2955] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.199663  1445 catalog_manager.cc:5697] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.240688  1444 catalog_manager.cc:5697] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.252251  1444 catalog_manager.cc:5697] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.264031  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet e4abaeaa789c4d7b9da036c18751f9b6 with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34170
I20260709 13:00:17.268184  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 58998217db5f42c08255f6a6a86b3dae with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35688
I20260709 13:00:17.270102  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet a70c773fba6b40bfad053ffbcc4b9d86 with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39234
I20260709 13:00:17.306509  2542 tablet_replica.cc:333] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:00:17.313452  2542 raft_consensus.cc:2243] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:17.303303  1617 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:17.311231  2541 tablet_replica.cc:333] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:00:17.316921  2541 raft_consensus.cc:2243] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:17.324064  2270 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:17.315259  2542 raft_consensus.cc:2272] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:17.309010  2543 tablet_replica.cc:333] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:00:17.328799  2543 raft_consensus.cc:2243] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:17.329790  2543 raft_consensus.cc:2272] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:17.317939  2541 raft_consensus.cc:2272] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:17.327087  2504 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:17.335292  2543 ts_tablet_manager.cc:1916] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:17.339046  2542 ts_tablet_manager.cc:1916] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:17.351928  2541 ts_tablet_manager.cc:1916] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:17.349858  2533 raft_consensus.cc:2955] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.365731  2270 raft_consensus.cc:2955] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.390347  1691 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:17.392030  2504 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:17.402752  2543 ts_tablet_manager.cc:1929] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:17.407653  2543 log.cc:1199] T a70c773fba6b40bfad053ffbcc4b9d86 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/a70c773fba6b40bfad053ffbcc4b9d86
I20260709 13:00:17.409803  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet a70c773fba6b40bfad053ffbcc4b9d86 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:17.413364  2541 ts_tablet_manager.cc:1929] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:17.415385  2541 log.cc:1199] T e4abaeaa789c4d7b9da036c18751f9b6 P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/e4abaeaa789c4d7b9da036c18751f9b6
I20260709 13:00:17.415247  1697 raft_consensus.cc:2955] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:17.414743  2542 ts_tablet_manager.cc:1929] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:17.417860  2542 log.cc:1199] T 58998217db5f42c08255f6a6a86b3dae P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/58998217db5f42c08255f6a6a86b3dae
I20260709 13:00:17.417963  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet e4abaeaa789c4d7b9da036c18751f9b6 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:17.420451  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet 58998217db5f42c08255f6a6a86b3dae (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:17.431761  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 162dcbb665f341d1ab765403c5c3a480 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:17.451957  1446 catalog_manager.cc:5697] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.508395  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 162dcbb665f341d1ab765403c5c3a480 with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35688
I20260709 13:00:17.509807  2542 tablet_replica.cc:333] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:00:17.511059  2542 raft_consensus.cc:2243] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:17.511845  2542 raft_consensus.cc:2272] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:17.517915  2542 ts_tablet_manager.cc:1916] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:17.570655  2542 ts_tablet_manager.cc:1929] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:17.571310  2542 log.cc:1199] T 162dcbb665f341d1ab765403c5c3a480 P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/162dcbb665f341d1ab765403c5c3a480
I20260709 13:00:17.573412  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet 162dcbb665f341d1ab765403c5c3a480 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:18.620251  1691 consensus_queue.cc:237] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:00:18.644304  1662 consensus_peers.cc:597] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4ba9e8bda7e4019b703c785aae4f0a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.644399  1615 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:18.647893  1546 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:18.648504  2514 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:18.657217  2514 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:18.661043  2548 raft_consensus.cc:2955] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:18.664485  1615 raft_consensus.cc:2955] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:18.682492  1617 consensus_queue.cc:237] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:18.688920  1446 catalog_manager.cc:5697] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.700625  1546 raft_consensus.cc:2955] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
W20260709 13:00:18.715150  1588 consensus_peers.cc:597] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5886b3175b9d44069e5ba1077b09a28f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.719359  1691 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:18.722597  2504 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:18.738457  1546 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:18.747311  2504 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:18.796442  2432 raft_consensus.cc:2955] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:18.801079  1547 raft_consensus.cc:2955] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:18.908828  1691 raft_consensus.cc:2955] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:18.933602  1615 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:00:18.951545  1588 consensus_peers.cc:597] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d2ae0506db549df9409cfeceb2f3e3b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:18.952495  1546 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:18.952040  1690 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:18.956681  2432 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:18.958464  2509 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:18.967203  1444 catalog_manager.cc:5697] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:18.995635  2504 raft_consensus.cc:2955] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:18.998445  1691 raft_consensus.cc:2955] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:19.006976  1546 raft_consensus.cc:2955] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:19.024168  1444 catalog_manager.cc:5697] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:19.026059  2564 ts_tablet_manager.cc:933] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:19.030606  1547 consensus_queue.cc:237] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:19.097711  2564 tablet_copy_client.cc:323] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.131:43987
I20260709 13:00:19.102401  1707 tablet_copy_service.cc:140] P c20847a6dcea4c2a9cbaf35a2171e33d: Received BeginTabletCopySession request for tablet e4ba9e8bda7e4019b703c785aae4f0a3 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:58526)
I20260709 13:00:19.103224  1707 tablet_copy_service.cc:161] P c20847a6dcea4c2a9cbaf35a2171e33d: Beginning new tablet copy session on tablet e4ba9e8bda7e4019b703c785aae4f0a3 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:58526: session id = e37b8013aec24431a6672a857806329e-e4ba9e8bda7e4019b703c785aae4f0a3
I20260709 13:00:19.119402  1707 tablet_copy_source_session.cc:215] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:19.125496  2564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ba9e8bda7e4019b703c785aae4f0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:19.134985  1615 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:19.136633  1513 consensus_peers.cc:597] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b77299e14b04383b105cbae0697fbca. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:19.136745  2457 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:19.155115  2564 tablet_copy_client.cc:806] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:19.156438  2564 tablet_copy_client.cc:670] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:19.162261  2568 raft_consensus.cc:2955] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:19.164186  1614 raft_consensus.cc:2955] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:19.171334  2564 tablet_copy_client.cc:538] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:19.171445  1690 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:19.177747  2457 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:19.184742  2564 tablet_bootstrap.cc:492] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:19.211194  1691 raft_consensus.cc:2955] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:19.230921  1443 catalog_manager.cc:5697] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:19.254096  2564 tablet_bootstrap.cc:492] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.255455  2564 tablet_bootstrap.cc:492] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:19.256407  2564 ts_tablet_manager.cc:1403] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.016s
I20260709 13:00:19.260780  2564 raft_consensus.cc:359] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:19.267344  2564 raft_consensus.cc:740] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:19.268112  2564 consensus_queue.cc:260] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:19.286520  2573 ts_tablet_manager.cc:933] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:19.296036  2573 tablet_copy_client.cc:323] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:00:19.297819  2564 ts_tablet_manager.cc:1434] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.041s	user 0.021s	sys 0.010s
I20260709 13:00:19.298447  1633 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 5886b3175b9d44069e5ba1077b09a28f from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:00:19.298998  1633 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 5886b3175b9d44069e5ba1077b09a28f from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-5886b3175b9d44069e5ba1077b09a28f
I20260709 13:00:19.301892  1707 tablet_copy_service.cc:342] P c20847a6dcea4c2a9cbaf35a2171e33d: Request end of tablet copy session e37b8013aec24431a6672a857806329e-e4ba9e8bda7e4019b703c785aae4f0a3 received from {username='slave'} at 127.0.0.1:58526
I20260709 13:00:19.302376  1707 tablet_copy_service.cc:434] P c20847a6dcea4c2a9cbaf35a2171e33d: ending tablet copy session e37b8013aec24431a6672a857806329e-e4ba9e8bda7e4019b703c785aae4f0a3 on tablet e4ba9e8bda7e4019b703c785aae4f0a3 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:19.312580  1633 tablet_copy_source_session.cc:215] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:19.319139  2573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5886b3175b9d44069e5ba1077b09a28f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:19.344095  2573 tablet_copy_client.cc:806] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:19.344810  2573 tablet_copy_client.cc:670] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:19.350198  2573 tablet_copy_client.cc:538] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:19.357266  2573 tablet_bootstrap.cc:492] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:19.376219  2573 tablet_bootstrap.cc:492] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.377168  2573 tablet_bootstrap.cc:492] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:19.377874  2573 ts_tablet_manager.cc:1403] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.021s	user 0.021s	sys 0.000s
I20260709 13:00:19.381222  2573 raft_consensus.cc:359] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:19.382048  2573 raft_consensus.cc:740] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:19.382681  2573 consensus_queue.cc:260] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:19.388006  2573 ts_tablet_manager.cc:1434] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:00:19.391875  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-5886b3175b9d44069e5ba1077b09a28f received from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:19.392359  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-5886b3175b9d44069e5ba1077b09a28f on tablet 5886b3175b9d44069e5ba1077b09a28f with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:19.510804  2573 ts_tablet_manager.cc:933] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:00:19.513085  2573 tablet_copy_client.cc:323] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.129:46597
I20260709 13:00:19.515403  1558 tablet_copy_service.cc:140] P 44c8c572048a40b1a5e71865068ed1bb: Received BeginTabletCopySession request for tablet 8b77299e14b04383b105cbae0697fbca from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:53718)
I20260709 13:00:19.516353  1558 tablet_copy_service.cc:161] P 44c8c572048a40b1a5e71865068ed1bb: Beginning new tablet copy session on tablet 8b77299e14b04383b105cbae0697fbca from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:53718: session id = e37b8013aec24431a6672a857806329e-8b77299e14b04383b105cbae0697fbca
I20260709 13:00:19.525012  1558 tablet_copy_source_session.cc:215] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:19.529604  2573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b77299e14b04383b105cbae0697fbca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:19.537333  2564 ts_tablet_manager.cc:933] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:19.549332  2564 tablet_copy_client.cc:323] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:00:19.552728  1633 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 1d2ae0506db549df9409cfeceb2f3e3b from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:00:19.553287  1633 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 1d2ae0506db549df9409cfeceb2f3e3b from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-1d2ae0506db549df9409cfeceb2f3e3b
I20260709 13:00:19.563392  2573 tablet_copy_client.cc:806] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:19.564500  2573 tablet_copy_client.cc:670] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:19.568284  1633 tablet_copy_source_session.cc:215] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:19.569245  2573 tablet_copy_client.cc:538] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:19.576200  2564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2ae0506db549df9409cfeceb2f3e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:19.585310  2573 tablet_bootstrap.cc:492] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:19.600152  2564 tablet_copy_client.cc:806] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:19.601001  2564 tablet_copy_client.cc:670] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:19.619292  2564 tablet_copy_client.cc:538] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:19.631901  2564 tablet_bootstrap.cc:492] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:19.634028  2270 raft_consensus.cc:1217] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:19.674367  2573 tablet_bootstrap.cc:492] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.675474  2573 tablet_bootstrap.cc:492] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:19.676266  2573 ts_tablet_manager.cc:1403] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.091s	user 0.028s	sys 0.030s
I20260709 13:00:19.678506  2270 raft_consensus.cc:1217] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:19.680894  2573 raft_consensus.cc:359] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:19.681856  2573 raft_consensus.cc:740] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:19.682528  2573 consensus_queue.cc:260] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:19.685811  2573 ts_tablet_manager.cc:1434] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:00:19.688428  1558 tablet_copy_service.cc:342] P 44c8c572048a40b1a5e71865068ed1bb: Request end of tablet copy session e37b8013aec24431a6672a857806329e-8b77299e14b04383b105cbae0697fbca received from {username='slave'} at 127.0.0.1:53718
I20260709 13:00:19.688848  1558 tablet_copy_service.cc:434] P 44c8c572048a40b1a5e71865068ed1bb: ending tablet copy session e37b8013aec24431a6672a857806329e-8b77299e14b04383b105cbae0697fbca on tablet 8b77299e14b04383b105cbae0697fbca with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:19.721793  2564 tablet_bootstrap.cc:492] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:19.722892  2564 tablet_bootstrap.cc:492] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:19.724980  2564 ts_tablet_manager.cc:1403] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.004s
I20260709 13:00:19.727985  2564 raft_consensus.cc:359] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:19.728838  2564 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:19.729559  2564 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:19.732189  2564 ts_tablet_manager.cc:1434] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:19.746148  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-1d2ae0506db549df9409cfeceb2f3e3b received from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:19.746594  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-1d2ae0506db549df9409cfeceb2f3e3b on tablet 1d2ae0506db549df9409cfeceb2f3e3b with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:19.933650  2270 raft_consensus.cc:1217] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:20.091841  2270 raft_consensus.cc:1217] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:20.098120  2548 raft_consensus.cc:1064] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:20.103271  2548 consensus_queue.cc:237] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:20.173174  2557 raft_consensus.cc:1064] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:20.187140  2557 consensus_queue.cc:237] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:20.223788  2272 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:20.229451  1617 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:20.229609  2514 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:20.230551  1546 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:20.245921  2514 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:00:20.265763  2272 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:20.271373  2584 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:20.333909  1690 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:20.345136  1540 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:20.350414  2514 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:00:20.361553  2557 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:20.375244  2556 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:20.379971  2588 raft_consensus.cc:2955] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.393342  1547 raft_consensus.cc:2955] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.431777  2584 raft_consensus.cc:2955] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.443583  2272 raft_consensus.cc:2955] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.454200  1547 raft_consensus.cc:2955] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.464922  1690 raft_consensus.cc:2955] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.464439  1443 catalog_manager.cc:5697] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.487345  1615 raft_consensus.cc:2955] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.501262  2585 raft_consensus.cc:1064] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:20.511057  2585 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:20.529665  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 59047.9us
I20260709 13:00:20.530491  2270 raft_consensus.cc:2955] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.569478  2270 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:20.569936  1695 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:20.576181  1540 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:20.577876  2509 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:20.579543  2432 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:20.587919  2432 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:20.607198  2583 raft_consensus.cc:1064] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:20.611950  2583 consensus_queue.cc:237] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:20.613729  2432 raft_consensus.cc:2955] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.616300  2270 raft_consensus.cc:2955] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.629159  1690 raft_consensus.cc:2955] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.663254  1695 consensus_queue.cc:237] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:20.673157  1621 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:20.677505  2272 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:20.667620  1444 catalog_manager.cc:5697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.680060  2570 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:20.680990  1444 catalog_manager.cc:5697] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.689942  2570 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:20.695063  1693 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:20.699878  2270 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:20.702462  2588 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:20.714416  1615 consensus_queue.cc:237] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:20.723135  2595 raft_consensus.cc:2955] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.732940  1547 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:20.733596  1546 raft_consensus.cc:2955] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.736479  2570 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:00:20.730432  2270 raft_consensus.cc:2955] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.753772  1444 catalog_manager.cc:5697] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.757761  2577 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:20.760622  2270 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:20.762233  2432 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:20.770849  2568 raft_consensus.cc:2955] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.776651  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet e4ba9e8bda7e4019b703c785aae4f0a3 with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34170
I20260709 13:00:20.780871  1546 raft_consensus.cc:2955] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.790050  2585 raft_consensus.cc:2955] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.792205  2270 raft_consensus.cc:2955] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.795430  1544 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:20.798343  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e4ba9e8bda7e4019b703c785aae4f0a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:20.809306  1615 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:20.809376  2270 raft_consensus.cc:2955] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.812554  1444 catalog_manager.cc:5697] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:20.817724  2584 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:20.827046  2611 tablet_replica.cc:333] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:00:20.829723  2611 raft_consensus.cc:2243] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:20.829900  1544 consensus_queue.cc:237] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:20.850234  2272 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:20.850670  2611 raft_consensus.cc:2272] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:20.851819  2272 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:20.852295  2583 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:20.853785  1695 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:20.856019  2509 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:20.864197  2611 ts_tablet_manager.cc:1916] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:20.863253  2509 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:00:20.866958  2589 raft_consensus.cc:2955] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.869354  2568 raft_consensus.cc:2955] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.878062  1444 catalog_manager.cc:5697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.878579  1695 raft_consensus.cc:2955] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.880354  2270 raft_consensus.cc:2955] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.899518  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 5886b3175b9d44069e5ba1077b09a28f with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39234
I20260709 13:00:20.886756  1546 raft_consensus.cc:2955] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.929006  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b77299e14b04383b105cbae0697fbca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:20.930219  2612 tablet_replica.cc:333] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:00:20.931946  2612 raft_consensus.cc:2243] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:20.932811  2612 raft_consensus.cc:2272] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:20.928861  2611 ts_tablet_manager.cc:1929] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:20.940442  2611 log.cc:1199] T e4ba9e8bda7e4019b703c785aae4f0a3 P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/e4ba9e8bda7e4019b703c785aae4f0a3
I20260709 13:00:20.939189  2612 ts_tablet_manager.cc:1916] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:20.942967  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet e4ba9e8bda7e4019b703c785aae4f0a3 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:20.945525  1615 raft_consensus.cc:2955] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.957429  1446 catalog_manager.cc:5697] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.963979  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d2ae0506db549df9409cfeceb2f3e3b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:20.967024  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5886b3175b9d44069e5ba1077b09a28f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:20.969552  2270 raft_consensus.cc:2955] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.972347  1614 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:20.985617  2612 ts_tablet_manager.cc:1929] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:20.986279  2612 log.cc:1199] T 5886b3175b9d44069e5ba1077b09a28f P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/5886b3175b9d44069e5ba1077b09a28f
I20260709 13:00:20.986617  1443 catalog_manager.cc:5697] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:20.988242  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet 5886b3175b9d44069e5ba1077b09a28f (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:20.990816  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b77299e14b04383b105cbae0697fbca with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39234
I20260709 13:00:20.995327  2612 tablet_replica.cc:333] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:00:20.996883  2612 raft_consensus.cc:2243] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:21.006395  2612 pending_rounds.cc:70] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d: Trying to abort 1 pending ops.
I20260709 13:00:21.017831  2570 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:21.007160  2612 pending_rounds.cc:77] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305633876414582784 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "8b77299e14b04383b105cbae0697fbca" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } } }
I20260709 13:00:21.019601  2612 raft_consensus.cc:2917] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:00:21.020306  2612 raft_consensus.cc:2889] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:00:21.020761  2612 raft_consensus.cc:2272] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:21.026821  2612 ts_tablet_manager.cc:1916] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:21.047400  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d2ae0506db549df9409cfeceb2f3e3b with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35688
I20260709 13:00:21.060344  2613 tablet_replica.cc:333] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:00:21.062673  2613 raft_consensus.cc:2243] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:21.063723  2613 raft_consensus.cc:2272] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:21.068552  2613 ts_tablet_manager.cc:1916] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:21.074157  2612 ts_tablet_manager.cc:1929] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:21.074807  2612 log.cc:1199] T 8b77299e14b04383b105cbae0697fbca P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/8b77299e14b04383b105cbae0697fbca
I20260709 13:00:21.077374  1614 raft_consensus.cc:2955] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:21.082747  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet 8b77299e14b04383b105cbae0697fbca (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:21.100203  2613 ts_tablet_manager.cc:1929] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:21.101585  2613 log.cc:1199] T 1d2ae0506db549df9409cfeceb2f3e3b P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/1d2ae0506db549df9409cfeceb2f3e3b
I20260709 13:00:21.103703  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet 1d2ae0506db549df9409cfeceb2f3e3b (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:22.127971  1690 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:22.136387  1540 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:22.136147  1617 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:22.136651  1662 consensus_peers.cc:597] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77eb0c0355254cf592e70feb5035e50f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:22.138248  2616 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:22.139351  2621 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:22.156273  2615 raft_consensus.cc:2955] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:22.158692  1617 raft_consensus.cc:2955] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:22.158509  1540 raft_consensus.cc:2955] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:22.179352  1446 catalog_manager.cc:5697] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:22.187008  1690 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:00:22.199900  1662 consensus_peers.cc:597] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3006951ad004b6b87217fff5303a9ab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:22.202814  1617 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:22.204680  1540 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:22.205765  2616 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:22.208088  2621 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:22.222734  2616 raft_consensus.cc:2955] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:22.236624  1615 raft_consensus.cc:2955] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:22.243558  1546 raft_consensus.cc:2955] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:22.262163  1446 catalog_manager.cc:5697] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:22.264775  1615 consensus_queue.cc:237] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:22.273293  1690 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:22.273833  1588 consensus_peers.cc:597] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c5c9f43dc704dd09f6c603fa4ea346c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:22.275197  2589 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:22.279557  1546 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:22.281610  2587 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:22.302573  1691 raft_consensus.cc:2955] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:22.299491  2587 raft_consensus.cc:2955] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
W20260709 13:00:22.337860  1477 debug-util.cc:398] Leaking SignalData structure 0x7b0800034860 after lost signal to thread 433
W20260709 13:00:22.338934  1477 debug-util.cc:398] Leaking SignalData structure 0x7b0800035f40 after lost signal to thread 1480
W20260709 13:00:22.340118  1477 debug-util.cc:398] Leaking SignalData structure 0x7b0800334800 after lost signal to thread 1572
W20260709 13:00:22.341174  1477 debug-util.cc:398] Leaking SignalData structure 0x7b08003249e0 after lost signal to thread 1647
W20260709 13:00:22.342218  1477 debug-util.cc:398] Leaking SignalData structure 0x7b0800314880 after lost signal to thread 1721
I20260709 13:00:22.344108  1540 raft_consensus.cc:2955] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:22.347720  1446 catalog_manager.cc:5697] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
W20260709 13:00:22.343257  1477 debug-util.cc:398] Leaking SignalData structure 0x7b0800280c60 after lost signal to thread 2296
I20260709 13:00:22.364986  1540 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:00:22.411983  1513 consensus_peers.cc:597] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e60c013c7e324514aef1674561db1cc6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:22.413249  1617 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:22.423727  2457 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:22.416239  1691 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:22.428911  2457 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:22.453667  2457 raft_consensus.cc:2955] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:22.456884  1617 raft_consensus.cc:2955] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:22.463449  1691 raft_consensus.cc:2955] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:22.484053  1446 catalog_manager.cc:5697] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:22.601794  2638 ts_tablet_manager.cc:933] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:22.616953  2638 tablet_copy_client.cc:323] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.131:43987
I20260709 13:00:22.619328  1707 tablet_copy_service.cc:140] P c20847a6dcea4c2a9cbaf35a2171e33d: Received BeginTabletCopySession request for tablet 77eb0c0355254cf592e70feb5035e50f from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:58526)
I20260709 13:00:22.619997  1707 tablet_copy_service.cc:161] P c20847a6dcea4c2a9cbaf35a2171e33d: Beginning new tablet copy session on tablet 77eb0c0355254cf592e70feb5035e50f from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:58526: session id = e37b8013aec24431a6672a857806329e-77eb0c0355254cf592e70feb5035e50f
I20260709 13:00:22.629904  1707 tablet_copy_source_session.cc:215] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:22.633792  2638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77eb0c0355254cf592e70feb5035e50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:22.677989  2638 tablet_copy_client.cc:806] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:22.678850  2638 tablet_copy_client.cc:670] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:22.720487  2638 tablet_copy_client.cc:538] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:22.728883  2640 ts_tablet_manager.cc:933] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:22.765249  2640 tablet_copy_client.cc:323] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.131:43987
I20260709 13:00:22.767961  2638 tablet_bootstrap.cc:492] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:22.770326  1707 tablet_copy_service.cc:140] P c20847a6dcea4c2a9cbaf35a2171e33d: Received BeginTabletCopySession request for tablet c3006951ad004b6b87217fff5303a9ab from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:58526)
I20260709 13:00:22.770925  1707 tablet_copy_service.cc:161] P c20847a6dcea4c2a9cbaf35a2171e33d: Beginning new tablet copy session on tablet c3006951ad004b6b87217fff5303a9ab from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:58526: session id = e37b8013aec24431a6672a857806329e-c3006951ad004b6b87217fff5303a9ab
I20260709 13:00:22.782199  1707 tablet_copy_source_session.cc:215] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:22.786109  2640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3006951ad004b6b87217fff5303a9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:22.809433  2640 tablet_copy_client.cc:806] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:22.810149  2640 tablet_copy_client.cc:670] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:22.827595  2640 tablet_copy_client.cc:538] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:22.839672  2640 tablet_bootstrap.cc:492] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:22.900388  2642 ts_tablet_manager.cc:933] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:22.913203  2642 tablet_copy_client.cc:323] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:00:22.916401  1633 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 3c5c9f43dc704dd09f6c603fa4ea346c from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:00:22.917181  1633 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 3c5c9f43dc704dd09f6c603fa4ea346c from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-3c5c9f43dc704dd09f6c603fa4ea346c
I20260709 13:00:22.927525  1633 tablet_copy_source_session.cc:215] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:22.931497  2642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5c9f43dc704dd09f6c603fa4ea346c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:22.948426  2640 tablet_bootstrap.cc:492] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.949414  2640 tablet_bootstrap.cc:492] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:22.950141  2640 ts_tablet_manager.cc:1403] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.111s	user 0.025s	sys 0.001s
I20260709 13:00:22.953616  2638 tablet_bootstrap.cc:492] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:22.953739  2642 tablet_copy_client.cc:806] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:22.954576  2638 tablet_bootstrap.cc:492] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:22.954630  2642 tablet_copy_client.cc:670] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:22.955349  2638 ts_tablet_manager.cc:1403] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.188s	user 0.021s	sys 0.011s
I20260709 13:00:22.960213  2642 tablet_copy_client.cc:538] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:22.972627  2638 raft_consensus.cc:359] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:22.973906  2638 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:22.975835  2638 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:22.977058  2642 tablet_bootstrap.cc:492] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:22.969226  2640 raft_consensus.cc:359] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:22.979741  2640 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:22.981395  2640 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:23.002528  2640 ts_tablet_manager.cc:1434] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.005s
I20260709 13:00:23.005566  2638 ts_tablet_manager.cc:1434] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.004s
I20260709 13:00:23.015930  2649 ts_tablet_manager.cc:933] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:00:23.016088  1707 tablet_copy_service.cc:342] P c20847a6dcea4c2a9cbaf35a2171e33d: Request end of tablet copy session e37b8013aec24431a6672a857806329e-c3006951ad004b6b87217fff5303a9ab received from {username='slave'} at 127.0.0.1:58526
I20260709 13:00:23.017808  1707 tablet_copy_service.cc:434] P c20847a6dcea4c2a9cbaf35a2171e33d: ending tablet copy session e37b8013aec24431a6672a857806329e-c3006951ad004b6b87217fff5303a9ab on tablet c3006951ad004b6b87217fff5303a9ab with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:23.018949  1706 tablet_copy_service.cc:342] P c20847a6dcea4c2a9cbaf35a2171e33d: Request end of tablet copy session e37b8013aec24431a6672a857806329e-77eb0c0355254cf592e70feb5035e50f received from {username='slave'} at 127.0.0.1:58526
I20260709 13:00:23.019344  1706 tablet_copy_service.cc:434] P c20847a6dcea4c2a9cbaf35a2171e33d: ending tablet copy session e37b8013aec24431a6672a857806329e-77eb0c0355254cf592e70feb5035e50f on tablet 77eb0c0355254cf592e70feb5035e50f with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:23.030252  2642 tablet_bootstrap.cc:492] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:23.032603  2642 tablet_bootstrap.cc:492] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:23.037305  2642 ts_tablet_manager.cc:1403] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.061s	user 0.023s	sys 0.012s
I20260709 13:00:23.036060  2649 tablet_copy_client.cc:323] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.129:46597
I20260709 13:00:23.040386  1558 tablet_copy_service.cc:140] P 44c8c572048a40b1a5e71865068ed1bb: Received BeginTabletCopySession request for tablet e60c013c7e324514aef1674561db1cc6 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:53718)
I20260709 13:00:23.041074  1558 tablet_copy_service.cc:161] P 44c8c572048a40b1a5e71865068ed1bb: Beginning new tablet copy session on tablet e60c013c7e324514aef1674561db1cc6 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:53718: session id = e37b8013aec24431a6672a857806329e-e60c013c7e324514aef1674561db1cc6
I20260709 13:00:23.043182  2642 raft_consensus.cc:359] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:23.044349  2642 raft_consensus.cc:740] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:23.045533  2642 consensus_queue.cc:260] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:23.049795  2642 ts_tablet_manager.cc:1434] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:00:23.051869  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-3c5c9f43dc704dd09f6c603fa4ea346c received from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:23.052352  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-3c5c9f43dc704dd09f6c603fa4ea346c on tablet 3c5c9f43dc704dd09f6c603fa4ea346c with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:23.062099  1558 tablet_copy_source_session.cc:215] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:23.066012  2649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60c013c7e324514aef1674561db1cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:23.101717  2649 tablet_copy_client.cc:806] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:23.102471  2649 tablet_copy_client.cc:670] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:23.107057  2649 tablet_copy_client.cc:538] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:23.117416  2649 tablet_bootstrap.cc:492] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:23.144083  2649 tablet_bootstrap.cc:492] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:23.145138  2649 tablet_bootstrap.cc:492] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:23.145916  2649 ts_tablet_manager.cc:1403] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.012s
I20260709 13:00:23.150734  2649 raft_consensus.cc:359] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:23.153937  2649 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:23.154335  2268 raft_consensus.cc:1217] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:23.154932  2649 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:23.159852  2649 ts_tablet_manager.cc:1434] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:00:23.162844  1558 tablet_copy_service.cc:342] P 44c8c572048a40b1a5e71865068ed1bb: Request end of tablet copy session e37b8013aec24431a6672a857806329e-e60c013c7e324514aef1674561db1cc6 received from {username='slave'} at 127.0.0.1:53718
I20260709 13:00:23.163508  1558 tablet_copy_service.cc:434] P 44c8c572048a40b1a5e71865068ed1bb: ending tablet copy session e37b8013aec24431a6672a857806329e-e60c013c7e324514aef1674561db1cc6 on tablet e60c013c7e324514aef1674561db1cc6 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:23.207690  2268 raft_consensus.cc:1217] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:23.371330  2268 raft_consensus.cc:1217] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:23.445359  2268 raft_consensus.cc:1217] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:23.699163  2621 raft_consensus.cc:1064] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:23.706985  2616 raft_consensus.cc:1064] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:23.706128  2621 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:23.713651  2616 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:23.888682  2268 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:23.893067  2268 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:23.896163  2654 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:23.895820  2662 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:00:23.911343  2658 raft_consensus.cc:1064] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:23.913862  2658 consensus_queue.cc:237] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:23.987931  2271 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:23.988795  1693 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:23.989645  2658 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:23.991030  1615 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:23.992831  1615 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:23.992784  2658 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:24.000597  2615 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.003149  2616 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.013230  1540 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:24.027627  2583 raft_consensus.cc:1064] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:24.029980  2583 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:24.035531  2615 raft_consensus.cc:2955] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.053193  1622 raft_consensus.cc:2955] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.060089  2654 raft_consensus.cc:2955] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.077304  1546 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:24.087462  1541 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:24.090281  2270 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:24.091739  2509 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.095302  1443 catalog_manager.cc:5697] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.096613  1615 raft_consensus.cc:2955] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.097061  2656 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:24.106410  2657 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:24.116349  1690 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:24.122130  2656 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.104590  2616 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:00:24.126354  2617 raft_consensus.cc:2955] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.129335  1693 raft_consensus.cc:2955] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.130000  2272 raft_consensus.cc:2955] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.140417  1617 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:24.151010  2583 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:00:24.166960  1444 catalog_manager.cc:5697] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:24.192866  2268 raft_consensus.cc:2955] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.233079  1547 raft_consensus.cc:2955] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.195147  1541 raft_consensus.cc:2955] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.323853  2457 raft_consensus.cc:2955] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.326400  1690 raft_consensus.cc:2955] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.336040  2271 raft_consensus.cc:2955] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.333747  1542 raft_consensus.cc:2955] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.338558  2270 raft_consensus.cc:2955] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.413074  1617 raft_consensus.cc:2955] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.450083  1443 catalog_manager.cc:5697] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:24.469349  1446 catalog_manager.cc:5697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.469941  1622 consensus_queue.cc:237] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:24.476964  2270 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:24.478560  2587 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:24.479862  1693 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:24.487598  2617 raft_consensus.cc:2955] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.497388  2268 raft_consensus.cc:2955] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.511147  2667 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:24.513150  1547 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:24.526943  2268 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:24.527263  1693 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:24.532725  2583 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:24.533598  2457 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:24.542274  1693 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:24.542299  1695 raft_consensus.cc:2955] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.546393  2655 raft_consensus.cc:2955] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.548969  2270 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:24.551592  2662 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:24.556221  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3c5c9f43dc704dd09f6c603fa4ea346c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:24.557994  1617 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:24.560011  2615 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:24.564307  1693 raft_consensus.cc:2955] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.567535  2661 raft_consensus.cc:2955] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.569643  2271 raft_consensus.cc:2955] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.572610  2272 raft_consensus.cc:2955] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.577517  1614 raft_consensus.cc:2955] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.605473  1445 catalog_manager.cc:5697] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:24.614002  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e60c013c7e324514aef1674561db1cc6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:24.624610  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 77eb0c0355254cf592e70feb5035e50f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:24.626989  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c5c9f43dc704dd09f6c603fa4ea346c with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35688
I20260709 13:00:24.638890  1444 catalog_manager.cc:5697] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.641374  1444 catalog_manager.cc:5697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.652179  2685 tablet_replica.cc:333] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:00:24.653800  2685 raft_consensus.cc:2243] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.654592  2685 raft_consensus.cc:2272] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.657377  2685 ts_tablet_manager.cc:1916] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:24.665278  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 77eb0c0355254cf592e70feb5035e50f with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35688
I20260709 13:00:24.665524  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet e60c013c7e324514aef1674561db1cc6 with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34170
I20260709 13:00:24.686932  2685 ts_tablet_manager.cc:1929] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:24.688066  2685 log.cc:1199] T 3c5c9f43dc704dd09f6c603fa4ea346c P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/3c5c9f43dc704dd09f6c603fa4ea346c
I20260709 13:00:24.689960  2685 tablet_replica.cc:333] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:00:24.689780  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet 3c5c9f43dc704dd09f6c603fa4ea346c (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:24.691325  2685 raft_consensus.cc:2243] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.692211  2685 raft_consensus.cc:2272] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.696147  2686 tablet_replica.cc:333] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:00:24.697193  2686 raft_consensus.cc:2243] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.697641  2685 ts_tablet_manager.cc:1916] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:24.703014  2686 raft_consensus.cc:2272] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.709271  2686 ts_tablet_manager.cc:1916] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:24.716202  1693 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:24.720665  2685 ts_tablet_manager.cc:1929] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:24.721138  2685 log.cc:1199] T 77eb0c0355254cf592e70feb5035e50f P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/77eb0c0355254cf592e70feb5035e50f
I20260709 13:00:24.721285  2271 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:24.722904  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet 77eb0c0355254cf592e70feb5035e50f (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:24.724083  2621 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:24.726958  1547 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:24.729156  2654 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:24.734093  2661 raft_consensus.cc:2955] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.737079  2268 raft_consensus.cc:2955] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.753881  1547 raft_consensus.cc:2955] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.772280  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c3006951ad004b6b87217fff5303a9ab with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:24.777885  1446 catalog_manager.cc:5697] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:24.803380  2686 ts_tablet_manager.cc:1929] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:24.803881  2686 log.cc:1199] T e60c013c7e324514aef1674561db1cc6 P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/e60c013c7e324514aef1674561db1cc6
I20260709 13:00:24.805384  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet e60c013c7e324514aef1674561db1cc6 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:24.809000  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet c3006951ad004b6b87217fff5303a9ab with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34170
I20260709 13:00:24.810228  2686 tablet_replica.cc:333] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:00:24.811231  2686 raft_consensus.cc:2243] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:24.811952  2686 raft_consensus.cc:2272] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:24.815629  2686 ts_tablet_manager.cc:1916] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:24.832088  2686 ts_tablet_manager.cc:1929] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:24.832479  2686 log.cc:1199] T c3006951ad004b6b87217fff5303a9ab P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/c3006951ad004b6b87217fff5303a9ab
I20260709 13:00:24.833923  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet c3006951ad004b6b87217fff5303a9ab (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:25.876173  1617 consensus_queue.cc:237] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:25.884516  1690 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:25.886518  1588 consensus_peers.cc:597] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1af6b960277d47bd994134d20b77c59a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:25.886811  2617 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:25.888711  1547 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:25.890578  2509 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:25.914676  1542 raft_consensus.cc:2955] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:25.912559  2617 raft_consensus.cc:2955] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:25.933261  1695 raft_consensus.cc:2955] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:25.942946  1446 catalog_manager.cc:5697] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:26.041069  1617 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:00:26.076545  1588 consensus_peers.cc:597] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e0e70f76a194ff7ab05b64009ded3c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:26.080245  1695 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:26.082253  1541 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:26.084323  2689 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:26.086732  2509 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.095993  2587 raft_consensus.cc:2955] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:26.099956  1541 raft_consensus.cc:2955] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:26.102083  1695 raft_consensus.cc:2955] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:26.119835  1542 consensus_queue.cc:237] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:26.126288  1446 catalog_manager.cc:5697] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:26.155305  1513 consensus_peers.cc:597] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8493cdac98b4860b0ddbe729b652ee9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:26.157447  1695 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:26.158771  1614 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:26.161051  2457 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.162021  2655 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.188993  2655 raft_consensus.cc:2955] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:26.190806  1617 raft_consensus.cc:2955] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:26.209017  1695 raft_consensus.cc:2955] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:26.216254  1693 consensus_queue.cc:237] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:26.218752  1444 catalog_manager.cc:5697] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:26.225414  1662 consensus_peers.cc:597] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33125bfca16d4902a09564d1eef1a47f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:26.227226  1617 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:26.228602  2621 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.232393  1542 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:26.240931  2621 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:26.260479   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:26.266484  2695 raft_consensus.cc:2955] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:26.293787  1614 raft_consensus.cc:2955] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:26.314178  1446 catalog_manager.cc:5697] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.321583  1542 raft_consensus.cc:2955] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:26.410854  2707 ts_tablet_manager.cc:933] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:26.460860  2707 tablet_copy_client.cc:323] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:00:26.483646  1633 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 1af6b960277d47bd994134d20b77c59a from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:00:26.484248  1633 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 1af6b960277d47bd994134d20b77c59a from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-1af6b960277d47bd994134d20b77c59a
W20260709 13:00:26.484898  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 137964us
I20260709 13:00:26.494469  1633 tablet_copy_source_session.cc:215] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:26.499898  2707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af6b960277d47bd994134d20b77c59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.529706  2707 tablet_copy_client.cc:806] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:26.530328  2707 tablet_copy_client.cc:670] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:26.536425  2707 tablet_copy_client.cc:538] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:26.559058  2716 ts_tablet_manager.cc:933] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:26.561368  2707 tablet_bootstrap.cc:492] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:26.601447  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:26.602172  1614 raft_consensus.cc:606] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS e37b8013aec24431a6672a857806329e
I20260709 13:00:26.605911  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:26.606613  1622 raft_consensus.cc:606] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:26.610657  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "738a15ae04514d49969f3624caa73f45"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:26.611552  1622 raft_consensus.cc:606] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:26.617841  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:26.618449  1622 raft_consensus.cc:606] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:26.621055  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:26.622125  1622 raft_consensus.cc:606] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS e37b8013aec24431a6672a857806329e
I20260709 13:00:26.623843   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:26.623698  2707 tablet_bootstrap.cc:492] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:26.624920  2707 tablet_bootstrap.cc:492] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:26.625535   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:26.625814  2707 ts_tablet_manager.cc:1403] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.065s	user 0.040s	sys 0.005s
I20260709 13:00:26.629067  2707 raft_consensus.cc:359] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:26.630223  2707 raft_consensus.cc:740] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:26.630928  2707 consensus_queue.cc:260] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:26.638019  2692 raft_consensus.cc:993] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:26.638547  2692 raft_consensus.cc:1081] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:26.640206  2271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163"
dest_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:54496
I20260709 13:00:26.640841  2271 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:26.641217  2271 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.655834  2707 ts_tablet_manager.cc:1434] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.030s	user 0.013s	sys 0.001s
I20260709 13:00:26.658077  2271 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:26.659407  2716 tablet_copy_client.cc:323] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:00:26.663057  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:26.663877  1622 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.663530  1632 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 5e0e70f76a194ff7ab05b64009ded3c5 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:00:26.664198  1622 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:26.665190  1622 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:26.663053  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-1af6b960277d47bd994134d20b77c59a received from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:26.666352  1622 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.666666  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-1af6b960277d47bd994134d20b77c59a on tablet 1af6b960277d47bd994134d20b77c59a with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:26.670354  1632 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 5e0e70f76a194ff7ab05b64009ded3c5 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-5e0e70f76a194ff7ab05b64009ded3c5
I20260709 13:00:26.679914  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:26.680708  1690 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.693701  1632 tablet_copy_source_session.cc:215] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:26.698010  2716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e0e70f76a194ff7ab05b64009ded3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.725366  1690 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:26.727437  2268 raft_consensus.cc:1217] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:26.727496  2231 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:26.729031  2721 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:26.729497  2721 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:26.730432  2721 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:26.679033  2271 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:26.763293  2707 ts_tablet_manager.cc:933] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
W20260709 13:00:26.775663  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 61515.3us
I20260709 13:00:26.778620  1443 catalog_manager.cc:5697] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 2 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.785992  1622 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:26.787750  2707 tablet_copy_client.cc:323] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.129:46597
I20260709 13:00:26.791250  1558 tablet_copy_service.cc:140] P 44c8c572048a40b1a5e71865068ed1bb: Received BeginTabletCopySession request for tablet c8493cdac98b4860b0ddbe729b652ee9 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:53718)
I20260709 13:00:26.791828  1558 tablet_copy_service.cc:161] P 44c8c572048a40b1a5e71865068ed1bb: Beginning new tablet copy session on tablet c8493cdac98b4860b0ddbe729b652ee9 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:53718: session id = e37b8013aec24431a6672a857806329e-c8493cdac98b4860b0ddbe729b652ee9
I20260709 13:00:26.804176  1558 tablet_copy_source_session.cc:215] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:26.808893  2707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8493cdac98b4860b0ddbe729b652ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.811594  2716 tablet_copy_client.cc:806] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:26.812247  2716 tablet_copy_client.cc:670] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:26.835736  2716 tablet_copy_client.cc:538] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:26.852521  2707 tablet_copy_client.cc:806] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:26.853444  2707 tablet_copy_client.cc:670] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:26.854034  2726 ts_tablet_manager.cc:933] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:26.857602  2707 tablet_copy_client.cc:538] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:26.864050  2726 tablet_copy_client.cc:323] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.131:43987
I20260709 13:00:26.867476  1706 tablet_copy_service.cc:140] P c20847a6dcea4c2a9cbaf35a2171e33d: Received BeginTabletCopySession request for tablet 33125bfca16d4902a09564d1eef1a47f from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:58526)
I20260709 13:00:26.868191  1706 tablet_copy_service.cc:161] P c20847a6dcea4c2a9cbaf35a2171e33d: Beginning new tablet copy session on tablet 33125bfca16d4902a09564d1eef1a47f from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:58526: session id = e37b8013aec24431a6672a857806329e-33125bfca16d4902a09564d1eef1a47f
I20260709 13:00:26.875643  2707 tablet_bootstrap.cc:492] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:26.875985  2716 tablet_bootstrap.cc:492] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:26.882629  1706 tablet_copy_source_session.cc:215] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:26.886749  2726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33125bfca16d4902a09564d1eef1a47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:26.912945  2716 tablet_bootstrap.cc:492] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:26.913965  2716 tablet_bootstrap.cc:492] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:26.914757  2716 ts_tablet_manager.cc:1403] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.039s	user 0.023s	sys 0.011s
I20260709 13:00:26.915305  2707 tablet_bootstrap.cc:492] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:26.916265  2707 tablet_bootstrap.cc:492] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:26.916895  2707 ts_tablet_manager.cc:1403] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.013s
I20260709 13:00:26.918188  2716 raft_consensus.cc:359] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:26.919116  2716 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:26.920265  2716 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:26.923352  2716 ts_tablet_manager.cc:1434] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:26.923765  2707 raft_consensus.cc:359] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:26.924587  2707 raft_consensus.cc:740] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:26.925544  2707 consensus_queue.cc:260] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:26.929257  2707 ts_tablet_manager.cc:1434] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:00:26.930356  2271 raft_consensus.cc:1217] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:26.933261  1558 tablet_copy_service.cc:342] P 44c8c572048a40b1a5e71865068ed1bb: Request end of tablet copy session e37b8013aec24431a6672a857806329e-c8493cdac98b4860b0ddbe729b652ee9 received from {username='slave'} at 127.0.0.1:53718
I20260709 13:00:26.933744  1558 tablet_copy_service.cc:434] P 44c8c572048a40b1a5e71865068ed1bb: ending tablet copy session e37b8013aec24431a6672a857806329e-c8493cdac98b4860b0ddbe729b652ee9 on tablet c8493cdac98b4860b0ddbe729b652ee9 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:26.938609  1632 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-5e0e70f76a194ff7ab05b64009ded3c5 received from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:26.939031  1632 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-5e0e70f76a194ff7ab05b64009ded3c5 on tablet 5e0e70f76a194ff7ab05b64009ded3c5 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:26.940420  2726 tablet_copy_client.cc:806] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:26.940974  2726 tablet_copy_client.cc:670] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:26.948917  2726 tablet_copy_client.cc:538] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:26.962951  2587 raft_consensus.cc:993] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:26.964102  2587 raft_consensus.cc:1081] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:26.965063  2726 tablet_bootstrap.cc:492] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:26.965421  2617 raft_consensus.cc:993] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:26.966769  2617 raft_consensus.cc:1081] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:26.967639  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35712
I20260709 13:00:26.968297  1541 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:26.968653  1541 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.969901  2271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977"
dest_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:54496
I20260709 13:00:26.970494  2271 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:26.970832  2271 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.975780  1541 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:26.977777  1541 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:26.982487  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:26.983178  1614 raft_consensus.cc:3055] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.983534  1614 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:26.984331  1614 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:26.985479  1614 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.987952  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:26.988658  1690 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:27.002339  2713 raft_consensus.cc:993] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:27.003037  2617 raft_consensus.cc:1081] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:27.010280  1690 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:27.011271  2271 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:27.014745  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "738a15ae04514d49969f3624caa73f45"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39238
I20260709 13:00:27.015322  1691 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:27.015399  1614 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:27.015707  1691 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:27.017123  1511 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:27.017926  2722 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:27.018358  2722 raft_consensus.cc:697] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:27.019196  2722 consensus_queue.cc:237] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:27.023793  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:27.024405  1542 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:27.033097  2271 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:27.033990  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:27.034540  1622 raft_consensus.cc:3055] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:27.034830  1622 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:27.035526  1622 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:27.040060  1542 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:27.041181  1691 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:27.043144  1622 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:27.057772  1691 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:27.092342  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:27.092995  1617 raft_consensus.cc:3055] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:27.093037  1622 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:27.093415  1617 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:27.094110  1617 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:27.097114  2234 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:27.109859  1617 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:27.122206  1617 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:27.109845  2721 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:27.148313  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:27.149096  1542 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:27.149468  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 50292.6us
I20260709 13:00:27.133265  2721 raft_consensus.cc:697] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:27.143311  2692 raft_consensus.cc:993] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:27.170759  1542 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:27.180229  2721 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:27.170507  2692 raft_consensus.cc:1081] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:27.187175  2692 raft_consensus.cc:1064] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:27.188256  1661 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:27.189493  2715 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:27.190279  2715 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:27.191556  2715 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:27.177408  1443 catalog_manager.cc:5697] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 2 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.201001  2268 raft_consensus.cc:1217] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:00:27.226540  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 61566.8us
W20260709 13:00:27.257156  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 58362us
I20260709 13:00:27.378772  1690 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:27.390759  2723 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 13:00:27.418742  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 263017us
I20260709 13:00:27.435712  1444 catalog_manager.cc:5697] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.453577  2726 tablet_bootstrap.cc:492] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:27.454507  2726 tablet_bootstrap.cc:492] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:27.455168  2726 ts_tablet_manager.cc:1403] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.490s	user 0.035s	sys 0.021s
W20260709 13:00:27.461088  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 107474us
I20260709 13:00:27.451223  2692 consensus_queue.cc:237] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:27.479239  1446 catalog_manager.cc:5697] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 2 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.487056  1614 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.513445  1693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39238
I20260709 13:00:27.514137  1693 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:27.517843  1547 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:27.514899  1693 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:27.520923  2457 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:27.532657  2689 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:27.534786  1693 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:27.540048  1693 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:27.488292  2726 raft_consensus.cc:359] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:27.542006  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:27.543118  1622 raft_consensus.cc:3055] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:27.543605  1622 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:27.544437  1622 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:27.545573  1622 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:27.554466  1617 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:27.559237  2266 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:27.565296  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:27.566273  1544 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:27.543018  2726 raft_consensus.cc:740] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:27.585718  1695 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:27.587102  1691 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:27.577482  2726 consensus_queue.cc:260] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:27.601465  2723 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:27.606283  1544 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:27.610116  1661 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:27.611534  2712 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:27.612025  2712 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:27.613379  1622 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:27.613005  2712 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:27.627040   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:27.632181  2692 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:27.639231  1696 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.641520  2655 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:27.688642  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 84281.7us
W20260709 13:00:27.698153  2751 log.cc:927] Time spent T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:00:27.713104  1622 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.715309  2744 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:27.716179  2740 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:00:27.790886  2617 raft_consensus.cc:1064] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:27.799898  2617 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:27.813971  2457 raft_consensus.cc:1064] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:27.816319  2457 consensus_queue.cc:237] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:27.824910  2726 ts_tablet_manager.cc:1434] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.351s	user 0.020s	sys 0.001s
I20260709 13:00:27.835245  1444 catalog_manager.cc:5697] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.841797  1706 tablet_copy_service.cc:342] P c20847a6dcea4c2a9cbaf35a2171e33d: Request end of tablet copy session e37b8013aec24431a6672a857806329e-33125bfca16d4902a09564d1eef1a47f received from {username='slave'} at 127.0.0.1:58526
I20260709 13:00:27.842308  1706 tablet_copy_service.cc:434] P c20847a6dcea4c2a9cbaf35a2171e33d: ending tablet copy session e37b8013aec24431a6672a857806329e-33125bfca16d4902a09564d1eef1a47f on tablet 33125bfca16d4902a09564d1eef1a47f with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:27.842903  1542 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.844478  2621 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:27.844230  1689 raft_consensus.cc:2955] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:27.818326  2713 raft_consensus.cc:2955] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:27.860436  2272 raft_consensus.cc:1217] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:27.931115  1544 raft_consensus.cc:2955] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:27.967072  2272 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:27.970494  2736 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:00:27.970369  1446 catalog_manager.cc:5697] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:27.978124  1544 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:27.968209  2266 raft_consensus.cc:2955] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:27.990315  1617 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:27.991098  2748 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:00:28.001276  2758 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:00:28.003379  1696 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.031165  1614 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:28.033824  2621 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:00:28.018597  2692 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:00:28.074652  1547 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:28.181440   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:28.187274  2741 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
W20260709 13:00:28.188206  2771 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:00:28.312294  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 156059us
W20260709 13:00:28.330610  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 214366us
W20260709 13:00:28.354794  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 247421us
I20260709 13:00:28.378741  1622 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.433435  2272 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:28.439637  1546 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:28.444501  2773 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:00:28.447018  2772 log.cc:927] Time spent T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:00:28.450218  2770 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:00:28.488402  2767 log.cc:927] Time spent T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:00:28.510200  2722 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:28.523103  2271 raft_consensus.cc:2955] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:28.535739  2687 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:00:28.550496  2587 raft_consensus.cc:2955] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:00:28.597867  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 184822us
I20260709 13:00:28.604794  1546 raft_consensus.cc:2955] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:28.617287  1696 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:00:28.685911  2771 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:28.696969  2774 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
W20260709 13:00:28.728217  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 66480.7us
I20260709 13:00:28.733060  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:28.733644  1614 raft_consensus.cc:606] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:28.757099  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 101047us
W20260709 13:00:28.754223  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 115780us
I20260709 13:00:28.756820  2457 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:28.809518  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 183085us
I20260709 13:00:28.864877  2776 raft_consensus.cc:1064] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:28.866485  1446 catalog_manager.cc:5697] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:00:28.878685  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 51579.2us
I20260709 13:00:28.883459  2776 consensus_queue.cc:237] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:28.915668  2687 raft_consensus.cc:2955] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:00:28.953006  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 43742.7us
I20260709 13:00:28.984226  2272 raft_consensus.cc:2955] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.018888  1621 consensus_queue.cc:237] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:29.075485  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 44668us
I20260709 13:00:29.109768  1695 raft_consensus.cc:2955] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:00:29.119233  2807 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 13:00:29.202060  2809 log.cc:927] Time spent T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:00:29.220070  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 128082us
W20260709 13:00:29.240504  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.369400  1622 raft_consensus.cc:2955] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:00:29.375131  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 60491.5us
W20260709 13:00:29.404953  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.417958  2272 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:29.435441  2272 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:29.448357  2782 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:00:29.476684  2692 raft_consensus.cc:993] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:29.476819  2819 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:00:29.477391  2692 raft_consensus.cc:1081] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:29.479099  1541 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:29.481638  1621 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:29.497121  1690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39238
I20260709 13:00:29.496516  1446 catalog_manager.cc:5697] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.497661  1690 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:29.498085  1690 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:29.494783  1621 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:29.513621  1689 raft_consensus.cc:2955] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.516314  1690 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:29.530751  2271 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:29.533116  1697 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:29.533062  2819 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:00:29.536550  1690 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:29.538282  2819 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:29.546453  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:29.547001  1541 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:29.553848  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:00:29.554433  1542 raft_consensus.cc:606] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:29.558743  2692 raft_consensus.cc:2955] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.562203  1541 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:29.574224  1661 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:29.573323  2271 raft_consensus.cc:2955] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.578699  2814 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:29.581442  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:29.582058  1622 raft_consensus.cc:3055] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:29.582332  1622 raft_consensus.cc:740] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:29.582995  1622 consensus_queue.cc:260] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:29.587200  1622 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:29.569181  2748 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:00:29.588138  2776 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:29.615631  1622 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:29.617308  2776 raft_consensus.cc:697] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:29.647581  2812 raft_consensus.cc:2955] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.649752  2689 raft_consensus.cc:2955] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.652145  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5e0e70f76a194ff7ab05b64009ded3c5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:29.653090  2776 consensus_queue.cc:237] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:29.662377  2271 raft_consensus.cc:2955] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.673156  1539 raft_consensus.cc:2955] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.702078  1697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:49328
I20260709 13:00:29.703281  1697 raft_consensus.cc:606] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:29.703191  1689 raft_consensus.cc:2955] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.709338  2687 raft_consensus.cc:993] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:29.710009  2780 raft_consensus.cc:1081] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:29.717618  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:29.718255  1615 raft_consensus.cc:606] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS e37b8013aec24431a6672a857806329e
I20260709 13:00:29.720806  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8820554e3d9a4662b150408d84019889"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:29.721320  1615 raft_consensus.cc:606] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:29.724465  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:29.724952  1615 raft_consensus.cc:606] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:29.728519  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c033fce18c634feb995adf2f2422308c"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:29.730136  1615 raft_consensus.cc:606] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:29.731462   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:00:29.733615   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:29.736195  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1af6b960277d47bd994134d20b77c59a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:29.742551  2272 raft_consensus.cc:2955] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.763157  1442 catalog_manager.cc:5697] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.774464  1539 raft_consensus.cc:2955] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.781622  1542 consensus_queue.cc:237] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:29.794363  1689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39244
I20260709 13:00:29.795028  1689 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:29.795526  1689 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:29.800659  2271 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:29.802616  1615 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:29.804949  2787 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:29.813611  2816 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:00:29.816044  2780 raft_consensus.cc:2955] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.820941  2271 raft_consensus.cc:2955] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.841467  1615 raft_consensus.cc:2955] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.856617  1689 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:29.857437  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c8493cdac98b4860b0ddbe729b652ee9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:29.860301  1622 raft_consensus.cc:2955] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.859397  1442 catalog_manager.cc:5697] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.864715  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:29.867626  1539 raft_consensus.cc:3055] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:29.868191  1539 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:29.869244  1539 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:29.871052  1539 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:29.876993  1689 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:29.884408  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:29.885309  1622 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:29.885654  2819 raft_consensus.cc:993] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:29.886121  2819 raft_consensus.cc:1081] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:29.887609  1690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39238
I20260709 13:00:29.888090  1690 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:29.888453  1690 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:29.889523  2819 raft_consensus.cc:993] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:29.890012  2819 raft_consensus.cc:1081] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:29.895088  1539 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:29.901180  1661 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:29.901997  2812 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:29.902465  2812 raft_consensus.cc:697] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:29.903255  2812 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:29.904381  1446 catalog_manager.cc:5697] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:29.906765  1446 catalog_manager.cc:5697] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:29.905292  1690 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:29.910812  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8820554e3d9a4662b150408d84019889"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35712
I20260709 13:00:29.911497  1542 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:29.911906  1542 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:29.915055  1690 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:29.916464  1622 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:29.919166  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e0e70f76a194ff7ab05b64009ded3c5 with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35688
I20260709 13:00:29.929366  1690 consensus_queue.cc:237] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:29.931663  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:29.932307  1622 raft_consensus.cc:3055] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:29.935750  2272 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:29.936151  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 1af6b960277d47bd994134d20b77c59a with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39234
I20260709 13:00:29.937412  2744 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:29.932580  1622 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:29.938884  2712 raft_consensus.cc:993] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:29.939325  2712 raft_consensus.cc:1081] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:29.939481  1622 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:29.945099  1541 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:29.944941  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:29.949402  1539 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:29.952354  1542 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:29.952679  1622 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:29.953547  2742 raft_consensus.cc:2955] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.955127  2272 raft_consensus.cc:2955] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:29.958666  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35704
I20260709 13:00:29.968397  1541 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:29.968878  1541 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:29.961033  2812 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:29.979799  1622 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:29.981405  1542 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:29.982666  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:29.985078  1689 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:29.985860  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:29.986449  1618 raft_consensus.cc:3055] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:29.986852  1618 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:29.986312  1445 catalog_manager.cc:5697] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 1 to 2, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:29.988335  1618 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:29.990108  1618 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:29.983106  1541 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:29.992316  1446 catalog_manager.cc:5697] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 1 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:30.005015  1663 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:30.010372  2744 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:30.010917  2744 raft_consensus.cc:697] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:30.011852  2744 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:30.018056  1539 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:30.020129  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:30.020699  1615 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.021096  1689 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:30.023501  1618 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:30.027011  1511 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:30.046782  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:30.047760  1690 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:30.048357  1690 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:30.045866  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 33125bfca16d4902a09564d1eef1a47f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:30.063216  1618 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:30.064356  1541 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:30.069718  2692 raft_consensus.cc:993] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:30.070415  2692 raft_consensus.cc:1081] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:30.074930  2712 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:30.084149  2687 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:30.084848  2687 raft_consensus.cc:697] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:30.086468  2687 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:30.090425  1690 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:30.092429  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 65491.1us
I20260709 13:00:30.093982  1690 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.100558  2738 raft_consensus.cc:993] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:30.101073  2738 raft_consensus.cc:1081] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:30.114198  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet c8493cdac98b4860b0ddbe729b652ee9 with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39234
I20260709 13:00:30.115901  2271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c"
dest_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:54496
I20260709 13:00:30.149613  2271 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:30.152709  2271 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.124079  2835 tablet_replica.cc:333] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:00:30.124497  2834 tablet_replica.cc:333] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:00:30.155218  2834 raft_consensus.cc:2243] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:30.156054  2834 raft_consensus.cc:2272] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:30.159328  2834 ts_tablet_manager.cc:1916] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:30.165905  2271 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:30.131312  1615 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:30.168248  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c033fce18c634feb995adf2f2422308c"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35712
I20260709 13:00:30.168874  1542 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:30.169276  1542 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.172206  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:30.167378  1690 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:30.173305  1622 raft_consensus.cc:3055] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:30.173754  1622 raft_consensus.cc:740] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:30.174672  1622 consensus_queue.cc:260] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:30.177259  1622 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.189160  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:30.189726  1689 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.190939  2271 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:30.195567  1622 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:30.200810  2234 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:30.215583  2785 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:30.216291  2785 raft_consensus.cc:697] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:30.217417  2785 consensus_queue.cc:237] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:30.283025  1689 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:30.298193  2835 raft_consensus.cc:2243] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:30.298936  2835 raft_consensus.cc:2272] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:30.302173  2835 ts_tablet_manager.cc:1916] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:30.145475  1446 catalog_manager.cc:5697] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:30.181628  1514 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:00:30.333427  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 151749us
W20260709 13:00:30.338294  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.349424  2784 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:30.371119  2784 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:30.395463  2784 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:30.401132  1542 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:30.403766  1542 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:30.406661  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 46884.6us
I20260709 13:00:30.425330  1444 catalog_manager.cc:5697] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:30.440392  1622 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:30.466487  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet 33125bfca16d4902a09564d1eef1a47f with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34170
I20260709 13:00:30.475380  1542 raft_consensus.cc:2955] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:30.478400  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:30.479707  1615 raft_consensus.cc:3055] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:30.480043  1615 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:30.481192  1615 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:30.483063  1615 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.476418  1539 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:30.496222  1442 catalog_manager.cc:5697] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 2 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:30.521281  2835 ts_tablet_manager.cc:1929] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:30.549613  2834 ts_tablet_manager.cc:1929] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:30.550185  2834 log.cc:1199] T 5e0e70f76a194ff7ab05b64009ded3c5 P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/5e0e70f76a194ff7ab05b64009ded3c5
I20260709 13:00:30.570174  1615 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:30.573300  1619 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:30.573951  1540 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:30.571725  2835 log.cc:1199] T 1af6b960277d47bd994134d20b77c59a P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/1af6b960277d47bd994134d20b77c59a
I20260709 13:00:30.576917  1546 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:30.580289  2835 tablet_replica.cc:333] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:00:30.580231  2744 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:30.582664  2835 raft_consensus.cc:2243] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:30.584126  2835 raft_consensus.cc:2272] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:30.595932  2845 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:30.595145  1514 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:30.598348  2845 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:30.598886  2845 raft_consensus.cc:697] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:30.599982  2845 consensus_queue.cc:237] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:30.578539  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet 1af6b960277d47bd994134d20b77c59a (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:30.606890  1615 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:30.615695  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet 5e0e70f76a194ff7ab05b64009ded3c5 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:30.623507  2712 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:30.626533  1696 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:30.632714  2621 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:30.644659  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:30.645483  1693 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.655769  2621 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:30.681733  1693 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:30.687400  2814 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:30.688390  1540 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:30.695832  2848 tablet_replica.cc:333] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:00:30.706642  2835 ts_tablet_manager.cc:1916] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:30.721665  2745 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:30.740974   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:30.748247  1619 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:30.750164  2848 raft_consensus.cc:2243] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:30.751255  2848 raft_consensus.cc:2272] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:30.751688  2785 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:00:30.773775  1446 catalog_manager.cc:5697] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 2 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:00:30.811225  1693 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:30.854202  2848 ts_tablet_manager.cc:1916] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:30.861259  2785 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:30.877041  2835 ts_tablet_manager.cc:1929] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 13:00:30.902781  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 63614us
I20260709 13:00:30.892587  2835 log.cc:1199] T c8493cdac98b4860b0ddbe729b652ee9 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/c8493cdac98b4860b0ddbe729b652ee9
I20260709 13:00:30.965235  1690 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:30.973479  2784 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:00:30.950598  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet c8493cdac98b4860b0ddbe729b652ee9 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:31.030081  1621 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:30.988449  1442 catalog_manager.cc:5697] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 2, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 2 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:31.033594  1442 catalog_manager.cc:5697] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 2 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:31.055516  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 73873.9us
I20260709 13:00:31.146890  1695 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:31.159498  2874 log.cc:927] Time spent T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:00:31.167244  2745 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:31.198349   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:31.200968  2848 ts_tablet_manager.cc:1929] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:31.201534  2848 log.cc:1199] T 33125bfca16d4902a09564d1eef1a47f P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/33125bfca16d4902a09564d1eef1a47f
I20260709 13:00:31.204623  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet 33125bfca16d4902a09564d1eef1a47f (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:31.221817  2870 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:31.238231  1619 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:31.241242  2780 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:31.313551  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:31.314138  1614 raft_consensus.cc:606] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS e37b8013aec24431a6672a857806329e
I20260709 13:00:31.318406  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:31.318933  1614 raft_consensus.cc:606] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS e37b8013aec24431a6672a857806329e
I20260709 13:00:31.323014  1539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:00:31.323958  1539 raft_consensus.cc:606] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Received request to transfer leadership to TS e37b8013aec24431a6672a857806329e
I20260709 13:00:31.328214  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:31.329135  1619 raft_consensus.cc:606] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS e37b8013aec24431a6672a857806329e
I20260709 13:00:31.336102  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "738a15ae04514d49969f3624caa73f45"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:49328
I20260709 13:00:31.337855  1689 raft_consensus.cc:606] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:31.344337  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:31.344830  1614 raft_consensus.cc:606] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Received request to transfer leadership to TS e37b8013aec24431a6672a857806329e
I20260709 13:00:31.347854  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:31.348282  1614 raft_consensus.cc:606] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:31.349478   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:00:31.352200   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:31.507248  2781 raft_consensus.cc:993] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:31.507833  2781 raft_consensus.cc:1081] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Signalling peer e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:31.509639  2272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3"
dest_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:54496
I20260709 13:00:31.510260  2272 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:31.510607  2272 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.518386  2272 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.521301  2272 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:31.523656  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:31.524224  1614 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:31.524504  1614 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:31.525228  1614 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.526036  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:31.526517  1614 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.526702  1539 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.534607  1614 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:31.536118  2234 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:31.537146  2871 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:31.537629  2871 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:31.538484  2871 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.544245  1539 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:31.554147  2843 raft_consensus.cc:993] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:31.554754  2843 raft_consensus.cc:1081] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Signalling peer e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:31.560439  2272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d"
dest_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:54504
I20260709 13:00:31.561142  2272 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:31.561558  2272 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.582623  1696 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:31.583865  2272 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.585915  2272 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:31.586501  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:31.587090  1539 raft_consensus.cc:3055] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:31.587460  1539 raft_consensus.cc:740] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:31.588577  1539 consensus_queue.cc:260] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.592687  1539 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.595527  1445 catalog_manager.cc:5697] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 2 to 3, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 3 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:31.596649  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:31.596948  1542 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:31.597319  1696 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.600611  1539 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:31.601852  2232 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:31.602524  1614 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:31.602895  2871 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:31.608588  2871 raft_consensus.cc:697] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:31.598443  2876 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 13:00:31.613355  1662 consensus_peers.cc:597] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a63558e47a84017a3a62f52bb8cb3eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:31.615710  1696 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:31.617889  2869 raft_consensus.cc:993] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:31.618428  2689 raft_consensus.cc:1081] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:31.619730  2782 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:31.609551  2871 consensus_queue.cc:237] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.628196  2271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480"
dest_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:54496
I20260709 13:00:31.628728  2271 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:31.629055  2271 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.630151  2868 raft_consensus.cc:993] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:31.633267  1542 raft_consensus.cc:2955] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:31.634821  2819 raft_consensus.cc:1081] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:31.630364  2875 raft_consensus.cc:2955] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:31.644280  2272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a"
dest_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:54496
I20260709 13:00:31.645063  2272 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:31.644148  1619 raft_consensus.cc:2955] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:31.645438  2272 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.653388  2272 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.656512  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:31.656574  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:31.657032  1539 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.657195  1615 raft_consensus.cc:3055] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:31.657588  1615 raft_consensus.cc:740] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:31.657778  2272 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:31.658381  1615 consensus_queue.cc:260] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.669160  1614 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:31.671819  1615 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.668156  1446 catalog_manager.cc:5697] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index -1 to 3, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:31.667636  1445 catalog_manager.cc:5697] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 2, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 2 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:31.643019  2271 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.678985  1615 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:31.680514  2271 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:31.683669  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:31.684227  1617 raft_consensus.cc:3055] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:31.684510  1617 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:31.685268  1617 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.686744  1617 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.689615  2234 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:31.691567  2871 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:31.692013  2871 raft_consensus.cc:697] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:31.705181  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:31.705778  1696 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.707973  1539 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:31.692767  2871 consensus_queue.cc:237] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.734774  1617 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:31.736129  2234 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:31.737080  2785 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:31.737812  2785 raft_consensus.cc:697] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:31.738747  2785 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.766541  2876 raft_consensus.cc:993] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: : Instructing follower 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:00:31.767038  2876 raft_consensus.cc:1081] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Signalling peer 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:00:31.769557  1444 catalog_manager.cc:5697] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 2 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:31.771981  1614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "738a15ae04514d49969f3624caa73f45"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:34180
I20260709 13:00:31.773136  1614 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:31.773517  1614 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.774566  1689 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:31.775275  1588 consensus_peers.cc:597] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75442f7324f24d4494f1ba99a64ed4ac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:31.777917  1696 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:31.780632  1539 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:31.781973  2868 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:31.791198  2868 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:31.798988  1444 catalog_manager.cc:5697] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 2 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:31.807960  2781 raft_consensus.cc:993] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:31.808950  2781 raft_consensus.cc:1081] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer e37b8013aec24431a6672a857806329e to start an election
I20260709 13:00:31.811580  2272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f"
dest_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:54496
I20260709 13:00:31.812245  2272 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:31.812618  2272 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.818349  2846 raft_consensus.cc:2955] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:31.822986  1689 raft_consensus.cc:2955] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:31.826906  1542 raft_consensus.cc:2955] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:31.830618  1614 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:31.833433  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:31.833971  1691 raft_consensus.cc:3055] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:31.834223  1691 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:31.835292  1691 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:31.835892  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:31.836617  1691 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.839107  1539 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.848537  2272 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.851307  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:31.851923  1544 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.866643  1539 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:31.863672  1544 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:31.869581  2232 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:31.870568  2785 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:31.871071  2785 raft_consensus.cc:697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:31.871276  1691 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:31.872102  2785 consensus_queue.cc:237] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.872713  1586 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:31.882002  2781 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:31.882552  2781 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:31.883390  2781 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:31.887041  1614 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:31.890409  1446 catalog_manager.cc:5697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 2 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:31.887455  2272 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:31.906447  1615 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:31.906455  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:31.908034  1621 raft_consensus.cc:3055] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:31.908344  1621 raft_consensus.cc:740] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:31.909240  1621 consensus_queue.cc:260] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:31.910174  1621 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.916673  2781 raft_consensus.cc:993] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:31.917224  2781 raft_consensus.cc:1081] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:31.875028  1444 catalog_manager.cc:5697] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:31.920804  1621 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:31.931735  1539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35712
I20260709 13:00:31.932420  1539 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:31.932788  1539 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:31.941409  1588 consensus_peers.cc:597] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: effd69042c284e8386aafb50372a93b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:31.942606  1544 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:31.943913  1539 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:31.946290  2781 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:31.947556  1689 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:31.949985  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:31.950138  1539 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:31.950507  1621 raft_consensus.cc:3055] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:31.950838  1621 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:31.951615  1621 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:31.952212  2781 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:31.952720  1621 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.955241  1444 catalog_manager.cc:5697] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 2 to 3, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 3 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:31.957047  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:31.957746  1696 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.960301  1621 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:31.964641  1696 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:31.969439  1514 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:31.970305  2870 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:31.970743  2870 raft_consensus.cc:697] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:31.971822  2870 consensus_queue.cc:237] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:31.977029  2869 raft_consensus.cc:2955] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:31.993803  1696 raft_consensus.cc:2955] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:31.999596  1691 consensus_queue.cc:237] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:32.001443  1544 raft_consensus.cc:2955] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:32.005690  1444 catalog_manager.cc:5697] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 2 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:32.027341  1442 catalog_manager.cc:5697] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
W20260709 13:00:32.031311  1662 consensus_peers.cc:597] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89a432d1e3024e13a2d20229db9a8d85. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:32.036844  1621 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:32.039575  2876 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:32.051324  1539 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:32.053833  1696 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:32.059931  2785 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:32.060990  2876 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:32.091579  1619 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:32.093014  2875 raft_consensus.cc:2955] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:32.095813  2785 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:32.099750  1544 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:32.101195  2785 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:32.100895  1619 raft_consensus.cc:2955] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:32.129068  1619 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:32.136582  2871 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:32.178025  2902 ts_tablet_manager.cc:933] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:32.200788  2902 tablet_copy_client.cc:323] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.131:43987
I20260709 13:00:32.208273  1706 tablet_copy_service.cc:140] P c20847a6dcea4c2a9cbaf35a2171e33d: Received BeginTabletCopySession request for tablet 8a63558e47a84017a3a62f52bb8cb3eb from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:58526)
I20260709 13:00:32.208995  1689 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:32.209024  1706 tablet_copy_service.cc:161] P c20847a6dcea4c2a9cbaf35a2171e33d: Beginning new tablet copy session on tablet 8a63558e47a84017a3a62f52bb8cb3eb from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:58526: session id = e37b8013aec24431a6672a857806329e-8a63558e47a84017a3a62f52bb8cb3eb
I20260709 13:00:32.270177  1706 tablet_copy_source_session.cc:215] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:32.277297  2902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a63558e47a84017a3a62f52bb8cb3eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:32.296753  2906 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:32.313521  2908 ts_tablet_manager.cc:933] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:32.356434   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:32.512652  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 216765us
I20260709 13:00:32.581682  2908 tablet_copy_client.cc:323] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:00:32.598241  2902 tablet_copy_client.cc:806] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:32.598966  2902 tablet_copy_client.cc:670] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:32.658358  1540 raft_consensus.cc:2955] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:32.685034  1615 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:32.764748  2902 tablet_copy_client.cc:538] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:32.778760  2871 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:32.795460  1696 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:32.811749  2917 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:32.823472  2902 tablet_bootstrap.cc:492] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Bootstrap starting.
W20260709 13:00:32.833767  2232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.004s	sys 0.020s
W20260709 13:00:32.834301  2232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.005s	sys 0.020s
I20260709 13:00:32.836920  1632 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 75442f7324f24d4494f1ba99a64ed4ac from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:00:32.837532  1632 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 75442f7324f24d4494f1ba99a64ed4ac from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-75442f7324f24d4494f1ba99a64ed4ac
I20260709 13:00:32.871439  1615 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:32.873162  2904 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:00:33.047487  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 145966us
I20260709 13:00:33.052603  1695 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:33.147432  2904 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.148226  2904 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:33.152311  2904 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:33.158295  2921 ts_tablet_manager.cc:933] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:33.166198  1632 tablet_copy_source_session.cc:215] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:33.213080  2923 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:33.213917  2923 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:33.216847  2923 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:33.224581  2923 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:33.225255  2923 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.229250  2923 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:33.211128  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 335689us
I20260709 13:00:33.214771  2902 tablet_bootstrap.cc:492] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:33.237748  2902 tablet_bootstrap.cc:492] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:33.238610  2902 ts_tablet_manager.cc:1403] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.415s	user 0.013s	sys 0.027s
I20260709 13:00:33.244596  2908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75442f7324f24d4494f1ba99a64ed4ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:33.246578  2942 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.247139  2942 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.253561  2745 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:33.254326  2745 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.254705  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:33.256784  2745 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:33.253679  2942 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:33.259558  1617 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:33.263486  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:33.266706  2745 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:33.268406  2942 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:33.268956  2942 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.274384  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:33.251359  2868 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.288347  2942 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:33.268586  2921 tablet_copy_client.cc:323] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:00:33.303701  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:33.318645  2914 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.305954  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:33.333786  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 44636.6us
I20260709 13:00:33.335111  2941 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.290302  2868 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.337899  2941 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.339403  2952 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.340202  2952 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.341993  2953 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.343451  2952 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:33.344493  2868 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:33.344354  2953 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:33.360101  2902 raft_consensus.cc:359] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:33.348090  2941 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:33.363665  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 60540.9us
W20260709 13:00:33.411191  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 49180.8us
I20260709 13:00:33.361416  2861 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.371630  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:33.319511  2914 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:33.393918  1442 catalog_manager.cc:5697] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 1 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:33.409202  2920 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.409281  2902 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:33.411370  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:33.414326  2781 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:33.352101  1632 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet effd69042c284e8386aafb50372a93b6 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:00:33.435196  2914 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:33.435792  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:33.441903  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:33.417215  2861 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:33.485617  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 85441us
I20260709 13:00:33.488485  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:33.421265  2920 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.496915  2920 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:33.454917  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:33.440186  2955 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.455574  2953 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:00:33.501924  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 73393.5us
I20260709 13:00:33.452565  2904 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:33.450982  1632 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet effd69042c284e8386aafb50372a93b6 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-effd69042c284e8386aafb50372a93b6
I20260709 13:00:33.460458  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:33.523186  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:33.523949  2272 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:33.497660  2914 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:33.442675  2781 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.524904  1588 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:33.540344  2941 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:33.540797  2941 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.541165  2941 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:33.531570  2914 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:33.555042   435 debug-util.cc:398] Leaking SignalData structure 0x7b080000fd60 after lost signal to thread 2232
I20260709 13:00:33.556430  2914 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:33.562466  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:33.564782  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:33.565891  2961 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:33.566464  2961 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.568905  2961 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:33.571525  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:33.572683  2914 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:33.575016  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:33.579902  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 115724us
W20260709 13:00:33.580595  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 157904us
I20260709 13:00:33.467845  2902 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:33.584489  2961 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.592613  2961 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.593941  2902 ts_tablet_manager.cc:1434] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.355s	user 0.009s	sys 0.023s
I20260709 13:00:33.579613  2957 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.595373  2957 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.596335  1706 tablet_copy_service.cc:342] P c20847a6dcea4c2a9cbaf35a2171e33d: Request end of tablet copy session e37b8013aec24431a6672a857806329e-8a63558e47a84017a3a62f52bb8cb3eb received from {username='slave'} at 127.0.0.1:58526
I20260709 13:00:33.596951  1706 tablet_copy_service.cc:434] P c20847a6dcea4c2a9cbaf35a2171e33d: ending tablet copy session e37b8013aec24431a6672a857806329e-8a63558e47a84017a3a62f52bb8cb3eb on tablet 8a63558e47a84017a3a62f52bb8cb3eb with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:33.598302  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:33.577620  2904 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:33.600977  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:33.600054  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:33.677703  2959 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:33.598137  2961 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:33.598115  2957 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:33.679332  2958 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:00:33.680052  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:33.686775  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:33.687599  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:33.694567  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:33.696451  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:33.719508  2951 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:33.720338  2951 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.525233  2955 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.669381  2869 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:33.732651  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:33.695422  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:33.679975  2781 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:33.606544  2861 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:33.738269  1548 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:33.738415  2965 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.738543  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:33.738991  2960 ts_tablet_manager.cc:933] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:33.739370  2922 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:33.729949  2819 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:33.741343  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:33.741909  2904 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:33.747592  2945 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:33.748234  2944 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:33.749109  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:33.750334  1688 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:33.609889  2908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54496 (request call id 378) took 1328 ms. Trace:
I20260709 13:00:33.792492  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:33.800243  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:33.702051  2941 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:33.799950  2819 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:33.800670  2908 rpcz_store.cc:276] 0709 13:00:32.281482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.281592 (+   110us) service_pool.cc:224] Handling call
0709 13:00:32.313982 (+ 32390us) ts_tablet_manager.cc:934] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
0709 13:00:33.243342 (+929360us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:33.262257 (+ 18915us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:33.262361 (+   104us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:33.604763 (+342402us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:33.609459 (+  4696us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:33.609755 (+   296us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:33.609809 (+    54us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":19961,"tablet-copy.queue_time_us":31362,"thread_start_us":258780,"threads_started":2}
I20260709 13:00:33.818140  2819 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:33.818617  2908 tablet_copy_client.cc:806] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:33.800912  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:33.828851  2951 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:33.830353  2916 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.751505  2869 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:33.832701  1621 raft_consensus.cc:2393] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 2: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:33.802772  1632 tablet_copy_source_session.cc:215] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:00:33.834312  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 140934us
I20260709 13:00:33.831084  2916 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:33.735729  2959 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.836402  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:33.833290  2908 tablet_copy_client.cc:670] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:33.798655  2965 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.865355  2965 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:33.865476  2270 raft_consensus.cc:1217] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:00:33.837221  2945 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.870004  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:33.870998  2945 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:33.840649  2941 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:33.824050  2944 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:33.889420  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:33.894268  2782 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:33.905849  1541 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:33.908165  1544 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:33.893535  2955 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:33.822180  2922 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:33.916738  2949 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:33.914095  2782 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:33.910670  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2d40 after lost signal to thread 433
I20260709 13:00:33.919735  1544 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:33.918291  2949 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:33.912073  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 381) took 1132 ms. Trace:
I20260709 13:00:34.049355  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.108134  2964 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.048228  2267 rpcz_store.cc:276] 0709 13:00:32.778361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.901768 (+1123407us) service_pool.cc:224] Handling call
0709 13:00:33.910087 (+  8319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.910318 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.910356 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:33.910407 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:33.910458 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.910527 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.910654 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:34.140026  2949 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:34.140960  2967 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.150972  2944 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.152316  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.119345  2916 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:34.142310  2785 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:00:34.173882  2959 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.141541  2967 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:34.169447  2960 tablet_copy_client.cc:323] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.131:43987
I20260709 13:00:34.175081  2785 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:00:34.178944  2782 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:34.155550  2869 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.115398  2909 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:00:34.164681  2944 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:00:34.170946  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad4c0 after lost signal to thread 1480
I20260709 13:00:34.187860  2944 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:00:34.194643  2293 debug-util.cc:398] Leaking SignalData structure 0x7b0800258ee0 after lost signal to thread 1572
W20260709 13:00:34.195890  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6200 after lost signal to thread 1647
W20260709 13:00:34.196203  2293 debug-util.cc:398] Leaking SignalData structure 0x7b080017b2c0 after lost signal to thread 1648
W20260709 13:00:34.198905  2293 debug-util.cc:398] Leaking SignalData structure 0x7b0800311c40 after lost signal to thread 1721
I20260709 13:00:34.199452  2922 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:34.200276  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:00:34.200608  2293 debug-util.cc:398] Leaking SignalData structure 0x7b080031b980 after lost signal to thread 2296
I20260709 13:00:34.145895  2964 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:34.202911  2293 debug-util.cc:398] Leaking SignalData structure 0x7b080031b940 after lost signal to thread 2297
I20260709 13:00:34.196588  2944 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.208606  1706 tablet_copy_service.cc:140] P c20847a6dcea4c2a9cbaf35a2171e33d: Received BeginTabletCopySession request for tablet 89a432d1e3024e13a2d20229db9a8d85 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:58526)
I20260709 13:00:34.209424  1706 tablet_copy_service.cc:161] P c20847a6dcea4c2a9cbaf35a2171e33d: Beginning new tablet copy session on tablet 89a432d1e3024e13a2d20229db9a8d85 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:58526: session id = e37b8013aec24431a6672a857806329e-89a432d1e3024e13a2d20229db9a8d85
I20260709 13:00:34.210042  2967 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:34.200971  2971 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:34.211895  2971 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:34.208608  2964 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:34.218858  2971 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.225474  1706 tablet_copy_source_session.cc:215] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:34.227181  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 44) took 1925 ms. Trace:
W20260709 13:00:34.229773  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 62022.1us
I20260709 13:00:34.227702  1689 rpcz_store.cc:276] 0709 13:00:32.302254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.302438 (+   184us) service_pool.cc:224] Handling call
0709 13:00:32.302843 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.303286 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.303326 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.316056 (+ 12730us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.039165 (+723109us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:33.157014 (+117849us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.157232 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.157323 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.223046 (+1065723us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b2400208d78. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c678d79c4 00007f5c678d5acb 00007f5c67a90dc9 00007f5c67a90a55 00007f5c67a8ffb0 00007f5c6a706488 00007f5c6a706be8 00007f5c6a6de398 00007f5c6a6d976a 00007f5c6a6d8bb6
0709 13:00:34.226810 (+  3764us) raft_consensus.cc:1685] finished
0709 13:00:34.226947 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.227093 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":120458,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":18864,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":6869,"spinlock_wait_cycles":1055719808,"thread_start_us":192321,"threads_started":1,"wal-append.queue_time_us":305220}
I20260709 13:00:34.232013  2232 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:34.233228  2975 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.236060  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.256484  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.257688  2785 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.258440  2948 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:34.262319  2974 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:34.269276  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.272449  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.274952  2960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a432d1e3024e13a2d20229db9a8d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:34.279817  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.280907  2920 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:34.262876  2974 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:34.281388  2920 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:34.284114  2974 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.284128  2975 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:34.292177  2974 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:34.292884  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:34.292659  2974 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:34.294171  2267 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:34.294678  2974 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.296380  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.297252  1542 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 1.
I20260709 13:00:34.298491  2908 tablet_copy_client.cc:538] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:34.299013  2234 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:34.299101  2232 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:34.300465  2861 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.301151  2920 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.305373  1621 raft_consensus.cc:1240] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:34.307680  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.309655  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.305235  2921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effd69042c284e8386aafb50372a93b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:34.312747  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.313627  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.314927  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:34.315328  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.316049  2918 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:34.317116  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.317171  2950 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:34.316747  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.317829  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.318068  2950 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:34.321497  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.321987  2950 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:34.322192  2922 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.323074  1587 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.323711  2922 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.316823  2918 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:34.324170  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.314381  1588 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:34.309399  2909 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:34.330626  2909 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:34.331056  2909 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.331508  2869 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:34.332939  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.328348  1586 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:34.334024  1514 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.324930  2922 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:00:34.334024  1587 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.328500  2745 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.337393  2712 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:34.338325  2712 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:34.353120  2937 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:34.353641  2937 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:34.355460  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.353448  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.335639  2964 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.336082  2869 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:34.361852  2231 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:34.363144  2929 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 1.115s	user 0.008s	sys 0.004s
I20260709 13:00:34.364040  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.339888  2959 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.366529  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:34.354166  2937 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.367203  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:34.356539  2942 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.363186  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.378253  1663 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:34.360875  2953 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.379609  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:34.380577  2782 raft_consensus.cc:1064] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:34.357999  2745 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.384654  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.355611  2974 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:34.385599  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.390168  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.370749  2869 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.387629  2966 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:34.387846  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.387630  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.385241  2712 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:34.392874  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.393985  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.394660  2950 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.377512  2785 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.371042  2923 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:34.285261  2975 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:34.401770  1663 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:34.386759  2871 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:34.395680  2949 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:34.390829  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:34.414248  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 1836) took 1575 ms. Trace:
I20260709 13:00:34.420832  1696 rpcz_store.cc:276] 0709 13:00:32.838752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.838866 (+   114us) service_pool.cc:224] Handling call
0709 13:00:32.850468 (+ 11602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.850805 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.850835 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.855020 (+  4185us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.179585 (+324565us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:33.179628 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.179694 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.301375 (+1121681us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b2400208d78. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c678d79c4 00007f5c678d5acb 00007f5c67a90dc9 00007f5c67a90a55 00007f5c67a9009d 00007f5c6a6c210e 00007f5c6a6d988c 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221
0709 13:00:34.413989 (+112614us) raft_consensus.cc:1685] finished
0709 13:00:34.414009 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.414195 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3698,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":837,"spinlock_wait_cycles":979320704,"thread_start_us":295858,"threads_started":1,"wal-append.queue_time_us":311990}
I20260709 13:00:34.395619  2964 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:34.395619  2974 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:34.435048  2984 log.cc:927] Time spent T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:00:34.398741  1692 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:34.420418  2875 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:34.446401  2983 log.cc:927] Time spent T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:34.405534  2966 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:34.455842  2918 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:34.457193  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.438153  2963 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.412927  2923 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:34.427906  2949 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:34.478030  2949 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.483286  2861 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.484669  2272 raft_consensus.cc:1240] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:34.444780  2964 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:34.489419  2964 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:34.489938  2964 consensus_queue.cc:1059] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:34.452867  2975 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.470264  2963 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:34.491997  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 90289us
I20260709 13:00:34.432807  2871 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:34.490021  2909 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:34.458313  2782 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:34.500828  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 122446us
I20260709 13:00:34.504117  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.504195  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:34.505877  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.505016  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:34.506958  2272 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:34.509974  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.510469  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.514578  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.518213  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.527478  2936 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.517997  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.498247  2871 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.532080  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.534521  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.537348  1695 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:34.503922  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52824 (request call id 209) took 2317 ms. Trace:
I20260709 13:00:34.541942  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.506911  2923 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.535202  1513 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:34.566031  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:34.569156  1539 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.573686  2972 consensus_queue.cc:1059] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:00:34.575404  2966 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.583025  2974 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.571360  2949 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.585083  2964 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:34.607041  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.604208  2909 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.616415  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.625334  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:34.626602  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 122463us
I20260709 13:00:34.609184  2964 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:34.628530  1514 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.596488  2869 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:34.631048  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.640156  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:34.640991  2967 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:34.641708  2967 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:34.642494  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:34.643569  2745 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.644162  2972 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.644294  2745 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.638487  2966 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:34.645422  2966 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:34.648272  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:34.649443  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.650339  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.651458  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.652135  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.562021  1442 rpcz_store.cc:276] 0709 13:00:32.181137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.200735 (+ 19598us) service_pool.cc:224] Handling call
0709 13:00:34.498260 (+2297525us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:33.602000 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:33.821561 (+219561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:33.823616 (+  2055us) write_op.cc:435] Acquired schema lock
0709 13:00:33.826355 (+  2739us) tablet.cc:662] Decoding operations
0709 13:00:33.880327 (+ 53972us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:33.884017 (+  3690us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:33.885922 (+  1905us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:33.897618 (+ 11696us) tablet.cc:701] Row locks acquired
0709 13:00:33.899011 (+  1393us) write_op.cc:260] PREPARE: finished
0709 13:00:33.907276 (+  8265us) write_op.cc:270] Start()
0709 13:00:33.912776 (+  5500us) write_op.cc:276] Timestamp: P: 1783602033907215 usec, L: 0
0709 13:00:33.914447 (+  1671us) op_driver.cc:348] REPLICATION: starting
0709 13:00:34.122920 (+208473us) log.cc:844] Serialized 599 byte log entry
0709 13:00:34.232963 (+110043us) op_driver.cc:464] REPLICATION: finished
0709 13:00:34.249671 (+ 16708us) write_op.cc:301] APPLY: starting
0709 13:00:34.249770 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:34.249870 (+   100us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:34.250145 (+   275us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:34.250452 (+   307us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:34.250623 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:34.250672 (+    49us) write_op.cc:312] APPLY: finished
0709 13:00:34.251052 (+   380us) log.cc:844] Serialized 23 byte log entry
0709 13:00:34.251210 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:34.251301 (+    91us) write_op.cc:454] Released schema lock
0709 13:00:34.251336 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:34.251688 (+   352us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:34.251722 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":404356,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":16416,"apply.run_cpu_time_us":2030,"apply.run_wall_time_us":2042,"num_ops":1,"prepare.queue_time_us":99908,"prepare.run_cpu_time_us":32287,"prepare.run_wall_time_us":615563,"raft.queue_time_us":4688,"raft.run_cpu_time_us":10938,"raft.run_wall_time_us":16508,"replication_time_us":318362,"thread_start_us":99507,"threads_started":4,"wal-append.queue_time_us":77314}]]}
I20260709 13:00:34.656544  1615 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:34.656579  2268 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:34.633656  2964 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.658190  1514 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.675376  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:34.677302  1545 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:34.678138  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.678561  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.679574  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.680102  1546 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:34.683632  1539 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:34.683938  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.688566  2908 tablet_bootstrap.cc:492] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:34.688884  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:34.692193  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.693513  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:34.697427  2231 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.696116  1586 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:34.707613  2231 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.712052  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.716495  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:34.716652  2987 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:34.717248  2987 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:34.720059  2987 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.720141  2967 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.696828  2869 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:34.690433  2937 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:34.725597  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:34.714438  2871 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.714246  2861 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.737238  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.738677  1446 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52808 (request call id 187) took 1838 ms. Trace:
I20260709 13:00:34.739063  1446 rpcz_store.cc:276] 0709 13:00:32.893568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.893889 (+   321us) service_pool.cc:224] Handling call
0709 13:00:34.731698 (+1837809us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":330393,"reported_tablets":2}
I20260709 13:00:34.742309  2990 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:00:34.745505  2992 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:34.731506  2936 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.742880  2990 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:34.753558  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.760524  2990 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.754074  2931 consensus_queue.cc:1059] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:00:34.756094  2966 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.775259  2988 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.775347  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.762794  2948 raft_consensus.cc:3055] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:34.763060  2972 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:34.780016  2956 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:34.782364  2937 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.783195  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.779381  2948 raft_consensus.cc:740] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:34.808467  2972 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:34.839881  2948 consensus_queue.cc:260] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:34.842072  2948 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.848163  2972 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:34.848925  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:34.854175  1542 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:34.811964  2956 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:34.860320  1622 raft_consensus.cc:1240] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:34.861688  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:34.865386  2965 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:34.866281  2963 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:34.869046  2232 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.871341  2871 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:34.871862  2871 raft_consensus.cc:697] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:34.872676  2871 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:34.740871   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:34.865968  2965 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:34.882206  2931 consensus_queue.cc:1059] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:34.883639  2931 raft_consensus.cc:3055] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:34.884070  2931 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:34.884775  2960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54488 (request call id 257) took 2141 ms. Trace:
I20260709 13:00:34.885247  2960 rpcz_store.cc:276] 0709 13:00:32.743360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.415693 (+672333us) service_pool.cc:224] Handling call
0709 13:00:33.756819 (+341126us) ts_tablet_manager.cc:934] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
0709 13:00:34.263767 (+506948us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:34.573200 (+309433us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:34.596166 (+ 22966us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:34.883246 (+287080us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:34.884242 (+   996us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:34.884619 (+   377us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:34.884694 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":111246,"tablet-copy.queue_time_us":196296,"thread_start_us":286914,"threads_started":2}
I20260709 13:00:34.887003  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.890898  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.891144  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.894310  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:34.896037  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.887082  2960 tablet_copy_client.cc:806] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:34.897667  2960 tablet_copy_client.cc:670] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:34.897987  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.903858  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.915831  1661 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:34.851287  2964 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:34.908531  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:34.885143  2931 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:34.899242  2963 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.904057  2876 raft_consensus.cc:3055] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:34.940196  1511 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.942107  1587 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.942773  1544 raft_consensus.cc:1240] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:34.943358  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.949723  1661 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:34.949857  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.932595  2869 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.956650  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:34.961971  1661 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:34.958096  1587 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.939702  2932 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.939857  2876 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:34.969515  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:34.973819  1661 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:34.975464  1587 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.947991  2953 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.981768  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:34.991642  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.959972  2916 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:34.997617  1511 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:34.970924  2712 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.970515  2918 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.979367  2963 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:35.003453  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:35.011656  1511 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.006577  2955 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.992319  2988 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.993712  2869 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.998678  2961 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:35.030740  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 60890.6us
I20260709 13:00:35.033054  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:34.987337  2987 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:35.008446  2967 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.039624  1539 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:35.009004  2963 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:35.058636  2963 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:35.063573  2996 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:00:35.069361  2987 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:35.057279  2995 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.205s	user 0.002s	sys 0.000s
I20260709 13:00:35.020290  2944 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.018047  2972 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:35.073443  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 99738.7us
I20260709 13:00:35.010870  2916 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:35.101156  2916 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:35.090726  2971 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:35.121874  2971 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:35.125065  2971 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:35.108161  1661 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:35.126324  2965 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:35.127400  2956 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:35.112004  2876 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:35.129662  2876 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.130716  1661 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:35.133255  2919 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.127341  2946 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.140193  1661 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:35.120229  2964 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:35.145893  2946 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.144749  2232 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.078078  2972 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:35.159198  2946 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 13:00:35.185158  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.187129  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:00:35.200064  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 224685us
I20260709 13:00:35.203765  1587 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.205868  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:35.208074  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:35.210669  2920 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:35.211120  2920 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:35.211517  2920 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.173146  2785 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.174618  2972 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.256366  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:35.256801  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:00:35.201130  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 56499.8us
I20260709 13:00:35.256524  2921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54496 (request call id 382) took 2439 ms. Trace:
I20260709 13:00:35.262430  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:35.304472  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:35.323762  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:35.264581  2921 rpcz_store.cc:276] 0709 13:00:32.778754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.787872 (+  9118us) service_pool.cc:224] Handling call
0709 13:00:33.158744 (+370872us) ts_tablet_manager.cc:934] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
0709 13:00:34.292407 (+1133663us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:34.682792 (+390385us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:34.687602 (+  4810us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:35.211592 (+523990us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:35.211874 (+   282us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:35.215597 (+  3723us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:35.218427 (+  2830us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":750,"tablet-copy.queue_time_us":366148,"thread_start_us":327665,"threads_started":2}
I20260709 13:00:35.336484  2921 tablet_copy_client.cc:806] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:35.337177  2921 tablet_copy_client.cc:670] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:35.337886  1586 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.339596  2936 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.342584  1586 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.346215  2936 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.353799  1586 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.366128  1548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:00:35.366972  1548 raft_consensus.cc:606] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:35.379797  1614 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:35.380347  1618 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:35.382071  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:35.363217  2941 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.392174  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:35.392871  2963 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:35.398319  2963 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:35.363325  2921 tablet_copy_client.cc:538] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:00:35.408210  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 424239us
I20260709 13:00:35.409680  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:35.442113  1511 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.423840  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:49328
I20260709 13:00:35.444386  1511 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.455689  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:35.458216  1511 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.459506  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:35.460918  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:35.470778  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 95275.6us
I20260709 13:00:35.472327  1511 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.473501  1511 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:35.470635  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 54151.8us
I20260709 13:00:35.475749  1586 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.476951  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:35.411211  2971 consensus_queue.cc:1059] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:00:35.411435  2948 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:00:35.489428  2941 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:35.131625  2918 consensus_queue.cc:1175] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "44c8c572048a40b1a5e71865068ed1bb" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:35.500183  2989 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.487102  2988 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.467470  2949 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.559785  1622 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:35.560642  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 61431.2us
I20260709 13:00:35.423723  2954 consensus_queue.cc:1059] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 13:00:35.562598  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 89162.6us
I20260709 13:00:35.563352  1695 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:35.560266  2967 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.587556  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:35.596134  1621 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:00:35.596930  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.558068  2972 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:35.611053  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:35.612512  1511 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.614078  1541 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:35.616568  3000 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.617535  2949 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.621450  2990 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.622063  2990 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.633212  2972 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:35.602052  2989 raft_consensus.cc:3055] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:35.635636  2989 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:35.636535  2989 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:35.637920  2989 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.640719  3010 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:35.642388  3010 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:35.645457  3010 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:35.647497  2875 raft_consensus.cc:3055] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:35.647912  2875 raft_consensus.cc:740] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:35.648752  2875 consensus_queue.cc:260] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:35.649976  2875 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.651808  2951 consensus_queue.cc:1059] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:35.653543  2933 raft_consensus.cc:3055] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:35.653909  2933 raft_consensus.cc:740] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:35.654680  2933 consensus_queue.cc:260] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:35.664719  3014 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:35.665177  3014 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:35.693897  1444 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52838 (request call id 237) took 2399 ms. Trace:
I20260709 13:00:35.694311  1444 rpcz_store.cc:276] 0709 13:00:33.294461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.295570 (+  1109us) service_pool.cc:224] Handling call
0709 13:00:35.693839 (+2398269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238338,"reported_tablets":4}
I20260709 13:00:35.709434  2931 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:35.726015  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 164119us
W20260709 13:00:35.763876  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 168083us
I20260709 13:00:35.777595  2988 raft_consensus.cc:993] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower 27308aae2ef347ccba1b27e7f6f04334 to start an election
W20260709 13:00:35.797379  2920 consensus_meta.cc:287] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.585s	user 0.006s	sys 0.006s
I20260709 13:00:35.797952  2920 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:35.799708  1445 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33072 (request call id 117) took 2992 ms. Trace:
I20260709 13:00:35.800112  1445 rpcz_store.cc:276] 0709 13:00:32.807293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.807488 (+   195us) service_pool.cc:224] Handling call
0709 13:00:35.799652 (+2992164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":441957,"reported_tablets":6}
I20260709 13:00:35.804826  2908 tablet_bootstrap.cc:492] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:35.810245  2870 raft_consensus.cc:1081] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Signalling peer 27308aae2ef347ccba1b27e7f6f04334 to start an election
W20260709 13:00:35.815135  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 201059us
I20260709 13:00:35.808193  2921 tablet_bootstrap.cc:492] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:35.817679  1622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:34192
I20260709 13:00:35.818277  1622 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:35.818650  1622 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.666087  3014 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:35.825668  2272 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:00:35.829999  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 245450us
I20260709 13:00:35.831103  1586 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.822580  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:35.834376  2908 tablet_bootstrap.cc:492] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Bootstrap complete.
W20260709 13:00:35.858837  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 245111us
I20260709 13:00:35.859853  1511 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:35.856166  3014 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:35.861574  2960 tablet_copy_client.cc:538] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:35.895380  1541 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:35.895386  2967 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.862438  2933 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.838918  3016 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.895627  2908 ts_tablet_manager.cc:1403] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 1.207s	user 0.043s	sys 0.034s
I20260709 13:00:35.855432  2974 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:00:35.910758  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:35.914304  2920 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:35.931062  1623 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:35.929608  1622 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:35.956533  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:35.962015  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:00:35.966130  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 51015.1us
I20260709 13:00:35.967097  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:35.957968  2965 consensus_queue.cc:1059] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:35.973366  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:35.973924  1692 raft_consensus.cc:606] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Received request to transfer leadership to TS e37b8013aec24431a6672a857806329e
I20260709 13:00:35.974328  1692 raft_consensus.cc:614] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:35.918396  3021 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:00:35.980229  2919 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:35.989063  2868 raft_consensus.cc:3055] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:35.989554  2868 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:35.992666  1622 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:35.999969  2868 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:36.016666  2951 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:36.017252  2951 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:35.982645  2871 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:00:36.019244  2951 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:36.010356  2908 raft_consensus.cc:359] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:36.030098  2908 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:36.031097  2908 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:36.033221  2908 ts_tablet_manager.cc:1434] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.000s
I20260709 13:00:36.035291  1632 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-75442f7324f24d4494f1ba99a64ed4ac received from {username='slave'} at 127.0.0.1:33892
I20260709 13:00:36.035831  1632 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-75442f7324f24d4494f1ba99a64ed4ac on tablet 75442f7324f24d4494f1ba99a64ed4ac with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:36.076462  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:36.081894  1547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c033fce18c634feb995adf2f2422308c"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:00:36.082830  1547 raft_consensus.cc:606] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:36.088999  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:36.093181  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:36.093976  1695 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.098374  1587 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:36.070706  2871 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.124469  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:36.139354  1543 raft_consensus.cc:3055] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:36.139863  1543 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:36.096240  2964 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:36.157897  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:49328
I20260709 13:00:36.330111  1693 raft_consensus.cc:606] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:00:36.340498  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 242305us
I20260709 13:00:36.341774  3015 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.342300  3015 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:36.344815  2960 tablet_bootstrap.cc:492] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
W20260709 13:00:36.349974  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.345499  2942 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:36.140635  2871 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:36.124909  2933 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.232s
I20260709 13:00:36.357201  2871 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:36.357424  2933 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:36.357860  2933 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:36.358814  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:36.358680  2933 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:36.359467  1544 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:36.156250  3019 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:36.365613  3019 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:36.366767  3015 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:36.367857  3019 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:36.368333  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:36.368939  2268 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:36.370709  2933 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.371003  1622 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:36.371852  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:36.372246  3023 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.372705  3023 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:36.373363  1513 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:36.374284  2964 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:36.374635  2964 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.374688  3023 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:36.375041  2964 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.383057  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:36.383906  1622 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 2: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:36.387781  1661 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:36.392832  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:36.330116  2868 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.394027  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:36.404476  1661 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:36.403261  1623 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:36.408464  1695 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:36.406109  2951 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:36.411587  2234 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:36.417168  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:36.417824  1691 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:36.406555  1543 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:36.432492  1543 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:36.435650  2990 consensus_queue.cc:1175] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:00:36.437719  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:36.438525  1623 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
W20260709 13:00:36.440089  2745 consensus_queue.cc:1175] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "27308aae2ef347ccba1b27e7f6f04334" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:36.443933  1586 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:00:36.446712  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.410580  2782 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:36.462692  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:36.424587  3019 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:36.470068  2231 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:36.470834  2986 raft_consensus.cc:993] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:00:36.471342  2986 raft_consensus.cc:1081] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Signalling peer 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:00:36.464404  2942 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:36.478753  1622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c033fce18c634feb995adf2f2422308c"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:34192
I20260709 13:00:36.479337  1622 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:36.479837  1622 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.491267  2876 raft_consensus.cc:993] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:36.492000  3028 raft_consensus.cc:1081] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:36.494397  1548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35704
I20260709 13:00:36.494972  1548 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:36.495373  1548 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.494562  1662 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:36.465106  3019 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.502519   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:36.503610  1622 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:36.504621   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:36.527541  2271 raft_consensus.cc:1217] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:36.480593  2985 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:36.531865  2985 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:36.532399  2985 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.542208  2951 raft_consensus.cc:2955] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:36.544695  2964 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:36.505609  3019 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.570235  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:36.575114  1623 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.579815  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:36.580487  1541 raft_consensus.cc:3055] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:36.580746  1541 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:36.581439  1541 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:36.582464  1541 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.583014  1444 catalog_manager.cc:5697] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 2, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 2 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:36.592022  1545 raft_consensus.cc:2955] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:36.567922  2268 raft_consensus.cc:2955] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:36.622757  1622 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:36.628736  1541 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:36.629310  1623 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:36.634130  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:36.634991  1514 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:36.622395  2942 raft_consensus.cc:697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:36.639313  1548 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:36.647886  1548 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:36.654162  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:36.654819  1692 raft_consensus.cc:3055] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:36.655265  1692 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:36.657843  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:36.658421  2271 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.629354  2964 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:36.641014  3002 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:36.644641  3016 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:36.650837  2985 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:36.652992  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:00:36.666251  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 194792us
I20260709 13:00:36.683836  2271 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:36.685169  1513 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:36.685082  2942 consensus_queue.cc:237] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:36.691316  2964 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:36.691861  2964 raft_consensus.cc:697] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:36.692690  2964 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:36.676147  3016 raft_consensus.cc:697] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:36.696064  3016 consensus_queue.cc:237] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:36.663614  1692 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:36.697811  1692 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.678821  3002 raft_consensus.cc:697] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:36.701138  3002 consensus_queue.cc:237] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:36.701732  1543 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
W20260709 13:00:36.699892  3027 consensus_queue.cc:1175] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e37b8013aec24431a6672a857806329e" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 13:00:36.706780  3028 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:36.707820  3028 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:36.710449  3019 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:36.711997  2267 raft_consensus.cc:2393] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:00:36.713685  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:36.714396  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:36.714977  1548 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:36.716585  1661 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:36.719429  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:36.720156  1614 raft_consensus.cc:2393] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:36.715981  1623 raft_consensus.cc:2955] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:36.731595  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:36.732213  1690 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.742906  2937 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.743515  2937 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:36.746695  2937 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:36.754739  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:36.755405  1697 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:36.771919  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:36.712991  3019 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:36.782390  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:36.773087  1620 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:36.718708  3028 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:36.726715  3029 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:36.784380  2232 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:36.794713  3029 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:36.809698  3029 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.773953  2876 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:36.784593  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:36.792080  2956 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:36.821182  2269 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:36.803912  1692 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:36.818660  2904 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:36.821411  2956 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.833204  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:00:36.830475  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 96433.8us
I20260709 13:00:36.837203  2956 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.857291  2985 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:36.886201  1690 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:36.880649  2937 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.895215  2937 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:36.911563  3004 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.920517  3004 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:36.927374  3004 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:36.899154  2937 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:36.926893  2956 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:36.939127  2921 tablet_bootstrap.cc:492] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:36.943599  1623 raft_consensus.cc:2368] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3.
I20260709 13:00:36.931376  3029 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:36.947088  2234 leader_election.cc:400] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3.
I20260709 13:00:36.947504  2234 leader_election.cc:403] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:36.948119  3044 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.951375  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:36.952903  1697 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:36.955353  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:36.955838  1697 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.956789  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:36.957646  1689 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:36.973220  3029 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:36.976483  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:36.982965  1620 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:36.962697  2921 tablet_bootstrap.cc:492] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:36.982358  2956 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:37.048130  3019 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:37.054383  3019 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:37.047392  2921 ts_tablet_manager.cc:1403] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 1.270s	user 0.028s	sys 0.040s
I20260709 13:00:37.139906  1697 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:37.147212  1586 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:37.150409  1586 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:37.148389  2931 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.154304  2931 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:37.162132  3031 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:37.169404  3031 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.169791  3031 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:37.161904  2868 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:37.171778  2868 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.172124  2868 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.176255  2267 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:37.178087  2990 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:37.189846  2931 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:37.182844  2921 raft_consensus.cc:359] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:37.191512  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:37.192430  1620 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:37.194085  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:37.209800  1690 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:37.234877  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:37.191570  2921 raft_consensus.cc:740] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:37.199985  2931 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:37.245609  2931 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.246061  2931 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.248649  3018 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:37.252499  3044 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3.
I20260709 13:00:37.269551  2921 consensus_queue.cc:260] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:37.303778  1546 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:37.192252  2868 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:37.240805  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:37.319139  2931 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:37.332080  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:37.338420  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:37.348327  2268 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:37.354429  1691 raft_consensus.cc:2368] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3.
I20260709 13:00:37.308977  3031 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:37.372845  2868 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:37.351171  2916 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:00:37.351491  2965 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:37.396363  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 148517us
I20260709 13:00:37.402714  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:37.403136  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:37.403486  1548 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:37.403906  1545 raft_consensus.cc:2393] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 2: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:37.405902  3031 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:37.406539  2960 tablet_bootstrap.cc:492] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:37.407797  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:37.408408  1546 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:37.410193  2960 tablet_bootstrap.cc:492] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:37.405902  2921 ts_tablet_manager.cc:1434] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.350s	user 0.004s	sys 0.005s
I20260709 13:00:37.411060  2960 ts_tablet_manager.cc:1403] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 1.066s	user 0.043s	sys 0.054s
I20260709 13:00:37.401353  2965 raft_consensus.cc:697] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:37.415442  2965 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:37.415988  3016 raft_consensus.cc:1064] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:37.417687  2931 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:37.421375  2931 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.424458  2269 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:37.424045  1442 catalog_manager.cc:5697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 1 to 2, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:37.425777  3019 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:37.421890  2931 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:37.432510  2931 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:37.442258  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:37.446043  1623 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.450299  1547 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:37.457672  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 44456.1us
I20260709 13:00:37.462430  3002 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:37.456369  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:37.464422  1547 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.468622  1623 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:37.470145  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:00:37.471560  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 113322us
I20260709 13:00:37.485513  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:37.486420  2271 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:37.488144  1693 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:37.491168  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:37.492658  1693 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.494275  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:37.494828  1541 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:37.495460  2231 leader_election.cc:400] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3.
I20260709 13:00:37.497372  1662 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:37.500168  1548 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:37.504483  1690 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:37.469898  2916 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:37.463475  3002 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:37.489538  2931 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:37.524596  1693 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:37.491391  3004 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.516008  1541 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:37.541430  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:37.508623  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:37.511942  3027 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:37.536002  1632 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-effd69042c284e8386aafb50372a93b6 received from {username='slave'} at 127.0.0.1:33892
W20260709 13:00:37.591243  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 48603.8us
I20260709 13:00:37.593333  3031 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:37.595960  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 53493.1us
I20260709 13:00:37.582988  2931 raft_consensus.cc:697] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:37.620803  2931 consensus_queue.cc:237] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:37.621436  1445 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33072 (request call id 118) took 1151 ms. Trace:
I20260709 13:00:37.621845  1445 rpcz_store.cc:276] 0709 13:00:36.469669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.471835 (+  2166us) service_pool.cc:224] Handling call
0709 13:00:37.621375 (+1149540us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":6}
I20260709 13:00:37.512647   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:37.582816  1692 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:37.613570  1632 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-effd69042c284e8386aafb50372a93b6 on tablet effd69042c284e8386aafb50372a93b6 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:37.583380  2937 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:00:37.535856  2916 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:37.576891  3027 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.614533  1547 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:37.630054  2916 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:37.638218  1661 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:00:37.641857  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 44606.4us
I20260709 13:00:37.549553  3004 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:37.635217  3027 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.658965  3004 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:37.666949  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:37.667757  1620 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 2: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:37.676246  3002 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:37.678610  2876 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:37.678570  2269 raft_consensus.cc:1217] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:37.688762  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:37.650396  2956 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:00:37.689883  1620 raft_consensus.cc:2368] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3.
I20260709 13:00:37.694146  1514 leader_election.cc:400] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3.
I20260709 13:00:37.694566  1514 leader_election.cc:403] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:37.695168  3018 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.694855  1692 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:37.720319  1586 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:37.721441  1586 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:37.739399  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:37.751324  2869 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:37.768980  2869 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:37.737560  2956 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:37.770393  2956 raft_consensus.cc:697] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:37.688548  2876 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:37.713340  3067 raft_consensus.cc:2764] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:00:37.779718  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:37.781641  2876 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:37.782497  1695 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:37.782922  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:37.783653  1542 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 2: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:37.784488  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:37.783325  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:37.787320  1547 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:37.743161  2960 raft_consensus.cc:359] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:37.794617  2960 raft_consensus.cc:740] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:37.795567  2960 consensus_queue.cc:260] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:37.797935  2960 ts_tablet_manager.cc:1434] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.386s	user 0.007s	sys 0.002s
I20260709 13:00:37.808573  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:37.809176  1620 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:37.810333  1663 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:37.811205  2932 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:37.811647  2932 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:37.812070  2932 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.830597  2956 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:37.842732  1706 tablet_copy_service.cc:342] P c20847a6dcea4c2a9cbaf35a2171e33d: Request end of tablet copy session e37b8013aec24431a6672a857806329e-89a432d1e3024e13a2d20229db9a8d85 received from {username='slave'} at 127.0.0.1:58526
I20260709 13:00:37.843439  1706 tablet_copy_service.cc:434] P c20847a6dcea4c2a9cbaf35a2171e33d: ending tablet copy session e37b8013aec24431a6672a857806329e-89a432d1e3024e13a2d20229db9a8d85 on tablet 89a432d1e3024e13a2d20229db9a8d85 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:37.844620  2932 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:37.848214  2869 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:37.856668  3027 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:37.858240  1691 raft_consensus.cc:2368] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3.
I20260709 13:00:37.865768  3016 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:37.869745  3027 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:37.870884  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:37.899873  2272 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.874364  2932 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:37.874861  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:37.875329  1695 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:37.877441  1586 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:37.881507  2269 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:00:37.906456  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 121713us
I20260709 13:00:37.919889  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:37.929076  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:37.929929  1547 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:37.918099  2917 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:00:37.935689  3018 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3.
I20260709 13:00:37.942587  1545 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:37.944410  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:37.945009  1541 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.944941  2920 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:37.918426  2941 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:00:37.950129  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:37.950884  1547 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 2: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:37.951979  1541 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:37.966665  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:37.967794  3027 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:37.968298  3027 raft_consensus.cc:697] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:37.969141  3027 consensus_queue.cc:237] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:37.939025  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:37.987190  2272 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:37.989684  1623 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:38.035496  2272 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:38.028760  3063 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:37.982445  2959 raft_consensus.cc:1027] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: attempt to promote peer e37b8013aec24431a6672a857806329e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:00:37.987788  1692 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:38.110697  1622 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:38.084441  2942 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:00:38.144351  1663 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:00:38.196697  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 52476us
I20260709 13:00:38.184409  3029 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:00:38.222960  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 101095us
W20260709 13:00:38.224988  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 244967us
W20260709 13:00:38.216216  3079 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.230s	user 0.024s	sys 0.039s
W20260709 13:00:38.220569  3085 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.235s	user 0.002s	sys 0.000s
I20260709 13:00:38.226110  1511 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:38.228912  3029 raft_consensus.cc:697] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:38.272382  3018 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:38.233901  2961 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:38.284931  2961 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:38.328656  2272 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Advancing to term 3
I20260709 13:00:38.325692  2961 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:38.343612  2231 leader_election.cc:400] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3.
I20260709 13:00:38.335210  3029 consensus_queue.cc:237] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:38.346750  3087 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:00:38.345366  2231 leader_election.cc:403] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:38.395766  2272 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 3 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:38.384850  2916 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:38.411525  2916 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:38.412187  3091 log.cc:927] Time spent T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:38.412420  3100 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3.
I20260709 13:00:38.414170  2916 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:38.417490  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:38.421891  1623 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:38.446077  3068 raft_consensus.cc:1064] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:38.449745  3068 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:38.462635  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 122317us
I20260709 13:00:38.463222  1445 catalog_manager.cc:5697] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index 3 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.478003  1544 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:38.483987  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52824 (request call id 211) took 1341 ms. Trace:
I20260709 13:00:38.431990  2951 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:00:38.467724  3004 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.700968  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:38.688970  3102 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.201s	user 0.010s	sys 0.000s
I20260709 13:00:38.731945  2961 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:38.739429  2965 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:00:38.749349  3004 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:38.688557  3063 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:38.688527  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 286424us
I20260709 13:00:38.757071  3063 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:38.832764  3027 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:38.833408  3027 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:38.835912  3027 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:38.840287  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:38.842046  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:38.842882  1623 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 2: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:00:38.784854  3107 log.cc:927] Time spent T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:00:38.484436  1442 rpcz_store.cc:276] 0709 13:00:37.146251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.152247 (+  5996us) service_pool.cc:224] Handling call
0709 13:00:38.483921 (+1331674us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:37.617821 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:37.618338 (+   517us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:37.618374 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:00:37.618389 (+    15us) tablet.cc:662] Decoding operations
0709 13:00:37.618751 (+   362us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:37.618801 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:37.618831 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:37.618999 (+   168us) tablet.cc:701] Row locks acquired
0709 13:00:37.619014 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:00:37.619141 (+   127us) write_op.cc:270] Start()
0709 13:00:37.619242 (+   101us) write_op.cc:276] Timestamp: P: 1783602037619106 usec, L: 0
0709 13:00:37.619278 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:00:37.685572 (+ 66294us) log.cc:844] Serialized 541 byte log entry
0709 13:00:37.751302 (+ 65730us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b54000393d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab39e28 00007f5c6e574581 00007f5c6e573d58 00007f5c6e5789f1 00007f5c6e5789a9 00007f5c6e578939 00007f5c6e578901 00007f5c6e577b2d 000000000038f354 000000000038f199
0709 13:00:37.810684 (+ 59382us) op_driver.cc:464] REPLICATION: finished
0709 13:00:37.815225 (+  4541us) write_op.cc:301] APPLY: starting
0709 13:00:37.815324 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:37.815465 (+   141us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:37.815495 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:37.817344 (+  1849us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:37.817556 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:37.817622 (+    66us) write_op.cc:312] APPLY: finished
0709 13:00:37.817860 (+   238us) log.cc:844] Serialized 23 byte log entry
0709 13:00:37.818030 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:37.818130 (+   100us) write_op.cc:454] Released schema lock
0709 13:00:37.818176 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:37.819194 (+  1018us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:37.819234 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":145044,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":4276,"apply.run_cpu_time_us":1784,"apply.run_wall_time_us":3955,"num_ops":1,"prepare.queue_time_us":190252,"prepare.run_cpu_time_us":7762,"prepare.run_wall_time_us":135938,"replication_time_us":191274,"spinlock_wait_cycles":42418944,"thread_start_us":83501,"threads_started":2}]]}
I20260709 13:00:38.782213  3097 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:38.851776  1546 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:38.848106  2961 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:38.875555  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 92424.6us
W20260709 13:00:38.884433  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 127816us
W20260709 13:00:38.896804  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 67604.9us
I20260709 13:00:38.898427  1511 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:38.900238  3096 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.143s	user 0.001s	sys 0.001s
I20260709 13:00:38.880040  3055 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:38.904719  1689 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:38.904832  3055 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:38.923240  3118 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:38.925879  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:38.880071  3097 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:38.939031  1689 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:00:38.945494  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.948067  3055 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:38.945026  2876 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:38.950089  2876 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:38.952148  2876 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:38.954609  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:38.964323  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:38.950840  3097 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:38.998123  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 58092.3us
I20260709 13:00:39.013247  3004 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:39.013322  1662 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:38.957123  3014 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:38.968497  1692 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:00:39.015199  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 46794.6us
I20260709 13:00:39.056551  3014 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:39.063463  3113 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:00:39.084757  3014 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:39.077715  3122 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:39.099156  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 199183us
I20260709 13:00:39.131937  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.145329  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.182950  3123 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:39.188373  3123 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:39.182792  2959 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:39.194520  2959 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:39.170869  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:39.208125  3063 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:39.210067  3063 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:39.200139  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:39.181957  3122 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:00:39.217487  3123 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:39.220079  1692 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:39.226559  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:39.227919  2959 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:39.236166  2951 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:39.236647  3113 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:39.237126  2951 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:39.237511  3113 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:39.241302  3113 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:39.241887  2951 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:39.245971  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:39.247547  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:39.253542  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 235442us
I20260709 13:00:39.258298  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:39.258936  1542 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:39.259629  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:39.260340  1540 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:39.265527  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:39.313139  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.325119  1544 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:39.326431  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:39.328068  1544 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.389810  1621 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:39.401680  3132 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:39.402304  3132 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:39.405159  3132 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:39.316437  2959 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:00:39.383876  3031 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:39.428663  1544 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:39.429966  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:39.431777  1544 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:39.435981  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:39.444043  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:00:39.445470  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 50047.8us
I20260709 13:00:39.446012  3056 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:39.446538  3056 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:39.448992  3056 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:00:39.453855  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 143103us
I20260709 13:00:39.455624  1511 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:39.455870  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.472740  3142 consensus_queue.cc:1059] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:39.473762  3127 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:39.457056  3137 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:39.437659  3031 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:39.498371  1445 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52838 (request call id 240) took 1733 ms. Trace:
I20260709 13:00:39.468528  3070 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:39.491991  3031 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:39.509112  2951 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:39.510653  3121 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:39.515175  3140 raft_consensus.cc:3055] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:39.475396  3127 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:00:39.522341  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 195447us
I20260709 13:00:39.523524  1661 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:39.525087  1661 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:39.526510  1661 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:39.522254  3140 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:39.538945  3140 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:39.540506  3140 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.530488  2932 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:39.535033  3142 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:39.489100  3137 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:39.551676  3063 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:39.552433  3141 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:39.552959  3141 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:39.564267  3104 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:39.565150  3104 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:39.528941  3127 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:39.522046  2951 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:39.538300  3139 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:39.586937  2782 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:39.590873  2782 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:39.594144  2782 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:39.523008  3121 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:39.597992  3121 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:39.607333  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:39.499538  1445 rpcz_store.cc:276] 0709 13:00:37.765113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.765320 (+   207us) service_pool.cc:224] Handling call
0709 13:00:39.498316 (+1732996us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:38.876991 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:38.877639 (+   648us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:38.877688 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:00:38.877712 (+    24us) tablet.cc:662] Decoding operations
0709 13:00:38.878104 (+   392us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:38.878180 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:38.878215 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:38.878413 (+   198us) tablet.cc:701] Row locks acquired
0709 13:00:38.878433 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:00:38.878588 (+   155us) write_op.cc:270] Start()
0709 13:00:38.878906 (+   318us) write_op.cc:276] Timestamp: P: 1783602038878538 usec, L: 0
0709 13:00:38.878941 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:00:38.902484 (+ 23543us) log.cc:844] Serialized 599 byte log entry
0709 13:00:39.064217 (+161733us) op_driver.cc:464] REPLICATION: finished
0709 13:00:39.192029 (+127812us) write_op.cc:301] APPLY: starting
0709 13:00:39.192151 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:39.192292 (+   141us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:39.192471 (+   179us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:39.192776 (+   305us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:39.193091 (+   315us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:39.193148 (+    57us) write_op.cc:312] APPLY: finished
0709 13:00:39.193430 (+   282us) log.cc:844] Serialized 23 byte log entry
0709 13:00:39.193712 (+   282us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:39.193829 (+   117us) write_op.cc:454] Released schema lock
0709 13:00:39.193883 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:39.194339 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:39.194377 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":571201,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":127309,"apply.run_cpu_time_us":2342,"apply.run_wall_time_us":2352,"num_ops":1,"prepare.queue_time_us":187217,"prepare.run_cpu_time_us":3308,"prepare.run_wall_time_us":25823,"replication_time_us":183944,"spinlock_wait_cycles":66304,"thread_start_us":95499,"threads_started":2}]]}
W20260709 13:00:39.620850  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 165317us
I20260709 13:00:39.520956  3070 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:39.626428  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:39.622002  1511 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:39.589880  3139 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:39.583659  3148 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:39.640615  3148 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:39.635298  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:39.641734  1540 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:39.631901  2965 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:39.645592  3127 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:39.583621  3141 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:39.632349  2951 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:39.634450  3070 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:39.635497  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:39.636214  3139 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:39.658108  3104 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:39.674435  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 113901us
I20260709 13:00:39.652858  1511 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:39.656179  3123 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:39.678083  1511 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:39.666417  3148 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:39.692866  3029 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:39.683981  3141 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:39.693456  3029 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:39.695123  3137 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:39.695999  3029 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:39.698587  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:39.702322  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.703172  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:39.703370  1692 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:39.704077  1697 raft_consensus.cc:2410] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:39.707521  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.708212  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.715901  1697 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:39.717021  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.717475  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.717937  1446 catalog_manager.cc:5697] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:39.718449  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.719020  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.721287  1446 catalog_manager.cc:5697] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 2, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 2 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:00:39.724112  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 253051us
I20260709 13:00:39.730937  2272 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:39.732767  2231 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:39.737561  1689 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:39.773442  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 47287us
I20260709 13:00:39.689129  3064 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:39.782164  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:00:39.677999  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 117842us
I20260709 13:00:39.677516  3031 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:00:39.807160  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:39.840863  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:39.739529  3100 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:39.843487  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 109364us
I20260709 13:00:39.779206  3123 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.826241  3072 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:39.881047  3072 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:39.882144  3139 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:39.808530  3064 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:39.839728  2269 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:39.886080  1697 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 2: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:39.877056  3123 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:39.893335  3064 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:39.897183  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 1940) took 1201 ms. Trace:
I20260709 13:00:39.899611  2963 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:39.901374  3139 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:39.907361  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:39.883322  3072 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:39.902117  3056 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:39.915655  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:39.920075  1542 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
W20260709 13:00:39.921439  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 139511us
I20260709 13:00:39.927351  3123 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:39.933679  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:39.933748  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:39.934392  1542 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 1.
I20260709 13:00:39.928540  3056 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.959862  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.912380  3027 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:00:39.964408  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.921737  2963 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:39.971848  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:39.962855  3056 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.978884  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:39.980643  3156 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:40.006094  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.990669  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:39.992671  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:39.993376  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:39.993436  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:39.994302  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:39.995069  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:39.996810  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:40.009212  1540 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.011732  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:40.009742  1544 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:40.012244  3156 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:39.959909  3031 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:00:39.912177  1545 rpcz_store.cc:276] 0709 13:00:38.695612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.705753 (+ 10141us) service_pool.cc:224] Handling call
0709 13:00:39.858375 (+1152622us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5800093398. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb17fc0 00007f5c6fb02929 00007f5c6fb023d2 00007f5c69079bd4
0709 13:00:39.879678 (+ 21303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.896756 (+ 17078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.896794 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:39.896850 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:39.896893 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.896967 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.897090 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37930752}
I20260709 13:00:40.037521  2963 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:40.038764  3141 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.057734  1540 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:40.080195  1661 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:40.081823  3120 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:40.081875  1661 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:40.083871  3156 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:40.085857  3149 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:40.085273  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:40.088184  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:40.096067  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:40.091917  3149 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:40.039278  3141 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:40.132339  2272 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:40.134088  1587 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:40.137010  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:40.137428  2232 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:40.138664  2785 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:40.103714  3114 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:40.153963  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 100457us
I20260709 13:00:40.149009  2965 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:40.156378  3063 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:00:40.160095  2965 raft_consensus.cc:697] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:40.161000  2965 consensus_queue.cc:237] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:40.148478  3156 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:00:40.186966  3141 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:40.189282  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:00:40.190659  3162 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:00:40.193147  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 105060us
I20260709 13:00:40.194285  2932 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:40.195708  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 54690.1us
I20260709 13:00:40.197495  3056 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:40.199751  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:40.200196  1540 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:40.200187  1545 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:40.202008  3142 raft_consensus.cc:1064] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:40.203775  1661 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:40.205588  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:40.213456  3027 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:00:40.224064  3143 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:40.210292  3112 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:40.238057  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:40.238531  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:40.229723  3056 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:40.246569  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 91933.4us
I20260709 13:00:40.258621  1588 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:40.260314  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:40.261114  1696 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.231873  3143 raft_consensus.cc:697] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:00:40.271765  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 117067us
I20260709 13:00:40.277120  1588 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:40.230396  3139 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:00:40.278494  1588 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:40.283649  1696 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:40.240577  3140 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:00:40.281072  2963 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:40.303507  3143 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:00:40.307310  3166 log.cc:927] Time spent T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.122s	user 0.002s	sys 0.000s
I20260709 13:00:40.263907  3156 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:00:40.315613  1588 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:40.316769  3156 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:40.318980  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:40.320293  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:40.288522  1587 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:40.288522  3055 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:40.317673  3156 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:40.328131  3142 consensus_queue.cc:237] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:40.360148  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 81089.7us
I20260709 13:00:40.376559   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:40.383301  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 94835.7us
I20260709 13:00:40.386373  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:40.389554  2963 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:40.393333  3161 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:40.393941  3161 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:40.403898  2234 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:40.407586  2234 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:40.412593  3145 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.412499  3027 raft_consensus.cc:2955] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:40.421422  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:40.423382  2965 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:40.423985  2965 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:40.413244  3044 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:40.424938  2965 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:40.466759  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 51817.4us
I20260709 13:00:40.482515  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:40.488293  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:40.485919  3161 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:40.486913  3100 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:40.493640  3100 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:40.501609  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:40.511260  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:40.513130  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:40.522451  3100 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:40.527575  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:40.530440  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:40.540331  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:40.500922  2267 raft_consensus.cc:2955] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:40.546635  3145 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:40.550752  3180 log.cc:927] Time spent T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:00:40.556018  2234 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:00:40.564663  3182 log.cc:927] Time spent T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.073s	user 0.003s	sys 0.000s
I20260709 13:00:40.566318  3100 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:40.569665  3161 raft_consensus.cc:2955] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:40.596487  1691 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:00:40.641383  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8a63558e47a84017a3a62f52bb8cb3eb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:40.677927  1620 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:00:40.693830  2267 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 3 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:00:40.725492  3140 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
W20260709 13:00:40.753741  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 70419.2us
I20260709 13:00:40.709455  2963 consensus_queue.cc:1059] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:00:40.765736  1446 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33072 (request call id 119) took 2858 ms. Trace:
I20260709 13:00:40.773608  3143 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:40.767303  1446 rpcz_store.cc:276] 0709 13:00:37.906571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.906718 (+   147us) service_pool.cc:224] Handling call
0709 13:00:40.765350 (+2858632us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:39.975317 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:39.984181 (+  8864us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:39.984219 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:00:39.984240 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:39.984857 (+   617us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:39.984912 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:39.984941 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:39.985280 (+   339us) tablet.cc:701] Row locks acquired
0709 13:00:39.985294 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:00:39.985430 (+   136us) write_op.cc:270] Start()
0709 13:00:39.985537 (+   107us) write_op.cc:276] Timestamp: P: 1783602039985387 usec, L: 0
0709 13:00:39.985559 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:00:39.986238 (+   679us) log.cc:844] Serialized 919 byte log entry
0709 13:00:40.164415 (+178177us) op_driver.cc:464] REPLICATION: finished
0709 13:00:40.379931 (+215516us) write_op.cc:301] APPLY: starting
0709 13:00:40.380117 (+   186us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:40.380288 (+   171us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:40.389109 (+  8821us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:40.389520 (+   411us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:40.389730 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:00:40.389779 (+    49us) write_op.cc:312] APPLY: finished
0709 13:00:40.390032 (+   253us) log.cc:844] Serialized 29 byte log entry
0709 13:00:40.390202 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:40.390298 (+    96us) write_op.cc:454] Released schema lock
0709 13:00:40.390345 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:40.496198 (+105853us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b5400039228. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70efa9e1 00007f5c70ef964c 00007f5c6e58a3fd 00007f5c6e576389 00007f5c6e575b53 00007f5c6e579d61 00007f5c6e579d19 00007f5c6e579ca9 00007f5c6e579c71 00007f5c6e578e9d 000000000038f354
0709 13:00:40.497241 (+  1043us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:40.497270 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":554139,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":194743,"apply.run_cpu_time_us":6302,"apply.run_wall_time_us":117292,"num_ops":2,"prepare.queue_time_us":176884,"prepare.run_cpu_time_us":3151,"prepare.run_wall_time_us":19127,"replication_time_us":178639,"spinlock_wait_cycles":19814528,"thread_start_us":252470,"threads_started":2}]]}
I20260709 13:00:40.775695  1514 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:40.687378  1691 raft_consensus.cc:2955] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:40.786258  1697 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:00:40.787313  1697 pending_rounds.cc:85] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 1
I20260709 13:00:40.787591  1697 pending_rounds.cc:107] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:40.787964  1697 raft_consensus.cc:2889] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:40.787806  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:40.814428  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:40.782015  2271 raft_consensus.cc:2955] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:40.832748  2745 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:40.833825  2745 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:40.835690  3170 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:00:40.836802  2745 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:40.802003  2963 consensus_queue.cc:1243] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 2.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:40.850541  2269 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:40.855683  1694 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:40.850598  3056 raft_consensus.cc:3055] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:40.858428  3056 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:40.859766  3056 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:40.866149  1545 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:00:40.866585  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:40.869953  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:00:40.883520  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 115214us
I20260709 13:00:40.785127  3127 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:40.887017  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:40.890972  3056 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:40.826859  1442 catalog_manager.cc:5697] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:40.893592  1697 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:40.910377  1547 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:40.914572  1544 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:00:40.918179  1542 raft_consensus.cc:2955] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:40.966377  2937 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 13:00:40.971138  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 84316.4us
I20260709 13:00:40.972265  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:40.980773  1587 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:40.983060  3161 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:40.962761  3127 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:41.002359  1545 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:41.019680  1442 catalog_manager.cc:5697] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 1 to 3, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 3 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:41.021945  1442 catalog_manager.cc:5697] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 2 to 3, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 3 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:41.005241  2745 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:41.026757  3114 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:41.035501  3127 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:41.038306  3127 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:41.042483  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 70396.5us
I20260709 13:00:41.041194  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:41.046543  1514 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:41.062448  2965 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:41.056353  3127 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:41.058641  1442 catalog_manager.cc:5697] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 1 to 3, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 3 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.085270  1442 catalog_manager.cc:5697] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 2 to 4, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 4 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:41.091965  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 62748.6us
I20260709 13:00:41.096530  3168 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:41.099299  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 44425.9us
I20260709 13:00:41.104794  3141 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:41.105958  3141 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:41.106470  3141 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:41.108927  2745 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:41.108062  3141 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:41.109947  2745 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:41.110318  3141 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.115907  2745 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:41.134491  1621 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:41.137279  2271 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:00:41.137707  2271 pending_rounds.cc:85] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Aborting all ops after (but not including) 2
I20260709 13:00:41.137970  2271 pending_rounds.cc:107] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:00:41.138236  2271 raft_consensus.cc:2917] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:00:41.138679  2271 raft_consensus.cc:2889] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:41.141345  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:41.143729  3027 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:41.145308  3027 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:41.146744  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:41.153864  3027 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:41.155520  1621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:41.156527  1621 raft_consensus.cc:606] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:41.161405  1620 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:00:41.161844  1620 pending_rounds.cc:85] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 2
I20260709 13:00:41.162072  1620 pending_rounds.cc:107] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:00:41.162297  1620 raft_consensus.cc:2917] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:00:41.162674  1620 raft_consensus.cc:2889] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:41.155786  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:41.167434  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:41.167512  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:49328
I20260709 13:00:41.169399  1694 raft_consensus.cc:606] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:41.196643  1543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:00:41.197854  1543 raft_consensus.cc:606] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:41.206413  1514 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:41.215922   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:41.216334  3131 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:41.218220   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:41.219436  2782 raft_consensus.cc:993] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:41.220026  2782 raft_consensus.cc:1081] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:41.193723  2932 raft_consensus.cc:2955] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.228061  1514 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:41.237643  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:41.232775  1539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35704
I20260709 13:00:41.232851  2745 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:41.241003  1539 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.241426  1539 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.243551  1622 raft_consensus.cc:2955] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.247783  3139 raft_consensus.cc:1064] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
W20260709 13:00:41.248329  3139 raft_consensus.cc:1068] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Unable to promote non-voter e37b8013aec24431a6672a857806329e: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:00:41.249895  3120 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:41.254698  1545 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:00:41.255268  1545 pending_rounds.cc:85] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 1
I20260709 13:00:41.255545  1545 pending_rounds.cc:107] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:41.255811  1545 raft_consensus.cc:2889] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:41.258280  1539 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:41.239058  1546 raft_consensus.cc:2955] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.275786  1511 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:41.279621  1539 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:41.281085  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:41.281646  2269 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.276533  2965 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:00:41.287072  3131 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:41.307801  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:41.308401  1691 raft_consensus.cc:3055] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:41.308699  1691 raft_consensus.cc:740] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:41.309485  1691 consensus_queue.cc:260] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:41.310572  1691 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.322322  2269 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:41.333346  1513 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:41.334318  3114 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:41.334800  3114 raft_consensus.cc:697] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:41.335769  3114 consensus_queue.cc:237] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:41.340972  2271 raft_consensus.cc:2955] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.365082  1691 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:41.397239  1446 catalog_manager.cc:5697] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 4 to 5, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.400615  1444 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52808 (request call id 189) took 1444 ms. Trace:
I20260709 13:00:41.406646  1444 rpcz_store.cc:276] 0709 13:00:39.956292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.956569 (+   277us) service_pool.cc:224] Handling call
0709 13:00:41.400431 (+1443862us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7173,"reported_tablets":4}
I20260709 13:00:41.404227  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52824 (request call id 212) took 1884 ms. Trace:
I20260709 13:00:41.406853  1446 catalog_manager.cc:5697] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.414544  1544 raft_consensus.cc:2955] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.408346  1442 rpcz_store.cc:276] 0709 13:00:39.519935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.520781 (+   846us) service_pool.cc:224] Handling call
0709 13:00:41.404170 (+1883389us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:41.205434 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:41.215272 (+  9838us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:41.215323 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:00:41.215344 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:41.253484 (+ 38140us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:41.253592 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:41.253618 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:00:41.254317 (+   699us) tablet.cc:701] Row locks acquired
0709 13:00:41.254372 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:00:41.254522 (+   150us) write_op.cc:270] Start()
0709 13:00:41.254678 (+   156us) write_op.cc:276] Timestamp: P: 1783602041254467 usec, L: 0
0709 13:00:41.254728 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:00:41.268039 (+ 13311us) log.cc:844] Serialized 2147 byte log entry
0709 13:00:41.373501 (+105462us) op_driver.cc:464] REPLICATION: finished
0709 13:00:41.374787 (+  1286us) write_op.cc:301] APPLY: starting
0709 13:00:41.374891 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:41.375076 (+   185us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:41.375222 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:41.376051 (+   829us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:41.376401 (+   350us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:00:41.376467 (+    66us) write_op.cc:312] APPLY: finished
0709 13:00:41.376776 (+   309us) log.cc:844] Serialized 47 byte log entry
0709 13:00:41.377851 (+  1075us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:41.377958 (+   107us) write_op.cc:454] Released schema lock
0709 13:00:41.378019 (+    61us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":1004,"apply.run_cpu_time_us":2723,"apply.run_wall_time_us":3575,"num_ops":5,"prepare.queue_time_us":52531,"prepare.run_cpu_time_us":4301,"prepare.run_wall_time_us":73755,"replication_time_us":118622,"thread_start_us":25048,"threads_started":2}]]}
I20260709 13:00:41.432096  3142 raft_consensus.cc:1064] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:00:41.438757  3142 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:41.453079  3141 raft_consensus.cc:993] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:00:41.454458  3131 raft_consensus.cc:1081] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Signalling peer 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:00:41.465443  1622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:34192
I20260709 13:00:41.466465  1622 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.467011  1445 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52838 (request call id 241) took 1824 ms. Trace:
I20260709 13:00:41.467038  1622 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.476233  2268 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:41.477849  2932 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:41.467510  1445 rpcz_store.cc:276] 0709 13:00:39.642026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.644859 (+  2833us) service_pool.cc:224] Handling call
0709 13:00:41.466820 (+1821961us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4588,"reported_tablets":7}
I20260709 13:00:41.482293  1539 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:00:41.563278  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 75901.5us
I20260709 13:00:41.566162  1621 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:41.565827  3142 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:41.562178  1622 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:41.583662  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 90876.8us
I20260709 13:00:41.601570  3139 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:41.602344  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a63558e47a84017a3a62f52bb8cb3eb with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:34170
I20260709 13:00:41.620528  1622 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:41.626219  3157 raft_consensus.cc:993] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:41.626883  3157 raft_consensus.cc:1081] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:41.630030  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39238
I20260709 13:00:41.630630  1691 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:41.631067  1691 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.633857  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:41.634503  2269 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.607338  1445 catalog_manager.cc:5697] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:00:41.652416  3120 raft_consensus.cc:2955] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:00:41.654073  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 60060.4us
I20260709 13:00:41.649958  1445 catalog_manager.cc:5697] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 2 to 3, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:41.661587  1544 raft_consensus.cc:2955] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.665884  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:41.666759  1539 raft_consensus.cc:3055] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:41.667096  1539 raft_consensus.cc:740] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:41.669242  1539 consensus_queue.cc:260] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:41.670708  1539 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.677495  1539 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:41.662663  1445 catalog_manager.cc:5697] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.681437  1445 catalog_manager.cc:5697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 1 to 3, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 3 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:41.685117  1445 catalog_manager.cc:5697] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:41.682461  2269 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:41.647645  1691 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:41.702272  1588 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:41.703235  1691 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:41.704008  3056 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:41.706480  3056 raft_consensus.cc:697] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:41.712191  3056 consensus_queue.cc:237] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:41.721819  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:41.722569  2269 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.730720  1620 raft_consensus.cc:2955] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.736552  1442 catalog_manager.cc:5697] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 2, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 2 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.730780  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:41.738901  1619 raft_consensus.cc:3055] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:41.739243  1619 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:41.731034  1622 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:41.740109  1619 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:41.741595  1619 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:41.752178  2269 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:41.765344  1662 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:41.767740  2932 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:41.768362  2932 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:41.769500  2932 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:41.780908  1619 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:41.782445  2269 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:41.784866  3156 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:41.787999  1544 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:41.799662  3169 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:41.802102  3211 tablet_replica.cc:333] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:00:41.803267  3211 raft_consensus.cc:2243] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:41.808153  2268 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:41.813023  2271 raft_consensus.cc:2955] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.823597  3131 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:00:41.846333  3211 raft_consensus.cc:2272] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:41.868400  2965 raft_consensus.cc:2955] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.876463  3211 ts_tablet_manager.cc:1916] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:41.879988  2268 raft_consensus.cc:2955] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.881448  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet effd69042c284e8386aafb50372a93b6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:41.897869  1694 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:41.898720  1444 catalog_manager.cc:5697] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:41.912916  1444 catalog_manager.cc:5697] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 1 to 2, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.920063  3211 ts_tablet_manager.cc:1929] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:41.920675  3211 log.cc:1199] T 8a63558e47a84017a3a62f52bb8cb3eb P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/8a63558e47a84017a3a62f52bb8cb3eb
I20260709 13:00:41.922501  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet 8a63558e47a84017a3a62f52bb8cb3eb (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:41.922859  3210 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:41.930711  1539 raft_consensus.cc:2955] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:42.000700  1694 consensus_queue.cc:237] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:42.010587  1622 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:42.010928  1444 catalog_manager.cc:5697] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 3 to 4, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 1 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:42.011188  1694 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:42.013111  2932 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:42.018421  2271 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:42.022782  2932 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:00:42.031626  2268 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:42.038682  3139 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:00:42.047313  3140 raft_consensus.cc:2955] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:42.052659  3142 raft_consensus.cc:2955] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:42.054507  1620 raft_consensus.cc:2955] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:42.060227  2271 raft_consensus.cc:2955] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:42.062019  2268 raft_consensus.cc:2955] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:42.070308  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 75442f7324f24d4494f1ba99a64ed4ac with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:42.072041  1622 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:42.076083  3142 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:42.095358  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 89a432d1e3024e13a2d20229db9a8d85 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:42.097689  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet effd69042c284e8386aafb50372a93b6 with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39234
I20260709 13:00:42.119004  3218 tablet_replica.cc:333] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:00:42.113549  1442 catalog_manager.cc:5697] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.121982  1622 raft_consensus.cc:2955] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:42.124471  1441 catalog_manager.cc:5697] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 4 to 5, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 3 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:00:42.138844  3218 raft_consensus.cc:2243] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:42.139921  3218 raft_consensus.cc:2272] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:42.145510  1430 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 75442f7324f24d4494f1ba99a64ed4ac with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 4 but the committed config has opid_index of 5
I20260709 13:00:42.147796  3218 ts_tablet_manager.cc:1916] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:42.176545  1442 catalog_manager.cc:5697] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index 4 to 5, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.193897  1548 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:42.196033  3161 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:42.197707  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 89a432d1e3024e13a2d20229db9a8d85 with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:35688
I20260709 13:00:42.205871  1534 tablet_service.cc:1558] Processing DeleteTablet for tablet 75442f7324f24d4494f1ba99a64ed4ac with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:35688
I20260709 13:00:42.220718  1619 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:42.223361   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:42.228246  3140 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:42.240899  3218 ts_tablet_manager.cc:1929] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:42.244608  2271 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:42.246075  3218 log.cc:1199] T effd69042c284e8386aafb50372a93b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/effd69042c284e8386aafb50372a93b6
I20260709 13:00:42.247231  3156 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:42.250211  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet effd69042c284e8386aafb50372a93b6 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:42.255378  2268 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:42.264005  3139 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:42.290449  3219 tablet_replica.cc:333] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:00:42.292088  3219 raft_consensus.cc:2243] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:42.297890  3219 raft_consensus.cc:2272] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:42.324092  3219 ts_tablet_manager.cc:1916] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:42.373087  3219 ts_tablet_manager.cc:1929] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:00:42.373675  3219 log.cc:1199] T 89a432d1e3024e13a2d20229db9a8d85 P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/89a432d1e3024e13a2d20229db9a8d85
I20260709 13:00:42.377867  3219 tablet_replica.cc:333] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:00:42.379094  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet 89a432d1e3024e13a2d20229db9a8d85 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:42.420703  3219 raft_consensus.cc:2243] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:42.421654  3219 raft_consensus.cc:2272] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:42.428454   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:42.431910  3219 ts_tablet_manager.cc:1916] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:42.492022  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:42.492708  1622 raft_consensus.cc:606] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:42.495487  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:42.496042  1622 raft_consensus.cc:606] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:42.498442  3219 ts_tablet_manager.cc:1929] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:42.499384  3219 log.cc:1199] T 75442f7324f24d4494f1ba99a64ed4ac P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/75442f7324f24d4494f1ba99a64ed4ac
I20260709 13:00:42.500375  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:42.501269  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet 75442f7324f24d4494f1ba99a64ed4ac (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:00:42.501012  1622 raft_consensus.cc:606] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:42.504753  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:42.505849  1622 raft_consensus.cc:606] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:42.509927  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c033fce18c634feb995adf2f2422308c"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:42.510527  1622 raft_consensus.cc:606] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:42.511812   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:42.513571   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:42.522732  3226 raft_consensus.cc:993] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:42.523247  3161 raft_consensus.cc:1081] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:42.525002  1548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35712
I20260709 13:00:42.525552  1548 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:42.525897  1548 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.532604  1548 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:42.534631  1548 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:42.535482  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:42.536645  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:42.537308  1695 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.536206  1622 raft_consensus.cc:3055] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:42.538539  1622 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:42.540531  1622 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:42.542152  1622 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.545776  1695 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:42.547291  1511 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:42.548293  3114 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:42.548806  3114 raft_consensus.cc:697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:42.549757  3114 consensus_queue.cc:237] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:42.574752  1622 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:43.528540  3237 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.529529  3237 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.588215  3237 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.597882  3247 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.599134  3247 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.605700  3242 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:43.606370  3242 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.608631  3247 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:43.614383  3237 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.615097  3237 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.618497  3237 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.788419  3243 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:43.792490  3241 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:43.792439  3243 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.793255  3241 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.794917  3243 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:43.788775  3231 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.788954  3248 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.790763  3233 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.845188  3233 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.845948  3259 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:43.846557  3259 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.791638  3238 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.678789  3230 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.803340  3244 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:43.796588  3241 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:43.798214  3232 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:43.795086  3239 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.796151  3240 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:43.800110  3234 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.799711  3242 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:43.801791  3235 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:43.801221  3251 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.795997  3253 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.799888  3255 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:43.801033  3249 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.889175  3255 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.872252  3239 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.890122  3249 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.871658  3233 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:43.892521  3249 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:43.803879  3246 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:43.892984  3233 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:43.893898  3246 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.894119  3233 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.818110  3236 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.896620  3233 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.897220  3233 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.800783  3229 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.867125  3248 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.883581  3235 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.898429  3229 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.900801  3248 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:43.901152  3235 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:43.901917  3235 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.902443  3235 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.869776  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:43.878294  3259 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.879671  3261 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:43.880393  3257 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:43.865481  3238 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.867383  3230 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.883563  3253 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.871234  3232 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.932049  3261 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.886097  3258 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.935624  3258 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.865913  3244 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.938493  3253 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:43.939594  3244 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.887384  3250 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:43.869963  3231 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.941213  3238 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:43.942513  3231 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.943758  3230 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.940364  3250 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.943666  3248 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.944839  3248 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.946213  3250 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:43.889258  3252 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:43.946971  3248 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:43.946882  3252 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.948290  3232 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.948488  3235 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.896920  3236 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.833508  3243 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.792454  3237 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.903606  3256 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:43.877748  3240 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.904273  3251 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.892498  3255 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.877833  3234 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.892498  3239 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:43.907164  3249 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:43.908641  3242 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:43.896620  3246 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:43.911762  3145 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.911381  3229 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:43.919850  3254 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.857905  3260 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:43.975940  3247 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:43.981446  3247 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.962481  3237 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.949496  3252 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.968129  3240 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:43.968554  3245 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:43.968828  3261 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.969859  3241 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:43.980158  3145 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.980518  3248 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.981355  3260 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.958948  3243 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:43.961638  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:43.956933  3238 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.996902  3232 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.997645  3231 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:43.897840  3233 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.962874  3256 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.959434  3257 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:44.156891  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:44.375876  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:44.069502  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:44.427672  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:44.522665  1544 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 1.
I20260709 13:00:44.054685  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:44.287138  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:43.966604  3239 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:44.373826  3236 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.969978  3244 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:44.374393  3274 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:44.375341  3270 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:44.090775  3269 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:44.090385  3258 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:44.088536  3237 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:44.547711  3256 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:43.965569  3250 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:44.435650  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:44.435230  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:44.377664  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:43.970533  3242 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:43.967036  3249 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:44.526670  1688 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 1.
I20260709 13:00:44.851975  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:00:44.801102  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 281661us
W20260709 13:00:44.808758  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 109586us
I20260709 13:00:44.093938  1442 catalog_manager.cc:5697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 3, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 3 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:44.863869  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:44.847061  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:44.852000  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:44.760365  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:00:44.683631  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 247852us
I20260709 13:00:44.808527  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:44.084815  3252 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:44.861361  1616 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:44.967885  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.077260  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.077391  1692 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:45.077601  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.077864  1619 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:45.078181  1616 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:44.970094  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.078898  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:45.015102  1513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.010s	sys 0.052s
I20260709 13:00:44.089900  3234 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.054507  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:44.293762  3263 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:45.079169  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:44.926059  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:44.926514  3265 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:44.962941  3277 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:44.374368  3273 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:45.107513  3265 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:44.526880  3251 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.108206  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:44.873790  3239 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:44.896981  3269 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.109809  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.110462  1541 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:45.110847  3265 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.066061  3297 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:00:44.808930  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe400 after lost signal to thread 433
I20260709 13:00:45.017534  3284 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:44.052696  3240 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:44.000499  3259 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.075001  1547 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:44.617591  3261 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.113097  3284 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.113195  3240 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.113790  3261 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.114596  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:45.065871  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 256066us
W20260709 13:00:45.112447  1513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.010s	sys 0.058s
I20260709 13:00:45.117156  3240 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:45.072420  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.118070  3240 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:44.897799  3279 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:44.068773  3266 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:44.549674  3257 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.118983  3279 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:44.550086  3238 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.120191  3266 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:44.092890  3255 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:45.122566  3266 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.122520  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1218) took 1010 ms. Trace:
I20260709 13:00:44.885425  3250 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.107883  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.126430  1621 rpcz_store.cc:276] 0709 13:00:44.112093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.112280 (+   187us) service_pool.cc:224] Handling call
0709 13:00:44.265713 (+153433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.121463 (+855750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.121502 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.121553 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:45.121597 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.122260 (+   663us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b5400115154. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:45.122307 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.122453 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967486208}
I20260709 13:00:45.123183  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:44.092070  3235 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:45.125828  3252 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:44.794096  3232 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.128686  3235 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.108876  3251 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:45.130502  3251 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:44.677008  3231 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.133106  3231 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:44.053938  3245 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:44.375934  3272 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.134330  3272 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.135241  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1217) took 1064 ms. Trace:
I20260709 13:00:45.135757  3245 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:44.928110  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 65941.6us
I20260709 13:00:44.999044  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:44.148499  3253 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:44.061218  3246 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:44.925179  3270 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:44.717909  3248 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:44.374832  3264 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:44.873977  3260 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.111956  3269 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.111922  3239 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:44.677094  3241 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:44.877470   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:45.128302  3234 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.135910  1620 rpcz_store.cc:276] 0709 13:00:44.070487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.071875 (+  1388us) service_pool.cc:224] Handling call
0709 13:00:44.072236 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.134330 (+1062094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.134360 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.134401 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:45.134431 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.134998 (+   567us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400067554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:45.135041 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.135154 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2442127104}
I20260709 13:00:44.548540  3243 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:43.992832  3254 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.112027  3297 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:44.933035  3278 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.123461  3255 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:44.375003  3268 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:45.084538  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.118845  3240 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.265981  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:45.328642  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe720 after lost signal to thread 1480
I20260709 13:00:44.865424  1542 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:45.247617  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:00:45.155540  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 77358.2us
I20260709 13:00:45.149667  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.028626  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 483) took 1106 ms. Trace:
I20260709 13:00:45.273010  3232 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:45.191049  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 53730.8us
I20260709 13:00:45.325055  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.271730  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:44.965852  3276 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:44.085151  3262 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:44.085561  3267 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:44.089125  3247 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.139330  1540 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:45.130555  3252 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:44.143566  3229 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:45.107877  3277 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:44.953243  3282 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:45.331622  1541 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:45.139325  1619 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:45.122479  3238 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:00:45.052867  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.014s	sys 0.021s
W20260709 13:00:45.312148  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 449019us
I20260709 13:00:45.066742  3145 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:00:45.256351  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.340293  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.255682  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.191244  3284 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:00:45.341595  1718 debug-util.cc:398] Leaking SignalData structure 0x7b0800083ce0 after lost signal to thread 1572
I20260709 13:00:45.133474  3251 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:45.342154  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:45.133371  3235 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.363924  1691 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:45.325281  3255 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.373831  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.025254  3249 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:44.458998  3271 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:45.023247  3291 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.376561  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 485) took 1447 ms. Trace:
I20260709 13:00:45.378214  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.344727  3234 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.016595  3275 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:45.289996  3293 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:45.411043  3247 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.535008  2270 rpcz_store.cc:276] 0709 13:00:43.929239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.929471 (+   232us) service_pool.cc:224] Handling call
0709 13:00:43.929840 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.373787 (+1443947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.373815 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.373855 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:45.373886 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.376268 (+  2382us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400567054. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:45.376306 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.376412 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3320290560}
I20260709 13:00:45.380131  2234 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:45.337482  2267 rpcz_store.cc:276] 0709 13:00:43.922252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.922401 (+   149us) service_pool.cc:224] Handling call
0709 13:00:43.922729 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.810355 (+887626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.842070 (+ 31715us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.846780 (+  4710us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:44.847589 (+   809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.028221 (+180632us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b54004e0554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:45.028304 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.028511 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1930152320}
I20260709 13:00:45.381901  3231 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:45.533434  1690 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:45.385509  3254 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.015882  3280 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:45.388270  3248 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:45.389870  3240 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:45.248504  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.128322  3250 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.390905  1511 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:00:45.552886  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 162108us
I20260709 13:00:44.967793  3233 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.027171  3242 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:45.303965  3256 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:45.340441  1614 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:45.271893  3272 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:45.256325  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.117151  3261 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.264820  3279 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.542482  3236 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:00:45.534758  1718 debug-util.cc:398] Leaking SignalData structure 0x7b0800197c40 after lost signal to thread 1647
I20260709 13:00:45.113372  3259 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:45.540607  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 160546us
I20260709 13:00:45.399468  3229 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.541538  3252 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:45.345299  3274 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.534546  2232 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:45.344985  3278 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.341954  3253 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:45.413674  1514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.537s (SENT) [suppressed 1 similar messages]
I20260709 13:00:45.340118  3246 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.573398  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.342453  3268 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.550829  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.361562  3244 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.108254  3263 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.556255  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.108484  3273 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.411019  3277 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:45.401170  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.306s	user 0.018s	sys 0.029s
I20260709 13:00:45.561586  1661 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:00:45.581485  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 1.48665e+06us
I20260709 13:00:45.581928  1661 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:45.545405  3145 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:45.566835  1718 debug-util.cc:398] Leaking SignalData structure 0x7b0800241680 after lost signal to thread 1721
I20260709 13:00:45.374320  3262 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.585206  3243 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:45.585311  3145 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:45.585239  1661 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:45.372641  3276 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.585695  3243 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.587766  3243 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.588996  2272 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:45.542408  3247 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.539033  3239 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:45.401234  3267 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.584676  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1231) took 1531 ms. Trace:
I20260709 13:00:45.579128  3279 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:45.411325  3282 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.556856  3235 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:45.590730  1718 debug-util.cc:398] Leaking SignalData structure 0x7b0800385b00 after lost signal to thread 2296
I20260709 13:00:45.578991  3250 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:45.592808  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.594081  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.536471  3275 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.585700  3274 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:45.597177  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.601877  2231 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:45.340867  3264 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.604447  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.605022  1695 rpcz_store.cc:276] 0709 13:00:44.053194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.053395 (+   201us) service_pool.cc:224] Handling call
0709 13:00:44.375399 (+322004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.583675 (+1208276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.583703 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.583745 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:45.583785 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.584346 (+   561us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001289d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:45.584486 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.584603 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2778259712}
I20260709 13:00:45.605572  3279 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.621848  1548 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 1.
I20260709 13:00:45.550771  3231 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.592576  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:45.607034  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:45.559703  3256 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.572113  3236 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.623150  2270 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:45.611837   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:45.537752  3271 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.615684  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.582253  3255 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:45.590179  3251 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:45.662520  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.621135  3297 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:45.591287  3145 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.624782  1511 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:45.635994  3270 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.663209  1697 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:45.636197  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.636832  3299 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:45.625500  3279 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.641299  3231 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.642007  3246 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.578317  3252 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.683799  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.653839  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.653208  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.644304  3269 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:45.662268  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.559175  3280 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.663901  1511 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:45.611191  3239 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.611119  3235 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.696045  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.532351  3291 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.612156  3238 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:45.670588  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:45.671689  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 134143us
I20260709 13:00:45.672060  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.702073  1690 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:45.672451  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.671669  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:45.674953  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 261336us
I20260709 13:00:45.622876  3241 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.678715  3234 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.626638  3249 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:45.662608  3245 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:45.660753  1513 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:00:45.685303  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 100133us
I20260709 13:00:45.718837  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.719687  1614 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:45.536484  3293 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.690346  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.690512  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.722959  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.723646  1697 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:45.692225  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:45.687758  1689 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:45.693178  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.662853  3251 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.669256  3258 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:45.667141  3255 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.699523  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.669975  3299 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.624929  3250 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.686774  3269 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.689570  3246 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:45.701292  3284 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:45.705144  1511 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:45.716028  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1212) took 1741 ms. Trace:
I20260709 13:00:45.708468  3238 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.689968  1545 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:45.699075  3235 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.723713  1620 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 1.
I20260709 13:00:45.725536  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.775893  1689 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:45.693460  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.727528  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:45.723023  1694 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:45.741168  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:00:45.746188  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 48587.4us
W20260709 13:00:45.746218  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 85541.3us
I20260709 13:00:45.747469  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1183) took 1210 ms. Trace:
I20260709 13:00:45.748380  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.706238  3276 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.750278  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1188) took 1185 ms. Trace:
I20260709 13:00:45.752753  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.758112  1622 rpcz_store.cc:276] 0709 13:00:43.974953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.975393 (+   440us) service_pool.cc:224] Handling call
0709 13:00:43.975808 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.603967 (+1628159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.603999 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.604046 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:45.604073 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.715612 (+111539us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400316854. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:45.715698 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.715925 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3743933824}
I20260709 13:00:45.745738  3251 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.765271  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.771363  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:45.762738  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 56913.3us
I20260709 13:00:45.779597  1539 rpcz_store.cc:276] 0709 13:00:44.522307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.522740 (+   433us) service_pool.cc:224] Handling call
0709 13:00:44.523050 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.627369 (+1104319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.627479 (+   110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.627538 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:45.627583 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.732016 (+104433us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540023fad4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:45.732080 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.732256 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2538896256}
I20260709 13:00:45.783346  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.779834  1546 rpcz_store.cc:276] 0709 13:00:44.552558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.552681 (+   123us) service_pool.cc:224] Handling call
0709 13:00:44.761750 (+209069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.606761 (+845011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.606805 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.606857 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:45.606900 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.737714 (+130814us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54000c2954. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:45.737793 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.737929 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1942758656}
I20260709 13:00:45.746312  3258 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.746129  3231 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:45.799446  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.800194  1618 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:45.800902  3273 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.801939  3267 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.751633  3261 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:45.760049  3269 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.767910  3253 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.827473  3275 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.827852  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:45.828241  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.828958  1690 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:45.829895  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.805555  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:45.749665  3264 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.809162  3258 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.812568  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.724593  3245 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.753057  3299 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.743568  3249 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.820060  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.816669  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:45.824194  1623 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:45.759105  3284 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.802160  1547 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:45.834826  1511 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:45.815965  3285 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:45.846731  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.840054  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:45.779629  3246 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.848311  3256 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.826316  3229 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.849824  3250 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.852325  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:45.827272  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:45.819205  3277 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:45.873219  3277 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.857024  1690 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:45.819257  3261 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:00:45.864219  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 86580.1us
I20260709 13:00:45.843895  3284 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.867087  1689 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:45.842046  3244 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.866727  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:45.877106  3261 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:45.817833  3231 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.885340  3229 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:45.885943  3229 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.842388  3270 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:45.887939  3270 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.888480  3270 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.889523  3259 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.845678  3264 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:45.893712  3264 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.894227  3264 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:45.897264  1548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53718 (request call id 139) took 1837 ms (client timeout 1517 ms). Trace:
I20260709 13:00:45.845242  3285 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:45.842171  3305 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:45.886435  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.913877  3244 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:45.921083  3305 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:45.921252  3244 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.921981  3276 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:45.875619  1588 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:00:45.914384  1548 rpcz_store.cc:269] 0709 13:00:44.060257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.060993 (+   736us) service_pool.cc:224] Handling call
0709 13:00:45.897010 (+1836017us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540027c9d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:45.897158 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2528756608}
I20260709 13:00:45.917740  3247 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:45.918599  3285 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:45.878856  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:45.919596  3252 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.919813  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:45.936975  3250 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:45.922518  3276 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:45.938771  3293 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:45.939738  3291 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:45.944139  3277 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.946864  3262 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:45.913514  3236 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.872694  3280 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:45.984412  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:45.983073  3250 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:45.990353  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1187) took 1438 ms. Trace:
I20260709 13:00:45.981928  3278 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:00:45.923209  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 47732.3us
I20260709 13:00:46.001287  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1240) took 1034 ms. Trace:
I20260709 13:00:46.028436  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:46.205463  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.115731  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.117821  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.204304  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.026654  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2055) took 1003 ms. Trace:
W20260709 13:00:46.037668  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 176663us
I20260709 13:00:46.115195  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.031510  3263 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.037066  3268 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:46.040654  3258 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:46.205096  1694 rpcz_store.cc:276] 0709 13:00:44.966842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.969815 (+  2973us) service_pool.cc:224] Handling call
0709 13:00:46.001047 (+1031232us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54001603d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:46.001202 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480368000}
I20260709 13:00:46.026194  3250 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.225198  1540 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:00:46.112612  3309 log.cc:927] Time spent T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:00:46.239637  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.249225  1617 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:46.118085  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.256320  1615 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:46.068071  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:46.210404  1541 rpcz_store.cc:276] 0709 13:00:45.022816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.412828 (+390012us) service_pool.cc:224] Handling call
0709 13:00:45.898202 (+485374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.898417 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.898455 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.898508 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:45.898541 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.898613 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.026439 (+127826us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b540027c9d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:46.026582 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1115588864}
I20260709 13:00:46.230422  2234 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:46.275856  3245 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.277237  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.223011  2270 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:46.204417  3305 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.303666  3277 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:46.108309  3249 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:46.112347  3238 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:46.111969  3255 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.349982  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:46.363655  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 133311us
I20260709 13:00:46.365216  2234 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:46.366926  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.113130  3244 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:46.368918  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:00:46.373904  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 158151us
W20260709 13:00:46.353009  1513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.000s	sys 0.020s
W20260709 13:00:46.443866  1513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.000s	sys 0.021s
I20260709 13:00:46.210095  1543 rpcz_store.cc:276] 0709 13:00:44.552189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.660483 (+108294us) service_pool.cc:224] Handling call
0709 13:00:44.843863 (+183380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.679311 (+835448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.683500 (+  4189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.691220 (+  7720us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:45.694091 (+  2871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.990054 (+295963us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54000a7dd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:45.990117 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.990289 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890566528}
I20260709 13:00:46.445525  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.445920  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.446831  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.447059  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.451319  1619 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
W20260709 13:00:46.453722  3235 consensus_meta.cc:287] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.641s	user 0.035s	sys 0.046s
W20260709 13:00:46.454532  3145 consensus_meta.cc:287] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.775s	user 0.007s	sys 0.002s
I20260709 13:00:46.454217  3235 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:46.450524  1623 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:46.459470  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.376616  3277 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:46.466430  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.475878  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.454954  3145 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.459885  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.476274  2268 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:46.477995  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.478540  1623 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:46.449105  3246 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:46.462924  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.463928  3282 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:46.485562  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.487169  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.489609  1623 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:46.492528  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:46.493446  1619 raft_consensus.cc:606] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:46.474550  3277 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:00:46.498456  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.501618  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.498342  3235 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.500079  2269 raft_consensus.cc:2393] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:00:46.500289  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.504081  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.504530  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.507200  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:46.506248  2232 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:46.508153  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.531595  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.504932  3277 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.533524  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.532011  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.538679  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.544719  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:00:46.545452  3285 consensus_meta.cc:287] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.012s
I20260709 13:00:46.545910  3285 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:46.542384  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.532837  3253 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:46.556419  3239 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:46.558523  1662 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:46.559309  3282 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:46.559754  3282 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:46.560245  3282 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.560645  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.561772  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.562312  1691 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:46.563066  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.564963  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.565675  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.566015  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.566642  1694 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:46.567052  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:46.567512  3279 consensus_meta.cc:287] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.882s	user 0.020s	sys 0.031s
I20260709 13:00:46.567905  3279 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.568102  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.568724  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.569341  1691 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:46.568261  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.570024  3279 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:46.570158  1690 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:46.560014  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.570720  2272 raft_consensus.cc:1240] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:46.571364  1697 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:46.579560  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.580529  1615 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:46.581622  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.582767  3282 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.583333  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.585965  3282 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:46.587381  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:46.591527  3243 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.003s	user 0.011s	sys 0.058s
I20260709 13:00:46.592132  3243 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:46.593679  1695 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:46.595885  3243 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:00:46.600184  3264 consensus_meta.cc:287] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.010s
I20260709 13:00:46.600737  3264 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:46.603073  3264 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.604790  3145 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.621001  1662 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:46.622426  3254 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:46.623292  3285 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:46.629271  3284 consensus_meta.cc:287] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.705s	user 0.018s	sys 0.010s
I20260709 13:00:46.629993  3229 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.689453  3231 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:46.690584  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1251) took 1037 ms. Trace:
I20260709 13:00:46.692199  1695 rpcz_store.cc:276] 0709 13:00:45.652768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.652927 (+   159us) service_pool.cc:224] Handling call
0709 13:00:46.690301 (+1037374us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b540022f954. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:46.690512 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088295808}
W20260709 13:00:46.659601  3269 consensus_meta.cc:287] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.824s	user 0.032s	sys 0.032s
I20260709 13:00:46.660327  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:00:46.662587  3251 consensus_meta.cc:287] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.856s	user 0.008s	sys 0.019s
W20260709 13:00:46.671811  3299 consensus_meta.cc:287] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.806s	user 0.019s	sys 0.014s
W20260709 13:00:46.681023  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 121654us
I20260709 13:00:46.693722  1692 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:46.641683  3261 consensus_meta.cc:287] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.751s	user 0.018s	sys 0.025s
I20260709 13:00:46.720112  3261 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.721871  3305 raft_consensus.cc:993] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:46.722391  3305 raft_consensus.cc:1081] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:46.722739  3261 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:00:46.698731  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 249262us
I20260709 13:00:46.690729  3243 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:46.704696  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.716084  1662 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:00:46.703788  1661 connection.cc:256] RPC call timeout handler was delayed by -1.0823652319999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260709 13:00:46.717808  3271 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:46.717656  3251 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:46.692375  3254 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.704564  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.728470  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.737455  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.738134  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.738366  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.731202  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.731202  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.732580  2234 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:46.733208  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.739266  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.739578  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.740156  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.740283  1619 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:46.741925  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.742766  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:46.743366  2272 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:46.744321  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.745357  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.697402  3284 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:46.707314  3277 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.748019  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:46.748422  2234 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:46.749094  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.747040  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:46.703188  3269 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.734404  3282 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:46.759809  3255 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:46.760273  3255 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:46.760521  2271 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:46.760727  3255 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.723546  3299 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:46.762207  3269 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.751248  3266 consensus_queue.cc:1059] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:00:46.764525  3266 raft_consensus.cc:3055] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:46.754299  3314 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:46.765187  1586 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:46.766543  1586 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:46.767627  3245 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:46.768349  3245 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:46.768836  3254 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.769167  3266 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:46.754379  2268 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:46.755836  1615 raft_consensus.cc:606] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:46.770361  3266 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:46.758857  3270 consensus_meta.cc:287] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.870s	user 0.028s	sys 0.036s
I20260709 13:00:46.759392  3251 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:46.764726  3284 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.765398  3314 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:46.771242  1696 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:46.779917  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.750609  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:46.763238  3299 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:46.756537  1693 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:46.772744  2272 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:46.732134  3243 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:46.773588  1662 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:46.783521  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.789117  1662 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:46.774061  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.776836  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.724675  3250 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.780000  3270 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:46.793721  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.793546  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:46.795051  3270 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.795328  3250 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:46.778549  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:46.781888  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.782179  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:46.784050  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.797504  1618 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:46.785434  3258 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.794562  1616 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:46.786077  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.786576  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 493) took 1096 ms. Trace:
I20260709 13:00:46.799147  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:46.799520  2271 rpcz_store.cc:276] 0709 13:00:45.690878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.691037 (+   159us) service_pool.cc:224] Handling call
0709 13:00:45.946469 (+255432us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b580000ff98. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19eee 0000000000375939 00007f5c6fa8d1e0 00007f5c6fb560c4 00007f5c6fb56131 00007f5c6fb17fc0 00007f5c6fb02929 00007f5c6fb023d2 00007f5c69079bd4
0709 13:00:46.056392 (+109923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.760963 (+704571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.786356 (+ 25393us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b5400572e54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:46.786519 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1623976960}
I20260709 13:00:46.796362  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2104) took 1076 ms. Trace:
I20260709 13:00:46.775836  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.800199  1615 raft_consensus.cc:606] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:46.802521  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:46.800619  1692 rpcz_store.cc:276] 0709 13:00:45.720131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.987166 (+267035us) service_pool.cc:224] Handling call
0709 13:00:46.693433 (+706267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.709373 (+ 15940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.796175 (+ 86802us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540022f950. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:46.796299 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1544339712}
I20260709 13:00:46.791487  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:46.809569  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.809983  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.810475  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1252) took 1157 ms. Trace:
I20260709 13:00:46.810796  1693 rpcz_store.cc:276] 0709 13:00:45.653119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.653330 (+   211us) service_pool.cc:224] Handling call
0709 13:00:46.810239 (+1156909us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002503d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:46.810392 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2418559744}
I20260709 13:00:46.814013  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 487) took 1239 ms. Trace:
I20260709 13:00:46.814417  2269 rpcz_store.cc:276] 0709 13:00:45.575101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.579600 (+  4499us) service_pool.cc:224] Handling call
0709 13:00:46.813801 (+1234201us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54006108d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:46.813928 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2010106624}
I20260709 13:00:46.814774  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.815516  2265 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:46.782207  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.808799  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.800176  3243 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.781123  3314 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.835443  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.869160  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.822079  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:46.834697  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.870090  1623 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:46.835017  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:46.822881  1696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1253) took 1169 ms (client timeout 1500 ms). Trace:
I20260709 13:00:46.835791  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.869676  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:46.841326  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:46.823925  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:46.823210  1688 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:46.836199  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.861325  1615 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:46.836676  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.826097  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:46.864725  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.822232  1689 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:46.865535  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.802111  3239 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:46.802002  3299 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:46.870402  1620 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:46.890856  2267 raft_consensus.cc:2393] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:00:46.914043  3299 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:46.915273  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.832813  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 372) took 1138 ms. Trace:
I20260709 13:00:46.915993  3299 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.918025  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.919492  1621 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:46.920205  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.920742  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.921361  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.921797  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:00:46.890650  1513 consensus_peers.cc:597] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a34da7993e4fee9ff4fc1266a6af38. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:46.821879  3266 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:46.923081  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 48610.8us
I20260709 13:00:46.824852  3277 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.841828  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:00:46.932288  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.936978  3268 consensus_queue.cc:1059] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:46.934109  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.938220  3268 raft_consensus.cc:3055] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:46.938714  3268 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:46.938762  1615 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:46.818713  3255 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.941414  3268 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.944790  3268 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:46.917433  1696 rpcz_store.cc:269] 0709 13:00:45.653484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.653608 (+   124us) service_pool.cc:224] Handling call
0709 13:00:46.822653 (+1169045us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400097ed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:46.822807 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2497561856}
I20260709 13:00:46.916443  2265 rpcz_store.cc:276] 0709 13:00:45.694110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.708972 (+ 14862us) service_pool.cc:224] Handling call
0709 13:00:46.815296 (+1106324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.815930 (+   634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.832580 (+ 16650us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54006108d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:46.832752 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2403650816}
I20260709 13:00:46.947122  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.947981  1621 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:46.948239  3251 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:46.949213  3282 raft_consensus.cc:3055] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:46.823360  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:46.916042  1620 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:46.897069  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52808 (request call id 195) took 2812 ms. Trace:
I20260709 13:00:46.949717  3282 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:46.950789  3282 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.917585  3239 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:46.943351  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.926172  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2110) took 1126 ms. Trace:
I20260709 13:00:46.821659  3276 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:46.935612  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2103) took 1216 ms. Trace:
I20260709 13:00:46.952589  3282 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.965885  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.967044  1619 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:46.967638  1614 raft_consensus.cc:606] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:46.956875  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.968339  1614 raft_consensus.cc:614] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:46.957718  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.956468  1689 rpcz_store.cc:276] 0709 13:00:45.799768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.224506 (+424738us) service_pool.cc:224] Handling call
0709 13:00:46.822043 (+597537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.913879 (+ 91836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.925884 (+ 12005us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54002503d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:46.926093 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1373463936}
I20260709 13:00:46.967444  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:46.958490  3314 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.956338  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:46.973033  2266 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:46.954711  2268 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:46.956223  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:46.974720  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:46.957562  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 172744us
I20260709 13:00:46.976464  1511 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:46.976760  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.977412  1511 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:46.977664  3251 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:46.978343  3251 consensus_queue.cc:1059] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:46.978746  1511 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:46.978883  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.979354  3251 raft_consensus.cc:3055] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:46.972452  2264 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:46.979876  3258 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:46.956323  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:46.974145  1661 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:46.981258  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:46.983733  1661 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:46.981132  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:46.980466  3236 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:46.953236  3239 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.990137  3236 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:46.990614  3236 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.993324  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:46.994784  3271 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:46.995203  3271 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:46.995632  3271 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.995484  3232 consensus_queue.cc:1059] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:46.996084  3259 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:46.996551  3259 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:46.996937  3259 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.997150  3232 raft_consensus.cc:3055] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:46.997551  3232 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:46.994797  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.005195  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:46.950181  1442 rpcz_store.cc:276] 0709 13:00:44.084654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.085329 (+   675us) service_pool.cc:224] Handling call
0709 13:00:46.896987 (+2811658us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:45.542039 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:45.612240 (+ 70201us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:45.615486 (+  3246us) write_op.cc:435] Acquired schema lock
0709 13:00:45.619767 (+  4281us) tablet.cc:662] Decoding operations
0709 13:00:45.683194 (+ 63427us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:45.683273 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:45.683309 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:45.705516 (+ 22207us) tablet.cc:701] Row locks acquired
0709 13:00:45.708618 (+  3102us) write_op.cc:260] PREPARE: finished
0709 13:00:45.736505 (+ 27887us) write_op.cc:270] Start()
0709 13:00:45.751933 (+ 15428us) write_op.cc:276] Timestamp: P: 1783602045727034 usec, L: 0
0709 13:00:45.758209 (+  6276us) op_driver.cc:348] REPLICATION: starting
0709 13:00:45.848528 (+ 90319us) log.cc:844] Serialized 541 byte log entry
0709 13:00:46.714369 (+865841us) op_driver.cc:464] REPLICATION: finished
0709 13:00:46.891247 (+176878us) write_op.cc:301] APPLY: starting
0709 13:00:46.891333 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:46.891458 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:46.891583 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:46.891804 (+   221us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:46.892058 (+   254us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:46.892102 (+    44us) write_op.cc:312] APPLY: finished
0709 13:00:46.892284 (+   182us) log.cc:844] Serialized 23 byte log entry
0709 13:00:46.892476 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:46.892552 (+    76us) write_op.cc:454] Released schema lock
0709 13:00:46.892592 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:46.892921 (+   329us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:46.892959 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":176606,"apply.run_cpu_time_us":1673,"apply.run_wall_time_us":1678,"num_ops":1,"prepare.queue_time_us":402151,"prepare.run_cpu_time_us":16927,"prepare.run_wall_time_us":563200,"raft.queue_time_us":463911,"raft.run_cpu_time_us":6518,"raft.run_wall_time_us":98292,"replication_time_us":944590,"thread_start_us":821077,"threads_started":4,"wal-append.queue_time_us":141788}]]}
I20260709 13:00:47.010524  2234 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:46.957453  1688 rpcz_store.cc:276] 0709 13:00:45.719635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.944880 (+225245us) service_pool.cc:224] Handling call
0709 13:00:46.823019 (+878139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.918188 (+ 95169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.935323 (+ 17135us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b5400097ed0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:46.935537 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2018608000}
I20260709 13:00:47.015765  3239 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:47.016026  3232 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:47.017445  3232 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:46.958958  3243 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:46.999516  3273 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:00:47.020622  3243 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:47.020854  3285 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:46.967679  3255 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:46.987541  3258 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:47.022324  3258 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.022745  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:47.023288  3314 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:47.024959  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:46.989008  3234 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.026986  3234 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:47.027053  3145 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:46.989465  3310 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.027405  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:47.027866  3145 raft_consensus.cc:697] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:47.028257  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:46.979974  3251 raft_consensus.cc:740] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:47.029811  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:47.029982  3251 consensus_queue.cc:260] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:47.029003  3145 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:47.036346  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:47.048174  1616 raft_consensus.cc:606] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.038821  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:47.039963  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.040511  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.040676  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.042574  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.042647  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.055727  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.035992  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:47.044939  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.056821  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.057457  1545 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:47.044530  1695 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:47.045430  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:47.046339  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.035502  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:47.000070  3282 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.068898  3282 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:47.069491  3271 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.070778  3239 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:47.027586  3234 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.053360  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.073781  1541 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 2: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:47.075775  1539 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:47.076047  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.053505  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:00:47.053987  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 64286.3us
I20260709 13:00:47.079717  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:47.079985  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:47.031383  3251 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.069509  3282 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.059842  3318 consensus_queue.cc:1059] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:47.063619   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:47.065644  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.067751  1548 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:47.089686  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.092312   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:47.098403  1543 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:47.100044  3258 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.100112  3236 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.102516  3258 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:47.106630  3282 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.107756  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:47.108086  1540 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 2: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:47.079109  3259 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:47.109719  3271 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:47.110817  3236 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:47.111534  3243 raft_consensus.cc:3055] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:00:47.116092  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.118835  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:47.130206  3310 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.136031  3285 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:47.117717  3243 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:47.147485  1540 raft_consensus.cc:1240] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:47.148432  3243 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:47.149392  3255 consensus_queue.cc:1059] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:47.150488  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:47.152055  3281 raft_consensus.cc:3055] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:47.152490  3281 raft_consensus.cc:740] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:47.153542  3281 consensus_queue.cc:260] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:47.154098  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:47.154639  3281 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.159621  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:47.166545  1540 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.168157  1541 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:47.168939  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.169235  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.170989  1539 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.171794  1547 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:47.167824  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.172891  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.173202  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.171828  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.170192  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.177773  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.179180  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.183264  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.188141  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.188930  1543 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:47.116905  3259 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:47.191540  3234 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.192443  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.192556  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.193800  3234 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:47.194427  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.196007  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:47.196123  3239 consensus_queue.cc:1059] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:47.200107  1544 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.150533  3243 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.203644  1661 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:47.204938  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.208367  3251 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:47.208920  3251 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:47.209406  3251 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.211923  3318 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.213757  3239 raft_consensus.cc:3055] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:47.214288  3239 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:47.195514  3282 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:47.216938  3239 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:47.217809  1514 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.218915  3232 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.219477  3232 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:47.219929  3232 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.223840  1661 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:47.224494  3234 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:47.225302  3318 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.225898  3318 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:47.226367  3318 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.227335  1514 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.229348  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.234030  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:47.236893  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.237128  3236 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.219146  3239 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.238440  2231 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.239686  3255 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:47.238961  1443 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 2 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:47.240533  3255 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.244272  2231 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.243016  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:47.245508  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.246107  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.250166  2231 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.251878  3253 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:47.248699  3232 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.256271  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:47.256951  1546 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.257287  1586 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:47.258217  1586 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.259862  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:47.261644  2231 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.263013  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:47.263964  3285 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.265580  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:47.265772  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:47.265776  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.266251  1542 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.266546  1548 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.266716  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:47.267592  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:47.268672  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:47.269071  2231 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.269701  1545 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 2: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:47.271765  1586 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:47.272434  1539 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:47.273068  1546 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:00:47.276918  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.278841  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.279913  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:47.280438  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.249182  3234 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.292604  2231 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.294888  1544 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:47.284437  1514 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.297214  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.267594  3266 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:47.289249  3232 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:47.267482  3236 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.267809  3279 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.267666  3268 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:47.318244  3268 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:47.318764  3268 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.288501  1548 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:47.271245  3250 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.321547  3250 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:47.322111  3250 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:47.322664  3250 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.305435  3253 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.298861  3269 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:47.304442  3309 log.cc:927] Time spent T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:00:47.275540  3145 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.303745  3266 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:47.327839  3266 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.284803  3314 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.291282  3258 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.332201  3258 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:47.332600  3258 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.304098  3235 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.333104  3235 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:47.333534  3235 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.291489  3285 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:47.340474  3285 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:47.340873  3285 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:47.342000  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.302716  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.290990  3310 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.343700  3310 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:47.344085  3310 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.309827  3251 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:47.351840  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 49236.5us
I20260709 13:00:47.284610  3276 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:47.311139  1542 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:47.356863  3276 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:47.357105  3232 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:47.357416  3276 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.357206  1514 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.361225  3236 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:47.361598  3236 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:47.361984  3236 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.363214  1693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39238
I20260709 13:00:47.364297  1693 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:47.364713  1693 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.364918  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:47.369285  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 191896us
I20260709 13:00:47.372148  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:47.373242  1689 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:47.353191  3259 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:47.381980  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.380348  1514 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.383937  1442 catalog_manager.cc:5697] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 1 to 2, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.387568  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:47.389523  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:47.396590  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.399135  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:47.408273  1697 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.413615  3243 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.369048  3318 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.427021  3318 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:47.428985  3268 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.429656  3250 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:47.434852  1694 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
W20260709 13:00:47.436823  1587 connection.cc:256] RPC call timeout handler was delayed by -1.4160734500000558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 13:00:47.437402  1587 connection.cc:256] RPC call timeout handler was delayed by -1.2675734500000431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
W20260709 13:00:47.439862  1587 connection.cc:256] RPC call timeout handler was delayed by -1.2072734500000593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
I20260709 13:00:47.436064  1693 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.438374  1689 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:47.438256  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 57966.6us
I20260709 13:00:47.444525  1693 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:47.431041  3268 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:47.445441  1696 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 5. Ops: []
W20260709 13:00:47.440589  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 168895us
W20260709 13:00:47.446676  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 149368us
I20260709 13:00:47.455637  1586 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:47.455698  2231 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.465384  3330 ts_tablet_manager.cc:933] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:00:47.472688  3330 tablet_copy_client.cc:323] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.129:46597
I20260709 13:00:47.445513  3232 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.481834  3326 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.492455  3266 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:47.504282  3251 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:47.504719  3250 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:47.515219  2231 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.522615  2231 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:47.523681  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 151402us
I20260709 13:00:47.530031  1663 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:00:47.511643  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 69698.4us
I20260709 13:00:47.511055  1690 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
W20260709 13:00:47.530936  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 134449us
I20260709 13:00:47.532102  1661 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:47.534386  1663 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:47.535177  3328 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.535308  3251 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.537611  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.539800  1663 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:47.523564  3281 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.543874  1661 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:47.542948  1663 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:47.544234  3323 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:47.541046  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 85490.7us
I20260709 13:00:47.546088  1661 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:47.546890  1663 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:47.531708  3325 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:47.537321  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:47.559492  2231 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:47.540295  3326 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.561657  2231 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:47.562853  1542 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.544363  3328 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:47.547608  3318 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.546298  3271 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.545802  3329 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:47.533267  3258 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.557611  3325 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:47.587656  3325 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.590341  3236 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.591147  3258 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:47.560139  3243 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:47.573886  3254 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:47.572337  3281 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:47.592535  3243 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:47.586690  3328 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:47.610724  3281 raft_consensus.cc:697] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:47.612176  3281 consensus_queue.cc:237] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:47.612948  3310 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.570622  3305 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:00:47.616050  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:47.616991  3305 raft_consensus.cc:993] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:47.617633  3305 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:47.618163  3305 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:47.572621  3282 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.605312  2264 raft_consensus.cc:1240] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.558516  3331 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:00:47.619061  3243 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.606160  1558 tablet_copy_service.cc:140] P 44c8c572048a40b1a5e71865068ed1bb: Received BeginTabletCopySession request for tablet 11a34da7993e4fee9ff4fc1266a6af38 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:53718)
I20260709 13:00:47.620169  3331 raft_consensus.cc:1081] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:47.606767  3332 consensus_queue.cc:1059] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:00:47.621213  1558 tablet_copy_service.cc:161] P 44c8c572048a40b1a5e71865068ed1bb: Beginning new tablet copy session on tablet 11a34da7993e4fee9ff4fc1266a6af38 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:53718: session id = e37b8013aec24431a6672a857806329e-11a34da7993e4fee9ff4fc1266a6af38
I20260709 13:00:47.622063  3331 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:47.622622  3331 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:47.624017  1619 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:47.595811  3329 raft_consensus.cc:697] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:47.624976  3276 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:47.625157  3329 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.608116  3266 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:47.625432  1621 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:47.617718  3328 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.640547  1616 raft_consensus.cc:1240] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:47.579574  3271 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:47.601816  1542 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:47.638128  3285 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.646447  3285 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:47.628382  3268 raft_consensus.cc:3055] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:47.647142  3268 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:47.647948  3268 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.650517  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:47.651373  1546 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.650584  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:47.651937  1545 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.652083  1547 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:47.657594  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:00:47.657877  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 97934.5us
I20260709 13:00:47.658318  1541 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.661055  1586 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.669340  1546 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:47.684507  1558 tablet_copy_source_session.cc:215] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:47.649346  3271 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.688149  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:47.693943  1545 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
W20260709 13:00:47.697005  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 64933.9us
I20260709 13:00:47.691001  1541 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:47.681638  3276 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:47.696427  3239 consensus_queue.cc:1059] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:00:47.626775  3305 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.640723  3145 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:00:47.679740  3254 raft_consensus.cc:697] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:47.700217  3251 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.672039  3314 consensus_queue.cc:1059] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:00:47.721510  2266 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:47.707954  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:47.687518  3338 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.701472  3339 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:47.731979  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 155097us
I20260709 13:00:47.735184  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:47.718098  1543 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:47.631074  3331 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.696943  3326 consensus_queue.cc:1059] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:47.675748  3321 consensus_queue.cc:1059] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 13:00:47.744127  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 67199.2us
I20260709 13:00:47.732410  3236 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:47.718814  3277 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:00:47.733970  3339 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:47.724740  3235 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.764482  3339 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.748277  3266 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:47.766647  1661 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:47.765046  3321 raft_consensus.cc:3055] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:00:47.799870  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 101000us
I20260709 13:00:47.795356  1661 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:47.796212  3235 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:47.797014  3344 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:47.787925  3266 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:00:47.808405  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 261578us
I20260709 13:00:47.750342  3330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a34da7993e4fee9ff4fc1266a6af38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:47.759860  3268 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.754359  3331 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.741247  3325 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.748703  3305 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.750052  3310 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:47.797487  3326 raft_consensus.cc:3055] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:47.833730  1661 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:47.838160  1663 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:47.799448  3321 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:47.855623  3250 consensus_queue.cc:1059] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:47.858450  3250 consensus_queue.cc:1059] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:47.834661  3266 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.856942  3341 raft_consensus.cc:3055] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:47.799239  3282 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:00:47.836163  3328 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:47.873327  1545 raft_consensus.cc:1240] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:47.818395  3353 consensus_queue.cc:1059] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:00:47.873343  1541 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:47.874168  1546 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:47.881840  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 62303.7us
I20260709 13:00:47.883630  1587 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.850993  3318 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.864766  3347 raft_consensus.cc:993] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:47.850520  3344 raft_consensus.cc:697] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:47.850824  3326 raft_consensus.cc:740] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:47.870072  3341 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:47.811026  3351 consensus_queue.cc:1059] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:00:47.899219  1587 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.832762  3254 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:47.906867  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.884949  3345 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:47.890221  3243 consensus_queue.cc:1059] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:00:47.905530  3346 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.934681  1616 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:47.905083  3347 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.915329  3344 consensus_queue.cc:237] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.925762  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.930404  3354 raft_consensus.cc:3055] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:47.930923  3271 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.917441  3321 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:47.940112  1587 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.933780  3351 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.915169  3325 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:47.938638  3342 log.cc:927] Time spent T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:00:47.913712  3350 raft_consensus.cc:1081] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:00:47.953367  1587 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.923394  3345 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:47.933794  3346 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:47.934597  3353 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:47.954552  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 116482us
I20260709 13:00:47.957078  1663 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:47.958248  1663 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:47.958956  3239 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:47.959390  3239 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:47.959586  3324 raft_consensus.cc:3055] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.959839  3239 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.959682  3243 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:47.960053  3324 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:47.960438  3243 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:47.960938  3243 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.962977  1663 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.964417  3299 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:47.942881  3354 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:47.965245  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:47.969249  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.978068  1663 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:47.979717  3321 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:47.982344  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.981173  3299 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:47.982344  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.983783  3299 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:47.984171  3350 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:47.984366  3299 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.984642  3350 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:47.985692  3350 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.987214  3250 raft_consensus.cc:3055] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:47.987795  1587 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:47.989073  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 188302us
I20260709 13:00:47.949420  3279 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:47.966429  3351 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.955663  3347 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.956766  3346 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.005000  1663 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.990453  1587 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:47.954550  3352 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.018878  1663 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:47.982434  3282 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.949795  3326 consensus_queue.cc:260] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:48.004935  3318 raft_consensus.cc:3055] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:47.990872  3353 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.004007  3325 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:47.987967  3250 raft_consensus.cc:740] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:48.031985  1663 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:47.958984  3341 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:48.036433  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.960984  3324 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.018045  3355 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.023507  3276 raft_consensus.cc:3055] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:00:48.062590  3356 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:00:48.062947  3324 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.065693  3341 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.065476  1443 catalog_manager.cc:5697] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 2 to 3, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 3 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.068040  1443 catalog_manager.cc:5697] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 3 to 4, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 4 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.035238  3352 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.032145  3329 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.029832  3318 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:48.033339  3357 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:48.049873  3282 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.096019   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:48.053417  3276 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:48.103399  1694 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:48.104626  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:48.120628  3251 raft_consensus.cc:3055] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.126019  3251 raft_consensus.cc:740] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:48.031764  3354 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.092144  3328 raft_consensus.cc:697] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:48.134455  3251 consensus_queue.cc:260] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:48.145628  3251 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.146806  3318 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.101694  3359 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:48.178884  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.034597  3345 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.101100  3357 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.124205  3271 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:48.136163  3352 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:00:48.191924  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 66480.2us
W20260709 13:00:48.204380  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 73291.2us
I20260709 13:00:48.180244  3239 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:48.206970  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 205059us
I20260709 13:00:48.204088  3243 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.216025  1586 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:48.196440  3359 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:00:48.183513  3276 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.201673  3271 consensus_queue.cc:1059] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:00:48.196671  3352 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:48.234045  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 243666us
I20260709 13:00:48.238425  3352 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:48.233626  3353 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.240039  3353 consensus_queue.cc:1059] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:48.241062  3353 raft_consensus.cc:3055] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:48.241426  3353 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:48.242267  3353 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:48.243872  3360 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:00:48.247833  3276 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:48.248252  3363 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:00:48.263023  3253 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:48.263564  3253 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:48.264582  3253 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:48.290179  3326 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.298002  3318 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.265990  1621 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.222754  3364 consensus_queue.cc:1059] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:00:48.213297  3340 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:00:48.268546  3282 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.236284  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:00:48.357626  1514 leader_election.cc:336] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.668s (SENT)
I20260709 13:00:48.209951  3328 consensus_queue.cc:237] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.242512  3266 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:48.374214  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 137994us
I20260709 13:00:48.392488  1587 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:48.239048  3352 consensus_queue.cc:1059] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:00:48.334856  3324 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:48.340008  3353 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.370554  3253 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.399858  3354 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.422206   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:48.419601  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:48.400334  3358 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:48.433382  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.434846  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.435273  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.435585  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.436676  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.436609  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.438474  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.439217  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.440101  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.440018  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.438771  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.445614  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:00:48.422330  3339 consensus_meta.cc:287] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.004s
I20260709 13:00:48.447099  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:48.447750  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:48.455513  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:48.458158  1693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39238
I20260709 13:00:48.458858  1693 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.459304  1693 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.417424  3372 raft_consensus.cc:3055] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:48.469925  1696 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.469578  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:48.473085  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:48.473500  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.474161  1619 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:48.477267  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.477587  3371 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.444406  3332 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.414239  3324 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:48.514868  3370 consensus_queue.cc:1059] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:00:48.524659  3324 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:48.525617  1621 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:48.479130  3243 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:48.484432  3266 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:00:48.485443  3268 consensus_meta.cc:287] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.000s
I20260709 13:00:48.485314  1619 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:48.489063  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.540093  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:48.540865  1692 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 2: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:48.490437  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.490960  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:48.492285  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.542906  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.464859  3372 raft_consensus.cc:740] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:48.500001  1693 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:48.501977  3373 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:00:48.557297  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.557648  1690 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:00:48.467082  3339 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:48.508704  3346 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.514485  1623 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
W20260709 13:00:48.471832  3305 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.002s
W20260709 13:00:48.537014  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 119789us
I20260709 13:00:48.544003  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35712
I20260709 13:00:48.559563  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.559808  1541 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.560144  1541 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.560887  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:48.493957  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.544876  1546 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.563167  1617 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.564244  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:48.566045  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.567781  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.545313  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:48.569126  1694 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.545414  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:48.545991  1539 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 5. Ops: []
I20260709 13:00:48.546373  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.570572  1619 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:48.546862  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.547215  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:48.548605  1688 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:48.548889  1544 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.552896  1540 raft_consensus.cc:1240] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:48.549196  3299 consensus_meta.cc:287] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.554s	user 0.005s	sys 0.009s
I20260709 13:00:48.575605  1542 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:48.576566  1620 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:00:48.575801  1693 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:48.575881  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.582121  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.582998  1619 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.527496  3357 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:48.592089  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.539237  3239 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:48.616935  1696 raft_consensus.cc:1240] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:48.618113  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:00:48.592644  1514 leader_election.cc:336] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.765s (SENT)
I20260709 13:00:48.582155  1541 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.598824  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.620205  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:00:48.615842  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 53826.5us
I20260709 13:00:48.620671  1618 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:48.621232  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.614480  3361 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:00:48.586925  3299 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.630175  3299 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:48.630831  1691 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:48.631913  1697 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.632747  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.633468  1616 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:48.634233  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.627386  1546 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.639278  1617 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:48.619939  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:48.614992  3374 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.623778  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:48.624078  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:48.618515  1586 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:48.645393  1618 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:48.648610  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:48.648669  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:48.649705  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:00:48.649940  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 57364.8us
I20260709 13:00:48.650297  1541 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:48.646620  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.651862  1618 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:48.651791  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.652803  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.653074  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.653889  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.654060  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.604640  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:48.547731  3314 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:00:48.654560  1618 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.656317  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:48.658726  1622 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:48.660917  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:00:48.664142  1514 leader_election.cc:336] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.665s (SENT)
W20260709 13:00:48.668995  1514 leader_election.cc:336] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.876s (SENT)
I20260709 13:00:48.662952  1695 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:48.642117  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:48.661948  1586 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:48.663304  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:48.670854  1693 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:00:48.670221  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:48.673389  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:48.674820  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:48.675859  3276 consensus_queue.cc:1059] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:48.677019  3276 consensus_queue.cc:1243] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:48.677489  3276 raft_consensus.cc:3055] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.677781  3276 raft_consensus.cc:740] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:48.678604  3276 consensus_queue.cc:260] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.679641  3338 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.680516  3347 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.682545  1586 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:48.683389  3346 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:48.683579  3347 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:48.685061  3321 consensus_meta.cc:287] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.002s
I20260709 13:00:48.685330  3339 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:48.689159  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:48.689757  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:48.690392  1546 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.690847  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:48.691196  1693 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:48.691560  1547 raft_consensus.cc:1240] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:48.692683  1695 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.655038  2265 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.695664  1619 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:48.698293  1514 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:48.709088  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:48.672189  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.659853  3258 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.665584  3358 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.713337  1690 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:48.713495  1622 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.701800  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:48.660181  3324 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.723868  1694 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:48.647097  3371 consensus_queue.cc:1059] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:00:48.741506  1694 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:48.717605  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:48.683400  3338 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.648932  3266 consensus_queue.cc:1059] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:00:48.746372  1622 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:48.697373  3310 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.760982  1663 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:48.761833  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.762991  1622 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.765866  1618 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:48.727264  3351 raft_consensus.cc:3055] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.767652  1615 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
W20260709 13:00:48.774098  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 107728us
I20260709 13:00:48.742539  3332 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.666522  3374 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:48.768708  3341 consensus_meta.cc:287] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.702s	user 0.006s	sys 0.006s
W20260709 13:00:48.771057  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.791163  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 141145us
I20260709 13:00:48.770759  1663 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:48.768092  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.739051  3352 consensus_queue.cc:1059] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:00:48.802294  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 104121us
I20260709 13:00:48.772254  3310 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:00:48.803119  1514 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:48.805244  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:00:48.806156  3326 consensus_meta.cc:287] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.001s
I20260709 13:00:48.770848  3390 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.807286  3390 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:48.777408  3358 consensus_queue.cc:1059] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:00:48.773970  3351 raft_consensus.cc:740] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:48.791800  1622 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:48.800465  1618 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:48.800635  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:48.811915  2270 raft_consensus.cc:2393] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:00:48.759147  3276 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.812780  1514 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:48.813395  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:48.813850  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.814076  1697 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:48.814484  1618 raft_consensus.cc:3055] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:48.814772  1618 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:48.773517  3258 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.815649  2231 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:48.817338  1663 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:48.818326  3354 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.818589  3352 raft_consensus.cc:3055] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:48.819001  3352 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:48.818874  3354 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:48.820894  3341 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:48.821376  3341 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.821843  3341 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.816046  3234 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.823180  3234 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.823629  3234 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:48.778967  3332 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:48.821784  3236 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:48.827029  1663 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:48.779059  3383 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.830693  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:48.825238  3234 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:48.837872  1622 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:48.829690  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:48.838743  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:48.841800  1663 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:48.821125  3354 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:48.810830  3345 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.847502  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.844499  1663 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:00:48.839689  3350 consensus_meta.cc:287] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.853s	user 0.015s	sys 0.000s
W20260709 13:00:48.844024  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 100346us
I20260709 13:00:48.836210  3258 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:48.854764  3352 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.855732  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:48.856585  2267 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:48.856699  3250 consensus_queue.cc:260] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.843533  3251 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.858177  3250 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.833194  3332 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:48.841150  1618 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:48.861634  1618 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.845029  3323 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:48.849426  1663 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:48.843053  3236 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:48.868412  3236 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.810497  3314 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:00:48.849963  1622 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.809643  3390 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:48.735330  3372 consensus_queue.cc:260] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.851145  3329 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.874811  3345 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:48.856494  3352 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.866876  1663 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:00:48.848945  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 132108us
I20260709 13:00:48.880262  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:48.881090  1693 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.881387  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:48.882084  1694 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:48.883363  1692 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:48.885401  1622 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:48.886854  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.887488  1622 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:48.891253  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.860162  3374 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:48.895037  3392 consensus_queue.cc:1059] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:00:48.901022  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:48.904356  3365 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.906243  3251 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.866000  3323 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:48.887120  3346 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.916481  1614 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:00:48.917140  1618 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:48.918509  3234 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.919616  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:48.921003  1618 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.921995  3341 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:48.853119  3350 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:48.910540  1622 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
W20260709 13:00:48.912003  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 82421.5us
I20260709 13:00:48.911847  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:48.902446  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:48.879554  3345 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:48.926489  1586 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:48.910254  1663 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:48.915025  3323 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:48.925768  3393 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.890086  3258 consensus_queue.cc:1059] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:00:48.932957  3347 consensus_queue.cc:1059] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:48.963382  1622 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.933108  3369 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:48.966096  1514 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:48.972227  1616 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:48.980317  1622 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:48.970875  1618 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:48.982025  1618 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:48.971406  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61285us
I20260709 13:00:48.983631  1623 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.985324  1618 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:48.986549  1618 raft_consensus.cc:1240] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:48.927037  3332 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:48.975075  1621 raft_consensus.cc:2393] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:48.975679  3391 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:48.974462  3374 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:48.973690  1696 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:48.964560  3355 raft_consensus.cc:3055] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.984740  1663 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:48.992813  1663 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:48.989583  1622 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:48.991088  1623 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:48.971401  3345 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.994029  1618 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:48.994185  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:48.994390  3369 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:48.999678  3258 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:49.000288  3258 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.000723  3258 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.001020  3341 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:49.003392  3351 consensus_queue.cc:260] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.003859  2265 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:48.993117  3374 raft_consensus.cc:697] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:49.004828  3351 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.006350  1662 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:49.006502  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:49.007602  1693 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.007891  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:49.008525  1697 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:49.009922  2231 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:49.012153  1663 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:48.989013  3391 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.993050  3393 raft_consensus.cc:3055] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:48.994686  3282 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:48.992169  3355 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:48.999153  3251 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.020344  3328 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:48.993216  3332 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:49.031957  3332 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.035367  3324 raft_consensus.cc:3055] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:49.036021  3324 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:49.013510  3369 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:49.020905  3391 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.030402  3395 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.030572  3328 raft_consensus.cc:697] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:49.014050  3258 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:49.039331  1619 raft_consensus.cc:606] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:49.055058  1619 raft_consensus.cc:614] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:49.055919  1620 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:49.040822  1618 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:49.017599  3359 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:49.044860  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.021554  1663 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:49.021723  3393 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:49.038367  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:49.060902  3383 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.036980  3324 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.045924  3251 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:49.066468  1622 raft_consensus.cc:1240] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:49.069540  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:49.109388  1544 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:49.022569  3282 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:49.115545  3282 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.120098  3279 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.121063  3279 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.131487  3229 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.133006  3229 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.135895  1621 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:49.140149  3279 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:49.022130  2267 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:49.005187  3374 consensus_queue.cc:237] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.098280  3346 consensus_queue.cc:1059] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:49.142484  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:49.142861  3346 raft_consensus.cc:3055] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:49.143378  3346 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:49.144213  3346 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.144747  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:49.145752  3346 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.145900  1691 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:49.147799  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:49.101935  1588 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:49.103889  1693 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
W20260709 13:00:49.163792  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 61949.9us
I20260709 13:00:49.151093  3229 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:49.166345  1588 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:49.153127  2231 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:49.162376  3279 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.168421  3276 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.169047  3279 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.167131  3325 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:49.175474  1662 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:49.157855  1615 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:49.177157  3374 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.178419  3145 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.179152  3145 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.179287  3374 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.171681  3279 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.182777  3145 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:49.185271  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:49.186609  1615 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:49.188547  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:49.156319  1623 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:49.207284  3323 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.209262  3318 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.210000  3346 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.212042  3368 consensus_queue.cc:1059] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:49.213580  3321 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:49.214679  3365 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:49.190022  1616 raft_consensus.cc:606] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:00:49.220700  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 133896us
I20260709 13:00:49.219862  3374 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.223083  1620 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:49.245155  1623 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:49.246173  1616 raft_consensus.cc:614] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:49.221971  1615 raft_consensus.cc:1240] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:49.255263  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 374806us
I20260709 13:00:49.224831  3359 raft_consensus.cc:697] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:49.227735  3341 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:49.250653  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:49.259253  1546 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.220553  3395 raft_consensus.cc:697] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:49.264982  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:49.269486  1542 raft_consensus.cc:2393] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:49.251293  2265 raft_consensus.cc:2393] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:00:49.269222  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:49.283778  1616 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:49.287770  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:49.288697  1616 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:49.293903  2234 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:49.302964  1546 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:00:49.305555  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:49.238183  3318 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.308218  2234 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:49.319224  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:49.242035  3346 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.286549  3324 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.286270  3229 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:49.295763  3330 consensus_meta.cc:287] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.654s	user 0.014s	sys 0.000s
I20260709 13:00:49.331830  3277 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.333098  3276 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:49.361394  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 108700us
I20260709 13:00:49.287113  3329 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:49.226823  3355 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.295254  3328 consensus_queue.cc:237] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.338411  1617 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:49.285534  3376 consensus_queue.cc:1059] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:00:49.322816  3390 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.316118  3350 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:49.295576  3368 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:00:49.385239  1619 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:49.385159  1621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "738a15ae04514d49969f3624caa73f45"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:43086
I20260709 13:00:49.395588  1621 raft_consensus.cc:606] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:49.396138  1621 raft_consensus.cc:614] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:49.335861  3406 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.349874  3364 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.304664  3395 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.405896  3376 raft_consensus.cc:3055] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:49.406507  3376 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:49.407402  3376 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.358453  3277 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.409395  3277 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.409772  3323 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:49.410506  3279 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.401525   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:49.396150  3377 consensus_queue.cc:1059] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:00:49.404248  3406 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.347855  3340 consensus_queue.cc:1059] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:00:49.409116  3376 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.346061  3258 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:49.416610  3409 consensus_queue.cc:1059] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:00:49.367363  3229 raft_consensus.cc:697] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:49.305362  3251 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.347287  3282 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.394260  3390 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:49.439388  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.436769  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:00:49.424520  3352 consensus_meta.cc:287] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.000s
I20260709 13:00:49.448127  3243 raft_consensus.cc:3055] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:49.448729  3243 raft_consensus.cc:740] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:49.294907  3393 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.386858  3344 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:00:49.431653  3310 raft_consensus.cc:3055] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:49.449836  3243 consensus_queue.cc:260] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.435948  3372 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.440265  3258 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.393006  3359 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.465553  3310 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:49.456797  3390 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.420982  3364 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.491482  3330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54504 (request call id 334) took 2075 ms. Trace:
I20260709 13:00:49.440961  3229 consensus_queue.cc:237] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.496948  3243 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.497861  3310 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.499073  3406 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:49.499857  3318 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:49.500053  3393 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.499866  3346 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:49.546689  3310 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.508224  3330 rpcz_store.cc:276] 0709 13:00:47.417170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.417437 (+   267us) service_pool.cc:224] Handling call
0709 13:00:47.467021 (+ 49584us) ts_tablet_manager.cc:934] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
0709 13:00:47.732372 (+265351us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:48.633728 (+901356us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:48.633839 (+   111us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:49.367993 (+734154us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:49.429229 (+ 61236us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:49.468061 (+ 38832us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:49.491325 (+ 23264us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":476,"tablet-copy.queue_time_us":45972,"thread_start_us":30146,"threads_started":2}
I20260709 13:00:49.557520  3330 tablet_copy_client.cc:806] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:49.558310  3330 tablet_copy_client.cc:670] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:49.562215  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:49.565804  3374 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.577718  1688 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:49.581934  3330 tablet_copy_client.cc:538] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:00:49.602821  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.582913  3277 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.596552  3406 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.605688  3346 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.624586  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.622959  3346 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.611084  3411 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:49.618170  3406 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:49.648859  1514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.024s	sys 0.057s
I20260709 13:00:49.641242  3395 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:00:49.644586  3351 consensus_meta.cc:287] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.639s	user 0.006s	sys 0.008s
W20260709 13:00:49.661502  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.647957  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 385881us
W20260709 13:00:49.700625  1514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.025s	sys 0.057s
I20260709 13:00:49.648819  3383 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:49.647358  3279 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:49.677033  3374 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:49.632556  3411 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.708487  3406 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:49.708727  3254 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.701006  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:00:49.710768  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 716601us
I20260709 13:00:49.701875  3372 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:00:49.705762  3345 consensus_meta.cc:287] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.690s	user 0.006s	sys 0.011s
I20260709 13:00:49.712519  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:49.704277  3364 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:49.712801  3341 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:49.730593  3341 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.713635  3255 raft_consensus.cc:3055] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:49.732825  3255 raft_consensus.cc:740] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:49.733842  3255 consensus_queue.cc:260] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.714550  3397 raft_consensus.cc:3055] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:49.735833  3330 tablet_bootstrap.cc:492] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:00:49.716991  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:49.717620  3346 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:49.704634  3396 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.722865  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:49.726662  2270 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:49.727058  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:49.724223  3254 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.728379  3414 consensus_queue.cc:1059] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:49.757841  3414 raft_consensus.cc:3055] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:49.758356  3414 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:49.758385  3236 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.759181  3236 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:49.760191  3236 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.729453  3406 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:49.765051  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:49.767771  1619 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:49.766017  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33072 (request call id 131) took 1724 ms. Trace:
I20260709 13:00:49.729979  3372 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.704821  3395 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.734349  3383 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.736104  3390 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.775188  3395 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:49.741034  3282 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:49.776523  3258 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:49.777128  3390 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:49.741611  3411 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:49.715752  3277 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:49.725046  3391 consensus_meta.cc:287] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.002s
I20260709 13:00:49.753312  3396 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.749534  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:49.778792  3391 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.779691  2268 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:49.751925  1615 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.780718  3396 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:49.765285  3398 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:00:49.781219  3391 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:49.782758  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:49.783480  2270 raft_consensus.cc:2368] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4.
I20260709 13:00:49.785066  1662 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:49.751788  1514 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:49.735195  3255 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.789968  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:49.794965  1614 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.735575  3397 raft_consensus.cc:740] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:49.801182  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:49.756469  3254 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:49.760812  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1178) took 1220 ms. Trace:
I20260709 13:00:49.761721  1622 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.759546  3414 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.729168  1511 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:00:49.768772  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.804857  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:49.808939  3365 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:49.815977  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:49.815920  3365 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.817845  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:49.819622  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:49.814424  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:49.821142  1623 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:49.814479  1692 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:49.797286  3355 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:49.823215  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:49.826027  1663 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:00:49.829609  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 100555us
I20260709 13:00:49.770015  2234 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:49.766889  3326 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:00:49.773334  3372 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:49.746040  3345 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.765020  3351 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:00:49.837419  1441 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52808 (request call id 196) took 1258 ms. Trace:
I20260709 13:00:49.838039  3345 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:49.790940  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:49.838946  1620 raft_consensus.cc:2393] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:49.838299  1446 catalog_manager.cc:5697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 4 to 5, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 5 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.840080  1620 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:49.792532  3258 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:49.839965  1446 catalog_manager.cc:5697] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 3 to 4, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 4 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.841461  1446 catalog_manager.cc:5697] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 2 to 3, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 3 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.791710  1514 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:49.843982  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 52344.5us
I20260709 13:00:49.844600  3341 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.798110  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:49.845220  1514 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:49.810114  1617 rpcz_store.cc:276] 0709 13:00:48.540020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.660551 (+120531us) service_pool.cc:224] Handling call
0709 13:00:49.760568 (+1100017us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b540016fb54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:49.760714 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819750784}
I20260709 13:00:49.798378  1662 leader_election.cc:400] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4.
I20260709 13:00:49.799513  3411 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:49.845770  1621 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
W20260709 13:00:49.802242  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.803684  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:49.804649  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:49.805276  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:49.855868  1693 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.806221  1696 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:49.807216  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:49.830485  3409 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.832448   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:49.832361  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52824 (request call id 225) took 1342 ms. Trace:
I20260709 13:00:49.861512  1442 rpcz_store.cc:276] 0709 13:00:48.490073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.511647 (+ 21574us) service_pool.cc:224] Handling call
0709 13:00:49.832275 (+1320628us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":523799,"reported_tablets":1}
I20260709 13:00:49.818413  3365 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:49.833606  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:49.771894  3406 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:49.867925  1618 raft_consensus.cc:2393] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:49.850982  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:49.838083  3351 raft_consensus.cc:3055] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:49.811801  3414 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.835593  3395 consensus_queue.cc:1059] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:49.846159  1662 leader_election.cc:403] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:49.846747  1514 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:49.864814  3390 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.842854  1446 catalog_manager.cc:5697] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.867606  3406 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:00:49.851686  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.799542  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1308) took 1139 ms. Trace:
I20260709 13:00:49.878917  3325 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:49.890221  1688 rpcz_store.cc:276] 0709 13:00:48.660303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.663834 (+  3531us) service_pool.cc:224] Handling call
0709 13:00:49.799356 (+1135522us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54000974d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:49.799482 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980237696}
I20260709 13:00:49.888509  3390 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.891883  3390 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.857682  1690 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:00:49.858544  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 88746.9us
I20260709 13:00:49.837847  1441 rpcz_store.cc:276] 0709 13:00:48.579487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.584330 (+  4843us) service_pool.cc:224] Handling call
0709 13:00:49.837346 (+1253016us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":578903,"reported_tablets":2}
I20260709 13:00:49.832329  3321 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:49.861107  1694 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.868425  3409 raft_consensus.cc:697] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:00:49.911120  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 112933us
I20260709 13:00:49.834208  2231 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:00:49.912981  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 79006.5us
I20260709 13:00:49.862766  3393 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.768606  1443 rpcz_store.cc:276] 0709 13:00:48.041530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.041723 (+   193us) service_pool.cc:224] Handling call
0709 13:00:49.765948 (+1724225us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:48.370431 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:48.501769 (+131338us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:48.501808 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:00:48.501828 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:48.502298 (+   470us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:48.502375 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:48.502406 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:48.502724 (+   318us) tablet.cc:701] Row locks acquired
0709 13:00:48.502744 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:00:48.502900 (+   156us) write_op.cc:270] Start()
0709 13:00:48.503023 (+   123us) write_op.cc:276] Timestamp: P: 1783602048502857 usec, L: 0
0709 13:00:48.503048 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:00:48.503769 (+   721us) log.cc:844] Serialized 919 byte log entry
0709 13:00:48.626688 (+122919us) op_driver.cc:464] REPLICATION: finished
0709 13:00:48.806612 (+179924us) write_op.cc:301] APPLY: starting
0709 13:00:48.806745 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:48.806943 (+   198us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:48.807110 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:48.807494 (+   384us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:48.807697 (+   203us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:00:48.808154 (+   457us) write_op.cc:312] APPLY: finished
0709 13:00:48.808374 (+   220us) log.cc:844] Serialized 29 byte log entry
0709 13:00:48.808537 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:48.808644 (+   107us) write_op.cc:454] Released schema lock
0709 13:00:48.808684 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:48.809047 (+   363us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:48.809081 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15311,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":179516,"apply.run_cpu_time_us":2563,"apply.run_wall_time_us":2564,"num_ops":2,"prepare.queue_time_us":211778,"prepare.run_cpu_time_us":3717,"prepare.run_wall_time_us":164431,"replication_time_us":123282,"thread_start_us":159217,"threads_started":2}]]}
I20260709 13:00:49.882962  3391 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:49.862423  3258 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:49.854601  3411 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:49.924381  3411 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.886561  1446 catalog_manager.cc:5697] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 3 to 5, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 5 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.929538  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:49.930275  2265 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.929847  1446 catalog_manager.cc:5697] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 3 to 4, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 4 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.848454  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:49.931985  1697 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.868790  2264 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.895215  1693 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:00:49.897599  1614 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:49.877647  1615 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:00:49.913888  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:49.896132  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:49.898428  1661 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:49.814116  3397 consensus_queue.cc:260] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.916484  3396 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:49.917440  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.917524  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 70848.1us
I20260709 13:00:49.919216  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:49.880460  3351 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:49.923496  3391 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:49.937003  1690 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:00:49.942333  1617 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.884981  3365 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:00:49.944120  1694 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:49.947045  2234 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:49.909880  3321 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:49.948101  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 49782.2us
I20260709 13:00:49.917188  3234 raft_consensus.cc:3055] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:49.938690  3392 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:49.939575  3393 raft_consensus.cc:697] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:49.941092  3258 raft_consensus.cc:697] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:49.944360  3323 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4.
I20260709 13:00:49.945987  3396 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.969177  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:49.952186  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:49.994445  2231 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:49.964321  3321 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.965797  3326 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:49.964195  3234 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:49.951984  3383 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:50.008556  3234 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.038257  1547 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:49.995870  3396 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:49.974382  3397 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:50.017498  3423 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.002s
I20260709 13:00:50.019090  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:50.054023  1544 raft_consensus.cc:2393] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:50.020392  2267 raft_consensus.cc:2368] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4.
I20260709 13:00:50.023918  1546 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:50.024729  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:50.001092  3406 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.027181  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:50.075681  1545 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:50.024000  1539 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 3. Ops: []
I20260709 13:00:50.033042  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:50.040189  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:50.008819  3411 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.999209  3388 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:50.051156  1617 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:00:50.077761  1547 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:50.080314  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:50.080821  1547 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:50.084458  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:50.085341  1546 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.052842  1542 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:50.094619  1542 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:50.073402  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:50.088946  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:50.099704  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:50.101428  1539 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:50.102120  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:50.032738  3326 raft_consensus.cc:697] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:50.116822  3279 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:50.117504  3279 raft_consensus.cc:697] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:50.104269  1547 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:50.108920  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:50.119771  1694 raft_consensus.cc:2368] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4.
I20260709 13:00:50.124276  2231 leader_election.cc:400] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4.
I20260709 13:00:50.124744  2231 leader_election.cc:403] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:00:50.130420  3279 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:49.999464  3351 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:50.081418  3395 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:00:50.132891  3352 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:50.134330  1543 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:00:50.134590  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 285422us
I20260709 13:00:50.074745  3345 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:50.135974  3345 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:50.139539  3234 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:50.140031  3424 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:00:50.144979  3411 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:50.146106  1697 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:50.081792  3409 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.126972  3410 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:50.149500  3410 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:50.152034  3325 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.152619  3325 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.152781  2265 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:50.154667  3325 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.156072  3410 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:50.156062  2264 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:50.118047  3341 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.160593  3396 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:50.163321  1548 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 2. (term mismatch)
I20260709 13:00:50.163960  1548 pending_rounds.cc:85] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 1
I20260709 13:00:50.164294  1548 pending_rounds.cc:107] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:00:50.164633  1548 raft_consensus.cc:2917] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:00:50.165118  1548 raft_consensus.cc:2889] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:50.128931  1691 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:50.169008  1588 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:50.171144  3253 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:50.171248  3328 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:50.171833  3253 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:50.174081  3253 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:50.117827  3326 consensus_queue.cc:237] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:50.181264  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:50.203233  1697 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:50.203732  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:50.204481  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:50.204481  1693 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:50.205822  1690 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:50.166074  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:50.189357  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:00:50.189685  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.208925  1621 raft_consensus.cc:2393] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 2: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:50.192533  1662 leader_election.cc:400] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4.
I20260709 13:00:50.192826  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:50.194736  3406 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.211169  1662 leader_election.cc:403] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:50.138880  3324 consensus_queue.cc:1059] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:00:50.213028  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53706 (request call id 6) took 4578 ms. Trace:
I20260709 13:00:50.219035  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:50.219887  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 256510us
W20260709 13:00:50.220724  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 250345us
I20260709 13:00:50.176730  3145 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4.
I20260709 13:00:50.221385  1694 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:50.235123  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:50.215937  1546 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:50.236164  1691 raft_consensus.cc:2393] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:00:50.186753  3358 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:50.218650  1548 rpcz_store.cc:276] 0709 13:00:45.608918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.800678 (+191760us) service_pool.cc:224] Handling call
0709 13:00:45.898550 (+ 97872us) log.cc:844] Serialized 506 byte log entry
0709 13:00:46.712625 (+814075us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b1800003820. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a1f2a6 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6aabeb26 00007f5c6aab849a 00007f5c6aab7714
0709 13:00:46.713104 (+   479us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b54000d82a0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6aabeb26 00007f5c6aab849a 00007f5c6aab7714 00007f5c6aa97eaa 00007f5c6aa9ed53 00007f5c6aa9ecd9 00007f5c6aa9ec69 00007f5c6aa9ec31 00007f5c6aa9ddfd 000000000038f354
0709 13:00:46.715727 (+  2623us) spinlock_profiling.cc:243] Waited 885 us on lock 0x7b1800003820. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:00:46.778076 (+ 62349us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b1800003820. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c679cbc0a 00007f5c7110b219 00007f5c67a53a40 00007f5c67a4e4e4 00007f5c67a4e455 00007f5c6aa97b0b 00007f5c6ab1cb63 00007f5c6ab44752 00007f5c6fb04d29
0709 13:00:46.795310 (+ 17234us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b54000d82a0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6aab7142 00007f5c6aa97eaa 00007f5c6aa9ed53 00007f5c6aa9ecd9 00007f5c6aa9ec69 00007f5c6aa9ec31 00007f5c6aa9ddfd 000000000038f354 000000000038f199 00007f5c67a51475
0709 13:00:46.823919 (+ 28609us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b2c000e1a38. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69446a0a 00007f5c69446693 00007f5c69446631 00007f5c6ab7ab52 00007f5c6ab7acf5 00007f5c6aab7691 00007f5c6aa97eaa 00007f5c6aa9ed53 00007f5c6aa9ecd9 00007f5c6aa9ec69
0709 13:00:46.826627 (+  2708us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b18001bebe0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab7ad01 00007f5c6aab7691 00007f5c6aa97eaa 00007f5c6aa9ed53 00007f5c6aa9ecd9 00007f5c6aa9ec69 00007f5c6aa9ec31 00007f5c6aa9ddfd 000000000038f354 000000000038f199
0709 13:00:50.179471 (+3352844us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117610,"raft.queue_time_us":446293,"raft.run_cpu_time_us":25364,"raft.run_wall_time_us":878467,"spinlock_wait_cycles":326714112,"thread_start_us":357189,"threads_started":1,"wal-append.queue_time_us":508394,"wal-append.run_cpu_time_us":1861,"wal-append.run_wall_time_us":1007440}
I20260709 13:00:50.185845  3396 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.135138  3390 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:50.242038  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.238436  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.243793  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 77964.4us
I20260709 13:00:50.245124  1663 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:00:50.248236  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 55844.8us
I20260709 13:00:50.248801  1661 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:50.249326  1662 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:50.286473  1514 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:50.128785  3393 consensus_queue.cc:237] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.234509  3369 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:50.296732  1514 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:50.268816  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:50.255337  3359 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:50.294786  3243 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:50.300990  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 164955us
I20260709 13:00:50.220059  3328 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:00:50.317348  3414 consensus_queue.cc:1059] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:50.318295  3372 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:50.220573  3392 raft_consensus.cc:697] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:50.239792  3345 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:00:50.300745  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 108562us
I20260709 13:00:50.303517  3355 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:50.331446  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.185606  3258 consensus_queue.cc:237] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.337719  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:50.304237  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 55531.9us
I20260709 13:00:50.362563  1661 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:50.338008  1514 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:50.296913  3374 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4.
I20260709 13:00:50.336755  2267 raft_consensus.cc:2368] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4.
W20260709 13:00:50.338019  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 90617.1us
I20260709 13:00:50.343204  3310 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.300365  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 50977.4us
I20260709 13:00:50.270457  3410 consensus_queue.cc:1059] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:00:50.337018  3243 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.294435  3411 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:00:50.338245  3359 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.342353  3236 raft_consensus.cc:2764] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:50.337611  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:50.321880  3383 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:00:50.340065  3432 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.355792  3358 raft_consensus.cc:697] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:50.378834  1514 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:50.346653  3346 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:00:50.338449  3369 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:50.365437  3431 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.395593  1663 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:50.380501  3243 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:50.406976  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 44494.8us
I20260709 13:00:50.405509  2232 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:50.384016  3359 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.390215  3412 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.386389  3372 raft_consensus.cc:697] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:50.392670  3355 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:50.479557  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 71762.3us
I20260709 13:00:50.419690  3388 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:50.502789  2270 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:50.379462  3310 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.400374  3236 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:50.533833  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:50.403198  3364 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:00:50.550756  1622 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.532187  3372 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:50.514822  1494 auto_rebalancer.cc:629] Failed to schedule move for tablet 11a34da7993e4fee9ff4fc1266a6af38: Aborted: Op aborted by new leader
I20260709 13:00:50.473889  3391 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.559895  3236 raft_consensus.cc:697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:50.386623  3323 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:00:50.569690  3431 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:50.571842  3431 raft_consensus.cc:2764] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:50.409485  3432 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.550398  3234 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.554881  3345 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:50.577217  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:50.591058  1622 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:00:50.447966  3412 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.574975  3391 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:50.550907  3443 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 13:00:50.602015  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 84953.7us
I20260709 13:00:50.574579  3390 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.589244  3374 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.578099  3355 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:00:50.609642  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 60318.6us
I20260709 13:00:50.550599  3358 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:50.639021  3391 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.665486  3391 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:50.667774  3442 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:00:50.667851  3391 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.668989  3391 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.669456  3391 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:50.670770  3439 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:00:50.611222  2264 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:50.671473  3391 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.671983  3391 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.672394  3391 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:50.673384  3435 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:50.674409  3391 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.674958  3391 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.675385  3391 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:50.678201  3321 consensus_meta.cc:287] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.649s	user 0.006s	sys 0.003s
I20260709 13:00:50.679602  3391 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:50.680148  3391 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.680816  3391 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.515300  3392 consensus_queue.cc:237] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:50.639182  3434 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:00:50.597535  3234 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.678718  3321 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.605469  3446 consensus_queue.cc:1059] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
W20260709 13:00:50.719784  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.631430  3374 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.624523  3445 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.107s
I20260709 13:00:50.631217  3355 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.687885  3364 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:00:50.749342  3452 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.755774  3310 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.640874  3236 consensus_queue.cc:237] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.739622  3369 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.775961  3444 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.779511  3444 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:50.789891  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 394523us
I20260709 13:00:50.799218  3448 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.812341  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.771733  3452 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.800776  3412 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:00:50.822901  3397 consensus_meta.cc:287] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.753s	user 0.008s	sys 0.004s
I20260709 13:00:50.807858  3443 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.811887  3391 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.841562  1545 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:50.843631  3321 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:50.847734  3456 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:50.848515  3456 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.841086  3352 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:50.854363  3352 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:50.829375  3234 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.888312  3325 raft_consensus.cc:3055] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:50.831063  3455 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:50.815677  3448 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.838816  3450 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.904453  3388 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:50.838295  3446 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:50.906526  3324 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.822043  3445 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:00:50.907105  3446 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.903762  3243 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.851235  3456 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.839952  3412 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.865489  3391 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:50.886637  3352 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:50.893832  3325 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:50.892059  3432 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:50.916039  3406 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.696s	user 0.014s	sys 0.001s
I20260709 13:00:50.842484  3443 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.919390  3456 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.921335  3351 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.946292  3365 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.922873  3410 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.017s	sys 0.013s
I20260709 13:00:50.916566  3324 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.924453  3355 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:50.920411  3412 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:50.966099  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 408540us
I20260709 13:00:50.950230  3448 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:50.963279  3410 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.017s	sys 0.013s
I20260709 13:00:50.924114  3391 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:50.996574  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:50.996613  2234 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:50.921555  3450 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:50.967154  3446 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:50.979278  3409 raft_consensus.cc:3055] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:50.918157  3455 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.966809  3365 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.960179  3456 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:50.984546  3325 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.001441  3388 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:51.006163  3409 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:51.037222  3452 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:51.028127  3388 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:51.037271  3409 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.042904  3409 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:51.043368  3463 log.cc:927] Time spent T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:00:51.048221  3450 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:00:51.083530  1547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.047s	sys 0.090s
W20260709 13:00:51.084517  1547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.047s	sys 0.091s
W20260709 13:00:51.085417  1514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.005s	sys 0.016s
W20260709 13:00:51.085652  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.086107  1514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.006s	sys 0.016s
W20260709 13:00:51.087951  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.013s	sys 0.013s
W20260709 13:00:51.088497  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.014s	sys 0.013s
I20260709 13:00:51.009945  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:00:51.094060  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 715209us
W20260709 13:00:51.084404  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.020s	sys 0.001s
W20260709 13:00:51.098688  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.020s	sys 0.002s
I20260709 13:00:51.099767  3326 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.101099  3326 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.101940  1511 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:00:51.096149  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 320394us
I20260709 13:00:51.106462  3391 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:51.106210  3388 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.107257  3324 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.117215  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:00:51.127542  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.127377  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.130537  3326 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.131953  2264 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:51.147142  1543 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.146848  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.151629  3456 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.152175  1694 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:51.153561  3365 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:51.147965  3326 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:51.149302  3464 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:00:51.149328  3330 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.203s	user 0.000s	sys 0.002s
I20260709 13:00:51.154999  3471 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.159400  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.154976  3326 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.174569  3326 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.178193  1662 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:51.180089  3473 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.155376  3393 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:51.184408  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.167187  3365 raft_consensus.cc:476] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:51.221618  1690 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.222774  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:51.217742  3393 raft_consensus.cc:697] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:51.226994  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:51.229066  3393 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.231982  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:51.233870  3467 consensus_queue.cc:1059] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:51.231923  3310 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:51.236690  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 58955.2us
I20260709 13:00:51.242442  3345 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:51.243055  3345 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:51.243569  3345 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.243630  3471 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.246661  3471 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:51.226977  3374 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:51.248270  3374 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.242488  3414 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:51.249140  3374 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.253669  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:51.254815  1693 raft_consensus.cc:2376] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3. Re-sending same reply.
I20260709 13:00:51.256453  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.253989  3374 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:51.260686  3464 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.267387  3412 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:51.269711  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.269778  3345 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.268458  1691 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:51.275581  3345 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:51.285699  1693 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:51.286131  3410 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:51.290663   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:51.291841  3458 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.292315  3467 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.292912  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.293323  3234 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:51.293864  3392 raft_consensus.cc:3055] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:51.294092  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.294409  3466 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.296339  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.297029  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.298368  3451 raft_consensus.cc:3055] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:51.237507  3473 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.327780  3467 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.330293  3473 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:00:51.302279  3449 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.610s	user 0.004s	sys 0.000s
I20260709 13:00:51.303364  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.304280  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.305614  3445 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:51.306464  2264 raft_consensus.cc:1240] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:51.305655  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.309274  3243 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:51.309715  1662 leader_election.cc:400] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4.
I20260709 13:00:51.333210  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.336417  1662 leader_election.cc:403] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:00:51.319388  3234 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.337663  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.338099  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.338526  1544 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:51.339927  3234 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:51.323760  1691 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:51.325845  3455 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:51.326745  1546 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:51.323801  1548 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:51.337387  1540 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:51.344997  3397 consensus_queue.cc:1059] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:00:51.346374  3243 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:51.341886  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 65317.3us
I20260709 13:00:51.316205  3392 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:51.350425  3462 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.350711  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:51.331004  3451 raft_consensus.cc:740] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:51.350569  3458 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.330986  3467 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.334995  1543 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:51.357868  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.361868  3444 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:51.364696  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.359606  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.366194  1697 raft_consensus.cc:2393] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:51.366474  1690 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:51.346495  3445 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.362208  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.369684  1693 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:51.375120  1691 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:51.376611  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.377400  3330 tablet_bootstrap.cc:492] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:00:51.378253  1539 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:51.368677  3324 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:51.373407  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.379307  3324 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.378178  3433 raft_consensus.cc:3055] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:51.377599  1696 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:51.380620  1694 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:51.384053  2264 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:51.382351  3433 raft_consensus.cc:740] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:51.384465  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:51.388069  2265 raft_consensus.cc:2393] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:00:51.389665  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.391007  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.393184  1546 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:51.394547  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.371518  3464 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.400714  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:51.401086  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:51.400591  3392 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.401760  2265 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.401962  3236 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:51.402006  3330 tablet_bootstrap.cc:492] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:00:51.403131  3358 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:51.403839  3358 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.404615  3325 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.403857  3330 ts_tablet_manager.cc:1403] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 1.668s	user 0.017s	sys 0.042s
I20260709 13:00:51.408663  3236 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:51.409291  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:51.410250  1620 raft_consensus.cc:2368] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4.
I20260709 13:00:51.367937  3466 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.395015  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.405341  3445 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:51.412693  3236 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:00:51.414309  3324 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:51.417258  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.421964  3467 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:51.421979  3430 consensus_queue.cc:1059] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:51.402122  3392 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.422160  1696 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 3. Ops: []
I20260709 13:00:51.423290  3467 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.394315  3462 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.434490  3451 consensus_queue.cc:260] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.385819  3433 consensus_queue.cc:260] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.435956  2232 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:51.436168  3145 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:00:51.442389  3467 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:51.443630  3459 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:51.444052  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:51.449530  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:51.449863  2268 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:51.453342  1539 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:51.440871  1588 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:51.458257  1620 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.460144  3391 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:51.455754  1513 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:51.461356  3391 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.461880  3352 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:51.462116  3450 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:51.462576  3352 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.462980  3450 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.460198  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:51.464247  1696 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.464198  3391 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.465029  3352 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.465420  3450 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:51.451988  3445 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:00:51.444186  3459 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:51.459216  1547 consensus_queue.cc:237] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:51.467274  2232 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:51.431375  3443 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:51.440779  3324 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.479894  1622 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:00:51.485747  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 127846us
I20260709 13:00:51.473470  3459 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.473093  3430 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:51.474174  3358 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.479655  3458 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.480947  3279 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:51.479598  3324 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.493654  3430 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:51.502456  1694 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:51.509090  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.509552  1621 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:51.509768  1690 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:51.511580  1697 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:51.512092  1691 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.509588  1693 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:51.513379  1511 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:51.514365  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.514593  3234 raft_consensus.cc:3055] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:51.515058  3234 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:51.516120  1622 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:51.513633  3448 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:51.517410  3486 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:00:51.517688  3448 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.518337  3448 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:51.524964  3487 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:51.525678  3458 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:51.526253  3458 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.526513  3236 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:51.527251  3467 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:51.528661  3451 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.526605  3458 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:51.536731  3485 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:00:51.507192  3430 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.539315  3433 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.541126  3462 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.516163  3234 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.544691  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.494179  3450 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.499748  3279 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:51.581790  1696 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:51.589637  3445 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:51.590466  3445 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.597626  3388 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.555740  3234 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:51.577602  3279 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.612566  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:51.607949  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:51.551954  3483 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.600849  3445 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:00:51.627662  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.611775  3450 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.632838  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.610416  3324 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.639226  3396 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:51.640105  3396 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.643522  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.601083  3388 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.654683  3310 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.655298  3310 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.656858  3243 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4.
I20260709 13:00:51.646692  3396 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:00:51.658010  3310 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:51.658638  3351 consensus_meta.cc:287] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.669s	user 0.015s	sys 0.003s
I20260709 13:00:51.663712  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.664095  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.664184  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.665006  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.665450  1696 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:51.665320  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:51.694522  1623 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:51.667743  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.629629  3325 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.679747  1697 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:00:51.693483  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.714610  1618 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:51.719525  1619 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:51.724587  1692 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:51.725414  2265 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:51.726866  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.727640  1543 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:51.728319  2268 raft_consensus.cc:1240] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:51.728502  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:51.728641  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.728349  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:51.729332  1696 raft_consensus.cc:2393] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 3: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:51.732365  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.734148  3450 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:51.729461  1544 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 2: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:51.717906  1617 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
W20260709 13:00:51.741436  3359 consensus_meta.cc:287] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.320s	user 0.013s	sys 0.010s
I20260709 13:00:51.741988  3359 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.743705  1690 raft_consensus.cc:2368] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4.
I20260709 13:00:51.669740  3279 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.705482  3330 raft_consensus.cc:359] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:51.735049  3409 consensus_meta.cc:287] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.005s
I20260709 13:00:51.749461  1623 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:51.750283  1618 raft_consensus.cc:2410] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:51.708379  3458 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:51.753733  1513 consensus_peers.cc:597] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 953db44baef24f55a28e65ff051866d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.754951  1540 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:51.755708  3448 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.757956  3448 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:51.760116  3388 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:51.761335  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.709131  3483 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.761309  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:51.766248  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.750177  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.770661  1622 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:51.772149  3406 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:51.772874  3483 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.773178  3406 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.776922  1616 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:51.777345  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.778716  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:51.706027  3325 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.779384  1618 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:51.783672  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.785426  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.785876  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.807228  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.816022  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.817189  1620 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:00:51.788658  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:51.825891  1539 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:51.778894  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.835198  1616 raft_consensus.cc:2410] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:51.836972  1662 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:51.780179  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.846462  1623 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
W20260709 13:00:51.851820  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.788177  3458 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.785760  3325 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.797302  3330 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:00:51.784250  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.784646  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:51.823997  3483 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:51.870079  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 56230.3us
I20260709 13:00:51.870852  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.865180  1617 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:51.772886  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:51.881364  3325 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:51.879020  1542 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:51.871959  1615 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:51.863481  3243 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:51.891984  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.887367  3325 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.896931  3330 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:51.867965  3388 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:00:51.904596  3430 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.907806  3445 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.908648  3445 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.911962  2265 raft_consensus.cc:2368] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3.
I20260709 13:00:51.913337  1541 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:51.914834  3483 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:51.916455  2234 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:51.917034  3406 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.917865  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.919304  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.923385  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.882231  3448 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.925742  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.928002  2234 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:51.899144  3325 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.917419  3483 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:51.953563  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.939803  1623 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:51.960372  3145 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:51.960882  3145 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:51.961278  3145 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.936511  3448 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.921595  3243 raft_consensus.cc:697] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:51.970530  1617 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:51.929612  3388 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:51.962119  1616 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:51.979940  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:51.981072  1542 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:51.984143  3243 consensus_queue.cc:237] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:51.979599  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:51.990258  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:51.979314  3430 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:51.992132  1620 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:51.993069  3458 consensus_queue.cc:1059] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:51.994184  3458 raft_consensus.cc:3055] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:51.994628  3458 raft_consensus.cc:740] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:51.995610  1615 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:51.998438  1618 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:51.999912  2268 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:52.003024  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:52.003769  1539 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:52.004667  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:52.005825  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:52.005927  3325 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.006403  1539 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:52.008867  1513 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:52.006976  3325 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:52.009768  3430 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:52.009938  3502 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:00:52.010461  3430 raft_consensus.cc:697] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:52.011577  3430 consensus_queue.cc:237] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:52.012655  3495 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.163s	user 0.003s	sys 0.000s
I20260709 13:00:51.921854  3459 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.017251  3459 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:52.018435  3458 consensus_queue.cc:260] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.019358  3325 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:52.020203  3458 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:52.024822  3330 ts_tablet_manager.cc:1434] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.619s	user 0.009s	sys 0.004s
I20260709 13:00:52.025374  3483 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.025291  3145 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.026332  3483 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:52.025307  3330 ts_tablet_manager.cc:1467] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Tablet startup took 619ms
I20260709 13:00:52.028826  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:52.041476  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:00:52.043258  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.047730  1544 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:51.979876  3445 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:52.053503  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:52.052851  2232 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:52.073510  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:52.074731  1539 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:00:52.076938  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:52.029072  3483 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:52.046267  3448 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:52.052664  3145 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:52.100061  1542 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:52.068430  3388 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:52.116173  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:52.068593  3325 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.129205  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 55591us
I20260709 13:00:52.123425  1587 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:52.117319  3443 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.115103  3388 raft_consensus.cc:697] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:52.142606  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:00:52.147811  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 219897us
I20260709 13:00:52.162230  1542 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:52.155181  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:52.165776  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:52.166375  2268 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.138188  3445 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.167203  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:52.169485  1618 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.175043  1588 leader_election.cc:400] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3.
I20260709 13:00:52.184556  1588 leader_election.cc:403] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:52.175534  3448 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.187541  1545 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:52.177342  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:52.188493  2264 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:52.188804  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:52.187270  3443 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.181218  3279 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:52.181365  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:52.183529  3466 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:52.184648  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 66493.4us
I20260709 13:00:52.184731  1622 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:52.156050  1586 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.871s (SENT) [suppressed 47 similar messages]
I20260709 13:00:52.186510  2268 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:52.176339  2266 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:52.200603  1542 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:52.201135  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:52.201221  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:52.199246  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:52.212409  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:52.213521  3359 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:52.149117  3325 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:52.213339  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:52.192965  3243 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.218986  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.219254  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 44384.4us
I20260709 13:00:52.225944  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:52.234531  1588 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:00:52.240918  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 84886.4us
I20260709 13:00:52.187803  3445 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:52.249429  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:52.251520  1588 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:52.233412  3456 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.249310  3483 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:52.241875  3451 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:52.237210  3443 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:52.273675  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:52.228292  3243 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:52.286124  1618 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:00:52.293279  1541 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:52.270018  3483 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.245929  3509 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:00:52.273738  3451 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.301590  2232 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:52.282173  3406 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:00:52.029820  3330 ts_tablet_manager.cc:1469] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Trace:
0709 13:00:47.417170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.417437 (+   267us) service_pool.cc:224] Handling call
0709 13:00:47.467021 (+ 49584us) ts_tablet_manager.cc:934] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
0709 13:00:47.732372 (+265351us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:48.633728 (+901356us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:48.633839 (+   111us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:49.367993 (+734154us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:49.429229 (+ 61236us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:49.468061 (+ 38832us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:49.491325 (+ 23264us) inbound_call.cc:177] Queueing success response
0709 13:00:49.735292 (+243967us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:00:51.405535 (+1670243us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:00:51.638989 (+233454us) tablet_replica.cc:261] Starting instrumentation
0709 13:00:51.639720 (+   731us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":476,"mutex_wait_us":28648,"raft.queue_time_us":3376,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"tablet-copy.queue_time_us":45972,"tablet-download-pool.queue_time_us":147,"tablet-download-pool.run_cpu_time_us":1441,"tablet-download-pool.run_wall_time_us":22768,"thread_start_us":30146,"threads_started":2}
I20260709 13:00:52.311295  3455 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:52.323170  3455 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.323585  3395 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.323730  3455 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.324450  3395 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:52.326457  3406 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.326910  3395 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:52.328733  3325 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:52.329340  3325 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:52.329792  3325 raft_consensus.cc:697] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:00:52.331718  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 132684us
I20260709 13:00:52.332610  3243 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:00:52.333555  3493 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.616s	user 0.000s	sys 0.002s
I20260709 13:00:52.333300  3279 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:52.334882  3455 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.312214  3451 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.336439  3445 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:52.308244  3483 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.347024  3455 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:52.328766  3406 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:52.354143  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:52.324988  3340 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:52.357460  3340 raft_consensus.cc:697] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:52.303176  3448 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:52.358739  3340 consensus_queue.cc:237] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.361815  3448 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.274914  3388 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.362259  3448 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.362741  3451 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:52.364199  3483 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.366153  3359 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.330709  3325 consensus_queue.cc:237] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.367622  1446 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52838 (request call id 251) took 3256 ms. Trace:
I20260709 13:00:52.375737  1442 catalog_manager.cc:5697] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 2, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 2 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.382366  3359 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:52.385049  1442 catalog_manager.cc:5697] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 2, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 2 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.370579  3445 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:52.360882  2231 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:52.392382  1548 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:52.387506  1442 catalog_manager.cc:5697] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 2, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 2 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.416352  1690 raft_consensus.cc:1240] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:52.415277  1442 catalog_manager.cc:5697] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 3, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 3 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.424226  1697 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:52.425660  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:52.423589  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:52.419608  3395 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.423781  1442 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 2, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 2 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.449790  3359 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:52.460688  1690 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:52.457329  1442 catalog_manager.cc:5697] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 2 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.432502  3387 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:52.463135  1697 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:52.465540  1442 catalog_manager.cc:5697] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 3, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 3 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:52.488857  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:52.489528  1690 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.490784  3520 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.491524  1689 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:52.383478  1446 rpcz_store.cc:276] 0709 13:00:49.111234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.111371 (+   137us) service_pool.cc:224] Handling call
0709 13:00:52.367162 (+3255791us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:50.253811 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:50.400712 (+146901us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:50.405088 (+  4376us) write_op.cc:435] Acquired schema lock
0709 13:00:50.407649 (+  2561us) tablet.cc:662] Decoding operations
0709 13:00:50.772478 (+364829us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:50.772595 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:50.772632 (+    37us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:00:50.779387 (+  6755us) tablet.cc:701] Row locks acquired
0709 13:00:50.779432 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:00:50.779592 (+   160us) write_op.cc:270] Start()
0709 13:00:50.779718 (+   126us) write_op.cc:276] Timestamp: P: 1783602050779545 usec, L: 0
0709 13:00:50.779742 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:00:50.824480 (+ 44738us) log.cc:844] Serialized 2478 byte log entry
0709 13:00:51.054535 (+230055us) op_driver.cc:464] REPLICATION: finished
0709 13:00:51.212474 (+157939us) write_op.cc:301] APPLY: starting
0709 13:00:51.277521 (+ 65047us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:51.348152 (+ 70631us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:51.371218 (+ 23066us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:51.461606 (+ 90388us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:51.462019 (+   413us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:00:51.462095 (+    76us) write_op.cc:312] APPLY: finished
0709 13:00:51.462555 (+   460us) log.cc:844] Serialized 53 byte log entry
0709 13:00:51.478486 (+ 15931us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:51.555248 (+ 76762us) write_op.cc:454] Released schema lock
0709 13:00:51.581329 (+ 26081us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:51.611227 (+ 29898us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:51.611258 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":691980,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":968,"apply.run_cpu_time_us":6484,"apply.run_wall_time_us":490798,"num_ops":6,"prepare.queue_time_us":273649,"prepare.run_cpu_time_us":11879,"prepare.run_wall_time_us":758111,"raft.queue_time_us":11285,"raft.run_cpu_time_us":1567,"raft.run_wall_time_us":131096,"replication_time_us":274661,"thread_start_us":390963,"threads_started":4,"wal-append.queue_time_us":194039}]]}
I20260709 13:00:52.492677  1663 leader_election.cc:400] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4.
I20260709 13:00:52.497444  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:52.497476  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 136864us
I20260709 13:00:52.499600  1694 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:52.477705  3451 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:52.502400  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 200907us
I20260709 13:00:52.507786  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:52.508791  1693 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:52.510860  2231 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:52.512205  3145 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:52.513247  3483 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:52.493790  3387 raft_consensus.cc:697] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:52.466476  3395 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:52.521840  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 154884us
I20260709 13:00:52.524322  1690 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
W20260709 13:00:52.520856  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 286553us
W20260709 13:00:52.544675  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 284311us
I20260709 13:00:52.555130  1587 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:52.564158  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:52.491331  3520 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:52.575686  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.565793  1586 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:00:52.580817  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 329328us
I20260709 13:00:52.516398  3359 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:00:52.603008  2234 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:52.519176  3145 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:00:52.577353  3451 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:52.617055  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 70409us
I20260709 13:00:52.616575  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:52.626983  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:52.627964  2270 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.622756  1586 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:00:52.637137  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 121382us
I20260709 13:00:52.613740  3451 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:52.642980  1661 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:52.656030  1558 tablet_copy_service.cc:342] P 44c8c572048a40b1a5e71865068ed1bb: Request end of tablet copy session e37b8013aec24431a6672a857806329e-11a34da7993e4fee9ff4fc1266a6af38 received from {username='slave'} at 127.0.0.1:53718
I20260709 13:00:52.656329  3519 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:52.656911  1558 tablet_copy_service.cc:434] P 44c8c572048a40b1a5e71865068ed1bb: ending tablet copy session e37b8013aec24431a6672a857806329e-11a34da7993e4fee9ff4fc1266a6af38 on tablet 11a34da7993e4fee9ff4fc1266a6af38 with peer e37b8013aec24431a6672a857806329e
I20260709 13:00:52.656960  3519 raft_consensus.cc:697] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:52.636283  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:52.658239  3519 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.667908  3527 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 13:00:52.684520  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.652536  3451 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.671962  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:52.616480  3526 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:00:52.698376  2268 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:52.656131  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:52.663930  3533 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:52.718096  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.701884  3527 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.705415  3509 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.727375  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 104703us
I20260709 13:00:52.702737  3359 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:52.704005  3535 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:52.638160  3387 consensus_queue.cc:237] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.709064  3533 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.728751  1586 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:00:52.726787  3529 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 13:00:52.740675  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 68884.7us
I20260709 13:00:52.672389  3531 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:00:52.713600  3448 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:52.731766  3236 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.749536  1586 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:52.736677  3455 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:52.764323  1587 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:52.736440  3533 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:52.774026  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.733896  3359 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:52.742152  3528 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:52.733093  3527 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.733372  3509 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.774403  3455 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:52.775578  3456 consensus_meta.cc:287] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.001s
W20260709 13:00:52.788872  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 146004us
I20260709 13:00:52.782085  3325 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:52.778704  3528 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.780826  3520 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:52.769800  3236 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:52.788480  3455 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.787546  3538 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:52.787546  3542 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:52.784468  3547 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:52.804893  1661 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:52.795485  3543 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:52.793351  3456 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3.
W20260709 13:00:52.809991  3540 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:00:52.813308  3509 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:00:52.813547  3534 log.cc:927] Time spent T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:00:52.814698  3530 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 13:00:52.814939  3466 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:52.794328  3544 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:52.818575  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:52.741761  3535 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:52.818461  3547 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.795203  3528 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:52.820952  3524 log.cc:927] Time spent T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:00:52.824244  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:52.852326  1548 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:52.831547  3526 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.816954  3359 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:52.832124  3520 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:52.832387  3279 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:52.839039  2270 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:00:52.840458   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:52.861183  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 221779us
I20260709 13:00:52.862056  1663 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:52.845184  3544 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.863799  3544 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.854440  3550 ts_tablet_manager.cc:933] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:00:52.821321  3543 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.822450  3519 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:52.859359  1623 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:52.857007  3456 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.861263  1588 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:52.864058  2232 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:52.851645  3547 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.858373  3520 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.861383  3527 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:52.821265  3542 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.882850  1587 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:52.823200  3538 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.877266  3456 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:52.857101  3466 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.870505  3543 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:52.858428  3526 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:52.878262  3520 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.919975  3556 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:52.920663  3483 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:52.856706  3533 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:52.924088  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 43892.6us
I20260709 13:00:52.865235  3279 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.945792  3279 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:52.870177  3549 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
W20260709 13:00:52.929306  3548 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:52.947309  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:52.929926  3535 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:52.930289  3554 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:00:52.931581  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 57150.6us
W20260709 13:00:52.932374  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 84185.3us
I20260709 13:00:52.887778  3459 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:52.912858  3448 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:52.914237  3395 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:00:52.938434  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 86578.9us
I20260709 13:00:52.940677  1663 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:52.942289  3556 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:52.872032  3519 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:52.911922  3516 consensus_queue.cc:1059] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
W20260709 13:00:52.970435  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 185542us
I20260709 13:00:52.964321  1661 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:52.980507  3541 raft_consensus.cc:2764] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:52.952107  1543 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:00:53.011854  1587 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:52.976744  3459 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.977314  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:53.008123  3533 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:53.016451  1514 leader_election.cc:336] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.726s (SENT)
W20260709 13:00:53.040848  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 89470.4us
I20260709 13:00:53.039669  1514 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:53.043196  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:00:53.043448  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 102286us
I20260709 13:00:53.032428  3459 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.030241  3456 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:53.049343  1587 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:53.054167  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:53.028499  3526 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:53.025075  3538 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:53.020342  3466 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:53.028882  3516 consensus_queue.cc:1243] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer e37b8013aec24431a6672a857806329e log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:53.029117  3519 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:53.056484  3310 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:53.030191  3455 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.045943  3558 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:53.052502  3541 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:53.052729  3243 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:00:53.066315  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:53.067098  2266 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:53.088573  2270 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:53.049640  3542 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:53.090955  2232 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:53.092968  3464 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:53.093387  3464 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:53.094014  3464 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.076087  3456 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:53.069041  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:53.096573  1513 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:53.097325  3538 consensus_queue.cc:1059] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:53.098160  1543 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:53.099604  3456 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:53.099908  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:53.100320  3466 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:53.100741  3466 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:53.070022  3556 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:53.106856  3538 raft_consensus.cc:3055] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:53.107285  3538 raft_consensus.cc:740] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:53.108080  3538 consensus_queue.cc:260] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:53.109299  3538 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.084509  3541 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.109841  3541 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.110623  3459 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:53.100035  3456 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:00:53.125924  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 120152us
W20260709 13:00:53.101974  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.102972  1587 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:53.043263  3448 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:53.104071  3518 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:53.104627  3388 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:53.105643  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:53.101100  3466 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.095252  3520 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.084183  3558 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:53.116044  3236 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:53.135944  1539 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:53.117350  3550 tablet_copy_client.cc:323] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.129:46597
W20260709 13:00:53.117769  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 64949.2us
I20260709 13:00:53.069698  3559 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:53.137797  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:53.135739  3388 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:53.154598  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:53.155210  3551 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.348s	user 0.005s	sys 0.000s
I20260709 13:00:53.155499  1697 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 2: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:53.156461  3388 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:53.157123  1696 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:53.157387  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.157159  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.158308  1691 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:53.134708  3528 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.139372  3519 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:53.140332  1587 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:53.163338  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 57409.9us
I20260709 13:00:53.134147  3448 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.141278  3541 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.141609  3547 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.127580  3456 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:53.135897  3558 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:53.145313  3544 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.143132  3451 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.164563  1663 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:00:53.148051  1514 leader_election.cc:336] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.836s (SENT)
I20260709 13:00:53.184345  1514 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:53.175761  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.125195  3543 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.184343  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.158533  1693 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:53.173519  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.175650  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.178143  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:53.192322  1688 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:53.179667  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.136159  3556 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:53.186368  1689 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 2: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:53.149322  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.187433  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.161144  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.173980  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.153565  3559 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:53.195514  1690 raft_consensus.cc:2368] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3.
I20260709 13:00:53.411720  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.319629  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:53.272188  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:53.251116  1618 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:53.301828  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:53.193298  1539 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
W20260709 13:00:53.247080  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 82705.1us
I20260709 13:00:53.418326  1696 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:53.272166  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.296270  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:53.419133  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:53.246868  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.413683  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.251600  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:53.423493  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:53.174165  3448 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.272639  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.317124  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.425664  1694 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:53.423136  1615 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
W20260709 13:00:53.427773  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 300937us
I20260709 13:00:53.180064  3544 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:53.424242  1617 raft_consensus.cc:2368] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3.
I20260709 13:00:53.317101  1616 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:53.431022  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.433234  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:53.433797  1691 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:53.435015  1619 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:53.285710  3236 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:53.367368  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:53.302578  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:53.442291  1692 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:53.193984  3325 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:53.444175  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.451443  1697 raft_consensus.cc:2410] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:53.446046  1614 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:53.447160  1621 raft_consensus.cc:2410] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:53.445416  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:53.453011  1620 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.442431  1689 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:53.454766  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:53.338322  3565 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:53.436326  3393 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:53.410547  3455 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:53.458103  1615 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:53.273422  3406 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:53.422173  3559 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.458377  1511 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:53.417121  3556 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:53.261114  3516 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:53.455588  1514 leader_election.cc:336] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.892s (SENT)
I20260709 13:00:53.316408  3466 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:53.430857  3310 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:53.461675  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.471346  1514 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:53.432204  3459 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:53.472406  3556 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.478530  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.479311  3458 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:53.480125  3537 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:53.435382  3541 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:53.473124  3520 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:53.448762  3545 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.448496  3542 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:00:53.512115  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:53.476640  3544 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.450815  3325 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:53.517503  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:53.526115  1691 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.520236  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:53.471663  3236 consensus_queue.cc:1059] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:00:53.489821  3516 raft_consensus.cc:697] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:53.448078  3532 consensus_queue.cc:1059] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:00:53.528514  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:53.458834  3395 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:00:53.473640  3393 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.485571  3234 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:00:53.481230  3430 consensus_queue.cc:1059] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:00:53.455874  3565 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.488085  3406 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:53.488583  3310 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:53.532956  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.713941  1689 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:00:53.714956  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:53.693817  3543 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:53.589233  1622 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:53.592422  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:53.721688  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:53.692694  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 172590us
I20260709 13:00:53.735301  1616 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:53.536103  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:53.647651  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 210313us
I20260709 13:00:53.724426  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:53.736809  1615 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:53.740805  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:53.741534  1622 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:53.620288  2266 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:53.743568  1616 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:53.747038  2268 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:53.748648  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:53.749504  1544 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:53.751269  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.568324  3564 log.cc:927] Time spent T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.409s	user 0.002s	sys 0.000s
I20260709 13:00:53.531124  3325 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.757136  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:53.757803  1541 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:53.758687  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:53.753115  1543 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:53.656661  3458 raft_consensus.cc:3055] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:53.753695  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:53.724164  3466 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:53.756508  3310 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:53.593063  3537 raft_consensus.cc:697] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:00:53.763900  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 227737us
I20260709 13:00:53.780696  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:53.655979  3519 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:00:53.759397  1541 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 2: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:53.759840  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:53.761538  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:53.786891  1539 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:53.727886  3451 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:53.647680  3236 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:53.612991  3547 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:53.764873  1542 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:53.765659  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:53.770248  1616 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:53.769981  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:53.774243  3466 raft_consensus.cc:3055] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:53.742985  3528 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:53.740368  3558 consensus_meta.cc:287] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 13:00:53.529368  3535 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.532315  3544 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.811738  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:53.812537  1548 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.814543  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:53.785331  1614 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:53.759684  3575 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.792369  1547 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:53.794701  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:53.794953  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:53.767594  3458 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:53.797931  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:53.822721  1541 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:53.786437  3538 consensus_meta.cc:287] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.677s	user 0.013s	sys 0.002s
I20260709 13:00:53.799113  1622 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:53.795567  3466 raft_consensus.cc:740] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:53.845491  1615 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:53.844642  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 97811.1us
W20260709 13:00:53.847373  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.847854  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:53.851959  1614 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:53.853447  1622 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:53.816787  3558 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.827147  3578 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:53.844609  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:53.824540  3535 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.898136  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:53.903297  1690 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.824935  3575 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:53.903388  1546 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:53.904893  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:53.910333  1689 raft_consensus.cc:2368] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4.
I20260709 13:00:53.913116  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:53.914067  1695 raft_consensus.cc:2368] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4.
I20260709 13:00:53.915622  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:53.908318  3566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.012s
I20260709 13:00:53.920370  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.925454  1689 raft_consensus.cc:2368] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4.
I20260709 13:00:53.921988  1661 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:53.888576  3458 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.932312  3458 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:53.936529  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:53.936738  1620 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:53.937307  1622 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:00:53.938158  1544 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:53.940706  1539 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:53.940541  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:53.947279  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:00:53.952127  1541 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:53.960790  3393 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:53.932354  3582 log.cc:927] Time spent T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:00:53.997629  1546 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:00:53.970070  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:53.926498  3566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.006s	sys 0.012s
I20260709 13:00:53.976501  3565 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:53.845981  3516 consensus_queue.cc:237] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.984970  3542 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:54.017740  3544 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:53.911273  3466 consensus_queue.cc:260] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:54.044230  3466 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.047888  3325 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:54.049309  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:54.050105  1696 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:54.051950  1621 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:54.051199  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:54.056595  3455 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:54.058038  2231 leader_election.cc:400] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4.
I20260709 13:00:54.055635  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:49328
W20260709 13:00:53.985206  3456 consensus_meta.cc:287] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.806s	user 0.010s	sys 0.005s
I20260709 13:00:53.987923  1691 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:53.943598  3586 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.899777  3537 consensus_queue.cc:237] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:53.989472  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:53.987962  1690 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:53.979856  3596 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:53.996351  1548 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
W20260709 13:00:53.964926  3594 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:54.006860  1620 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:00:54.007504  3589 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:00:54.043069  3559 consensus_meta.cc:287] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.000s
I20260709 13:00:54.059476  1696 raft_consensus.cc:606] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:54.225430  1696 raft_consensus.cc:614] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:54.156060  1663 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.031s	sys 0.026s
I20260709 13:00:54.161110  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:54.419826  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:54.421011  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:54.421667  1697 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:54.422464  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:00:54.424546  3610 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.052s	user 0.003s	sys 0.001s
W20260709 13:00:54.166602  3545 consensus_meta.cc:287] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.642s	user 0.014s	sys 0.009s
I20260709 13:00:54.168496  3535 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:54.169894  3558 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:54.427763  3545 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:54.060783  3448 consensus_meta.cc:287] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.004s
I20260709 13:00:54.428506  3448 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:54.430274  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:54.431209  3448 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:54.061224  3556 consensus_meta.cc:287] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.500s	user 0.006s	sys 0.020s
I20260709 13:00:54.431732  1692 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.432133  3556 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:54.433547  1617 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:54.434551  3556 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:54.195587  3325 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:54.196904  3393 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:54.435748  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.436035  3393 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:54.436980  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.438130  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.438315  3393 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:54.098474  2231 leader_election.cc:400] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4.
I20260709 13:00:54.205607  1622 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:54.439013  1617 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:54.201898  3544 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:54.224270  3596 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.440070  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.440217  2234 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:54.440419  3596 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.440840  1617 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:54.441694  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.442811  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.221730  3586 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:54.443392  1617 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:54.444386  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.444970  1617 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:54.445817  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.446557  1617 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:54.250702  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.447183  1620 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:00:54.220113  3456 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:54.262632  3595 consensus_queue.cc:1059] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:54.237818  3464 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 1.143s	user 0.020s	sys 0.014s
I20260709 13:00:54.448689  3464 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:54.449800  3456 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:54.450484  3456 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.264091  3466 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:54.451495  3456 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:54.452831  1618 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:54.454231  3456 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:54.229105  3458 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.457293  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 440) took 1354 ms. Trace:
W20260709 13:00:54.308310  3527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.006s	sys 0.009s
W20260709 13:00:54.458042  3527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.278s	user 0.007s	sys 0.009s
W20260709 13:00:54.458114  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 398875us
I20260709 13:00:54.294559  3528 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:00:54.459167  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:54.459793  3532 raft_consensus.cc:3055] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:54.460191  3532 raft_consensus.cc:740] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:54.460554  2231 leader_election.cc:400] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4.
I20260709 13:00:54.305491  3310 consensus_queue.cc:1059] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:00:54.303555  3579 consensus_queue.cc:1059] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:00:54.461310  3310 raft_consensus.cc:3055] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:54.461557  3579 raft_consensus.cc:3055] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:54.461781  3310 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:54.462047  3579 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:54.462261  3525 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:54.462750  3525 raft_consensus.cc:697] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:54.462916  3579 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:54.463613  3459 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:54.325640  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.464388  3579 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.311751  3578 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
W20260709 13:00:54.336395  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.337283  1661 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:54.341739  3359 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:00:54.346592  3516 consensus_queue.cc:1059] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:54.481096  3516 raft_consensus.cc:3055] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:54.348289  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.481540  3527 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:54.314302  3538 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:00:54.482148  3527 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.482522  3527 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.314251  3584 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:00:54.360932  3526 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.376761  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:54.376286  3574 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:54.360322  3387 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:54.484704  1695 raft_consensus.cc:2376] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 4. Re-sending same reply.
I20260709 13:00:54.485163  3387 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:54.485737  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:54.484982  3574 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:54.486579  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.387992  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:54.389964  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.488595  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:54.488691  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:54.489568  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "738a15ae04514d49969f3624caa73f45"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:49328
I20260709 13:00:54.490096  1689 raft_consensus.cc:606] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:54.390298  2232 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:54.490792  1696 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:54.491344  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 101104us
I20260709 13:00:54.491811  1558 tablet_copy_service.cc:140] P 44c8c572048a40b1a5e71865068ed1bb: Received BeginTabletCopySession request for tablet 953db44baef24f55a28e65ff051866d1 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:53718)
I20260709 13:00:54.492354  1558 tablet_copy_service.cc:161] P 44c8c572048a40b1a5e71865068ed1bb: Beginning new tablet copy session on tablet 953db44baef24f55a28e65ff051866d1 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:53718: session id = e37b8013aec24431a6672a857806329e-953db44baef24f55a28e65ff051866d1
I20260709 13:00:54.393438  3549 raft_consensus.cc:3055] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:54.493510  3549 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:54.493505  3574 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:54.494458  3549 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:54.394482  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.495743  1621 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:00:54.496696  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.497604  1621 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 2: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:54.417301  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:54.446395  3586 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:54.455014  3456 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.456151  2266 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:00:54.296871  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:00:54.516247  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 219899us
I20260709 13:00:54.517495  1586 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:54.456944  3458 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:54.242712  3559 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:54.460294  3528 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:00:54.335274  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.465294  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.526039  1617 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:00:54.526723  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.466856  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:54.467017  1623 raft_consensus.cc:2368] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5.
W20260709 13:00:54.467218  1663 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.034s	sys 0.028s
I20260709 13:00:54.467727  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:54.472370  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 135205us
I20260709 13:00:54.473384  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:54.473949  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.529951  1622 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:00:54.530519  1544 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:54.474327  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:54.475122  1692 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:00:54.439730  3544 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:54.500097  3574 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:54.476538  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:54.536711  1690 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 2: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:54.477067  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:54.477707  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:54.537042  1586 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:54.478024  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:00:54.478289  3607 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.108s	user 0.000s	sys 0.003s
I20260709 13:00:54.478559  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:54.537964  1542 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:54.538864  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.480258  3575 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:54.481559  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.482331  1614 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:54.487181  1545 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.387048  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.540884  1615 raft_consensus.cc:2410] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:00:54.395639  3605 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:00:54.500739  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.542860  1621 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:54.543816  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:54.510771  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:54.518922  3448 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:54.519605  3565 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:54.522127  1689 raft_consensus.cc:1240] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:54.521706  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:54.448697  3595 raft_consensus.cc:3055] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:54.524478  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:54.529361  1616 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:54.484627  3526 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:54.462864  3310 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:54.530576  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:54.472404  3535 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:54.555058  1688 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:54.532799  3509 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:54.476233  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:54.479147  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1308) took 1151 ms. Trace:
I20260709 13:00:54.539319  1542 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.537339  1547 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:00:54.481607  3516 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:54.535998  3466 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:00:54.514875  3456 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:54.545590  1586 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:54.545392  1514 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:54.548915  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.531787  3387 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:54.547937  1548 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
W20260709 13:00:54.530716  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 932992us
I20260709 13:00:54.551818  1690 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:54.527521  3464 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:54.552825  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:54.532961  1697 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:54.534049  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.556710  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.536269  3574 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:54.538002  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:54.540563  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:54.741783  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52808 (request call id 197) took 2540 ms. Trace:
I20260709 13:00:54.546741  3549 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.570888  2270 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:54.583896  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:54.584385  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:49328
I20260709 13:00:54.576198  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.709892  1545 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
W20260709 13:00:54.767149  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.726318  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:54.725466  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2220) took 1264 ms. Trace:
I20260709 13:00:54.561951  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.725874  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:54.772739  1544 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.543578  3556 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:54.549731  3595 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:00:54.777464  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 224672us
I20260709 13:00:54.772228  1618 rpcz_store.cc:276] 0709 13:00:53.328261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.427718 (+ 99457us) service_pool.cc:224] Handling call
0709 13:00:53.436233 (+  8515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.453415 (+1017182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.478891 (+ 25476us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003ccdd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:54.479065 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2337353088}
W20260709 13:00:54.718508  1623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1301) took 1469 ms (client timeout 1892 ms). Trace:
I20260709 13:00:54.800359  1617 raft_consensus.cc:2410] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:54.724493  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:54.809928  1614 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.558674  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.588331  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.801970  1688 raft_consensus.cc:606] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:54.696141  3310 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.730437  3532 consensus_queue.cc:260] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:54.816311  3532 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:54.816547  3595 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:54.574158  3526 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:54.590575  3406 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:54.575939  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:54.805197  1615 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:54.546458  3393 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:54.805300  1661 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:54.546344  3565 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:54.806412  1623 rpcz_store.cc:269] 0709 13:00:53.249516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.249666 (+   150us) service_pool.cc:224] Handling call
0709 13:00:54.718238 (+1468572us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003cb9d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:54.718381 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2334108032}
I20260709 13:00:54.846721  1661 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:54.679708  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:54.697827  3509 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:54.820246  1539 raft_consensus.cc:2410] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:54.820638  1619 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:00:54.822052  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 276723us
W20260709 13:00:54.658270  2231 leader_election.cc:336] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.617s (SENT)
W20260709 13:00:54.777262  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 231696us
I20260709 13:00:54.574705  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:54.586534  3613 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.215s	user 0.002s	sys 0.002s
I20260709 13:00:54.457885  2264 rpcz_store.cc:276] 0709 13:00:53.103051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.118435 (+ 15384us) service_pool.cc:224] Handling call
0709 13:00:53.135600 (+ 17165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.180747 (+ 45147us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:53.354839 (+174092us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.719893 (+365054us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b1800420a60. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de23a 00007f5c6ab48a2a
0709 13:00:53.811546 (+ 91653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:53.819907 (+  8361us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:53.822616 (+  2709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.205952 (+383336us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b1800420a60. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a1f2a6 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419
0709 13:00:54.456849 (+250897us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b54008309d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:54.456932 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.457172 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2657,"prepare.queue_time_us":143812,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":11748,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":11109,"spinlock_wait_cycles":132432128,"thread_start_us":73414,"threads_started":1,"wal-append.queue_time_us":493650}
I20260709 13:00:54.827175  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.849208  1514 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:54.827282  3579 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:54.827947  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:54.828152  2265 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:54.828518  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.803758  3556 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.855527  1540 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:00:54.803956  3325 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:54.773856  1442 rpcz_store.cc:276] 0709 13:00:52.201779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.202024 (+   245us) service_pool.cc:224] Handling call
0709 13:00:54.741676 (+2539652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:52.801260 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:52.832358 (+ 31098us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:52.832457 (+    99us) write_op.cc:435] Acquired schema lock
0709 13:00:52.832478 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:52.913195 (+ 80717us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:52.913336 (+   141us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:52.913376 (+    40us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:00:52.914078 (+   702us) tablet.cc:701] Row locks acquired
0709 13:00:52.914131 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:00:52.914302 (+   171us) write_op.cc:270] Start()
0709 13:00:52.914508 (+   206us) write_op.cc:276] Timestamp: P: 1783602052914236 usec, L: 0
0709 13:00:52.914526 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:00:52.950803 (+ 36277us) log.cc:844] Serialized 2870 byte log entry
0709 13:00:53.173300 (+222497us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b1800271300. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a4e455 00007f5c6aabb190 00007f5c6aab4ae7 00007f5c6aab3dd9 00007f5c6aabe930
0709 13:00:53.528631 (+355331us) op_driver.cc:464] REPLICATION: finished
0709 13:00:53.963681 (+435050us) write_op.cc:301] APPLY: starting
0709 13:00:53.984124 (+ 20443us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:53.985897 (+  1773us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:53.985943 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:53.987623 (+  1680us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:53.987900 (+   277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:00:53.987946 (+    46us) write_op.cc:312] APPLY: finished
0709 13:00:53.988277 (+   331us) log.cc:844] Serialized 59 byte log entry
0709 13:00:53.999605 (+ 11328us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:54.007951 (+  8346us) write_op.cc:454] Released schema lock
0709 13:00:54.008001 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:54.008474 (+   473us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:54.008500 (+    26us) write_op.cc:454] Released schema lock
0709 13:00:54.399845 (+391345us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b54000393d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3b32a 00007f5c6aac0f14 00007f5c6aac0ec3 00007f5c6aac0e38 00007f5c6aac0df3 00007f5c6aac00dc 00007f5c6aae9e16 00007f5c6aad1cbb 00007f5c6aabc39d 00007f5c6aabfd75
Metrics: {"mutex_wait_us":135466,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":421337,"apply.run_cpu_time_us":8121,"apply.run_wall_time_us":44771,"num_ops":7,"prepare.queue_time_us":138663,"prepare.run_cpu_time_us":41941,"prepare.run_wall_time_us":255155,"raft.queue_time_us":405445,"raft.run_cpu_time_us":49325,"raft.run_wall_time_us":921372,"replication_time_us":585936,"spinlock_wait_cycles":16326912,"thread_start_us":582168,"threads_started":4,"wal-append.queue_time_us":92408}]]}
I20260709 13:00:54.676306  3578 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:54.802847  3541 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:54.823537  1692 rpcz_store.cc:276] 0709 13:00:53.453960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.454392 (+   432us) service_pool.cc:224] Handling call
0709 13:00:54.717146 (+1262754us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54000e7ed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:54.717261 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2245270400}
I20260709 13:00:54.575693  3535 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:54.873737  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 215505us
I20260709 13:00:54.871600  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:54.882598  1539 raft_consensus.cc:2410] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:54.773332  3574 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.838304  1620 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:00:54.681056  3607 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:00:54.823136  1621 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:54.676955  3596 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:54.844280  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.892809  1546 raft_consensus.cc:2368] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3.
W20260709 13:00:54.893154  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.845211  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.697762  3443 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.848063  1542 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:54.906525  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.849696  1618 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:54.849990  1622 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:54.851926  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1316) took 1142 ms. Trace:
I20260709 13:00:54.559455  3558 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:54.675998  3430 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:54.830889  1511 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:54.776144  3544 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:54.673364  3458 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:54.736459  1443 catalog_manager.cc:5697] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:54.858197  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:54.678736  3559 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:54.834561  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.858278  3359 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:54.868537  3393 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.854890  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.863981  1544 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:54.885711  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.853367  3565 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.905381  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.905025  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.933712  1623 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:00:54.908838  1619 rpcz_store.cc:276] 0709 13:00:53.709566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.713757 (+  4191us) service_pool.cc:224] Handling call
0709 13:00:54.448032 (+734275us) spinlock_profiling.cc:243] Waited 912 us on lock 0x7b5800085298. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:00:54.588052 (+140020us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b5800085298. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19e9c 00007f5c67a19a5b 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:00:54.851856 (+263804us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44257024}
I20260709 13:00:54.935247  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:54.935468  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.894115  1615 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:54.936311  1621 raft_consensus.cc:2368] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3.
I20260709 13:00:54.937245  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:54.938238  1615 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:54.938642  1542 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:00:54.859620  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:54.939793  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:54.940155  1547 raft_consensus.cc:2410] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:54.941311  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.941934  1547 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:00:54.942480  1547 pending_rounds.cc:85] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 5
I20260709 13:00:54.942793  1547 pending_rounds.cc:107] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:00:54.859171  3325 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.943687  3325 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:54.858355  3556 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.914214  1443 catalog_manager.cc:5697] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:54.948882  1443 catalog_manager.cc:5697] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:54.917201  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.868637  3545 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:54.909265  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 78448.7us
I20260709 13:00:54.956195  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.922634  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:54.931007  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.936349  1619 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
W20260709 13:00:54.959157  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.960357  1619 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:54.952152  1622 raft_consensus.cc:2410] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:54.860085  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:54.952854  1695 raft_consensus.cc:2368] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4.
I20260709 13:00:54.932310  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.962509  1620 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:00:54.953061  1539 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:54.953851  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:49328
I20260709 13:00:54.964982  1692 raft_consensus.cc:606] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:00:54.965636  1692 raft_consensus.cc:614] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:54.966593  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1319) took 1216 ms. Trace:
I20260709 13:00:54.951236  1443 catalog_manager.cc:5697] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:54.919390  3466 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:54.967234  1541 rpcz_store.cc:276] 0709 13:00:53.750197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.953430 (+203233us) service_pool.cc:224] Handling call
0709 13:00:53.953924 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.993215 (+ 39291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.993254 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.200818 (+207564us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.356076 (+155258us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:54.362110 (+  6034us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.363553 (+  1443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.363632 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.477156 (+113524us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b18002edc20. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a1f2a6 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db
0709 13:00:54.477721 (+   565us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:00:54.966314 (+488593us) raft_consensus.cc:1685] finished
0709 13:00:54.966346 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.966512 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1809,"prepare.queue_time_us":6476,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":10277,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":1287,"spinlock_wait_cycles":21334144,"thread_start_us":133524,"threads_started":1,"wal-append.queue_time_us":166413}
I20260709 13:00:54.943143  1547 raft_consensus.cc:2889] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:54.911026  3566 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:54.672569  3525 consensus_queue.cc:237] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:54.983253  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:54.923672  3544 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:54.985487  1545 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:00:54.990864  1617 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:54.996829  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.965442  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:54.990008   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:54.916386  3443 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:54.982131  3466 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.923354  3430 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:55.013999  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:54.894527  3578 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:55.016031   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:55.016563  1540 raft_consensus.cc:1240] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:54.964926  3516 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:55.016640  1541 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:55.166177  3443 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:54.993204  3566 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:55.169054  3516 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.169898  3430 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:54.998831  3544 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:55.146185  3623 log.cc:927] Time spent T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:00:55.101836  3617 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:00:55.171218  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:00:55.126586  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 263904us
I20260709 13:00:55.172701  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:55.173166  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 218) took 1116 ms. Trace:
I20260709 13:00:55.012749  3456 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:55.173516  3629 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:55.173640  1691 rpcz_store.cc:276] 0709 13:00:54.056910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.549417 (+492507us) service_pool.cc:224] Handling call
0709 13:00:54.550537 (+  1120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.558819 (+  8282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.558863 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.680251 (+121388us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.839031 (+158780us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:54.857477 (+ 18446us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.986364 (+128887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.986442 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.172951 (+186509us) raft_consensus.cc:1685] finished
0709 13:00:55.172969 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.173110 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3629,"prepare.queue_time_us":18224,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":2663,"raft.queue_time_us":303064,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":17434,"thread_start_us":276171,"threads_started":2,"wal-append.queue_time_us":289919}
I20260709 13:00:55.175086  1587 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:55.176082  3629 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:55.177925  1539 raft_consensus.cc:2393] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:00:55.178058  3466 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:55.091224  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 206916us
W20260709 13:00:55.183476  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.184844  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 321387us
I20260709 13:00:55.185905  1514 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:55.187366  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:55.177896  1587 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:55.217675  1587 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:00:55.231398  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 354850us
I20260709 13:00:55.235054  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:00:55.245530  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 58248.9us
I20260709 13:00:55.246577  1514 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:55.235253  3430 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:55.248572  3430 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:55.243284  1587 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:55.265336  1514 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:55.270905  1587 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:00:55.319501  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 48717.2us
I20260709 13:00:55.320209  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:55.244886  3538 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:55.243184  3629 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:55.321094  1587 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:55.245280  3595 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.323266  3533 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:55.323719  3526 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:55.333321  3566 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:55.256392  3310 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:55.362344  3310 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:55.362788  3310 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:55.368556  3566 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:00:55.370632  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.372265  3310 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:55.252810  3456 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:55.373570  3456 raft_consensus.cc:697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:55.374873  3456 consensus_queue.cc:237] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:55.260820  3430 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:55.352233  3596 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:55.352799  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:55.357084  3535 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:55.356464  3629 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:00:55.410998  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.411993  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 146760us
I20260709 13:00:55.413337  1514 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:55.404599  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 224089us
I20260709 13:00:55.420727  1514 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:55.360080  3448 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:00:55.425204  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.403398  3406 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.405102  3586 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:55.400986  3509 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:55.420974  3527 consensus_meta.cc:287] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.936s	user 0.014s	sys 0.001s
I20260709 13:00:55.443866  1623 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:55.444428  3545 raft_consensus.cc:697] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:55.446115  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1249) took 1109 ms. Trace:
I20260709 13:00:55.408469  3629 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:55.423143  3535 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:55.565668  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.573702  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 153078us
W20260709 13:00:55.564457  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 143937us
I20260709 13:00:55.574599  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:55.575394  1661 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:00:55.586874  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.551951  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:55.423075  3528 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:55.577874  1615 rpcz_store.cc:276] 0709 13:00:54.336887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.938911 (+602024us) service_pool.cc:224] Handling call
0709 13:00:54.939360 (+   449us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:54.971577 (+ 32217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.971622 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:54.981628 (+ 10006us) log.cc:844] Serialized 52 byte log entry
0709 13:00:55.445356 (+463728us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:55.445396 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.445491 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.445777 (+   286us) raft_consensus.cc:1685] finished
0709 13:00:55.445796 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.446018 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4452,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":6973,"thread_start_us":420558,"threads_started":1,"wal-append.queue_time_us":442257}
W20260709 13:00:55.490492  3558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.008s	sys 0.006s
W20260709 13:00:55.551017  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.628665  1623 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:00:55.208102  3443 consensus_queue.cc:1175] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e37b8013aec24431a6672a857806329e" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:55.433435  3586 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:55.436599  3406 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:55.638154  3586 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:55.454490  3541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.006s	sys 0.003s
I20260709 13:00:55.610617  1546 raft_consensus.cc:2410] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:55.590011  3579 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.646127  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2137) took 1137 ms. Trace:
I20260709 13:00:55.588485  3458 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.609545  3325 consensus_meta.cc:287] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.004s
I20260709 13:00:55.450924  3559 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:55.635893  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:00:55.639272  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 63954.4us
I20260709 13:00:55.520498  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:55.572379  3535 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:55.640651  1663 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:55.425676  3626 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:55.648211  1614 consensus_meta.cc:287] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.828s	user 0.006s	sys 0.007s
I20260709 13:00:55.761966  1614 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:55.762809  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1256) took 1402 ms. Trace:
W20260709 13:00:55.655604  3541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.012s	sys 0.011s
I20260709 13:00:55.646505  1546 rpcz_store.cc:276] 0709 13:00:54.508898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.911264 (+402366us) service_pool.cc:224] Handling call
0709 13:00:55.454911 (+543647us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5800093398. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:00:55.646061 (+191150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24034560}
W20260709 13:00:55.694437  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 497131us
W20260709 13:00:55.627985  3558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.014s	sys 0.007s
I20260709 13:00:55.739171  2234 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:55.763268  1614 rpcz_store.cc:276] 0709 13:00:54.360658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.708548 (+347890us) service_pool.cc:224] Handling call
0709 13:00:55.762726 (+1054178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:55.649457  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:55.792141  1544 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.518275  3527 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:55.794729  1693 raft_consensus.cc:2368] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3.
W20260709 13:00:55.800628  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 441063us
W20260709 13:00:55.798110  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 59074.3us
W20260709 13:00:55.835983  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 178196us
I20260709 13:00:55.875782  1661 leader_election.cc:400] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3.
I20260709 13:00:55.876165  1661 leader_election.cc:403] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:55.695087  3325 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:55.876557  3455 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:00:56.048097  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 407507us
W20260709 13:00:55.909857  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 335077us
I20260709 13:00:55.813763  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:56.048758  3455 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:55.966089  1617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.015s	sys 0.042s
W20260709 13:00:55.924540  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 48919.9us
I20260709 13:00:55.892135  1587 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:00:55.892654  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2232) took 1622 ms (client timeout 1851 ms). Trace:
I20260709 13:00:55.728894  3535 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:55.762063  3630 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:55.728654  3538 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:55.933049  1544 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
W20260709 13:00:55.812067  3359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.010s	sys 0.035s
W20260709 13:00:56.055856  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 163830us
I20260709 13:00:56.086484  3527 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:56.050763  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 311) took 1250 ms. Trace:
W20260709 13:00:56.057721  1617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.015s	sys 0.043s
W20260709 13:00:56.057070  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 482497us
I20260709 13:00:55.787108  3647 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:55.793372  3526 raft_consensus.cc:697] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:55.836632  3525 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:55.877926  3556 consensus_meta.cc:287] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.930s	user 0.003s	sys 0.011s
W20260709 13:00:55.958931  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.054628  1693 rpcz_store.cc:269] 0709 13:00:54.270689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.504773 (+234084us) service_pool.cc:224] Handling call
0709 13:00:55.850780 (+1346007us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54003c23d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:55.892578 (+ 41798us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2866211072}
I20260709 13:00:55.790158  3541 raft_consensus.cc:697] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:55.796209  3533 raft_consensus.cc:697] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:55.697988  3458 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:55.796389  3558 raft_consensus.cc:697] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:56.097815  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2129) took 1610 ms. Trace:
I20260709 13:00:56.098516  1514 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:56.114074  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.076210  3532 consensus_meta.cc:287] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.259s	user 0.011s	sys 0.002s
I20260709 13:00:56.087612  1619 rpcz_store.cc:276] 0709 13:00:54.800252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.324209 (+523957us) service_pool.cc:224] Handling call
0709 13:00:55.324737 (+   528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.325070 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:55.659799 (+334729us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.001542 (+341743us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.001622 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:56.050379 (+ 48757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.050480 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.050649 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32560,"prepare.queue_time_us":595629,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":43873,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":143,"thread_start_us":668046,"threads_started":2,"wal-append.queue_time_us":426220}
I20260709 13:00:55.891264  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:56.005265  3406 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:55.957743  3633 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3.
W20260709 13:00:56.089238  3359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.016s	sys 0.042s
I20260709 13:00:55.728332  3579 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:56.138073  3647 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:56.138926  3639 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:00:56.162660  3556 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:56.140347  3565 consensus_meta.cc:287] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 1.160s	user 0.013s	sys 0.000s
W20260709 13:00:56.238317  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 362323us
I20260709 13:00:56.083776  3559 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:55.924146  3634 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:56.090262  3649 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:00:56.105285  3574 consensus_meta.cc:287] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 1.187s	user 0.009s	sys 0.004s
I20260709 13:00:55.923719  3653 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:00:56.160055  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.160914  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.251111  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.170573  1544 rpcz_store.cc:276] 0709 13:00:54.474316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.954295 (+479979us) service_pool.cc:224] Handling call
0709 13:00:55.648860 (+694565us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5800093398. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:00:56.084508 (+435648us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25484160}
W20260709 13:00:56.173249  1620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.014s	sys 0.022s
W20260709 13:00:56.267728  1620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.014s	sys 0.032s
I20260709 13:00:56.148123  3538 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.938499  3545 consensus_queue.cc:237] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.223278  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1358) took 1694 ms. Trace:
W20260709 13:00:56.217355  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 118843us
I20260709 13:00:56.222975   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:56.271535  1617 rpcz_store.cc:276] 0709 13:00:54.528985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.198709 (+669724us) service_pool.cc:224] Handling call
0709 13:00:55.199145 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.199501 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.199524 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.200514 (+   990us) log.cc:844] Serialized 506 byte log entry
0709 13:00:56.097242 (+896728us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:56.097292 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.097365 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.222988 (+125623us) raft_consensus.cc:1685] finished
0709 13:00:56.223011 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.223198 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":888533,"threads_started":1,"wal-append.queue_time_us":909145}
W20260709 13:00:56.248100  3516 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.078s	user 0.015s	sys 0.001s
I20260709 13:00:56.246222  2234 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:00:56.221957  3393 consensus_meta.cc:287] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.269s	user 0.012s	sys 0.000s
W20260709 13:00:56.220152  3549 consensus_meta.cc:287] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.409s	user 0.009s	sys 0.006s
I20260709 13:00:56.211846  3406 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:56.216537  3359 raft_consensus.cc:697] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:56.270539  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 315) took 1451 ms. Trace:
I20260709 13:00:56.246014  3532 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.281713  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:56.245005  3565 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.280402  3393 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:56.295624  1694 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:56.251647  3574 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:56.293802  1620 rpcz_store.cc:276] 0709 13:00:54.818950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.389328 (+570378us) service_pool.cc:224] Handling call
0709 13:00:55.390984 (+  1656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.391266 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:55.610041 (+218775us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.270161 (+660120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.270209 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:56.270256 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.270324 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.270479 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1815,"prepare.queue_time_us":609944,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"thread_start_us":864088,"threads_started":2,"wal-append.queue_time_us":641616}
I20260709 13:00:56.314090  3574 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:56.267920  3559 raft_consensus.cc:697] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:56.315006  2271 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:56.285250  1586 leader_election.cc:336] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.511s (SENT)
W20260709 13:00:56.317267  1586 leader_election.cc:336] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.538s (SENT)
I20260709 13:00:56.317818  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1252) took 1962 ms. Trace:
I20260709 13:00:56.318507  1618 rpcz_store.cc:276] 0709 13:00:54.355435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.957798 (+602363us) service_pool.cc:224] Handling call
0709 13:00:54.980176 (+ 22378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.980598 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.980639 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.994783 (+ 14144us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.336449 (+341666us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b4800150258. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6fa67aa1 00007f5c6fa5eb37 00007f5c6fa5e9ca 00007f5c6fb5626f 00007f5c6fb55f37 00007f5c6fb6a55c 00007f5c6fb6a508 00007f5c6fb6a488 00007f5c6fb6a443 00007f5c6fb696ec 00007f5c6ea93a96
0709 13:00:55.424157 (+ 87708us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:55.424235 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.424320 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.297525 (+873205us) raft_consensus.cc:1685] finished
0709 13:00:56.297545 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.317725 (+ 20180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2106,"raft.run_cpu_time_us":10013,"raft.run_wall_time_us":350569,"spinlock_wait_cycles":12928384,"thread_start_us":332760,"threads_started":1,"wal-append.queue_time_us":617880}
W20260709 13:00:56.297469  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 247821us
W20260709 13:00:56.301915  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 248971us
I20260709 13:00:56.301115  3532 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.311715  3630 raft_consensus.cc:697] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:56.317869  1586 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:56.329965  1622 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:00:56.329818  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 280663us
W20260709 13:00:56.336328  1586 leader_election.cc:336] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.556s (SENT)
I20260709 13:00:56.273926  3538 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.254621  3653 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:56.302040  3525 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:56.269882  3649 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.322119  3634 raft_consensus.cc:697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:56.372392  1663 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:56.330596  3406 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:56.373747  1587 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:56.280797  3533 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.315110  3574 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:00:56.378314  3549 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:56.374684  1663 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:56.273607  3541 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:56.340277  3393 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.337234  3658 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.415377  3556 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:56.415723  3658 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:00:56.416215  3673 consensus_queue.cc:1059] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:56.417121  3325 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:56.418566  3658 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:56.415428  3666 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.419798  3666 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:56.421180  3632 log.cc:927] Time spent T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.829s	user 0.000s	sys 0.010s
I20260709 13:00:56.358692  3630 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.385627  3406 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:56.422792  3406 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:56.368594  3656 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:56.423725  3656 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:56.426031  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 214) took 2508 ms. Trace:
I20260709 13:00:56.299603  3558 consensus_queue.cc:237] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:56.428920  3430 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.024s	user 0.013s	sys 0.000s
I20260709 13:00:56.391350  1586 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:56.337464  3640 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.337165  3662 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.426481  1694 rpcz_store.cc:276] 0709 13:00:53.918908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.508820 (+589912us) service_pool.cc:224] Handling call
0709 13:00:54.526902 (+ 18082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.303907 (+1777005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.425724 (+121817us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b5400352d54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:56.425931 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4058816896}
I20260709 13:00:56.356585  3663 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:56.322458  3655 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:00:56.302798  3526 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.414789  3670 consensus_queue.cc:1059] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 13:00:56.395695  3466 consensus_meta.cc:287] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.217s	user 0.012s	sys 0.002s
W20260709 13:00:56.440867  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 49716.7us
W20260709 13:00:56.437363  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 62794.4us
I20260709 13:00:56.444414  3668 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:56.449708  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 121508us
I20260709 13:00:56.417130  3673 raft_consensus.cc:3055] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:56.453879  3565 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:56.454306  3538 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:56.454666  3628 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:56.439877  3393 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:56.419826  3637 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.634s	user 0.005s	sys 0.000s
W20260709 13:00:56.458218  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 176533us
I20260709 13:00:56.412878  3458 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:56.472106  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 109351us
I20260709 13:00:56.521517  1514 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:56.495669  3549 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.492863  3625 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:56.522936  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:56.526819  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:56.527820  1514 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:56.438741  3430 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.449121  3640 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:56.534212  3640 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:56.534942  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:56.537014  3393 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:56.503451  3673 raft_consensus.cc:740] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:56.511206  3596 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.490270  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:56.400274  3455 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:56.358419  3559 consensus_queue.cc:237] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.448573  3556 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:56.436276  3578 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:56.505297  3466 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.435631  3359 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.513904  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 557) took 1678 ms. Trace:
I20260709 13:00:56.459560  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:56.580437  1544 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.555234  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:56.581794  1541 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:56.534090  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:56.509908  3648 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:56.511204  3668 raft_consensus.cc:697] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:00:56.544153  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:00:56.591552  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 47496.7us
I20260709 13:00:56.541831  3680 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.592535  1514 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:00:56.492276  1586 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:56.443025  3656 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:56.580108  2270 rpcz_store.cc:276] 0709 13:00:54.835993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.836167 (+   174us) service_pool.cc:224] Handling call
0709 13:00:54.845046 (+  8879us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.845562 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.845603 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.851735 (+  6132us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.235290 (+383555us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:55.235336 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.235406 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.420548 (+1185142us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:00:56.507378 (+ 86830us) raft_consensus.cc:1685] finished
0709 13:00:56.507423 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.513797 (+  6374us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":792,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":12187,"spinlock_wait_cycles":129515264,"thread_start_us":330327,"threads_started":1,"wal-append.queue_time_us":540073}
I20260709 13:00:56.583710  1546 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:56.537883  3538 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:56.587350  1539 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:00:56.594112  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 101928us
I20260709 13:00:56.591300  1545 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:56.549692  3456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.016s	sys 0.039s
I20260709 13:00:56.516377  3532 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:56.594343  1539 pending_rounds.cc:85] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 1
I20260709 13:00:56.599212  1689 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:56.599618  1539 pending_rounds.cc:107] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:56.600086  1539 raft_consensus.cc:2889] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:56.578444  3556 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:56.552495  3458 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:56.596491  1540 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:00:56.596547  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 106410us
I20260709 13:00:56.671681  1663 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:56.605185  3663 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:56.597718  1544 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:00:56.452131  3662 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.601534  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:56.586349  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 88964.5us
I20260709 13:00:56.604297  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:56.707058  1691 raft_consensus.cc:2376] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5. Re-sending same reply.
I20260709 13:00:56.605295  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1356) took 2076 ms. Trace:
I20260709 13:00:56.707974  1622 rpcz_store.cc:276] 0709 13:00:54.528552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.000533 (+471981us) service_pool.cc:224] Handling call
0709 13:00:55.000923 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.330662 (+1329739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.605070 (+274408us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54000d2ad4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:56.605244 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3055852800}
I20260709 13:00:56.708621  1689 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:56.548586  3596 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:56.623008  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:56.638936  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:56.599579  3456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.018s	sys 0.039s
I20260709 13:00:56.623757  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:56.638314  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:56.603137  3455 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:56.538180  3549 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:56.741427  3626 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:56.624164  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:56.744016  1697 raft_consensus.cc:2368] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3.
I20260709 13:00:56.540280  3625 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:56.596033  3578 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:56.661386  3624 raft_consensus.cc:993] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:56.745288  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:56.623169  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:56.638669  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1248) took 2307 ms. Trace:
I20260709 13:00:56.746032  1691 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:56.596026  3538 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:56.667106  1541 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
W20260709 13:00:56.649478  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 57010us
I20260709 13:00:56.597461  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:56.602926  3647 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:56.672995  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:56.626266  3556 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:56.686600  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.724761  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:00:56.750473  1544 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:56.709033  2232 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:00:56.643738  3532 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:56.726679  1694 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:00:56.734545  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:56.737717  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:56.737318  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:56.677603  3458 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:56.723986  3645 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:56.664835  1546 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
W20260709 13:00:56.679050  3669 log.cc:927] Time spent T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:00:56.783353  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:56.625478  3673 consensus_queue.cc:260] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:56.600445  3680 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.587921  3634 consensus_queue.cc:237] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.602149  3648 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:56.916738  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:56.746119  1621 rpcz_store.cc:276] 0709 13:00:54.331382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.937384 (+606002us) service_pool.cc:224] Handling call
0709 13:00:54.937783 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.955867 (+ 18084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.955899 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.972958 (+ 17059us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.419955 (+446997us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:55.419996 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.420068 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.419190 (+999122us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:00:56.607232 (+188042us) raft_consensus.cc:1685] finished
0709 13:00:56.607257 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.638606 (+ 31349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17546,"raft.queue_time_us":21752,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":11195,"spinlock_wait_cycles":116128000,"thread_start_us":409049,"threads_started":1,"wal-append.queue_time_us":611384}
I20260709 13:00:56.681639  1543 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:56.856041  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:56.927050  3685 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:57.564205  1513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.132:39517 timed out after 2.161s (SENT) [suppressed 46 similar messages]
I20260709 13:00:57.576465  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:57.242939  1539 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:57.241003  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:57.578531  1545 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:00:57.195587  1691 raft_consensus.cc:2376] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3. Re-sending same reply.
I20260709 13:00:57.578570  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1337) took 1022 ms. Trace:
I20260709 13:00:56.856820  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:57.146353  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:56.822989  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:57.144675  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 395671us
I20260709 13:00:57.193967  1695 raft_consensus.cc:2376] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5. Re-sending same reply.
W20260709 13:00:56.982846  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 306312us
I20260709 13:00:57.584472  1663 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:57.585731  1663 leader_election.cc:400] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3.
I20260709 13:00:57.586531  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:57.587141  1614 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:56.858882  1693 raft_consensus.cc:2368] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3.
W20260709 13:00:57.247066  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.001s	sys 0.015s
W20260709 13:00:56.784101  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 102984us
I20260709 13:00:57.588155  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:57.588620  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:57.589378  1614 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
W20260709 13:00:57.588171  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.006s	sys 0.017s
I20260709 13:00:57.592442  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:56.790951  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 63434.3us
I20260709 13:00:57.593761  1614 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:00:57.242523  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:00:57.590178  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 857974us
W20260709 13:00:58.276273  3526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.010s	sys 0.026s
I20260709 13:00:57.577584  3685 raft_consensus.cc:697] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:56.881975  3650 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:57.970009  3574 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:58.414921  3650 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:58.415246  3574 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:56.984907  3629 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 1.331s	user 0.012s	sys 0.000s
I20260709 13:00:56.928274  3668 consensus_queue.cc:237] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:58.416698  3629 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:58.417218  3650 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:00:57.553905  3693 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:00:57.856812  2231 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.203s	user 0.009s	sys 0.019s
I20260709 13:00:57.620929  1663 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:57.888140  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1333) took 1303 ms. Trace:
I20260709 13:00:58.421901  3545 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:56.893519  3647 consensus_queue.cc:1059] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 1.529s
W20260709 13:00:58.413899  3526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.010s	sys 0.032s
I20260709 13:00:57.246461  1558 tablet_copy_source_session.cc:215] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:56.982362  1586 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:58.157537  1514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.008s	sys 0.019s
I20260709 13:00:57.580116  1539 rpcz_store.cc:276] 0709 13:00:56.555766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.192378 (+636612us) service_pool.cc:224] Handling call
0709 13:00:57.242712 (+ 50334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.578208 (+335496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.578503 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:57.025552  3535 consensus_meta.cc:287] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.928s	user 0.010s	sys 0.000s
W20260709 13:00:57.192409  3558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.017s
I20260709 13:00:57.027736  3625 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:56.927217  3675 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:57.674753  3624 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.745s
W20260709 13:00:57.016474  3681 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:00:58.420195  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:58.420625  2231 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.767s	user 0.016s	sys 0.033s
I20260709 13:00:58.422318  3545 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.421514  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:56.849092  1544 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:57.191146  3430 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:57.020493  3682 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.275s	user 0.000s	sys 0.000s
I20260709 13:00:56.744681  3626 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:56.926800  3679 raft_consensus.cc:1081] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:00:58.413046  1661 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:57.981099  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2153) took 1459 ms. Trace:
W20260709 13:00:58.160439  1692 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.001s
I20260709 13:00:57.741277  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:00:57.469594  3595 consensus_meta.cc:287] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 2.077s	user 0.008s	sys 0.008s
W20260709 13:00:58.421586  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 800724us
W20260709 13:00:58.552251  1514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.019s	sys 0.036s
I20260709 13:00:58.950909  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2248) took 2343 ms. Trace:
I20260709 13:00:58.607926  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:58.955632  1619 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:00:58.955478  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 2.30153e+06us
I20260709 13:00:58.956025  1623 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:58.956159  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1363) took 1370 ms. Trace:
I20260709 13:00:57.591576  3645 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:58.840636  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.956498  1619 rpcz_store.cc:276] 0709 13:00:57.585836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.585941 (+   105us) service_pool.cc:224] Handling call
0709 13:00:58.956094 (+1370153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.614567  1539 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:58.964327  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.421296  1543 rpcz_store.cc:276] 0709 13:00:56.554111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.584797 (+ 30686us) service_pool.cc:224] Handling call
0709 13:00:56.642648 (+ 57851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.596343 (+953695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.833655 (+237312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.964754  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1343) took 1819 ms. Trace:
W20260709 13:00:57.568990  3406 consensus_meta.cc:287] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.146s	user 0.013s	sys 0.001s
I20260709 13:00:57.740820  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:58.954691  1663 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:00:57.262732  3541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.013s	sys 0.006s
I20260709 13:00:58.958165  1692 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:00:57.746793  1541 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:00:57.472576  3628 consensus_meta.cc:287] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.953s	user 0.008s	sys 0.003s
I20260709 13:00:57.024523  3466 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.067601  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 248) took 2392 ms. Trace:
W20260709 13:00:58.959080  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 546089us
I20260709 13:00:58.597978  3565 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:57.957502  3691 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.077268  3691 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:57.833173  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2255) took 1165 ms. Trace:
I20260709 13:00:59.079582  1688 rpcz_store.cc:276] 0709 13:00:56.668262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.627796 (+959534us) service_pool.cc:224] Handling call
0709 13:00:57.832340 (+204544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.832686 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.832731 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.832798 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:57.832848 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.832935 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.833093 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.935079  3697 consensus_queue.cc:1059] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 1.192s
I20260709 13:00:58.953830  1696 rpcz_store.cc:276] 0709 13:00:56.598249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.598405 (+   156us) service_pool.cc:224] Handling call
0709 13:00:56.598860 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.745248 (+146388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.745276 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.783318 (+ 38042us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.505406 (+722088us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:57.885290 (+379884us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.908177 (+ 22887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.844403 (+936226us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001293d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:58.844505 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.844774 (+   269us) raft_consensus.cc:1685] finished
0709 13:00:58.941321 (+ 96547us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.941616 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66723,"raft.queue_time_us":23168,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":138301,"spinlock_wait_cycles":335723776,"thread_start_us":617657,"threads_started":2,"wal-append.queue_time_us":1223367}
I20260709 13:00:58.968338  3645 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:58.822518  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2241) took 2227 ms (client timeout 2123 ms). Trace:
W20260709 13:00:59.081362  1693 rpcz_store.cc:269] 0709 13:00:56.595308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.595448 (+   140us) service_pool.cc:224] Handling call
0709 13:00:58.822059 (+2226611us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400146c54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:58.822313 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300304768}
W20260709 13:00:57.333400  3586 consensus_meta.cc:287] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.695s	user 0.015s	sys 0.000s
I20260709 13:00:59.082983  3586 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:58.570093  3535 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:57.958420  3684 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:59.085043  3684 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:58.953900  1540 rpcz_store.cc:276] 0709 13:00:56.522107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.522600 (+   493us) service_pool.cc:224] Handling call
0709 13:00:57.980807 (+1458207us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b54000a6ed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:57.981015 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161039232}
I20260709 13:00:58.598436  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:58.962626  3705 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.088354  1615 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:58.952294  1620 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:59.090979  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1361) took 1505 ms. Trace:
I20260709 13:00:59.091495  1620 rpcz_store.cc:276] 0709 13:00:57.585078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.585182 (+   104us) service_pool.cc:224] Handling call
0709 13:00:58.952053 (+1366871us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.090671 (+138618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.090913 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.971933  1621 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:00:58.966327  1614 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:00:58.972325  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 450) took 3083 ms. Trace:
I20260709 13:00:59.092909  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1367) took 1465 ms. Trace:
I20260709 13:00:58.973368  1542 raft_consensus.cc:2410] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:59.093465  1614 rpcz_store.cc:276] 0709 13:00:57.627163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.419932 (+792769us) service_pool.cc:224] Handling call
0709 13:00:59.092839 (+672907us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:57.258558  3533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.007s	sys 0.009s
W20260709 13:00:57.550093  3656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.006s	sys 0.015s
I20260709 13:00:59.092978  2271 rpcz_store.cc:276] 0709 13:00:55.880792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.880990 (+   198us) service_pool.cc:224] Handling call
0709 13:00:55.920197 (+ 39207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.316212 (+396015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.962981 (+2646769us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54008309d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:58.963565 (+   584us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907327232}
I20260709 13:00:56.754304  3578 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:00:58.971282  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.968462  1617 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:56.783743  3666 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:58.958829  3545 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:57.251031  3687 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:00:56.754614  3538 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:58.958457  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 1.97603e+06us
W20260709 13:00:59.104609  3533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.521s	user 0.012s	sys 0.040s
I20260709 13:00:57.026916  3549 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:56.924674  3663 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:56.927407  3676 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:58.832828  3310 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.142742  1616 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:57.738624  3670 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.199s	user 0.007s	sys 0.011s
I20260709 13:00:57.591464  3683 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.005986  3689 log.cc:927] Time spent T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.414s	user 0.000s	sys 0.002s
I20260709 13:00:58.420059  3673 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:57.191416  3458 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:59.066475  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.066685  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:00:58.173002  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.684985  3708 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:59.066475  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 221) took 2396 ms (client timeout 1856 ms). Trace:
I20260709 13:00:58.201217  3648 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:56.857820  3456 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:57.011451  3649 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:58.968922  3558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.298s	user 0.023s	sys 0.057s
I20260709 13:00:57.627923  3443 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:59.067788  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:58.570478  3528 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:59.088814  1546 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:58.187984  3680 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:58.965188  1539 rpcz_store.cc:276] 0709 13:00:57.144953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.593969 (+1449016us) service_pool.cc:224] Handling call
0709 13:00:58.614314 (+ 20345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.964511 (+350197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.964701 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:56.894672  3653 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:58.970512  3625 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:59.200606  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:59.201525  2272 raft_consensus.cc:2410] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:59.202932  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:59.088405  3705 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.205148  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:59.206751  3528 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.199764  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:59.209084  3528 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.197566  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1331) took 2645 ms. Trace:
I20260709 13:00:59.200205  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:59.200512  1623 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
W20260709 13:00:58.191843  3556 consensus_meta.cc:287] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 1.332s	user 0.014s	sys 0.000s
I20260709 13:00:58.820636  3579 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:58.797035  1558 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:53718 (request call id 234) took 4293 ms. Trace:
W20260709 13:00:58.970592  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1340) took 2400 ms (client timeout 1778 ms). Trace:
I20260709 13:00:58.967852  3574 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:58.972743  3633 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:59.109800  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1362) took 1524 ms (client timeout 1819 ms). Trace:
I20260709 13:00:57.548906  3596 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:00:59.070447  3541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.323s	user 0.041s	sys 0.056s
I20260709 13:00:58.785291  3544 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:59.115475  1541 rpcz_store.cc:276] 0709 13:00:56.675209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.629762 (+954553us) service_pool.cc:224] Handling call
0709 13:00:57.630079 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.067176 (+1437097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.067377 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:59.117218  1548 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:59.086915  3586 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.069932  3628 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:59.120437  1586 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:59.211381  3443 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:59.109005  3656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.078s	user 0.021s	sys 0.028s
I20260709 13:00:59.290932  3443 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:59.094059  3393 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.976321  3509 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:59.293498  3393 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:59.115949  3647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.004s	sys 0.013s
W20260709 13:00:59.295778  3647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.005s	sys 0.014s
I20260709 13:00:59.293522  3509 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:59.301533  3509 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:00:59.089938  3629 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.060261  3406 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:59.215562  3684 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.305502  3406 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:00:59.140192  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 142726us
I20260709 13:00:57.025916  3662 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.308921  3662 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.309758  3662 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:59.111003  3578 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:59.234272  3625 raft_consensus.cc:697] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:59.346722  1543 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:58.966428  3675 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:58.782160  3685 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:59.124044  3430 raft_consensus.cc:3055] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:59.355901  3430 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:00:59.356788  3430 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.357978  3430 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:59.109313  3565 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.361037  3565 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.123471  3691 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.209843  1547 rpcz_store.cc:276] 0709 13:00:56.551950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.553191 (+  1241us) service_pool.cc:224] Handling call
0709 13:00:56.591594 (+ 38403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.593786 (+  2192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.593815 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.601019 (+  7204us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.144245 (+543226us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:57.144306 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.144404 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.197354 (+2052950us) raft_consensus.cc:1685] finished
0709 13:00:59.197374 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.197492 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1841,"raft.queue_time_us":2349,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":53016,"spinlock_wait_cycles":1284352,"thread_start_us":107582,"threads_started":1,"wal-append.queue_time_us":885284}
W20260709 13:00:59.215098  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 157051us
W20260709 13:00:59.235780  1544 rpcz_store.cc:269] 0709 13:00:56.556708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.724394 (+167686us) service_pool.cc:224] Handling call
0709 13:00:58.956697 (+2232303us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:59.213552  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 261005us
I20260709 13:00:59.198429  3706 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:00:59.363899  3527 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:59.364035  3706 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:59.364593  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1338) took 2808 ms. Trace:
W20260709 13:00:59.148387  3670 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.630s	user 0.018s	sys 0.036s
I20260709 13:00:59.185442  3683 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:59.199764  3535 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.196775  3626 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:00:59.245335  1617 rpcz_store.cc:269] 0709 13:00:57.585473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.585577 (+   104us) service_pool.cc:224] Handling call
0709 13:00:59.109743 (+1524166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:59.246101  1619 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:59.246526  1692 rpcz_store.cc:269] 0709 13:00:56.669829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.855587 (+185758us) service_pool.cc:224] Handling call
0709 13:00:59.066384 (+2210797us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:59.271803  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 151493us
I20260709 13:00:59.376572  1586 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:59.377838  1586 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:59.060910  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 90925us
I20260709 13:00:59.276712  3528 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:59.276849  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:59.278051  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:59.233511  3556 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.283126  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:59.245021  1558 rpcz_store.cc:276] 0709 13:00:54.488903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.491621 (+  2718us) service_pool.cc:224] Handling call
0709 13:00:57.245890 (+2754269us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54003b5954. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab483f7 00007f5c6fade036 00007f5c6fae7a3e 00007f5c673ab27b 00007f5c6fae79ba 00007f5c6fae2acc 00007f5c6faddc7b 00007f5c6fad28d1 00007f5c6eb864b4 00007f5c6eb86442
0709 13:00:58.782314 (+1536424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3176176512}
W20260709 13:00:59.284444  1661 connection.cc:256] RPC call timeout handler was delayed by -1.1495904820000078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
I20260709 13:00:59.288010  3633 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.234954  3456 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:59.290023  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:59.272372  3574 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:00:59.149693  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.361343  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1259) took 4499 ms. Trace:
I20260709 13:00:59.365047  1546 rpcz_store.cc:276] 0709 13:00:56.556102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.193606 (+637504us) service_pool.cc:224] Handling call
0709 13:00:57.193995 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.200550 (+2006555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.364340 (+163790us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54000c4c54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:59.364526 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4357155072}
I20260709 13:00:59.388401  1586 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:00:59.396914  1661 connection.cc:256] RPC call timeout handler was delayed by -1.0955904820000342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
I20260709 13:00:59.364419  3527 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:59.462229  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:00:59.395255  3714 log.cc:927] Time spent T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.076s	user 0.002s	sys 0.002s
W20260709 13:00:59.468611  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.469532  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.470530  1514 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:59.472924  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:59.438313  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:59.474125  1614 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.474764  1692 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:00:59.454548  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:59.456246  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:59.147339  3663 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:00:59.464591  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 76300.8us
I20260709 13:00:59.452822  1616 rpcz_store.cc:276] 0709 13:00:54.861493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.570456 (+708963us) service_pool.cc:224] Handling call
0709 13:00:55.570933 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.143533 (+3572600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.360955 (+217422us) spinlock_profiling.cc:243] Waited 3.57 s on lock 0x7b54001f8bd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:59.361219 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8213645056}
I20260709 13:00:59.398156  3708 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:59.464696  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 265299us
I20260709 13:00:59.150175  3676 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.452908  3646 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:00:59.497243  1586 leader_election.cc:400] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4.
I20260709 13:00:59.511881  1614 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:00:59.486416  1514 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:59.503777  1691 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:59.505127  3535 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:59.537585  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.398527  3544 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:59.520395  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:59.561280  1623 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.480269  3653 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:59.553184  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 65660us
I20260709 13:00:59.484951  3558 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:59.520304  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:59.504007  1620 raft_consensus.cc:1240] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:59.564299  1615 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:59.564625  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 78481.7us
I20260709 13:00:59.565415  1514 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:59.566247  1514 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:00:59.566761  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 354236us
I20260709 13:00:59.435266  3633 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.567850  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.572512  1690 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:59.568372  1586 leader_election.cc:400] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3.
I20260709 13:00:59.568866  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.481397  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:59.574857  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.497068  3406 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.496801  3586 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.578438  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.578845  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:59.520402  3723 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.589478  1586 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:59.591387  1586 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:59.592832  1586 leader_election.cc:400] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3.
I20260709 13:00:59.593597  1586 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:00:59.594460  1586 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:59.596943  1514 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:59.597923  1514 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:59.598599  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:00:59.567901  3535 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.600987  1586 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:59.603464  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1359) took 2019 ms. Trace:
I20260709 13:00:59.567507  3558 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:59.603889  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.604324  1622 rpcz_store.cc:276] 0709 13:00:57.584266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.584395 (+   129us) service_pool.cc:224] Handling call
0709 13:00:57.584723 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.627205 (+ 42482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.627246 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.834274 (+207028us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.837723 (+1003449us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b180003dae0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de0d1 00007f5c6aaf9a0f
0709 13:00:58.971974 (+134251us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:59.245141 (+273167us) log.cc:844] Serialized 14 byte log entry
0709 13:00:59.245350 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.245427 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.590774 (+345347us) raft_consensus.cc:1685] finished
0709 13:00:59.603218 (+ 12444us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.603377 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10096,"prepare.queue_time_us":579132,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":6776,"raft.run_cpu_time_us":7001,"raft.run_wall_time_us":130802,"spinlock_wait_cycles":6335744,"thread_start_us":318083,"threads_started":2,"wal-append.queue_time_us":1251548}
I20260709 13:00:59.576725  3715 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:59.576452  3656 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:59.572753  3579 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:59.606909  3668 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:59.603056  3629 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:59.606930  3670 consensus_queue.cc:1059] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:00:59.591528  3595 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:59.604384  3310 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:59.617178  1692 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:59.601456  3544 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:59.599628  3708 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:59.660750  3544 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:59.619817  3715 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.661336  3544 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.588995  3653 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:00:59.662014  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.661778  3578 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:59.663267  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.663393  1540 raft_consensus.cc:1240] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:59.664361  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.664191  3595 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.555579  3710 consensus_queue.cc:1059] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:00:59.614234  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:59.667724  3527 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:59.602876  3565 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:59.668776  3565 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:59.669138  1619 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:00:59.603235  3697 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:59.669719  3697 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.659837  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.670470  3697 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.636533  3310 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.671324  3310 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.485579  3645 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.673357  1693 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:59.674713  3578 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:59.675670  3578 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:59.676030  3578 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.676354  3578 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.677549  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1336) took 3122 ms. Trace:
I20260709 13:00:59.677976  1548 rpcz_store.cc:276] 0709 13:00:56.555470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.580179 (+2024709us) service_pool.cc:224] Handling call
0709 13:00:58.725343 (+145164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.270737 (+545394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.677273 (+406536us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54000aa0d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:59.677479 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900582656}
I20260709 13:00:59.679529  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1372) took 1247 ms. Trace:
I20260709 13:00:59.679939  1619 rpcz_store.cc:276] 0709 13:00:58.439462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.964632 (+525170us) service_pool.cc:224] Handling call
0709 13:00:59.679303 (+714671us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:59.637655  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:59.681579  3706 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:59.681784  1623 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
W20260709 13:00:59.661464  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2133) took 5167 ms (client timeout 3160 ms). Trace:
W20260709 13:00:59.682762  1542 rpcz_store.cc:269] 0709 13:00:54.493833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.941017 (+447184us) service_pool.cc:224] Handling call
0709 13:00:59.661211 (+4720194us) spinlock_profiling.cc:243] Waited 4.03 s on lock 0x7b54003b4f54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:00:59.661359 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9270189952}
W20260709 13:00:59.683737  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 366548us
W20260709 13:00:59.684862  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.661813  3715 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:59.591252  3724 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:00:59.613368  3649 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:59.640349  3667 raft_consensus.cc:3055] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:59.688336  3649 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:00:59.688437  3667 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:00:59.612370  3535 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:59.614394  3456 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:59.625023  3656 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.627256  3579 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.646874  3676 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.667018  3595 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.648892  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1339) took 3092 ms. Trace:
I20260709 13:00:59.612519  3558 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.602799  3723 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.590072  3406 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.652674  3663 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:59.654506  3633 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:59.655275  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1360) took 2070 ms. Trace:
I20260709 13:00:59.745611  1618 rpcz_store.cc:276] 0709 13:00:57.584666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.584780 (+   114us) service_pool.cc:224] Handling call
0709 13:00:57.739904 (+155124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.833866 (+ 93962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.833911 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.963883 (+1129972us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.235019 (+271136us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:59.235060 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.235139 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.655066 (+419927us) raft_consensus.cc:1685] finished
0709 13:00:59.655082 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.655217 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53322,"raft.queue_time_us":755782,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":29626,"thread_start_us":138211,"threads_started":1,"wal-append.queue_time_us":537810}
I20260709 13:00:59.655817  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.656826  3640 raft_consensus.cc:3055] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:59.659096  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:00:59.659834  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.661392  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.756284  1692 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:00:59.669235  3565 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:59.689580  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 75414.5us
I20260709 13:00:59.694823  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.733341  3656 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:59.697829  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:59.645213  3545 consensus_meta.cc:287] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.521s	user 0.005s	sys 0.002s
I20260709 13:00:59.704033  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.773860  1619 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:00:59.713671  1588 connection.cc:256] RPC call timeout handler was delayed by -2.4619583319999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 13:00:59.733440  3525 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:00:59.688835  3649 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.729126  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.728844  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.730058  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.571395  3625 consensus_queue.cc:237] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.728845  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.732342  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:59.612334  3586 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.733749  1545 rpcz_store.cc:276] 0709 13:00:56.556402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.625310 (+1068908us) service_pool.cc:224] Handling call
0709 13:00:57.843719 (+218409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.540273 (+1696554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.540303 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.540381 (+    78us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:59.540414 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.648655 (+108241us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b5400303254. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:00:59.648702 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.648828 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3901140352}
I20260709 13:00:59.737046  3717 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:00:59.754629  3645 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:00:59.714720  3648 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:59.738777  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 101238us
I20260709 13:00:59.754798  3640 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:00:59.733141  3579 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:59.761688  1586 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:59.804668  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.805562  1619 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:59.696278  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.806617  1622 raft_consensus.cc:2376] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4. Re-sending same reply.
I20260709 13:00:59.772517  1616 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:59.807696  3456 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:59.808530  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.810067  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.811116  1616 raft_consensus.cc:2393] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:00:59.774744  1588 connection.cc:256] RPC call timeout handler was delayed by -2.2783583319999821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 13:00:59.811605  1588 connection.cc:256] RPC call timeout handler was delayed by -2.1145431319999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
I20260709 13:00:59.812289  3668 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:59.812764  3668 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:00:59.717257  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 131244us
I20260709 13:00:59.779441  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:00:59.778306  3673 consensus_meta.cc:287] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
W20260709 13:00:59.776124  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 177554us
I20260709 13:00:59.783335  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:00:59.742316  3528 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:59.785161  1620 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:00:59.785555  1621 raft_consensus.cc:2393] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:59.715457  3705 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.781976  3725 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:59.761768  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:00:59.733911  3691 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:00:59.795254  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.797024  2231 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:00:59.749055  1690 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
W20260709 13:00:59.779277  3458 consensus_meta.cc:287] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.534s	user 0.004s	sys 0.008s
I20260709 13:00:59.794529  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.733093  3712 consensus_queue.cc:1059] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:00:59.808766  3662 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:00:59.777745  3663 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.735708  3676 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:00:59.781028  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:00.000865  1623 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:00.001042  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.742399  3697 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.766167  3667 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:00:59.784346  3545 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.004117  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:00:59.898694  1588 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:00:59.985483  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:00:59.810374  3586 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.976282  1615 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:00:59.876298  3406 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.816151  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:00.009927  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.072077  1689 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:00:59.921665  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:00.009074  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 110497us
W20260709 13:00:59.862924  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.988878  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.076313  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.069720  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:00.068290  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61696.8us
I20260709 13:01:00.073897  1588 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:00.081123  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:00.016911  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 210811us
I20260709 13:00:59.896674  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:00:59.993227  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 196330us
W20260709 13:00:59.892493  3538 consensus_meta.cc:287] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.001s
I20260709 13:01:00.082641  1586 leader_election.cc:400] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3.
I20260709 13:00:59.997165  2270 raft_consensus.cc:2410] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:59.816151  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:00.004262  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:00.089128  1542 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
W20260709 13:00:59.836006  3443 consensus_meta.cc:287] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.005s
I20260709 13:01:00.008747  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.810491  3675 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.820075  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:00.103696  3430 consensus_queue.cc:1059] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:01:00.109450  1616 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:00.009769  3712 consensus_queue.cc:1243] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 27308aae2ef347ccba1b27e7f6f04334 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:59.880687  3723 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:00.065768  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:00.112653  1615 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:00.113294  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.081847  1623 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:01:00.113986  1697 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:00.114758  1623 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:00.114907  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.115897  1621 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:00.116039  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:00.117027  1621 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:00.124538  3393 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:00.125677  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:00:59.876314  3668 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:00:59.787886  3525 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:00.127969  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.128783  3545 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:00.129127  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:00.130160  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:00.131386  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.131705  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:00.132318  1689 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:00.132503  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.135139  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.008085  3528 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:00.078135  1695 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:00.080265  1514 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:00.095578  2232 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:00.084280  2231 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:00:59.874423  3310 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.104257  1619 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:00.104346  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:00:59.996451  3724 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:00.104365  1688 raft_consensus.cc:1240] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:00.126237  3640 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.091395  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:00:59.983814  3710 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:00.148434  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 58125.2us
I20260709 13:01:00.049317  3733 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.168766  3550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953db44baef24f55a28e65ff051866d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:00.169387  1618 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:00.169898  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:00.170614  3456 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.995066  3458 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:00.013110  3663 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:00.012810  3676 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:00:59.991067  3535 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:00.174647  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 94696.2us
I20260709 13:01:00.090044   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:00.212275  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.228179  1622 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:01:00.215816  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:00.335479  1695 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:00.329161  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.172778  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 88578.8us
W20260709 13:01:00.174683  1511 connection.cc:256] RPC call timeout handler was delayed by -1.3640840589999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
I20260709 13:01:00.235574  1689 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:00.341531  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.344225  1690 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:01:00.345635  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:00.341667  1514 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:01:00.347051  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 177355us
I20260709 13:01:00.097556  3626 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:00.340507  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.348515  1586 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:00.342608  1511 connection.cc:256] RPC call timeout handler was delayed by -1.3082840589999591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
I20260709 13:01:00.106518  3586 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.257647  3735 log.cc:927] Time spent T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:01:00.361209  1586 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:00.350832  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:00.265265  3558 consensus_meta.cc:287] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
I20260709 13:01:00.367684  1696 raft_consensus.cc:2376] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4. Re-sending same reply.
W20260709 13:01:00.340075  3715 consensus_meta.cc:287] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.649s	user 0.013s	sys 0.000s
W20260709 13:01:00.172230  3544 consensus_meta.cc:287] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.003s
W20260709 13:01:00.328234  3736 log.cc:927] Time spent T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Append to log took a long time: real 0.063s	user 0.001s	sys 0.001s
I20260709 13:01:00.363775  1514 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:00.346678  3456 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.212347  3675 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:00.339875  3683 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:00.366211  3586 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.336544  3733 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:00.368285  1586 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:00.151556  3595 raft_consensus.cc:3055] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:00.368623  1539 raft_consensus.cc:1240] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:00.359825  1511 connection.cc:256] RPC call timeout handler was delayed by -1.1912678250000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 13:01:00.346515  1690 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:00.204381  3730 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:00.173197  3716 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:00.097249  3538 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.379194  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.171571  3310 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:00.206302  3525 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:00.136384  3443 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.256796  3393 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:00.367050  3668 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:00.384023  3430 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:00.395685  3544 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:00.465576  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:00.396597  3565 consensus_meta.cc:287] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 13:01:00.396986  3626 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:00.204608  3697 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:00.402940  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.404726  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:00.367712  3705 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.379197  3662 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:00.350265  3653 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:00.172657  3579 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.480405  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:00.416232  1696 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:00.416857  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:00.459775  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:00.460594  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.397959  3456 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:00.408793  3578 consensus_meta.cc:287] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.002s
I20260709 13:01:00.396644  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 562) took 1016 ms. Trace:
I20260709 13:01:00.466811  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.400768  3675 raft_consensus.cc:697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:00.468454  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.402001  3733 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.363826  3624 consensus_queue.cc:1059] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:01:00.358836  3710 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:00.402328  3595 raft_consensus.cc:740] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:00.454192  3648 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:00.475656  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:00.479151  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.497443  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.502996  1544 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:00.382053  3558 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:00.416296  3716 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:00.503168  1691 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 3. Ops: [1.2-1.2]
I20260709 13:01:00.385227  3715 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:01:00.506606  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.612697  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:00.673333  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:00.511807  1620 raft_consensus.cc:2393] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:00.480834  3649 consensus_meta.cc:287] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.000s
I20260709 13:01:00.675806  3683 consensus_queue.cc:1059] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:01:00.680318  3683 raft_consensus.cc:3055] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:00.680821  3683 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:00.682178  3656 consensus_meta.cc:287] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.900s	user 0.010s	sys 0.000s
I20260709 13:01:00.682570  3656 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.685213  3667 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:00.631124  3549 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:01:00.459695  3730 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:00.695616  1690 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 1.
I20260709 13:01:00.473635  3565 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:00.680073  3310 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:00.680925  3742 log.cc:927] Time spent T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:01:00.580168  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 250) took 2989 ms. Trace:
I20260709 13:01:00.607762  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 249) took 3017 ms. Trace:
I20260709 13:01:00.471588  3430 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:00.673954  1545 raft_consensus.cc:2393] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:00.679180  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:00.696300  1542 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:00.701323  1543 rpcz_store.cc:276] 0709 13:00:57.590963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.201889 (+1610926us) service_pool.cc:224] Handling call
0709 13:00:59.202152 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.366165 (+164013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.579844 (+1213679us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54003b5e54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:00.580073 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261387648}
I20260709 13:01:00.468277  3393 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:00.654803  3739 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:01:00.680223  3544 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:00.703051  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:00.703368  1694 raft_consensus.cc:2393] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:00.701717  1540 rpcz_store.cc:276] 0709 13:00:57.590697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.088104 (+1497407us) service_pool.cc:224] Handling call
0709 13:00:59.088454 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.663874 (+575420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.607494 (+943620us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54003b4a54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:00.607701 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321804544}
I20260709 13:01:00.730391  1544 raft_consensus.cc:2376] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3. Re-sending same reply.
I20260709 13:01:00.705838  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:00.703908  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.732344  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.733408  1543 raft_consensus.cc:2410] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:00.675829  3716 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.502875  3653 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:00.710783  3744 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:01:00.622931  3748 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
I20260709 13:01:00.696959  1693 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:01:00.510579  3662 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:00.705072  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:00.701776  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:00.756040  1616 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:00.679282  3579 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:00.673969  3648 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:00.658667  3625 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:01:00.781122  3443 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:00.713099  3458 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:00.773428  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:00.793085  1614 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:00.774380  3662 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.775681  3656 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:00.776587  3430 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.777686  3675 consensus_queue.cc:237] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.779469  3538 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:00.705054  3310 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:00.502122  3705 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.786437  1695 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:01:00.766541  1542 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:00.679155  3649 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:00.705161  3663 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:00.760776  3653 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:00.750950  1511 connection.cc:256] RPC call timeout handler was delayed by -1.0929676470000231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33190000000000003s for a response
I20260709 13:01:00.814531  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.816514  1615 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:00.845096  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 322) took 1031 ms. Trace:
I20260709 13:01:00.845546  1615 rpcz_store.cc:276] 0709 13:00:59.814091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.767533 (+953442us) service_pool.cc:224] Handling call
0709 13:01:00.796509 (+ 28976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.844786 (+ 48277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.845020 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:00.816972  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.846081  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1287) took 1135 ms. Trace:
I20260709 13:01:00.782768  3648 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:00.692137  3578 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.844391  1693 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:00.835588  3558 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:00.847914  3393 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:00.813028  3586 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:00.875197  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.875975  1617 raft_consensus.cc:2393] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:00.876880  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 201586us
I20260709 13:01:00.846781  1621 rpcz_store.cc:276] 0709 13:00:59.710514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.117971 (+407457us) service_pool.cc:224] Handling call
0709 13:01:00.118306 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.118558 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:00.497052 (+378494us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.845525 (+348473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:00.845611 (+    86us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:00.845685 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.845788 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.845994 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":276376,"prepare.queue_time_us":495272,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":25276,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"thread_start_us":394248,"threads_started":2}
I20260709 13:01:00.877620  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:00.765832  3595 consensus_queue.cc:260] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.758787  3683 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:00.981305  3710 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:01.002583  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 380120us
I20260709 13:01:01.002908  3710 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.999724  1695 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:01.000592  3683 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.004920  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:01.001313  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:01.006067  1542 raft_consensus.cc:2376] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3. Re-sending same reply.
I20260709 13:01:01.002085  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:00.964087  1545 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:01.007045  2272 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 1.
I20260709 13:01:00.916786  1544 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:00.941862  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:00.881976  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:00.697533  2264 rpcz_store.cc:276] 0709 13:00:59.380096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.384104 (+  4008us) service_pool.cc:224] Handling call
0709 13:00:59.460463 (+ 76359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:59.519999 (+ 59536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.540375 (+ 20376us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:59.633363 (+ 92988us) log.cc:844] Serialized 52 byte log entry
0709 13:00:59.790399 (+157036us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:59.797635 (+  7236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.806504 (+  8869us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.396350 (+589846us) raft_consensus.cc:1685] finished
0709 13:01:00.396390 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.396577 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25077,"raft.queue_time_us":22983,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":35135,"thread_start_us":126813,"threads_started":1,"wal-append.queue_time_us":346681}
I20260709 13:01:01.001817  3595 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:00.982195  3715 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:01.004985  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:01.007339  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:01.011075  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:01.013952  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:01.010535  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:01.014714  1615 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.014024  1586 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:01.019395  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:01.014325  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.021381  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:01.022439  1542 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:01.022497  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:01.025394  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1387) took 1366 ms. Trace:
I20260709 13:01:01.028007  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:01.016381  1543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35704
I20260709 13:01:01.024405  1663 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:01.028898  1543 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:01.025840  1697 rpcz_store.cc:276] 0709 13:00:59.658988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.019169 (+1360181us) service_pool.cc:224] Handling call
0709 13:01:01.025331 (+  6162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.029814  1543 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.030346  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:01.030853  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:01.031296  1545 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:01.031466  1697 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.032922  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:01.033931  1695 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:01.038050  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:01.021906  3663 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:01.003639  3710 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.043869  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:01.047544  1692 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.048017  1663 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:01.052551  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:01.044217  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:01.065056  1695 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.028733  1542 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:01.070173  1542 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:01.072005  1542 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:00.865700  3730 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:01.085774  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 44323.2us
I20260709 13:01:01.045701  3527 raft_consensus.cc:3055] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:01.083940  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:01.045584  3565 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:01.083149  1542 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:01.105193  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 57325.5us
I20260709 13:01:01.106151  1663 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:01.109551  1697 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:01.076870  3663 raft_consensus.cc:697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:01.113063  1692 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:01.116492  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:01.081929  3762 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.115607  1697 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:01.126775  1697 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:01.127041  1663 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:01.128981  3625 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.092559  3527 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:01.092397  3757 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.121775  1542 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:01.144609  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:01.145790  1542 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:01.146899  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:01.147778  1621 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:01.147949  1542 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:01.121721  1615 raft_consensus.cc:2410] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:01.150038  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:01.151203  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:01.130270  3310 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:01.153036  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:01.148836  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 62321.9us
I20260709 13:01:01.135048  3705 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:01.158987  1663 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:01.159337  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:01.123569  3649 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:01.157320  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:01.123440  3578 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:01.160835  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:01.172030  1621 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:01.163050  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:01.168433  1586 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:01.173422  3544 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:01.120685  3761 consensus_queue.cc:1059] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:01:01.123530  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:01.174912  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 569) took 1440 ms. Trace:
I20260709 13:01:01.170540  1542 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.173971  3544 raft_consensus.cc:697] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:01:01.175881  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 54457.8us
I20260709 13:01:01.177096  3544 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:01.179733  2265 rpcz_store.cc:276] 0709 13:00:59.734843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.735726 (+   883us) service_pool.cc:224] Handling call
0709 13:01:01.123340 (+1387614us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b580000ff98. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:01:01.174782 (+ 51442us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14057344}
I20260709 13:01:01.180984  1587 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:01.182401  3668 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:01.171692  3527 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.184877  3527 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.150990  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:01.171797  3754 consensus_queue.cc:1059] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:01:01.175038  1511 leader_election.cc:336] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.516s (SENT)
I20260709 13:01:01.188524  3556 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:01.192881  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:01.200532  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:01.200862  1511 leader_election.cc:336] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.786s (SENT)
I20260709 13:01:01.201284  1615 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:01.201321  1511 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:01.207840  1511 leader_election.cc:336] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.903s (SENT)
I20260709 13:01:01.208437  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:01.213657  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:01.214470  1587 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:01.216533  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.218169  1542 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:01.171950  3565 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:01.161229  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:01.130082  3762 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:01.218873  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 55934.4us
I20260709 13:01:01.222678  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:01.226522  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:01.226389  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:01.221285  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 51256.6us
I20260709 13:01:01.246028  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:01.246932  1663 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:01.246999  1621 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:01.249163  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:01.249758  1621 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.245157  3544 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:01.254616  3755 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260709 13:01:01.255899  3753 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:01:01.259538  3556 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.259783  3565 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:01.261176  3565 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:01.264132  3764 log.cc:927] Time spent T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:01:01.251485  3653 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:01.265691  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:01.200989  3663 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.267777  1619 raft_consensus.cc:1240] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:01.268059  3710 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:01.268759  3626 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.216773  3765 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.224879  3578 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.224588  3649 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.292109  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:01.202358  3668 raft_consensus.cc:3055] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.172502  3767 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:01.226052  3754 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.222330  3662 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.314124  1615 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.325548  1661 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:01.267406  3653 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:01.313546  3667 consensus_meta.cc:287] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.628s	user 0.013s	sys 0.000s
I20260709 13:01:01.335503  3544 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.335327  3648 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:01.344338  1545 raft_consensus.cc:2410] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:01.317334  3668 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:01.341276  1543 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:01.321516  3767 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:01.349802  1615 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
W20260709 13:01:01.343243  3716 consensus_meta.cc:287] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.003s
I20260709 13:01:01.360517  1615 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:01.344904  3646 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.317734  3649 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.388998  3768 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.390187  1696 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:01.360148  3767 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.395917  3648 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:01.396987  3778 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:01.397676  3778 raft_consensus.cc:697] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:01.401360  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2273) took 1300 ms. Trace:
I20260709 13:01:01.401799  1693 rpcz_store.cc:276] 0709 13:01:00.101021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.078834 (+977813us) service_pool.cc:224] Handling call
0709 13:01:01.094175 (+ 15341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.094657 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.094706 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.111968 (+ 17262us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.315961 (+203993us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:01.316003 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.316079 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.401129 (+ 85050us) raft_consensus.cc:1685] finished
0709 13:01:01.401149 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.401298 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":175213,"threads_started":1,"wal-append.queue_time_us":243829}
I20260709 13:01:01.405370  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2272) took 1304 ms. Trace:
I20260709 13:01:01.405550  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:01.406349  1695 rpcz_store.cc:276] 0709 13:01:00.100615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.066762 (+966147us) service_pool.cc:224] Handling call
0709 13:01:01.067137 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:01.134958 (+ 67821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.134995 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:01.135692 (+   697us) log.cc:844] Serialized 52 byte log entry
0709 13:01:01.212123 (+ 76431us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:01.212163 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.212237 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.404894 (+192657us) raft_consensus.cc:1685] finished
0709 13:01:01.404943 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.405253 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19423,"raft.queue_time_us":82785,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":18387,"thread_start_us":105668,"threads_started":2,"wal-append.queue_time_us":182880}
I20260709 13:01:01.408401  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2275) took 1042 ms. Trace:
I20260709 13:01:01.408641  1695 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:01.408751  1693 rpcz_store.cc:276] 0709 13:01:00.366369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.407637 (+1041268us) service_pool.cc:224] Handling call
0709 13:01:01.407952 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.408112 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.408136 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.408174 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:01.408202 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.408251 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.408347 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.410562  1693 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:01.409245  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2276) took 1001 ms. Trace:
I20260709 13:01:01.411851  1695 rpcz_store.cc:276] 0709 13:01:00.408068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.408091 (+1000023us) service_pool.cc:224] Handling call
0709 13:01:01.408313 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.409026 (+   713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.409195 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.381100  3762 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:01.372102  3761 consensus_queue.cc:1059] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:01:01.373584  3771 consensus_queue.cc:1059] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:01:01.428386  3646 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.406678  3710 consensus_queue.cc:1059] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:01:01.365036  3716 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:01.398757  3778 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.432453  3771 raft_consensus.cc:3055] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:01.433912  3771 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:01.434047  3733 consensus_meta.cc:287] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.729s	user 0.013s	sys 0.001s
I20260709 13:01:01.434546  3733 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:01.434937  3771 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.435395  3625 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.436276  3771 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.436717  3733 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:01.438217  3716 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:01:01.440541  3777 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:01.444047  3777 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:01.444805  3777 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.439306  3765 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:01.451745  3768 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.456055  3767 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.458763  3777 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:01.447881  3761 raft_consensus.cc:3055] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:01.459592  3767 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:01.459602  3761 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:01.461155  3777 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:01.497280  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 250048us
I20260709 13:01:01.505522  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 234) took 1139 ms. Trace:
I20260709 13:01:01.506100  3544 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.508701  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:01.508304  3544 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:01:01.510558  1543 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:01.413151  1693 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:01.460980  3761 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.524353  3544 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:01.529912  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 231) took 1164 ms. Trace:
I20260709 13:01:01.506449  1697 rpcz_store.cc:276] 0709 13:01:00.366103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.128531 (+762428us) service_pool.cc:224] Handling call
0709 13:01:01.128850 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.189792 (+ 60942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.189821 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.190487 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.353708 (+163221us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:01.353791 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.353914 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.504660 (+150746us) raft_consensus.cc:1685] finished
0709 13:01:01.504740 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.505155 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63236,"raft.queue_time_us":93763,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":17233,"thread_start_us":223226,"threads_started":2,"wal-append.queue_time_us":227992}
W20260709 13:01:01.548777  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1266) took 1853 ms (client timeout 1884 ms). Trace:
I20260709 13:01:01.530671  1692 rpcz_store.cc:276] 0709 13:01:00.365191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.116852 (+751661us) service_pool.cc:224] Handling call
0709 13:01:01.124937 (+  8085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.228309 (+103372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.228343 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.278307 (+ 49964us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.529131 (+250824us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:01.529227 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.529413 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.529483 (+    70us) raft_consensus.cc:1685] finished
0709 13:01:01.529496 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.529724 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3592,"raft.queue_time_us":64040,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":26866,"thread_start_us":256401,"threads_started":2,"wal-append.queue_time_us":115729}
I20260709 13:01:01.550704  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1271) took 1852 ms. Trace:
I20260709 13:01:01.551347  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:01.559274  1620 rpcz_store.cc:276] 0709 13:00:59.697979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.016389 (+318410us) service_pool.cc:224] Handling call
0709 13:01:01.550237 (+1533848us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54000d39d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:01.550524 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377215872}
I20260709 13:01:01.559763  2267 raft_consensus.cc:3055] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:01.560257  2267 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:01.552403  1663 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:01.562448  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.562837  3771 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:01.560878  1617 rpcz_store.cc:269] 0709 13:00:59.695489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.695610 (+   121us) service_pool.cc:224] Handling call
0709 13:01:01.548002 (+1852392us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000d3ed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:01.548482 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2488584448}
I20260709 13:01:01.565801  3771 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:01.566630  3771 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.568776  2267 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:01.556913  2270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54504 (request call id 385) took 2286 ms (client timeout 1770 ms). Trace:
I20260709 13:01:01.557797  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1376) took 1931 ms. Trace:
I20260709 13:01:01.571328  2267 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:01.578516  2270 rpcz_store.cc:269] 0709 13:00:59.270444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.270583 (+   139us) service_pool.cc:224] Handling call
0709 13:01:01.556306 (+2285723us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b540068ddd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:01.556616 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408973056}
W20260709 13:01:01.575160  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 208002us
I20260709 13:01:01.582541  3676 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:01.583734  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.578819  1691 rpcz_store.cc:276] 0709 13:00:59.626674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.627656 (+   982us) service_pool.cc:224] Handling call
0709 13:00:59.628616 (+   960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.678468 (+1049852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.556581 (+878113us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54001289d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:01.557529 (+   948us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963734272}
I20260709 13:01:01.581367  1663 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:01.565802  3443 raft_consensus.cc:3055] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:01.587766  3787 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:01.588053  1513 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:01.588428  3787 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.588903  3787 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.587993  3443 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:01.577925  3550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54504 (request call id 368) took 8961 ms. Trace:
W20260709 13:01:01.591151  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1379) took 1934 ms (client timeout 2099 ms). Trace:
W20260709 13:01:01.597141  1694 rpcz_store.cc:269] 0709 13:00:59.656563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.659524 (+  2961us) service_pool.cc:224] Handling call
0709 13:01:01.590445 (+1930921us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400147b54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:01.590843 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2374221952}
I20260709 13:01:01.598179  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 318) took 1784 ms. Trace:
I20260709 13:01:01.598081  3443 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:01.600670  3443 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.601187  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 325) took 1786 ms. Trace:
I20260709 13:01:01.601751  1619 rpcz_store.cc:276] 0709 13:00:59.815096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.777586 (+962490us) service_pool.cc:224] Handling call
0709 13:01:00.777844 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.268421 (+490577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.600537 (+332116us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54000fbed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:01.600956 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126240000}
W20260709 13:01:01.603389  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.605316  1622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1282) took 1896 ms (client timeout 1909 ms). Trace:
W20260709 13:01:01.606175  1622 rpcz_store.cc:269] 0709 13:00:59.709142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.807294 (+ 98152us) service_pool.cc:224] Handling call
0709 13:01:01.604837 (+1797543us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54002648d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:01.605079 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274898304}
I20260709 13:01:01.585871  1661 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:01.617282  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:01.618904  3767 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.620710  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:01.623245  2270 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:01:01.623764  2270 pending_rounds.cc:85] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Aborting all ops after (but not including) 5
W20260709 13:01:01.618896  2268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 571) took 1860 ms (client timeout 1506 ms). Trace:
I20260709 13:01:01.624094  2270 pending_rounds.cc:107] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:01:01.624468  2270 raft_consensus.cc:2889] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:01.624285  2268 rpcz_store.cc:269] 0709 13:00:59.758127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.758263 (+   136us) service_pool.cc:224] Handling call
0709 13:01:01.616704 (+1858441us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b580000ff98. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:01:01.618640 (+  1936us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7654272}
I20260709 13:01:01.626204  3725 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.627211  3725 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:01.630273  3663 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:01.630654  3725 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:01.638866  3676 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:01.639822  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:01.640664  3676 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:01.641198  3676 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:01.644557  2265 raft_consensus.cc:2410] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:01.631199  3663 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.649983  3663 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:01.651790  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:01.653337  3528 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:01.598928  1616 rpcz_store.cc:276] 0709 13:00:59.813044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.409347 (+596303us) service_pool.cc:224] Handling call
0709 13:01:00.461925 (+ 52578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.770823 (+308898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.596707 (+825884us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b5400115654. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:01.597800 (+  1093us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630099200}
I20260709 13:01:01.656780  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:01.644088  3640 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.660924  3535 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:01.661547  3787 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.663508  3558 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.663980  3558 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:01.669140  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 88607.7us
I20260709 13:01:01.687340  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:01.666188  3528 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.688479  2268 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 1.
I20260709 13:01:01.687757  3727 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:01:01.699663  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2164) took 1234 ms. Trace:
I20260709 13:01:01.684788  3787 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:01.702787  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:01.611464  3550 rpcz_store.cc:276] 0709 13:00:52.626511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.633410 (+  6899us) service_pool.cc:224] Handling call
0709 13:00:52.871010 (+237600us) ts_tablet_manager.cc:934] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
0709 13:00:54.398511 (+1527501us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b4c0048a700. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c68e0aa20 00007f5c68e1ba29 00007f5c68e1c13f 00007f5c68de02ab 00007f5c68e0df3c 00007f5c68e0e461 00007f5c68e0e768 00007f5c6eb942eb 00007f5c6fab9d3b 00007f5c6fab4008 00007f5c6fab3405
0709 13:01:00.008408 (+5609897us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:01.251066 (+1242658us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:01.292307 (+ 41241us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:01.575817 (+283510us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:01.576699 (+   882us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:01.577272 (+   573us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:01.577582 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":32516,"spinlock_wait_cycles":76036352,"tablet-copy.queue_time_us":152550,"thread_start_us":265951,"threads_started":2}
I20260709 13:01:01.708010  1540 raft_consensus.cc:1240] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:01.712762  3767 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:01.713037  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1366) took 2243 ms. Trace:
I20260709 13:01:01.704051  1541 rpcz_store.cc:276] 0709 13:01:00.464984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.465131 (+   147us) service_pool.cc:224] Handling call
0709 13:01:01.699200 (+1234069us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54000aa0d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:01.699399 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2802699648}
I20260709 13:01:01.673637  3558 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.715021  1688 rpcz_store.cc:276] 0709 13:00:59.468229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.484676 (+ 16447us) service_pool.cc:224] Handling call
0709 13:00:59.500800 (+ 16124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.166575 (+665775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.710581 (+1544006us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400128ed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:01.711201 (+   620us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370401664}
W20260709 13:01:01.718819  1662 leader_election.cc:336] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Timed out: RequestConsensusVote RPC to 127.0.107.132:39517 timed out after 1.544s (SENT)
I20260709 13:01:01.722677  3765 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:01.722999  2232 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:01.725033  3778 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:01.725561  3778 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:01.728880  3778 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:01.735656  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.722733  1662 leader_election.cc:336] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Timed out: RequestConsensusVote RPC to 127.0.107.132:39517 timed out after 1.574s (SENT)
I20260709 13:01:01.739617  1544 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:01.740193  3725 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.740069  1662 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:01.742149  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1396) took 1131 ms. Trace:
W20260709 13:01:01.743240  1662 leader_election.cc:336] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Timed out: RequestConsensusVote RPC to 127.0.107.132:39517 timed out after 1.635s (SENT)
I20260709 13:01:01.744560  3716 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:01.740056  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:01.729076  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:01.746747  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 161049us
W20260709 13:01:01.740403  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2163) took 1280 ms (client timeout 1528 ms). Trace:
I20260709 13:01:01.742743  1696 rpcz_store.cc:276] 0709 13:01:00.610268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.699165 (+ 88897us) service_pool.cc:224] Handling call
0709 13:01:01.741722 (+1042557us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54001603d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:01.741942 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333155712}
I20260709 13:01:01.752620  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:01.755095  3558 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.755614  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:01.756359  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2167) took 1252 ms. Trace:
I20260709 13:01:01.757691  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 254) took 2549 ms. Trace:
I20260709 13:01:01.756944  1546 rpcz_store.cc:276] 0709 13:01:00.503930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.711873 (+207943us) service_pool.cc:224] Handling call
0709 13:01:00.728322 (+ 16449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.853140 (+124818us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:01.012051 (+158911us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.083758 (+ 71707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.083816 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:01.083867 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.755835 (+671968us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54003b6354. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:01.755904 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.756158 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":265288,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":59,"raft.queue_time_us":121,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":285998464,"thread_start_us":203399,"threads_started":2,"wal-append.queue_time_us":122330}
I20260709 13:01:01.758375  1539 rpcz_store.cc:276] 0709 13:00:59.207729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.234544 (+ 26815us) service_pool.cc:224] Handling call
0709 13:00:59.234947 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.408431 (+1173484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.743246 (+1334815us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002b3754. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:01.757451 (+ 14205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2606765440}
I20260709 13:01:01.759748  1621 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:01.761018  3730 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:01.750447  1547 rpcz_store.cc:269] 0709 13:01:00.459980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.460136 (+   156us) service_pool.cc:224] Handling call
0709 13:01:01.740005 (+1279869us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54000c4c54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:01.740210 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2843412224}
I20260709 13:01:01.749321  3778 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.765226  3727 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.761543  3730 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:01.769732  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:01.769590  3757 raft_consensus.cc:3055] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:01.771212  3757 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:01.780791  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:01.779101  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:01.771751  3528 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:01.825197  3761 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.838367  3757 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.840420  3757 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.841495  3574 consensus_queue.cc:1059] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:01.837276  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:01.849260  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.852388  3624 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:01.854598  3730 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:01.856222  3645 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:01.837531  3550 tablet_copy_client.cc:806] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:01.857241  3727 consensus_queue.cc:1059] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:01.838395  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 55287.8us
I20260709 13:01:01.820120  3676 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:01.894637  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.879738  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:01.901371  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 60470.2us
I20260709 13:01:01.866729  3624 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:01.902526  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 121024us
I20260709 13:01:01.906704  3550 tablet_copy_client.cc:670] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:01.909786  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:01.911212  1541 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:01.914448  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:01.922217  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:01.922504  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:01.923599  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:01.922204  1547 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:01.923748  1545 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:01.926134  1542 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:01.923724  3727 consensus_queue.cc:1243] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:01.943248  1546 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:01.943795  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:01.930569  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.931946  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:01.933525  3624 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.934535  3667 consensus_queue.cc:1059] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 13:01:01.934942  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 64183.9us
I20260709 13:01:01.964738  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:01.965538  1620 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:01.898769  3716 consensus_queue.cc:1059] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:01:01.968775  3716 raft_consensus.cc:3055] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:01.969347  3716 raft_consensus.cc:740] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:01.970697  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:01.972612  2267 raft_consensus.cc:2410] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:01.936089  3646 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:01:01.936096  3645 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:01.975829  3645 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:01.977240  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:01.977591  3645 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:01.937322  1543 raft_consensus.cc:1240] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:01.903759  3767 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:01:01.979821  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:01.939934  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:01.914858  3443 consensus_queue.cc:1059] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:01:01.981972  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:01.952760  3676 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:01.948151  1662 leader_election.cc:336] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Timed out: RequestConsensusVote RPC to 127.0.107.132:39517 timed out after 2.053s (SENT)
I20260709 13:01:01.984314  3645 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:01.956084  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:01.956753  1663 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:01.958811  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:01.959939  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:01.956069  3730 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.960740  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:01.975072  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:01.975178  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:01.984615  1690 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
W20260709 13:01:01.983227  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 63272.1us
I20260709 13:01:01.986814  3624 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:01.987366  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.988749  3663 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.990685  3738 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:01.953529  3771 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:01.982872  1547 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:01:01.995952  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:01.982257  3443 raft_consensus.cc:3055] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:01.999933  3430 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:02.002130  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:01.971856  3716 consensus_queue.cc:260] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:02.008478  3667 raft_consensus.cc:3055] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.011690  1539 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:02.021546  1544 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
W20260709 13:01:02.011690  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 95328.1us
I20260709 13:01:02.036407  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:02.040601  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:02.029243  3768 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.100579  1545 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:02.100466  1621 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:02.102005  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.104727  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.106280  1540 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:02.113065  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:02.038518  3443 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:02.115208  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:02.124168  1620 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.101289  3667 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:02.126112  1618 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.133216  3430 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:02.133834  3676 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:02.133708  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 73014.6us
I20260709 13:01:02.134475  3676 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:02.135635  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33072 (request call id 132) took 10164 ms. Trace:
W20260709 13:01:02.136679  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 180087us
I20260709 13:01:02.137878  1663 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:02.139721  3653 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:02.140483  3668 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:02.141625  3668 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.141803  3653 consensus_queue.cc:1059] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:02.142795  3653 consensus_queue.cc:1243] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:02.143577  3792 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:01:02.144258  2263 raft_consensus.cc:3055] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:02.144721  2263 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:02.146577  3649 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:02.150398  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:02.153232  3716 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:02.152122  3667 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:02.138195  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1407) took 1448 ms (client timeout 1798 ms). Trace:
W20260709 13:01:02.158946  1690 rpcz_store.cc:269] 0709 13:01:00.690330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.732098 (+ 41768us) service_pool.cc:224] Handling call
0709 13:01:02.137994 (+1405896us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400097ed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:02.138137 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2878235904}
I20260709 13:01:02.122236  3558 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:02.177497  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:02.160359  3629 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.126538  3663 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:02.161726  3649 raft_consensus.cc:3055] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:02.126751  3738 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:02.127506  3768 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:02.226068  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 90314.5us
I20260709 13:01:02.135690  3676 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:02.229768  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:02.176170  3778 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:01:02.202899  3767 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:02.217707  3667 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.136566  1443 rpcz_store.cc:276] 0709 13:00:51.880766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.881301 (+   535us) service_pool.cc:224] Handling call
0709 13:01:02.027680 (+10146379us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:55.638848 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:56.083943 (+445095us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:56.088467 (+  4524us) write_op.cc:435] Acquired schema lock
0709 13:00:56.097189 (+  8722us) tablet.cc:662] Decoding operations
0709 13:00:56.251569 (+154380us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:56.271790 (+ 20221us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:56.279219 (+  7429us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:00:56.364244 (+ 85025us) tablet.cc:701] Row locks acquired
0709 13:00:56.364278 (+    34us) write_op.cc:260] PREPARE: finished
0709 13:00:56.384342 (+ 20064us) write_op.cc:270] Start()
0709 13:00:56.404573 (+ 20231us) write_op.cc:276] Timestamp: P: 1783602056375174 usec, L: 0
0709 13:00:56.404614 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:00:56.539707 (+135093us) log.cc:844] Serialized 1686 byte log entry
0709 13:00:58.740495 (+2200788us) op_driver.cc:464] REPLICATION: finished
0709 13:00:59.484746 (+744251us) write_op.cc:301] APPLY: starting
0709 13:00:59.498397 (+ 13651us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:59.564715 (+ 66318us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:59.592212 (+ 27497us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:59.679879 (+ 87667us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:59.680150 (+   271us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:00:59.680217 (+    67us) write_op.cc:312] APPLY: finished
0709 13:00:59.680569 (+   352us) log.cc:844] Serialized 41 byte log entry
0709 13:00:59.987227 (+306658us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:59.997818 (+ 10591us) write_op.cc:454] Released schema lock
0709 13:01:00.001350 (+  3532us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:00.096820 (+ 95470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:00.105869 (+  9049us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":695406,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":658685,"apply.run_cpu_time_us":67455,"apply.run_wall_time_us":618811,"num_ops":4,"prepare.queue_time_us":399875,"prepare.run_cpu_time_us":142568,"prepare.run_wall_time_us":1560858,"raft.queue_time_us":1403247,"raft.run_cpu_time_us":29558,"raft.run_wall_time_us":376035,"replication_time_us":2327943,"thread_start_us":1572602,"threads_started":5,"wal-append.queue_time_us":1196539,"wal-append.run_cpu_time_us":26206,"wal-append.run_wall_time_us":3356772}]]}
I20260709 13:01:02.245558  2265 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:01:02.246225  2265 pending_rounds.cc:85] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Aborting all ops after (but not including) 5
I20260709 13:01:02.246596  2265 pending_rounds.cc:107] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:01:02.246888  2265 raft_consensus.cc:2889] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:02.248867  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.252195  2270 raft_consensus.cc:1240] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:02.255494  3443 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:02.256930  3443 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:02.257149  3771 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:02.259995  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.259672  1622 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:02.260989  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 319) took 2447 ms. Trace:
I20260709 13:01:02.259660  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:02.261901  2272 raft_consensus.cc:2393] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:02.262633  3792 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.263482  3527 raft_consensus.cc:3055] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:02.264019  3527 raft_consensus.cc:740] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:02.263262  3792 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:02.235592  3430 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:02.265316  3527 consensus_queue.cc:260] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:02.266242  2263 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:02.269392  2263 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:02.272361  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:02.260764  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.282280  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 144500us
I20260709 13:01:02.214609  3649 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:01:02.282945  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 46578.3us
I20260709 13:01:02.295178  1620 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:02.317394  1617 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:02.261497  1623 rpcz_store.cc:276] 0709 13:00:59.813275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.414598 (+601323us) service_pool.cc:224] Handling call
0709 13:01:01.611857 (+1197259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.613594 (+  1737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.613624 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.625693 (+ 12069us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.685846 (+ 60153us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:01.685900 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.691010 (+  5110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.827717 (+136707us) raft_consensus.cc:1685] finished
0709 13:01:01.827742 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.260572 (+432830us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002648d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:02.260789 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":775,"raft.run_cpu_time_us":1164,"raft.run_wall_time_us":1164,"spinlock_wait_cycles":2752035712,"thread_start_us":56835,"threads_started":1,"wal-append.queue_time_us":111838}
I20260709 13:01:02.344568  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:02.343871  1621 raft_consensus.cc:2410] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:02.345605  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:02.317684  3527 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.357847  1619 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:02.286031  3629 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:02.372900  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:02.342657  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:02.372308  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:02.400955  1690 raft_consensus.cc:1240] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:02.376403  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:02.402129  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.379621  1620 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.409554  3752 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.410248  3752 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:02.411255  1547 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:02.412525  3752 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:02.413074  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 166327us
W20260709 13:01:02.420310  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 418501us
I20260709 13:01:02.406033  3646 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:02.428357  1617 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:02.431461  1688 raft_consensus.cc:2393] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:02.429620  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:02.430094  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:02.437180  1540 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:02.451299  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:02.452798  1690 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:02.453161  3738 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:02.414675  3649 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:02.453431  1514 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:02.453981  3649 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.458320  3800 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:02.457768  3812 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:02.464257  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 124671us
I20260709 13:01:02.464874  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:02.466607  1619 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:02.444036  3528 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.479557  1663 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:02.460084  3550 tablet_copy_client.cc:538] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:02.483805  1514 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:02.490170  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:02.491626  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.500216  1623 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:02.500355  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 160863us
I20260709 13:01:02.502714  3805 consensus_queue.cc:1059] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:01:02.505367  1688 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:02.508472  1689 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:02.508474  1693 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:02.510362  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:02.510741  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:02.509620  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:02.511610  1689 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:02.512125  1692 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:02.519467  3794 raft_consensus.cc:3055] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.520651  3794 raft_consensus.cc:740] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:02.524339  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.524606  3629 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:02.528475  3768 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:02.529035  3574 raft_consensus.cc:3055] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:02.529485  3574 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:02.486101  3792 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:02.542841  1696 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:02.530624  3574 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:02.484767  3528 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:02.531466  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:02.534648  3663 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:02.511184  1691 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:02.577690  1618 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:02.536825  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:02.536580  3751 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.502823  2231 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:02.537499  1694 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:02.538113  1587 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:02.536072  3738 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:02.502885  3675 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:02.535534  3771 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:02.572788  1620 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
W20260709 13:01:02.612164  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 75393.8us
I20260709 13:01:02.522462  3794 consensus_queue.cc:260] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:02.628727  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 126041us
I20260709 13:01:02.630507  3794 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.619041  3675 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:02.631850  3675 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:02.631886  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 93909.3us
I20260709 13:01:02.633407  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:02.631116  2231 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:02.636816  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:02.623250  3800 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:02.619567  3771 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:02.630051  3528 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:02.636340  3716 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:02.652307  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:02.654350  3771 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.650369  3800 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.657013  3738 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:02.648134  3663 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:02.661190  1587 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:02.650786  3624 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.613s	user 0.014s	sys 0.000s
W20260709 13:01:02.663663  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.623447  3751 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:02.677073  1586 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:02.683094  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 250326us
I20260709 13:01:02.680307  3800 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.699608  2232 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:02.682677  3629 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:01:02.684260  3676 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:02.703991  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 78859.2us
I20260709 13:01:02.685468  3725 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:02.710440  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.710392  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 295598us
I20260709 13:01:02.711031  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:02.682933  3653 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:01:02.678184  3528 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 13:01:02.706494  3730 consensus_meta.cc:287] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.669s	user 0.010s	sys 0.008s
W20260709 13:01:02.720137  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 89333us
I20260709 13:01:02.703584  3793 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:02.708643  3804 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:02.731650  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.712716  3725 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:02.749890  3725 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:02.756135  3456 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:02.756703  3456 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.757089  3456 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:02.762167  3777 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.763062  3777 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:02.739992  3745 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:02.740279  3668 consensus_meta.cc:287] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.598s	user 0.018s	sys 0.010s
I20260709 13:01:02.740792  1540 raft_consensus.cc:1240] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:02.740312  3730 consensus_queue.cc:1059] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:02.720034  3667 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:02.733649  3804 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:02.846526  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 185430us
I20260709 13:01:02.880769  3663 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.888198  2231 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:02.925515  3663 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:02.926045  1587 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:02.926798  3792 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:02.724768  3558 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:02.829308  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.929145  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.845547  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 246212us
W20260709 13:01:02.846704  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 102551us
I20260709 13:01:02.906368  1623 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:02.764032  1514 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:02.927301  3792 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:02.927940  3668 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:01:02.912397  3667 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:02.973048  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 85021.5us
I20260709 13:01:02.878700  3804 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.881062  3752 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.974033  3558 raft_consensus.cc:697] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:02.763746  3751 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:02.974457  3745 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:02.882408  3629 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.848855  2234 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:02.976414  2268 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:02.976542  1614 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:02.827046  3443 consensus_meta.cc:287] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.570s	user 0.019s	sys 0.001s
I20260709 13:01:02.885740  3574 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:02.976549  3565 consensus_queue.cc:1059] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:03.011204  3430 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:03.036075  3430 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.036474  3430 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:02.978425  3528 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.979471  3663 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:02.995512  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.879951  1693 raft_consensus.cc:2410] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:02.964315  3777 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:03.000481  1620 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:03.002692  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 238777us
I20260709 13:01:03.009702  3667 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:03.004884  3646 consensus_meta.cc:287] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.541s	user 0.004s	sys 0.016s
I20260709 13:01:02.888324  3793 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:03.031522  3629 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.036888  3752 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:02.918031  3823 raft_consensus.cc:3055] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:03.004565  3792 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:03.039837  1623 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:02.996304  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:03.010643  1511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.052s (SENT) [suppressed 35 similar messages]
W20260709 13:01:03.067387  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 56780.4us
I20260709 13:01:03.045290  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:03.056470  1661 leader_election.cc:336] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.544s (SENT)
I20260709 13:01:03.049702  1586 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:03.058837  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 210287us
I20260709 13:01:03.063302  3823 raft_consensus.cc:740] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:02.994710  3725 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:03.040261  2263 consensus_meta.cc:287] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.746s	user 0.013s	sys 0.005s
I20260709 13:01:03.000023  3675 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:03.068849  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:03.057206  3646 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:03.058673  3793 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:03.059643  3794 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:03.071792  1511 leader_election.cc:336] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.099s (SENT)
I20260709 13:01:03.079718  3823 consensus_queue.cc:260] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:03.082875  1514 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:03.050870  3528 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.094537  2234 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:03.096009  1623 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:03.097337  3812 consensus_queue.cc:1059] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:01:03.107288  1618 raft_consensus.cc:2393] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:03.100288  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 47474.2us
W20260709 13:01:03.094336  3817 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.001s
I20260709 13:01:03.101166  3443 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:03.101341  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:03.103736  2263 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:03.077911  3745 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:03.109872  3823 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:03.116685  3771 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:03.118537  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 330) took 3220 ms. Trace:
I20260709 13:01:03.119180  3751 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:03.087160  3565 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:01:03.068553  3716 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:01:03.130548  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61207.4us
W20260709 13:01:03.134479  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.058446  3676 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:01:03.133033  1614 rpcz_store.cc:276] 0709 13:00:59.898288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.795209 (+896921us) service_pool.cc:224] Handling call
0709 13:01:01.551614 (+756405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.040901 (+1489287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.116956 (+ 76055us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54000d39d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:03.118167 (+  1211us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54000d39d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:03.118426 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5010814592}
W20260709 13:01:03.143042  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 48618.3us
I20260709 13:01:03.155061  3795 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:03.156230  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:03.157186  1688 raft_consensus.cc:2410] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:03.157617  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:03.158131  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:03.158497  1689 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:03.158772  1691 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:01:03.161713  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:03.162545  1694 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:03.162194  3804 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.164465  3675 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:03.164888  3804 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:03.165284  1623 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:03.165864  1548 raft_consensus.cc:1240] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:03.167496  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:03.168406  1620 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:03.136906  3751 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:03.173650  3528 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:03.177311  3745 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:03.180711  3801 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:03.187063  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:03.188279  3752 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:03.197517  3663 raft_consensus.cc:3055] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:03.197973  3663 raft_consensus.cc:740] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:03.198854  3771 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:03.207674  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61354.9us
W20260709 13:01:03.223730  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 97193.6us
I20260709 13:01:03.227916  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:03.153748  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 586) took 1013 ms. Trace:
I20260709 13:01:03.240818  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:03.241076  3443 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.241781  1688 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:03.242866  1586 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:03.131353  3558 consensus_queue.cc:237] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:03.198467  3667 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:03.250883  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:03.253435  1514 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:03.251322  1586 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:03.244263  3649 consensus_meta.cc:287] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.790s	user 0.009s	sys 0.005s
I20260709 13:01:03.241818  3443 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.257091  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:03.234959  3676 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:03.247388  3800 consensus_meta.cc:287] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.539s	user 0.002s	sys 0.010s
W20260709 13:01:03.258422  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.259965  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 104854us
I20260709 13:01:03.261902  1691 raft_consensus.cc:2393] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:03.263826  1618 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:01:03.248325  3668 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:03.267391  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 199397us
I20260709 13:01:03.253183  3752 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:03.198910  3663 consensus_queue.cc:260] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:03.265565  1618 pending_rounds.cc:85] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 2
I20260709 13:01:03.273613  1618 pending_rounds.cc:107] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:01:03.268822  1586 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:03.274152  1618 raft_consensus.cc:2889] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:03.248273  3745 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.252137  3629 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:03.224344  3832 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:01:03.260854  3528 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:03.283202  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 142675us
W20260709 13:01:03.287319  1588 leader_election.cc:336] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Timed out: RequestConsensusVote RPC to 127.0.107.132:39517 timed out after 1.506s (SENT)
I20260709 13:01:03.262921  3738 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:03.252257  3792 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:03.268098  3668 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.293191  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:03.329453  1695 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:03.280723  3528 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.295909  3443 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:03.284780  3725 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:03.284704  3649 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:03.299288  3663 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:03.300171  3794 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.300318  3430 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.237747  2263 rpcz_store.cc:276] 0709 13:01:02.140216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.143624 (+  3408us) service_pool.cc:224] Handling call
0709 13:01:02.144026 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.129051 (+985025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.148267 (+ 19216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:03.300212  3836 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:03.303694  3745 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.267452  3800 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.288981  3771 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.307152  3550 tablet_bootstrap.cc:492] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:01:03.307229  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:03.307590  2231 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:03.272185  3752 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:03.308230  3456 consensus_meta.cc:287] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.551s	user 0.004s	sys 0.008s
I20260709 13:01:03.337803  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:03.338467  3649 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.330754  3668 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:03.336000  3528 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:03.356132  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:03.356693  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 49412.6us
I20260709 13:01:03.393651  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:03.356055  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 68753.9us
I20260709 13:01:03.309048  3676 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:03.339927  3646 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.359982  3801 raft_consensus.cc:697] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:03.366660  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:03.365720  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:03.350353  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:03.376125  1689 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:03.400099  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:03.351497  3667 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:03.352428  3443 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.405982  1542 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:03.352800  3792 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:03.343080  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:03.394833  1697 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:03.401432  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:03.401015  1688 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:03.400034  2269 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:01:03.354977  3745 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:03.407931  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:03.364784  3752 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:03.364005  3675 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.391952  3649 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:03.412940  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:03.344322  3794 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:03.422640  1588 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:03.416033  1696 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:03.410606  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:03.420141  1688 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:03.421730  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:03.358785  3771 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.396986  3838 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:03.357530  3793 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:03.421015  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 114009us
I20260709 13:01:03.431211  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:03.432562  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.432772  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:03.433482  1617 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:03.376600  3456 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.439036  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:03.355692  3836 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:03.441006  1547 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:03.440825  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:03.441627  1586 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:03.443578  1514 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:03.425465  3761 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.417495  3839 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:03.453929  1588 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:03.455941  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:03.398268  3646 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.412621  3443 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.441313  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:03.460282  1514 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:03.459913  3653 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:03.470463  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:03.471858  1620 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:03.435322  3675 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.440670  3558 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:01:03.462496  3624 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.477571  1514 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:03.480325  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:03.417652  3801 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.482915  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:03.483119  3842 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:03.465435  3430 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:03.449895  3818 consensus_queue.cc:1059] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 13:01:03.449720  3730 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:01:03.459092  3761 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.475610  3839 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:03.477458  3738 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:03.498347  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:03.498672  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:03.508185  1620 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:03.502009  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:03.508296  2269 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 2: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:03.509274  1546 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:03.513532  1617 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:03.520566  3836 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:03.521523  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.500144  3676 raft_consensus.cc:697] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:03.525187  3708 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:03.525355  3646 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:03.526757  3814 raft_consensus.cc:3055] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:03.565821  1514 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:03.526906  3761 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:03.517071  3730 consensus_queue.cc:1243] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Peer 27308aae2ef347ccba1b27e7f6f04334 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:03.529749  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:03.530246  3751 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:03.501027  3777 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.485569  3624 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.613296  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:03.530779  2270 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:03.614501  1691 raft_consensus.cc:2410] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:03.535567  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:03.536052  3843 log.cc:927] Time spent T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:01:03.513231  3800 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:03.512490  3838 raft_consensus.cc:3055] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:03.539464  3771 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:03.539562  3833 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:03.499332  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:03.541603  3675 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:03.544210  1587 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:03.524344  3676 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.560514  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:03.561861  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:03.655784  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.564924  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:03.530526  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:03.618209  1546 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:03.555294  1511 connection.cc:256] RPC call timeout handler was delayed by -1.396252102999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 13:01:03.672581  1511 connection.cc:256] RPC call timeout handler was delayed by -1.3341521029999512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260709 13:01:03.673079  1511 connection.cc:256] RPC call timeout handler was delayed by -1.2999521029999528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260709 13:01:03.673418  1511 connection.cc:256] RPC call timeout handler was delayed by -1.1442521029999284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 13:01:03.673761  1511 connection.cc:256] RPC call timeout handler was delayed by -1.1028521029999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
I20260709 13:01:03.621709  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:03.676985  1696 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:03.559926  3839 raft_consensus.cc:697] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:03.620968  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:03.687642  1693 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:03.617859  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:03.629051  1692 raft_consensus.cc:1240] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:03.557981  3738 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:03.565951  3814 raft_consensus.cc:740] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:03.649645  1620 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:03.651790  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:03.679848  3800 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:03.705461  1691 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:03.705919  3800 raft_consensus.cc:697] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:03.626511  3777 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.707047  3800 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.613482  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:03.639691  3833 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.561112  3708 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.568972  3430 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:01:03.631433  3838 raft_consensus.cc:740] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:03.681973  1541 raft_consensus.cc:2393] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 6: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:03.711516  1662 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:03.710855  2231 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:03.715926  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:03.711688  1548 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:03.716953  1691 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
W20260709 13:01:03.720737  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 158927us
I20260709 13:01:03.728404  1695 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:03.850030  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:04.107782  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 256709us
W20260709 13:01:03.819130  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.896147  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:04.117084  1694 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:04.116968  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 406142us
I20260709 13:01:03.926367  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:04.110001  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 244131us
W20260709 13:01:03.942380  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 381625us
W20260709 13:01:04.113760  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 659839us
W20260709 13:01:03.942454  1545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.006s	sys 0.015s
I20260709 13:01:03.969792  1689 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
W20260709 13:01:04.119019  1545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.006s	sys 0.019s
I20260709 13:01:04.106798  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:04.118364  1697 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:03.822885  1543 raft_consensus.cc:1240] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:04.033187  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:04.105959  1688 raft_consensus.cc:2410] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:04.122933  1690 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:04.091084  2271 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:04.123175  1696 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:04.123502  2271 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:04.127986  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:04.128918  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:04.129145  1511 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:04.060045  3826 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:01:03.911469  3574 consensus_meta.cc:287] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.878s	user 0.015s	sys 0.000s
I20260709 13:01:04.135363  3793 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.136260  3793 consensus_queue.cc:1059] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:03.938166  3738 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:04.130533  3761 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:04.138837  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.714763  3794 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:03.728159  3833 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:03.815865  2265 raft_consensus.cc:2410] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:01:04.133602  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 589467us
I20260709 13:01:04.147149  1587 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:04.148113  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:04.116101  3805 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:03.927059  2264 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:04.115921  3708 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:03.908313  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:03.896064  3842 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:03.914005  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:03.711845  3849 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:03.704934  3771 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:03.712177  3443 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:03.914284  3667 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.931624  3857 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.911338  3456 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.134430  1696 raft_consensus.cc:2410] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:03.976562  3624 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:03.712769  3836 consensus_queue.cc:1059] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.427s
I20260709 13:01:03.711728  3792 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.428s
I20260709 13:01:03.807659  3629 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:03.712575  3818 consensus_queue.cc:1059] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.427s
I20260709 13:01:04.178648  3818 raft_consensus.cc:3055] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:04.154493  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:04.161859  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:03.821611  3649 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:04.162567  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 451084us
I20260709 13:01:04.192216  1695 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:04.195299  3849 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:01:04.195701  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 76651.3us
I20260709 13:01:04.196990  1588 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:04.196635  3849 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.187322  3653 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.203774  3653 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.205901  3653 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.207542  3856 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.208561  3777 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:04.208439  3856 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.163311  2272 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:04.138676  3795 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.845314  3528 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:03.825511  3675 consensus_queue.cc:1059] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.329s
I20260709 13:01:04.151288  3794 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.175884  3793 raft_consensus.cc:3055] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:04.176433  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:04.177279  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:04.180719  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61659.3us
I20260709 13:01:04.181515  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:04.224258  1691 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.224400  1514 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:04.182816  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:04.179764  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:04.228255  1693 raft_consensus.cc:2410] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:04.159044  2271 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.187529  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:04.164659  1443 catalog_manager.cc:5697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.707340  3839 consensus_queue.cc:237] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:01:04.195083  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:04.179312  3818 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:04.182219  3663 consensus_meta.cc:287] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.840s	user 0.009s	sys 0.004s
I20260709 13:01:04.230556  1689 raft_consensus.cc:2410] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:04.211199  3856 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.224753  1694 raft_consensus.cc:2410] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:01:04.238754  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.195183  3858 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:04.245584  1690 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:03.850893  3814 consensus_queue.cc:260] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:04.247177  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 100130us
W20260709 13:01:04.249200  1614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.052s	sys 0.053s
I20260709 13:01:04.207729  3832 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.261610  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:04.271247  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.271951  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.263571  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:04.271754  1696 raft_consensus.cc:2376] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5. Re-sending same reply.
W20260709 13:01:04.263906  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 67069.5us
W20260709 13:01:04.267458  1614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.052s	sys 0.054s
I20260709 13:01:04.276355  1691 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
W20260709 13:01:04.268661  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 44677.1us
I20260709 13:01:04.276388  1588 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:04.283237  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:04.172271  3667 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.261061  1443 catalog_manager.cc:5697] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 4 to 5, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 5 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.233381  3653 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:04.241842  3794 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.182050  3857 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.231958  3793 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:04.284474  1693 raft_consensus.cc:2376] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4. Re-sending same reply.
I20260709 13:01:04.289815  1443 catalog_manager.cc:5697] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 3, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 3 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:04.325938  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 49656us
I20260709 13:01:04.346035  1588 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:04.356192  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 239427us
I20260709 13:01:04.290558  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:04.291147  2271 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.364179  1696 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:04.365790  1587 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:04.332185  3852 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 13:01:04.333046  3851 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:01:04.288393  3675 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:04.333554  3745 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:04.326474  3856 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:04.291805  3752 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.856s	user 0.009s	sys 0.006s
I20260709 13:01:04.348198  1443 catalog_manager.cc:5697] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 2, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:01:04.368470  3771 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.351799  3858 raft_consensus.cc:697] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:04.380650  1689 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:04.323144  3528 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.416522  1691 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:04.376091  3805 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:04.222270  3795 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.383123  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:04.408072  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:04.410012  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:04.412304  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:04.413610  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:04.428632  1621 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:04.428797  1622 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:04.414201  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:04.414641  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:04.289443  3624 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:04.419891  1443 catalog_manager.cc:5697] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 3, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 3 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.434082  1443 catalog_manager.cc:5697] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 2, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 2 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:01:04.422428  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 76473.6us
I20260709 13:01:04.342389  3833 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:04.425823  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 296707us
I20260709 13:01:04.430449  1616 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:01:04.394057  3663 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:04.439090  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:04.444900  1622 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:04.442641  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:04.446005  1616 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:01:04.448191  1619 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:04.445663  1443 catalog_manager.cc:5697] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 4, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 4 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:01:04.396215  3675 raft_consensus.cc:697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:04.397940  3456 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:04.448830  1619 pending_rounds.cc:85] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 1
I20260709 13:01:04.422307  3653 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:04.451758  1443 catalog_manager.cc:5697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:01:04.415970  3752 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.458338  1619 pending_rounds.cc:107] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:04.426862  3859 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.471385  1619 raft_consensus.cc:2889] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:04.338045  3838 consensus_queue.cc:260] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.471597  1443 catalog_manager.cc:5697] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:04.454178  2268 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:01:04.473692  1621 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
W20260709 13:01:04.486097  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 125415us
I20260709 13:01:04.474932  1615 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:04.432762  3801 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.487138  1661 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:04.478127  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:04.488989  1618 raft_consensus.cc:2393] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:04.458966  3668 consensus_meta.cc:287] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 1.046s	user 0.011s	sys 0.003s
I20260709 13:01:04.417712  3771 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.264732  3842 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.473918  3856 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.499573  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1372) took 1126 ms. Trace:
I20260709 13:01:04.435516  3805 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.497583  1443 catalog_manager.cc:5697] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 3, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 3 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:01:04.505087  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 48059.5us
I20260709 13:01:04.507009  1511 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:04.443167  3624 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.500002  1539 rpcz_store.cc:276] 0709 13:01:03.366037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.366146 (+   109us) service_pool.cc:224] Handling call
0709 13:01:03.366433 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.400691 (+ 34258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.400726 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.412748 (+ 12022us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.682228 (+269480us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:03.682280 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.682374 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.491817 (+809443us) raft_consensus.cc:1685] finished
0709 13:01:04.491843 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.492034 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":263893,"threads_started":1,"wal-append.queue_time_us":760487}
I20260709 13:01:04.455516  3629 consensus_queue.cc:1059] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:01:04.504187  1443 catalog_manager.cc:5697] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 4, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 4 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:04.490935  3653 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:04.487769  3648 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:04.522750  1443 catalog_manager.cc:5697] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 4, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 4 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:04.524880  1511 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:04.490481  3810 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.427479  3793 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.533106  1621 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:04.484897  3859 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.476534  3456 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.535266  1443 catalog_manager.cc:5697] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 4, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 4 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:04.457494  3868 consensus_queue.cc:1059] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:01:04.542532  3676 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:04.543145  1511 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:04.545578  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:04.517439  3649 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.551050  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:04.584400  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:04.576555  1616 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:01:04.550308  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 77929.7us
I20260709 13:01:04.531041  3648 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:04.591261  3648 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:04.595633  1588 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:04.597107  1588 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:04.524442  3858 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.545073  3653 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.599908  1622 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:04.552016  3738 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:01:04.601581  3653 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.601820  3794 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:04.602187  3653 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:04.602612  3653 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:04.495748  3668 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.523917  3871 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:04.572937  1548 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:01:04.572183  1619 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 5. Ops: []
I20260709 13:01:04.605324  1618 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:01:04.621356  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:04.578107  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 195072us
I20260709 13:01:04.622840  1663 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:04.603011  3653 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:04.625037  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 136230us
I20260709 13:01:04.545378  3836 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.637321  3883 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:04.642877  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:04.515688  3856 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.643471  3878 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.644309  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 101272us
W20260709 13:01:04.644446  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.548261  3873 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:04.572065  3676 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:04.652664  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.653081  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.646577  1539 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:04.649597  1618 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:04.601576  3624 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:04.602967  3761 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:04.653167  2232 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:04.657088  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 86777.9us
I20260709 13:01:04.546206  3801 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.659117  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:04.646467  3793 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:04.549567  3810 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.656064  3676 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:04.669553  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:04.673494  1619 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:04.669684  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:04.674729  1618 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:04.675617  1616 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:01:04.676694  3861 log.cc:927] Time spent T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.332s	user 0.002s	sys 0.000s
I20260709 13:01:04.677281  1619 raft_consensus.cc:1240] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:04.677834  3875 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:04.678279  3862 log.cc:927] Time spent T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 13:01:04.679800  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1371) took 1314 ms. Trace:
I20260709 13:01:04.680615  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 588) took 1403 ms. Trace:
I20260709 13:01:04.680157  1545 rpcz_store.cc:276] 0709 13:01:03.365653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.365807 (+   154us) service_pool.cc:224] Handling call
0709 13:01:03.375884 (+ 10077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.390609 (+ 14725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.390642 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.408516 (+ 17874us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.119459 (+710943us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:04.119503 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.119571 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.679599 (+560028us) raft_consensus.cc:1685] finished
0709 13:01:04.679620 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.679744 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":683267,"threads_started":1,"wal-append.queue_time_us":747944}
I20260709 13:01:04.681089  2268 rpcz_store.cc:276] 0709 13:01:03.277604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.289386 (+ 11782us) service_pool.cc:224] Handling call
0709 13:01:03.895960 (+606574us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b580000ff98. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:01:04.680459 (+784499us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54006202d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:04.680560 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802013824}
I20260709 13:01:04.661059  3574 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:04.684494  1622 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:04.661302  3667 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.619093  3675 consensus_queue.cc:237] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.687280  1511 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:04.691793  3876 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:04.692296  3876 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:04.692504  3856 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.692979  3876 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.693118  3880 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:04.693727  3880 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.694725  3801 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:04.696246  3801 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:04.696563  3810 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.651582  3836 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.697069  3624 consensus_queue.cc:1059] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:04.689927  1692 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:04.700682  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:04.701198  2272 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:04.702147  1513 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:04.688119  3574 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.706260  3574 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:04.706077  3836 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.711555  3752 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.716023  3870 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:04.716717  3812 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:01:04.716784  3832 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:04.717129  3864 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:01:04.684092  3857 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.715637  1690 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:04.661489  3629 consensus_queue.cc:1059] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:01:04.653764  3878 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.716164  3882 raft_consensus.cc:3055] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:04.760766  3882 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:04.764883  3653 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.765002  3882 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.712425  3456 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.716878  3870 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:04.767305  3870 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:04.735852  3872 log.cc:927] Time spent T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:01:04.769747  3860 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.558s	user 0.002s	sys 0.002s
I20260709 13:01:04.729349  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 594) took 1422 ms. Trace:
I20260709 13:01:04.690538  3777 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:04.754558  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.760090  3875 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:04.725371  3801 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:04.775593  3801 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.776073  3801 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:04.776382  3863 log.cc:927] Time spent T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:01:04.656113  3873 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.729454  1622 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:04.772243  3875 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:04.863030  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 175869us
I20260709 13:01:04.770324  2271 rpcz_store.cc:276] 0709 13:01:03.292663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.292851 (+   188us) service_pool.cc:224] Handling call
0709 13:01:03.528302 (+235451us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b580000ff98. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb17fc0 00007f5c6fb02929 00007f5c6fb023d2 00007f5c69079bd4
0709 13:01:03.528602 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.090967 (+562365us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400505da0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6aab5dc0 00007f5c6ab401c0 00007f5c6ab41231 00007f5c6ab3dd8f 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c
0709 13:01:04.685483 (+594516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.685511 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:04.714507 (+ 28996us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:04.714604 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.714729 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.714893 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":702,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":11653,"spinlock_wait_cycles":340754432}
I20260709 13:01:04.778264  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 336) took 1361 ms. Trace:
W20260709 13:01:04.738114  3708 consensus_meta.cc:287] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.545s	user 0.001s	sys 0.009s
I20260709 13:01:04.863286  1618 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:01:04.872143  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54504 (request call id 406) took 1473 ms. Trace:
W20260709 13:01:04.882691  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 259906us
I20260709 13:01:04.862614  3738 raft_consensus.cc:3055] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:04.884338  3738 raft_consensus.cc:740] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:01:04.885618  3865 log.cc:927] Time spent T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:01:04.885298  3738 consensus_queue.cc:260] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.873103  2269 rpcz_store.cc:276] 0709 13:01:03.398527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.542444 (+143917us) service_pool.cc:224] Handling call
0709 13:01:03.542815 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.547682 (+  4867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.547728 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.567136 (+ 19408us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.939587 (+372451us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:03.939632 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.939705 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.768749 (+829044us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:04.770745 (+  1996us) raft_consensus.cc:1685] finished
0709 13:01:04.770773 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.872045 (+101272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13897,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":34004,"spinlock_wait_cycles":14938880,"thread_start_us":231900,"threads_started":1,"wal-append.queue_time_us":585710}
I20260709 13:01:04.866050  1614 rpcz_store.cc:276] 0709 13:01:03.417135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.417271 (+   136us) service_pool.cc:224] Handling call
0709 13:01:03.429104 (+ 11833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.592025 (+162921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.592054 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.616452 (+ 24398us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.276780 (+660328us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:04.327885 (+ 51105us) log.cc:844] Serialized 14 byte log entry
0709 13:01:04.328381 (+   496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.328486 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.778020 (+449534us) raft_consensus.cc:1685] finished
0709 13:01:04.778044 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.778203 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48009,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":15875,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":18836,"thread_start_us":645872,"threads_started":2,"wal-append.queue_time_us":797102}
I20260709 13:01:04.777783  3795 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:04.865440  3882 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.869258  3880 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:04.865129  3805 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.808674  3430 raft_consensus.cc:3055] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:04.898455  1514 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:04.918803  1663 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:04.881321  3868 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:04.862555  3574 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:04.893458  3663 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:04.923482  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:01:04.944895  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.812230  3648 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:04.954109  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:01:04.950956  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 52139.7us
I20260709 13:01:04.922224  3738 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:04.953346  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 315197us
I20260709 13:01:04.917241  3430 raft_consensus.cc:740] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:01:04.954831  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 60480.2us
I20260709 13:01:04.976917  1620 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:04.964433  1588 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:04.964632  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:04.956501  3880 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:04.965090  3839 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:01:04.973913  3873 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:04.947577  3443 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:04.878067  3708 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:04.978163  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 102234us
I20260709 13:01:04.979158  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:04.979576  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:04.982161  1692 raft_consensus.cc:1240] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:04.951637  3653 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:04.814141  3818 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.009514  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:05.010236  1689 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.011161  1588 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:04.950541  3868 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.013366  1691 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
W20260709 13:01:05.021129  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 56583.7us
I20260709 13:01:05.021978  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:04.979830  3777 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.980221  3859 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:04.991796  3663 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:05.019279  3873 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:05.043826  1663 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:05.031989  3818 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.028483  3456 raft_consensus.cc:2764] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:01:05.043432  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 151372us
I20260709 13:01:05.078948  1511 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:05.080823  1689 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:05.050714  3897 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:05.009156  3443 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.053826  3895 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.054800  3574 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:05.056211  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.057456  1695 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:04.984831  3676 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.074784  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:05.075078  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:05.075534  3875 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:05.057595  1623 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:05.142364  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.142706  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.076327  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:05.143272  1617 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:01:05.047257  2234 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:05.039719  3777 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.085101  3771 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:05.054242  3877 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 13:01:05.033845  3800 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:01:05.042326  3871 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:01:05.089445  3888 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:05.019546  3745 consensus_queue.cc:1059] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:01:05.055198  3885 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:05.096076  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.171087  1615 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:05.043011  3880 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:05.038878  3430 consensus_queue.cc:260] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.173597  3430 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.174500  3878 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:05.098637  3887 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:05.176944  3443 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:04.989168  3876 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.103595  1618 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:05.104785  3868 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:05.106678  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:05.079842  3858 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:05.107929  3902 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:05.181228  3668 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:05.181417  3876 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:05.135159  3839 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:05.107831  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:05.182369  3839 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.109441  1616 raft_consensus.cc:1240] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:05.110389  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.183713  3833 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:05.184921  3839 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:05.185202  3838 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.115756  2232 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:05.118098  3814 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:05.118381  1586 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:05.119378  3653 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.122485  3761 raft_consensus.cc:3055] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:01:05.123939  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.127885  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:05.137192  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 146411us
I20260709 13:01:05.143718  1623 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:01:05.138046  1614 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
W20260709 13:01:05.144860  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 98614.5us
I20260709 13:01:05.143852  1697 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:05.148465  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:05.153643  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:05.169382  3777 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:05.111570  3648 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:05.189433  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 73759.4us
I20260709 13:01:05.147792  3836 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:05.222700  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:05.213533  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 95234.1us
I20260709 13:01:05.236172  1544 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.204077  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.237885  1617 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:05.227645  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:05.239534  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 139750us
I20260709 13:01:05.237993  1545 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 1.
I20260709 13:01:05.239545  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:05.213476  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:05.242182  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:05.244218  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.242900  1623 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.237370  3761 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:05.239856  3801 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.252857  1514 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:05.253111  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:05.212622  3574 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:05.191567  3849 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:05.255213  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:05.139750  3895 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.238777  3878 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.261526  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:05.261821  3878 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.261945  3870 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.262398  2266 raft_consensus.cc:2393] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:05.257282  3839 consensus_queue.cc:1059] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:01:05.264909  3839 raft_consensus.cc:3055] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:05.265312  3839 raft_consensus.cc:740] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:05.266245  3839 consensus_queue.cc:260] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.256925  3871 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:05.267907  3871 raft_consensus.cc:697] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:05.268925  3895 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:05.269099  3884 raft_consensus.cc:3055] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:05.269605  3884 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:05.257874  3430 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:05.270085  3878 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:05.245735  3869 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:05.275835  3869 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.255800  3550 tablet_bootstrap.cc:492] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:01:05.241765  3653 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.278558  3550 tablet_bootstrap.cc:492] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:01:05.278602  3869 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:05.155203  3888 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.257884  3792 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:05.279731  3792 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.280989  3888 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:05.229043  3649 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:05.281924  3792 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:05.282279  3649 raft_consensus.cc:697] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:05.282657  1691 raft_consensus.cc:1217] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 13:01:05.283207  1691 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:05.283272  3649 consensus_queue.cc:237] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.260898  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:05.285514  2271 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:05.261234  3800 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:05.286703  3800 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.287957  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:05.288190  3800 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.288371  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:05.289067  1695 raft_consensus.cc:2410] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:05.289958  3550 ts_tablet_manager.cc:1403] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 2.017s	user 0.045s	sys 0.021s
I20260709 13:01:05.313959  1662 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:05.315224  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:05.316619  3888 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:05.317085  3888 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:05.317350  3874 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.716s	user 0.006s	sys 0.008s
I20260709 13:01:05.317422  3550 raft_consensus.cc:359] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.318323  3879 raft_consensus.cc:3055] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:05.318748  3879 raft_consensus.cc:740] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:05.276381  3676 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:05.287957  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:05.320223  1689 raft_consensus.cc:2410] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:05.319638  3879 consensus_queue.cc:260] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.321014  3879 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.321151  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:05.321807  1689 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.260663  3833 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:05.290119  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:05.290830  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:05.323279  1688 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:05.317461  3888 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:05.268786  3871 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.289320  1545 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:05.286291  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:05.329190  1692 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:01:05.292032  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:05.330438  1694 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:05.332089  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.258852  1696 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:05.294497  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:05.291266  3884 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.340598  3653 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:05.341006  3884 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.304735  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:05.307997  2232 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:05.339900  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:05.343809  1692 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.339967  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:05.308918  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.309780  3903 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:05.308956  3858 consensus_queue.cc:1059] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:01:05.288838  3761 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.254616  3574 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.311319  3801 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:05.325232  3887 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:05.327988  3877 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.331907  1511 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:05.333662  1695 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:05.302475  3708 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:05.293036  3870 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:05.331646  3839 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:05.354548  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 310770us
I20260709 13:01:05.366516  1623 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:05.368624  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:05.375195  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:05.399631  1663 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:05.399781  1622 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.319188  3550 raft_consensus.cc:740] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
W20260709 13:01:05.378242  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 70656.5us
I20260709 13:01:05.384977  1614 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:05.385609  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:05.385887  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:05.394515  1618 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:05.406550  1620 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.404524  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:05.408749  2269 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.412153  2232 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:05.404731  1691 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:05.418896  3792 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:05.419399  3792 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:05.419804  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.419880  3792 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:05.377918  3838 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:05.386229  3574 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.425236  1622 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:05.428202  1663 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:05.381580  1544 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:05.390158  3794 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.458043  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:05.398064  3833 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:05.454932  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 172468us
I20260709 13:01:05.461882  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:05.457422  1663 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:05.464164  1663 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:05.454664  1623 raft_consensus.cc:1275] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:05.459631  1514 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:05.459631  2232 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:05.428645  1692 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:05.466748  1663 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:05.468657  1663 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:05.469081  1695 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:05.475186  1663 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:05.472540  3876 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:05.482371  3902 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:05.482825  3902 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.483161  3902 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.487932  3868 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:05.488914  3868 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.488081  3443 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:05.489481  3868 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.492753  1663 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:05.527817  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 286857us
I20260709 13:01:05.533010  1511 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:05.537166  1689 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:05.463040  3761 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.491722  3653 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.523589  1620 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:05.542114  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:05.542172  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 49477.5us
W20260709 13:01:05.542420  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 82846us
I20260709 13:01:05.429102  3629 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.428995  3823 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.455562  3814 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.540441  3653 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.425005  3898 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:05.554121  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:05.555948  2268 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 1.
I20260709 13:01:05.461920  3895 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:05.559079  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.463008  3794 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:05.561902  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.475503  3833 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:05.461463  3870 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:05.564576  2270 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:05.491606  3777 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:05.491384  3708 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.529326  3801 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:05.541707  3869 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:05.576912  2234 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:05.544184  3836 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:05.590106  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 57323us
I20260709 13:01:05.548784  3876 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:05.552295  3443 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:05.595553  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:05.598613  1688 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:05.611831  1689 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:05.599941  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.600445  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.601903  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:05.604926  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 48915.1us
I20260709 13:01:05.553524  3887 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:05.613252  1620 raft_consensus.cc:2393] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:05.616379  1511 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:05.609377  2234 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:05.557799  3898 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.560840  3895 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.568557  3794 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.430665  3877 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.542102  3676 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:01:05.628873  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.631757  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.651734  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:05.652254  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.652539  1689 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:05.653313  1620 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:05.593247  3777 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.623023  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:05.632688  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.606837  3818 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.551731  3838 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.618649  3801 raft_consensus.cc:697] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:05.664863  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.663522  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:05.606146  3849 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:05.617892  3812 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:05.565383  3814 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.676434  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.560633  3885 consensus_queue.cc:1059] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 13:01:05.638525  3898 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:05.620222  3443 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.619191  3887 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.567224  3823 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.558945  3629 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.690093  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:05.690801  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 74494.3us
I20260709 13:01:05.661535  3777 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.637681  3895 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.713963  1620 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:05.535506  3550 consensus_queue.cc:260] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:01:05.625816  3876 raft_consensus.cc:697] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:05.596714  3857 consensus_queue.cc:1059] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:01:05.597636  3870 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.622363  3905 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
W20260709 13:01:05.667026  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 51903.2us
I20260709 13:01:05.643030  3903 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:01:05.715643  3909 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:05.738907  1688 raft_consensus.cc:2410] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:05.629899  3708 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.620776  3836 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.696569  3897 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:05.762913  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:05.716879  3812 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.724985  3443 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:05.772269  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.732585  3887 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.774718  1586 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:05.824920  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 50291.9us
I20260709 13:01:05.697501  3818 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:05.825332  1694 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:05.809682  3909 raft_consensus.cc:697] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:05.738858  3800 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.696828  3833 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:05.864270  1663 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:05.829259  1689 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:05.823845  3814 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:05.835355  3860 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:05.843451  3738 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:05.820652  3812 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:05.884305  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 275044us
I20260709 13:01:05.822602  3870 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:05.874523  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:05.920032  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 45647.2us
W20260709 13:01:05.842072  3912 log.cc:927] Time spent T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.387s	user 0.002s	sys 0.000s
W20260709 13:01:05.843255  3914 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.450s	user 0.000s	sys 0.002s
I20260709 13:01:05.819332  3838 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:05.900630  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 204462us
I20260709 13:01:05.922199  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.921202  1586 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:05.934291  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:05.846562  3869 raft_consensus.cc:697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:05.934522  1622 raft_consensus.cc:2393] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 2: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:05.825385  3430 consensus_queue.cc:1059] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
W20260709 13:01:05.925275  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 171237us
I20260709 13:01:05.858842  3653 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:05.930176  1588 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:05.941948  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.916788  3859 raft_consensus.cc:3055] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:05.910441  3885 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:05.949163  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.953058  3653 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:05.959523  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 105027us
I20260709 13:01:05.959523  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:05.920388  3738 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:05.927349  3649 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:05.967006  2231 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:05.977578  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.877876  3745 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:01:05.913609  3882 consensus_queue.cc:1059] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:01:05.951165  3833 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:05.990270  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:05.997560  1622 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
W20260709 13:01:05.998435  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.963171  3814 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:05.968036  3738 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:05.951881  3859 raft_consensus.cc:740] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:05.933965  3456 consensus_queue.cc:1059] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:01:05.868732  3801 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.015731  2234 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:06.022043  2269 consensus_meta.cc:287] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.003s
W20260709 13:01:06.002951  3911 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.377s	user 0.002s	sys 0.000s
I20260709 13:01:05.996371  3648 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:06.050144  3868 consensus_meta.cc:287] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.560s	user 0.012s	sys 0.002s
W20260709 13:01:06.052484  3884 consensus_meta.cc:287] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.711s	user 0.006s	sys 0.010s
W20260709 13:01:06.052719  3792 consensus_meta.cc:287] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.000s
I20260709 13:01:06.053546  3792 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.054152  1615 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:06.031908  2269 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:06.055064  2268 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:06.001134  3922 raft_consensus.cc:3055] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:06.066749  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 51115.5us
I20260709 13:01:06.009267  3814 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:06.075366  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.069322  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 85115.7us
I20260709 13:01:06.069746  2234 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:06.035089  3857 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:06.050822  3868 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.079216  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:06.090751  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 169593us
I20260709 13:01:06.023937  3882 raft_consensus.cc:3055] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:06.097170  1586 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:06.058725  3877 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:06.059978  3648 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.968938  3876 consensus_queue.cc:237] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.067929  3922 raft_consensus.cc:740] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:05.953109  3869 consensus_queue.cc:237] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.071376  3927 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.023185  3934 consensus_queue.cc:1059] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:01:06.077353  3814 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:06.093856  3653 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:06.099404  3838 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.098453  3882 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:06.124358  1586 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:05.995276  3909 consensus_queue.cc:237] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.058363  3745 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:01:06.152281  3653 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.129170  3818 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:06.128358  3708 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:06.111125  3836 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:01:06.118793  3792 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:06.182464  3882 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.098119  3859 consensus_queue.cc:260] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.187973  3882 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:06.151237  3935 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:06.191371  3939 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:06.192332  3939 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:06.191175  3574 consensus_meta.cc:287] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.000s
I20260709 13:01:06.198315  3939 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:06.205327  3923 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.384s	user 0.000s	sys 0.005s
W20260709 13:01:06.208155  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.187845  3919 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.200s	user 0.000s	sys 0.002s
I20260709 13:01:06.111989  3550 ts_tablet_manager.cc:1434] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.798s	user 0.007s	sys 0.008s
I20260709 13:01:06.110445  3648 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:06.145062  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:06.145628  1586 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:06.136103  3927 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.149554  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:06.150345  3920 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:01:06.104267  3857 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:06.122741  3629 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:06.162078  3902 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.003s
W20260709 13:01:06.132638  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 448129us
I20260709 13:01:06.095011  3887 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.232638  2234 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:06.196956  3574 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:06.238253  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.138200  3936 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:06.242456  1614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.012s	sys 0.043s
W20260709 13:01:06.274891  1614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.012s	sys 0.043s
W20260709 13:01:06.244496  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 116986us
I20260709 13:01:06.141254  3800 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:06.229075  3888 consensus_meta.cc:287] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.904s	user 0.018s	sys 0.001s
I20260709 13:01:06.279910  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:06.245194  3942 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.283159  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:06.250528  3870 raft_consensus.cc:2764] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:01:06.227545  3550 ts_tablet_manager.cc:1467] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Tablet startup took 913ms
I20260709 13:01:06.280985  2268 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:06.259126  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:06.252547  3738 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.313601  1548 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.207300  3443 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.318336  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:06.320865  3880 raft_consensus.cc:3055] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:01:06.321341  1587 leader_election.cc:336] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.683s (SENT)
I20260709 13:01:06.321762  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:06.322137  3878 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.323972  2263 raft_consensus.cc:1240] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:06.325667  3823 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:06.328976  3887 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:06.335067  3777 consensus_meta.cc:287] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.003s
I20260709 13:01:06.344597  3868 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:06.276180  3944 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:06.350821  3814 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.311174  2264 raft_consensus.cc:2368] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4.
I20260709 13:01:06.264289  3902 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.281359  3936 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.269112  3885 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.355790  3839 consensus_meta.cc:287] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.931s	user 0.009s	sys 0.006s
I20260709 13:01:06.328976  3927 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:06.283027  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:06.264621  3792 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:06.368809  1545 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
W20260709 13:01:06.242624  3879 consensus_meta.cc:287] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.921s	user 0.006s	sys 0.007s
I20260709 13:01:06.270002  3745 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:06.378809  3880 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:06.423960  1548 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:06.372392  1543 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:01:06.372020  1541 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:01:06.372076  1587 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:06.354247  3794 consensus_meta.cc:287] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.006s
W20260709 13:01:06.429648  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 49752.5us
I20260709 13:01:06.313019  3888 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:06.468039  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 146729us
I20260709 13:01:06.437345  3936 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:06.265338  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 298399us
I20260709 13:01:06.473469  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:06.442745  3895 consensus_meta.cc:287] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.650s	user 0.014s	sys 0.000s
I20260709 13:01:06.261732  3922 consensus_queue.cc:260] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.427109  3777 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:06.361227  3761 consensus_meta.cc:287] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.821s	user 0.011s	sys 0.003s
I20260709 13:01:06.514487  1622 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:06.440519  3944 raft_consensus.cc:697] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:06.465440  3745 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:06.503497  1617 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:06.429713  3878 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.369388  3942 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.428757  3812 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.475004  3649 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:06.488471  3879 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:06.512521  3880 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:06.532141  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 56608.8us
I20260709 13:01:06.441584  3885 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.473641  3794 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:06.529677  3898 consensus_meta.cc:287] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.798s	user 0.015s	sys 0.000s
I20260709 13:01:06.596279  1511 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:06.527876  3745 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:06.565930  3777 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:06.441852  3857 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:06.563587  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.507741  3895 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.529700  3947 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.615373  2272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.009s	sys 0.014s
I20260709 13:01:06.595790  3738 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:06.632098  1587 leader_election.cc:336] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.568s (SENT)
I20260709 13:01:06.635515  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:06.636073  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:06.636471  2268 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
W20260709 13:01:06.634266  2272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.010s	sys 0.014s
I20260709 13:01:06.568380  3943 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:06.640962  1661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.005s	sys 0.017s
W20260709 13:01:06.644555  1661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.005s	sys 0.017s
W20260709 13:01:06.615128  3456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.006s	sys 0.017s
I20260709 13:01:06.609731  3839 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:06.632396  3939 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.660391  1662 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:06.642367  3880 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:06.606353  3898 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.632517  3792 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:06.652525  3456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.009s	sys 0.017s
I20260709 13:01:06.643159  3879 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:06.367890  3550 ts_tablet_manager.cc:1469] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Trace:
0709 13:00:52.626511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.633410 (+  6899us) service_pool.cc:224] Handling call
0709 13:00:52.871010 (+237600us) ts_tablet_manager.cc:934] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
0709 13:00:54.398511 (+1527501us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b4c0048a700. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c68e0aa20 00007f5c68e1ba29 00007f5c68e1c13f 00007f5c68de02ab 00007f5c68e0df3c 00007f5c68e0e461 00007f5c68e0e768 00007f5c6eb942eb 00007f5c6fab9d3b 00007f5c6fab4008 00007f5c6fab3405
0709 13:01:00.008408 (+5609897us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:01.251066 (+1242658us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:01.292307 (+ 41241us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:01.575817 (+283510us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:01.576699 (+   882us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:01.577272 (+   573us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:01.577582 (+   310us) inbound_call.cc:177] Queueing success response
0709 13:01:03.261465 (+1683883us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:01:05.314067 (+2052602us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:01:05.314806 (+   739us) tablet_replica.cc:261] Starting instrumentation
0709 13:01:05.315405 (+   599us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":32516,"mutex_wait_us":9872,"raft.queue_time_us":266473,"raft.run_cpu_time_us":467,"raft.run_wall_time_us":37430,"spinlock_wait_cycles":76036352,"tablet-copy.queue_time_us":152550,"tablet-download-pool.queue_time_us":12809,"tablet-download-pool.run_cpu_time_us":2281,"tablet-download-pool.run_wall_time_us":521939,"thread_start_us":321081,"threads_started":3}
W20260709 13:01:06.657066  3833 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.002s
I20260709 13:01:06.654492  3937 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:06.690876  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:01:06.691715  1587 leader_election.cc:336] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.161s (SENT)
I20260709 13:01:06.694330  1587 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:06.654332  3943 raft_consensus.cc:697] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:06.669582  3443 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:06.669962  3761 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:06.735704  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.736974  3902 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:06.689693  2265 raft_consensus.cc:1240] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:06.718150  3839 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:06.791347  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.021s	sys 0.067s
W20260709 13:01:06.804476  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.021s	sys 0.068s
I20260709 13:01:06.793253  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:06.805042  1694 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:06.800076  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:06.801590  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:06.640115  3947 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.806649  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:06.807183  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:06.679554  3939 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.808605  1692 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
W20260709 13:01:06.809896  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 664271us
I20260709 13:01:06.722484  3761 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.687742  3792 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.814580  1586 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:06.815871  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:06.820719  1691 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
W20260709 13:01:06.817138  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 126360us
I20260709 13:01:06.823586  2231 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:06.824920  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:06.826836  1511 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:06.802441  3771 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.826984  2231 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:06.835732  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:06.836254  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:06.814934  3456 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:06.814596  3948 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.207s	user 0.005s	sys 0.001s
I20260709 13:01:06.684322  3649 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.845681  2231 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:06.820156  3761 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:06.815958  3777 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.857427  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:06.868470  1696 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.826351  3949 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:06.831605  3823 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:06.850299  3801 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:06.828277  3950 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.135s	user 0.004s	sys 0.004s
I20260709 13:01:06.666954  3944 consensus_queue.cc:237] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.854241  3960 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:06.867228  3885 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:06.845456  1693 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:06.868073  3777 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.873307  3895 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:06.858623  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:06.859701  1511 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:06.898221  1690 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:06.841267  3942 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:06.904062  3777 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:06.830130  3818 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:06.890028  3954 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.909255  3818 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.909328  3833 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:06.909866  3818 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.910086  3833 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.900204  3947 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:06.909027  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.915913  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 485) took 1312 ms. Trace:
I20260709 13:01:06.902148  3629 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:06.915760  1513 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:06.916744  3629 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.918218  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1439) took 1483 ms. Trace:
I20260709 13:01:06.866242  3898 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:06.905498  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 46009.6us
I20260709 13:01:06.918838  1614 rpcz_store.cc:276] 0709 13:01:05.439284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.457168 (+ 17884us) service_pool.cc:224] Handling call
0709 13:01:05.482802 (+ 25634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.483276 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.483304 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.496033 (+ 12729us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.275562 (+779529us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:06.275622 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.275717 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.321841 (+ 46124us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b4800150258. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6fa67aa1 00007f5c6fa5eb37 00007f5c6fa5e9ca 00007f5c6fb5626f 00007f5c6fb55f37 00007f5c6fb6a55c 00007f5c6fb6a508 00007f5c6fb6a488 00007f5c6fb6a443 00007f5c6fb696ec 00007f5c6ea93a96
0709 13:01:06.917923 (+596082us) raft_consensus.cc:1685] finished
0709 13:01:06.917945 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.918159 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":315,"raft.run_cpu_time_us":10993,"raft.run_wall_time_us":838409,"spinlock_wait_cycles":18357120,"thread_start_us":678804,"threads_started":1,"wal-append.queue_time_us":925680}
I20260709 13:01:06.906221  3839 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:06.907007  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.890923  1588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.016s	sys 0.029s
W20260709 13:01:06.921558  1588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.016s	sys 0.031s
W20260709 13:01:06.921940  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 685956us
I20260709 13:01:06.907539  3949 raft_consensus.cc:697] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:06.829977  3794 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:06.858048  3927 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:06.931077  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:06.852965  3878 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:06.930414  3839 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:06.861040  3939 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:06.937668  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:06.940409  3801 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:06.942655  1622 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:06.943615  1588 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:06.960275  1587 leader_election.cc:336] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.551s (SENT)
I20260709 13:01:06.852802  3771 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.974211  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:07.000720  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:07.001183  1539 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:06.973089  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:06.994861  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:07.002297  1544 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:06.858004  3675 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:01:06.930586  3927 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.929893  3456 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.943138  3833 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:06.970623  3708 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.008071  1588 leader_election.cc:400] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4.
I20260709 13:01:06.996769  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1442) took 1063 ms. Trace:
I20260709 13:01:06.978492  3794 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:07.007910  3648 consensus_meta.cc:287] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.757s	user 0.015s	sys 0.003s
I20260709 13:01:07.018509  1588 leader_election.cc:403] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:01:06.978700  3839 raft_consensus.cc:697] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:06.996091  3958 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:07.024627  1696 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:01:06.864110  3943 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:06.997577  3898 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.018810  1618 rpcz_store.cc:276] 0709 13:01:05.933335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.934308 (+   973us) service_pool.cc:224] Handling call
0709 13:01:05.961512 (+ 27204us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:06.072088 (+110576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.072169 (+    81us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:06.095550 (+ 23381us) log.cc:844] Serialized 52 byte log entry
0709 13:01:06.631208 (+535658us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:06.995913 (+364705us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.996168 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.996252 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.996300 (+    48us) raft_consensus.cc:1685] finished
0709 13:01:06.996323 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.996702 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91515,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":133,"thread_start_us":924494,"threads_started":3,"wal-append.queue_time_us":693324}
I20260709 13:01:07.013855  3653 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:06.925154  3960 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.036649  1691 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:07.020594  3794 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.064354  3794 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.065938  1539 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:01:07.067862  3898 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.072176  3839 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.075619  3895 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:07.076575  3895 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:07.080323  3955 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:01:07.082501  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 598) took 1545 ms. Trace:
I20260709 13:01:07.039219  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:07.039841  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 194670us
W20260709 13:01:07.083825  3959 log.cc:927] Time spent T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:01:07.082914  2272 rpcz_store.cc:276] 0709 13:01:05.537146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.537252 (+   106us) service_pool.cc:224] Handling call
0709 13:01:05.537568 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.537902 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.537930 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.553359 (+ 15429us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.638142 (+1084783us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:06.650837 (+ 12695us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.651440 (+   603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.651595 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.837501 (+185906us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b1800355a20. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a51522 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:01:07.082176 (+244675us) raft_consensus.cc:1685] finished
0709 13:01:07.082279 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.082428 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16011,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":3836,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":10217,"spinlock_wait_cycles":14714112,"thread_start_us":1019573,"threads_started":1,"wal-append.queue_time_us":1251732}
I20260709 13:01:07.041574  1544 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
W20260709 13:01:07.029448  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 77701.6us
I20260709 13:01:07.045680  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:07.045840  3838 consensus_meta.cc:287] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.903s	user 0.012s	sys 0.010s
I20260709 13:01:07.042884  3653 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.085825  1511 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:07.085850  3838 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:07.049726  3792 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:07.041705  3958 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.087361  1511 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:07.089133  3958 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:07.089304  3905 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:07.056097  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1444) took 1122 ms. Trace:
I20260709 13:01:07.090092  3905 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:07.090891  1621 rpcz_store.cc:276] 0709 13:01:05.933954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.948744 (+ 14790us) service_pool.cc:224] Handling call
0709 13:01:05.972735 (+ 23991us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.281853 (+309118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.281911 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.646893 (+364982us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b2c0005b5c8. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:01:06.647329 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.929495 (+282166us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:06.929556 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.929924 (+   368us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.055558 (+125634us) raft_consensus.cc:1685] finished
0709 13:01:07.055602 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.055985 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61997,"raft.queue_time_us":153969,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3237,"spinlock_wait_cycles":52358016,"thread_start_us":528510,"threads_started":2,"wal-append.queue_time_us":374946}
I20260709 13:01:07.092461  1511 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:07.092870  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.094053  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.094547  1621 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.094759  3905 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:07.012705  3927 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.046754  3878 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4.
W20260709 13:01:07.098668  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.100595  3836 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.101639  3836 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.089164  3833 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:07.035359  3648 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.105295  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1322) took 1505 ms. Trace:
I20260709 13:01:07.105688  1615 rpcz_store.cc:276] 0709 13:01:05.599875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.600028 (+   153us) service_pool.cc:224] Handling call
0709 13:01:07.105145 (+1505117us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b5400067a54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:07.105237 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013288704}
I20260709 13:01:07.107062  3648 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:07.083992  2269 raft_consensus.cc:2393] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:07.042982  2264 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 2 LEARNER]: Advancing to term 3
I20260709 13:01:07.086030  3653 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.111405  1622 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:06.928248  2263 rpcz_store.cc:276] 0709 13:01:05.603256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.603500 (+   244us) service_pool.cc:224] Handling call
0709 13:01:05.603927 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.431062 (+827135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.915383 (+484321us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b54004d76d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:06.915807 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1634351872}
I20260709 13:01:07.095283  3905 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:07.023396  3708 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:06.931226  3954 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.028280  3949 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.114976  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1441) took 1185 ms. Trace:
I20260709 13:01:07.116915  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.007871  3947 consensus_queue.cc:1059] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:01:07.120075  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.120905  1539 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:07.119114  1623 rpcz_store.cc:276] 0709 13:01:05.929338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.929604 (+   266us) service_pool.cc:224] Handling call
0709 13:01:05.930178 (+   574us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:06.020196 (+ 90018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.020298 (+   102us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:06.090516 (+ 70218us) log.cc:844] Serialized 52 byte log entry
0709 13:01:06.446014 (+355498us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:06.879835 (+433821us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.013108 (+133273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.013188 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.114765 (+101577us) raft_consensus.cc:1685] finished
0709 13:01:07.114786 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.114915 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":567058,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":34842,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":16861,"thread_start_us":942427,"threads_started":4,"wal-append.queue_time_us":546277}
I20260709 13:01:07.120249  1544 raft_consensus.cc:1240] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:07.062616  3761 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.128346  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:07.128672  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.134142  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:07.134826  2272 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:01:07.135070  1545 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:07.137163  1545 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:07.133010  1540 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:07.139043  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.137152  1621 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:07.140146  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.141244  1540 raft_consensus.cc:2410] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:07.142350  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:07.143357  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:07.143981  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.144428  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:07.145735  1540 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:07.151262  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:07.151464  2234 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:07.156328  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:07.156955  1544 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:07.157150  1539 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:07.157508  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.121436  3902 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.152916  1614 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:01:07.157207  2268 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:07.162213  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.164223  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.166896  1542 raft_consensus.cc:2410] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:07.166687  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.167841  1545 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:07.169163  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:07.146668  3919 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.899s	user 0.001s	sys 0.014s
W20260709 13:01:07.169220  1587 leader_election.cc:336] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.708s (SENT)
W20260709 13:01:07.144347  3957 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 13:01:07.041323  3456 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.175160  3898 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:07.263188  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:07.209388  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:07.171186  1688 raft_consensus.cc:2393] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:07.170465  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:07.264732  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 95534.8us
I20260709 13:01:07.172843  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.170557  2265 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:01:07.265803  1587 leader_election.cc:336] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.143s (SENT)
I20260709 13:01:07.265936  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:07.139811  3629 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:07.266919  2263 raft_consensus.cc:2393] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:07.173601  3708 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:07.173923  3771 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:07.175032  3836 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:07.270556  1545 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:07.217818  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:07.261101  3745 consensus_meta.cc:287] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.644s	user 0.013s	sys 0.000s
I20260709 13:01:07.175834  1546 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:07.268729  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.271912  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.275877  1623 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:01:07.167865  1621 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:07.273557  1539 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
W20260709 13:01:07.223862  3950 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:07.276701  1540 raft_consensus.cc:2368] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4.
I20260709 13:01:07.169466  3895 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:07.254472  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:07.274833  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.285071  1545 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:07.221135  3675 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:07.197572  3833 raft_consensus.cc:697] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:07.255102  3801 raft_consensus.cc:697] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:07.200623  3968 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:07.221582  3902 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.270464  3947 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:07.270162  3880 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:07.297993  3880 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.289439  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.293720  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1434) took 1928 ms. Trace:
I20260709 13:01:07.282845  3977 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:01:07.302983  3939 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:01:07.303620  1619 rpcz_store.cc:276] 0709 13:01:05.365522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.365639 (+   117us) service_pool.cc:224] Handling call
0709 13:01:05.419404 (+ 53765us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.429288 (+  9884us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:05.487981 (+ 58693us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.692067 (+204086us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.716353 (+ 24286us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.716515 (+   162us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:05.716558 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.716627 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.119135 (+1402508us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b24002aae98. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c678d79c4 00007f5c678d5acb 00007f5c67a90dc9 00007f5c67a90a55 00007f5c67a9009d 00007f5c6a6c210e 00007f5c6a6d988c 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221
0709 13:01:07.288411 (+169276us) raft_consensus.cc:1685] finished
0709 13:01:07.293382 (+  4971us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.293613 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11616,"prepare.queue_time_us":32142,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":68212,"raft.run_cpu_time_us":453,"raft.run_wall_time_us":40927,"spinlock_wait_cycles":11800960,"thread_start_us":177835,"threads_started":1,"wal-append.queue_time_us":437368}
I20260709 13:01:07.280408  3745 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.314962  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:07.315755  1540 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:07.303284  3936 consensus_meta.cc:287] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.776s	user 0.011s	sys 0.003s
I20260709 13:01:07.300702  3818 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.323276  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.302156  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:07.301070  3880 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:07.308974  3968 raft_consensus.cc:697] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:07.329180  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:07.330328  1539 raft_consensus.cc:2410] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:07.334116  3456 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:07.335209  3974 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:01:07.284560  3905 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.340166  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.340406  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.340873  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:07.341354  1547 raft_consensus.cc:2410] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:07.341584  2272 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.288805  3675 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.345785  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:07.347532  1542 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:07.338742  3888 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:07.326103  3745 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:07.362576  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.365672  1617 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.364001  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.367182  1615 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.364001  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:07.341945  3761 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:07.324158  3936 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.447489  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:07.375721  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.455957  2234 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:07.457077  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.441177  2272 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:07.449941  1514 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:01:07.396221  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.459892  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:07.393906  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.422124  1615 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:07.436859  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.403195  3902 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:07.463529  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.450004  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:07.379801  3833 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.457803  1694 raft_consensus.cc:2410] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:07.456848  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:07.466518  1546 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:07.405586  1617 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:07.472146  1615 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:07.370213  1619 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:07.376047  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.476238  1620 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.387776  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.479259  1539 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:01:07.458616  1622 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:07.484665  2232 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:07.427393  2264 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 3 LEARNER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:07.490402  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.497705  1543 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:07.476703  3945 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:07.498147  1558 tablet_copy_service.cc:342] P 44c8c572048a40b1a5e71865068ed1bb: Request end of tablet copy session e37b8013aec24431a6672a857806329e-953db44baef24f55a28e65ff051866d1 received from {username='slave'} at 127.0.0.1:53718
I20260709 13:01:07.498540  3945 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.498731  1558 tablet_copy_service.cc:434] P 44c8c572048a40b1a5e71865068ed1bb: ending tablet copy session e37b8013aec24431a6672a857806329e-953db44baef24f55a28e65ff051866d1 on tablet 953db44baef24f55a28e65ff051866d1 with peer e37b8013aec24431a6672a857806329e
I20260709 13:01:07.491966  2232 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:07.500119  2232 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:07.500844  3823 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:07.501276  2232 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:07.501669  3823 raft_consensus.cc:697] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:07.502270  2232 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:07.429003  3927 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.503610  3836 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:07.504022  3836 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:07.504372  3836 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.505187  1614 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:07.505329  3927 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:07.505990  3927 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:07.506459  3927 raft_consensus.cc:697] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:07.506639  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:07.504367  3975 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:07.507964  3975 raft_consensus.cc:697] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:07.490604  3839 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.510003  3839 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.511322  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.511993  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:07.512509  1548 raft_consensus.cc:2410] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:07.512794  1547 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.513234  3839 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:07.513661  2267 raft_consensus.cc:2368] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7.
I20260709 13:01:07.391016  3794 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.512648  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:07.515780  3794 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:07.515934  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.498965  3945 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.448788  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:07.497648  3902 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.517148  2263 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:01:07.517448  3902 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.508848  3975 consensus_queue.cc:237] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:07.514063  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.502614  3823 consensus_queue.cc:237] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.452847  3818 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:07.534508  1620 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:07.516158  3936 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:07.491554  1619 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:07.536829  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.520853  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.514225  3968 consensus_queue.cc:237] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.538828  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.475881  3978 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:07.539705  1614 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:01:07.495903  1615 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:07.513070  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:07.521463  1588 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:07.391288  3963 raft_consensus.cc:3055] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:07.397204  3814 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:07.526373  3902 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:07.553692  2234 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:07.562258  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.527281  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54504 (request call id 412) took 2157 ms. Trace:
I20260709 13:01:07.476238  3888 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.495605  3939 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:07.427908  3884 raft_consensus.cc:3055] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:07.587983  3884 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:07.589141  1615 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:07.589577  3884 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.590683  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.528030  3792 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:07.493201  3895 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.536294  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.605101  1620 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:07.484668  3675 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:07.484887  3976 consensus_queue.cc:1048] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:01:07.520008  3761 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.563933  1617 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:01:07.551753  3946 raft_consensus.cc:3055] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:07.555609  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.449302  3653 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.486337  3937 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:07.592103  1619 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:07.592209  1615 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:07.608088  1622 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:07.563236  1548 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:07.552934  3963 raft_consensus.cc:740] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:07.375253  3801 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:07.612226  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 109157us
I20260709 13:01:07.561951  3944 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:07.612675  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.528852  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:07.718108  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.597203  3794 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:07.718802  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.820256  1540 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:07.820569  1618 raft_consensus.cc:2393] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:07.714879  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.774309  1547 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
W20260709 13:01:07.745347  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.722142  3982 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.227s	user 0.000s	sys 0.002s
I20260709 13:01:07.784754  1617 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.613667  3946 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:01:07.752023  3983 log.cc:927] Time spent T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:01:07.808296  2268 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:07.767153  3991 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:01:07.809280  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:07.840914  1622 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:07.785120  3944 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.841909  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:07.810650  1546 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:07.816248  1542 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:07.753715  2272 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:07.614440  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.843788  1620 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:07.612317  3812 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:07.730353  3953 log.cc:927] Time spent T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:01:07.823333  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:07.596993  3888 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.604300  3980 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.233s
I20260709 13:01:07.888715  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.612026  3895 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.868557  1617 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:07.899536  1617 raft_consensus.cc:1240] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:07.870666  1615 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:07.863993  3902 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.888144  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.923133  1542 raft_consensus.cc:2376] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6. Re-sending same reply.
I20260709 13:01:07.611830  3927 consensus_queue.cc:237] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.797201  3880 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.890506  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.929502  1546 raft_consensus.cc:2376] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5. Re-sending same reply.
I20260709 13:01:07.615751  3761 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.898082  1620 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:07.622205  3978 raft_consensus.cc:697] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:07.905215  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:07.850301  3944 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:07.918668  1615 raft_consensus.cc:1240] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:07.922094  1587 leader_election.cc:336] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.824s (SENT)
I20260709 13:01:07.609050  3792 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.934425  1622 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:07.951596  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.954993  3978 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.887802  3898 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:01:07.972681  1617 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:07.974161  3933 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 1.793s	user 0.007s	sys 0.008s
I20260709 13:01:07.974711  3653 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:07.924644  3981 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.396s	user 0.002s	sys 0.000s
W20260709 13:01:07.977949  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.983973  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:07.865458  3977 consensus_queue.cc:1059] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:01:07.986393  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.000279  1542 raft_consensus.cc:2410] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:07.995837  1546 raft_consensus.cc:2410] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:08.001713  1622 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:07.924597  3794 raft_consensus.cc:697] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:08.030709  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.012553  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.049897  1546 raft_consensus.cc:2376] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5. Re-sending same reply.
I20260709 13:01:08.020493  3977 raft_consensus.cc:3055] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:07.930776  3902 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.948415  3880 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:07.891538  3963 consensus_queue.cc:260] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:07.998010  3836 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.020430  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1328) took 2416 ms. Trace:
I20260709 13:01:07.567507  2266 rpcz_store.cc:276] 0709 13:01:05.369577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.385906 (+ 16329us) service_pool.cc:224] Handling call
0709 13:01:05.494143 (+108237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.559079 (+ 64936us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:05.724625 (+165546us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.526747 (+1802122us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b18002e7e00. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c6a6e64bc 00007f5c67a3448b 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a4e455 00007f5c6ab36060 00007f5c6ab48716 00007f5c6ab59287
0709 13:01:07.526855 (+   108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.526909 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:07.526978 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.527064 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.527194 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15410,"prepare.queue_time_us":203059,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":245351,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":10801,"spinlock_wait_cycles":28148992,"thread_start_us":173434,"threads_started":2}
I20260709 13:01:08.069034  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:08.043184  1614 consensus_meta.cc:287] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.003s
I20260709 13:01:08.060627  1542 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:01:08.061054  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.833140  3937 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.034734  3895 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:08.071163  1614 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:08.055229  3977 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:08.064123  1616 rpcz_store.cc:276] 0709 13:01:05.604137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.683185 (+ 79048us) service_pool.cc:224] Handling call
0709 13:01:05.683638 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.705707 (+ 22069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.705753 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.732374 (+ 26621us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.946759 (+214385us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:05.946978 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.947174 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.972745 (+2025571us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:08.020034 (+ 47289us) raft_consensus.cc:1685] finished
0709 13:01:08.020073 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.020347 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20998,"raft.queue_time_us":22257,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":16955,"spinlock_wait_cycles":7449856,"thread_start_us":136247,"threads_started":1,"wal-append.queue_time_us":336524}
I20260709 13:01:08.108368  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:08.109483  1622 raft_consensus.cc:2410] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:08.085487  3875 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:08.111824  1587 leader_election.cc:336] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.584s (SENT)
I20260709 13:01:08.114841  1587 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:08.116161  1587 leader_election.cc:336] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.031s (SENT)
I20260709 13:01:08.117657  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.119387  3629 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:08.124804  3574 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:08.105054  3963 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:08.126988  3884 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.129011  1662 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:08.130265  3885 consensus_queue.cc:1059] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:08.138557  3945 consensus_meta.cc:287] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.003s
I20260709 13:01:08.140034  3895 consensus_queue.cc:1059] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:08.145627  3836 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:07.988768  3946 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:08.150260  1587 leader_election.cc:336] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.173s (SENT)
W20260709 13:01:08.154453  1587 leader_election.cc:336] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.204s (SENT)
I20260709 13:01:08.168308  3888 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:08.178406  1616 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:08.118191  2263 raft_consensus.cc:1240] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:08.191761  3849 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.194149  3849 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.196769  3849 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:08.197397  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.203969  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.206193  1542 raft_consensus.cc:2376] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5. Re-sending same reply.
I20260709 13:01:08.139134  3945 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.151510  3745 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.190670  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:08.169052  3888 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:08.224191  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.187656  1587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.772s (SENT) [suppressed 40 similar messages]
W20260709 13:01:08.262424  3823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.031s	sys 0.047s
I20260709 13:01:08.254786  3980 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.263185  1615 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:08.216476  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.181536  3946 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:08.276826  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 89198.9us
I20260709 13:01:08.280668  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.153134  3875 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:08.287948  1587 leader_election.cc:336] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.333s (SENT)
I20260709 13:01:08.288456  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:08.287155  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:08.288923  1587 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:08.286739  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 157828us
I20260709 13:01:08.289655  1691 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:08.289952  1689 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:08.297181  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:08.297292  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:08.298174  1688 raft_consensus.cc:2410] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:08.299515  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:08.301265  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:08.302605  1691 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:08.308598  1690 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:08.309604  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:08.310693  1691 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.314314  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:08.315162  1689 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:08.315503  1662 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:08.314323  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:08.316473  1690 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:08.277966  3888 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.320608  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:08.321493  1688 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:08.322261  1692 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:08.323904  1689 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:08.326157  1697 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:08.327571  1693 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:08.328330  3885 raft_consensus.cc:3055] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:08.184772  3794 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:08.330880  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.184767  3977 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.331957  3977 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.322762  1692 pending_rounds.cc:85] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 2
I20260709 13:01:08.323338  2264 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:08.335865  1692 pending_rounds.cc:107] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:08.336401  1692 raft_consensus.cc:2889] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:08.336717  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:08.337608  1615 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:08.328917  3885 raft_consensus.cc:740] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:08.341648  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.341648  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:08.342620  1696 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:08.343560  1694 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:08.350582  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:08.314819  3963 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:08.279021  3745 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.321463  3888 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.356722  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:08.357614  1697 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:08.360247  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:08.361136  1693 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
W20260709 13:01:08.361697  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.363641  2270 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:08.303058  3980 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.366570  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:08.370683  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 54235.9us
I20260709 13:01:08.377345  3875 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:08.342463  3629 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:01:08.368892  4003 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:08.380966  4003 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:08.381150  3997 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:01:08.381392  4003 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.383473  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:08.365024  3849 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.388116  3849 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.390803  3849 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:08.391966  3937 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:08.393600  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.394454  4003 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.392048  1662 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:08.395714  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.396194  4004 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:08.396772  4004 raft_consensus.cc:697] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:08.396917  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.397214  4003 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:08.397512  3745 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:08.398056  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.397938  4004 consensus_queue.cc:237] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.391695  3963 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:01:08.382479  3944 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.381656  3980 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:08.399366  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.350997  3653 consensus_queue.cc:1059] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:01:08.417806  1691 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:08.418200  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.419539  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:08.405822  4008 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:08.427446  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 89456.3us
I20260709 13:01:08.401949  3945 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:01:08.426146  3745 raft_consensus.cc:3055] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:08.431710  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.433736  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.445926  1542 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
W20260709 13:01:08.448112  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.448771  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.450093  1620 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:01:08.450347  1542 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:01:08.452860  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.454074  1542 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:08.406522  4003 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:08.455807  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.460968  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.435130  3745 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:08.456403  4003 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.462620  2263 raft_consensus.cc:2393] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:08.472477  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.464453  3859 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.437228  4006 consensus_queue.cc:1059] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:01:08.447962  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 490) took 1316 ms. Trace:
I20260709 13:01:08.437503  4008 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:08.466488  3954 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:08.402133  3944 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:08.480561  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.477681  2269 rpcz_store.cc:276] 0709 13:01:07.131637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.131787 (+   150us) service_pool.cc:224] Handling call
0709 13:01:07.132176 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.406291 (+274115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.406340 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:07.406415 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:07.406455 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.447595 (+1041140us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54004d71d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:08.447670 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.447876 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628908800}
I20260709 13:01:08.478060  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:08.482517  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 121532us
W20260709 13:01:08.486227  1587 leader_election.cc:336] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.760s (SENT)
I20260709 13:01:08.487182  2268 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:08.487341  1587 leader_election.cc:336] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.649s (SENT)
I20260709 13:01:08.491873  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.493196  1542 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:08.492810  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:08.494065  1620 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:08.494627  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.497529  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:08.500809  1623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 360) took 1351 ms (client timeout 1756 ms). Trace:
W20260709 13:01:08.501308  1623 rpcz_store.cc:269] 0709 13:01:07.149901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.150803 (+   902us) service_pool.cc:224] Handling call
0709 13:01:08.500631 (+1349828us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540016ec54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:08.500749 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276530048}
I20260709 13:01:08.504060  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 607) took 1361 ms. Trace:
I20260709 13:01:08.504528  2267 rpcz_store.cc:276] 0709 13:01:07.142809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.143875 (+  1066us) service_pool.cc:224] Handling call
0709 13:01:08.503812 (+1359937us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54004597d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:08.503993 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526724480}
I20260709 13:01:08.505232  4008 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:08.488566  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:08.515636  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.516515  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.526387  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.528911  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.530813  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.533994  1541 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:08.534682  1542 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:08.496445  3745 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:08.536547  3745 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.536724  2268 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:08.537992  1662 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:08.538262  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.538858  4006 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:08.539367  4006 raft_consensus.cc:697] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:08.539499  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.540222  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:08.540751  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.540522  4006 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.541376  1542 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:08.542205  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.542954  3792 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:08.540858  1621 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:08.539327  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2228) took 1003 ms. Trace:
I20260709 13:01:08.546319  1545 rpcz_store.cc:276] 0709 13:01:07.535753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.537943 (+1002190us) service_pool.cc:224] Handling call
0709 13:01:08.539274 (+  1331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.543183  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.511675  4003 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:08.550148  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:08.552340  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.555179  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.556155  1542 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:08.515053  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:08.559033  1511 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:08.557297  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.557225  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:08.558214  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.560726  1545 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:08.562899  1541 raft_consensus.cc:1240] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:08.526449  3888 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.561084  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:08.569047  1511 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:08.572175  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:08.576061  3833 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:08.559918  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:01:08.566802  3952 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:08.563499  3980 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:08.570969  3839 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:08.571854  3879 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:08.582427  3922 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.571277  2263 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:08.591156  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.592566  1547 raft_consensus.cc:2410] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:08.577663  3675 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:08.572028  3977 consensus_queue.cc:1059] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:01:08.585587  3839 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:08.602841  1662 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:08.627132  1546 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:08.629307  3979 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.629915  3979 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:08.631664  1542 raft_consensus.cc:606] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:08.632194  1542 raft_consensus.cc:614] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:08.602954  3839 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:08.644484  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 606) took 1502 ms. Trace:
I20260709 13:01:08.644999  2270 rpcz_store.cc:276] 0709 13:01:07.142531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.142707 (+   176us) service_pool.cc:224] Handling call
0709 13:01:07.175795 (+ 33088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.364082 (+1188287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.644104 (+280022us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54006108d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:08.644382 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2732106752}
I20260709 13:01:08.660454  3875 raft_consensus.cc:3055] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:08.661154  3875 raft_consensus.cc:740] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:08.662254  3875 consensus_queue.cc:260] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.664876  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2231) took 1052 ms. Trace:
I20260709 13:01:08.665457  1543 rpcz_store.cc:276] 0709 13:01:07.612915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.615778 (+  2863us) service_pool.cc:224] Handling call
0709 13:01:08.664569 (+1048791us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54002b3c54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:08.664785 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763770624}
I20260709 13:01:08.673652  1540 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:08.674412  3888 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:08.675321  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 307) took 1140 ms. Trace:
I20260709 13:01:08.688787  4006 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:08.681069  2232 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:08.717828  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 146014us
I20260709 13:01:08.718811  3836 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:08.677770  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:08.719383  3952 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:01:08.680335  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.720727  3952 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:08.702337  3979 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:08.681540  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.721217  3977 consensus_queue.cc:1059] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:08.722074  1548 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:08.722195  3977 consensus_queue.cc:1243] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:08.722513  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2232) took 1099 ms. Trace:
I20260709 13:01:08.699510  1540 rpcz_store.cc:276] 0709 13:01:07.534616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.672748 (+1138132us) service_pool.cc:224] Handling call
0709 13:01:08.673187 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.674734 (+  1547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.675130 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.721009  3859 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:08.699375  3761 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:08.722905  1548 rpcz_store.cc:276] 0709 13:01:07.623474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.681225 (+1057751us) service_pool.cc:224] Handling call
0709 13:01:08.722457 (+ 41232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.692793  3880 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:08.724742  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 43820.5us
I20260709 13:01:08.684639  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:08.722790  3980 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.750838  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.722887  3952 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:08.726982  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 356) took 1798 ms (client timeout 1802 ms). Trace:
W20260709 13:01:08.754176  1618 rpcz_store.cc:269] 0709 13:01:06.928576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.045363 (+116787us) service_pool.cc:224] Handling call
0709 13:01:08.726727 (+1681364us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54000d3ed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:08.726906 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1663673216}
I20260709 13:01:08.747876  2234 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:08.718477  4006 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:08.731575  1588 leader_election.cc:400] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7.
W20260709 13:01:08.753101  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.722858  3675 raft_consensus.cc:3055] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:08.755972  2234 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:08.720471  3801 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:01:08.763880  3792 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:08.690013  3885 consensus_queue.cc:260] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.765775  3792 raft_consensus.cc:697] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:08.766743  3885 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.748608  3972 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.760255  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.768416  3972 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.768347  3792 consensus_queue.cc:237] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:08.771550  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.749399  3875 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.760568  1587 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:08.719295  3836 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:08.775976  3836 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:08.760213  3951 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:08.780078  3951 raft_consensus.cc:697] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:08.780325  3895 raft_consensus.cc:3055] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:08.781068  3895 raft_consensus.cc:740] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:08.781435  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.782115  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2206) took 1620 ms. Trace:
I20260709 13:01:08.782043  3895 consensus_queue.cc:260] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.782629  1544 rpcz_store.cc:276] 0709 13:01:07.162251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.162468 (+   217us) service_pool.cc:224] Handling call
0709 13:01:08.781874 (+1619406us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54000a6ed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:08.782029 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007190912}
I20260709 13:01:08.784181  3836 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.781070  3951 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:08.787672  1587 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:08.807199  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.807893  1543 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.759676  1588 leader_election.cc:403] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:08.765239  2234 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:08.757364  2263 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:08.764267  3801 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:08.802201  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:08.798733  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:08.724423  3979 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:01:08.954101  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:08.892409  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:08.955849  2270 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:08.828389  1547 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:08.942181  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 51070.8us
I20260709 13:01:08.956610  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:08.818765  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:08.852658  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 121339us
W20260709 13:01:08.804114  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.840633  1541 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:08.888724  1694 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:08.959547  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:08.833043  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.887912  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:08.960357  1697 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:08.960537  1545 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:08.814472  2271 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
W20260709 13:01:08.896899  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 46443.6us
I20260709 13:01:08.822088  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:08.961493  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:08.962103  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:08.958092  1548 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:08.962807  1621 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:08.963774  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:08.964598  1620 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
W20260709 13:01:08.808652  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 43492.8us
I20260709 13:01:08.966724  2234 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:08.921195  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.930558  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:08.851377  1617 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:08.954746  1619 raft_consensus.cc:2368] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6.
I20260709 13:01:08.887912  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:08.973905  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1347) took 1020 ms. Trace:
I20260709 13:01:08.975023  1619 rpcz_store.cc:276] 0709 13:01:07.954020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.801847 (+847827us) service_pool.cc:224] Handling call
0709 13:01:08.973828 (+171981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.762400  4006 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:09.005975  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.763141  3675 raft_consensus.cc:740] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:08.819396  3895 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:08.833268  3952 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:08.795715  3738 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:09.090654  1663 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:09.096828  1623 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:09.097051  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:09.099889  1663 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:09.023475  1617 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:09.025365  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:08.889489  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 611) took 1368 ms. Trace:
I20260709 13:01:09.037683  1691 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:09.108886  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:09.109323  1694 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:09.109603  1691 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
W20260709 13:01:09.110196  2271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 605) took 1968 ms (client timeout 1663 ms). Trace:
W20260709 13:01:09.110610  2271 rpcz_store.cc:269] 0709 13:01:07.142141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.142253 (+   112us) service_pool.cc:224] Handling call
0709 13:01:09.110028 (+1967775us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54004d6cd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:09.110131 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3782075264}
I20260709 13:01:09.110873  1691 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:09.031875  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:08.934680  3973 raft_consensus.cc:3055] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:09.038293  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:09.037081  1695 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:08.986249  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:08.892616  3839 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:09.039960  1689 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:09.039026  1696 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:09.115780  1692 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:09.046660  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:09.068111  1543 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
W20260709 13:01:09.116308  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.049340  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2229) took 1456 ms. Trace:
I20260709 13:01:09.066097  1586 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:08.972440  3939 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 13:01:08.961478  3936 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.834874  3849 raft_consensus.cc:1027] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: attempt to promote peer e37b8013aec24431a6672a857806329e: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:01:08.886718  3745 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7.
I20260709 13:01:08.809340  3823 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:09.021193  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 54524.7us
I20260709 13:01:08.788705  3836 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:08.810268  3902 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:08.819136  3972 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:09.080611  3675 consensus_queue.cc:260] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:09.082882  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:09.084158  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.175592  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:09.085597  1548 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:08.787288  3960 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:09.066536  1545 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:09.076612  1618 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:08.954170  3801 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:09.110952  1662 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:09.200613  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 89732.9us
W20260709 13:01:09.201303  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.758816  3980 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:09.039878  3922 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:09.119544  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.208993  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.209904  1661 connection.cc:256] RPC call timeout handler was delayed by -1.9249317079999742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
I20260709 13:01:09.123811  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:09.132090  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:09.150388  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 84348.6us
I20260709 13:01:09.214811  1586 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:09.217177  1586 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:09.151341  1688 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:09.116813  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:09.119678  1539 rpcz_store.cc:276] 0709 13:01:07.592628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.930027 (+1337399us) service_pool.cc:224] Handling call
0709 13:01:09.049241 (+119214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:09.152356  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:09.167101  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:09.116669  4021 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.114023  3973 raft_consensus.cc:740] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:09.117398  3885 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:09.101728  1620 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.198752  2270 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:09.110721  3898 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:09.241535  1540 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:09.199303  1623 raft_consensus.cc:2393] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:09.113184  4003 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:09.120464  3761 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.219723  1617 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:09.173838  3738 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:09.234243  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52808 (request call id 198) took 5695 ms. Trace:
I20260709 13:01:09.247237  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:09.213518  3675 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:09.202407  3952 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.173435  3936 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:09.213809  3960 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:09.250933  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.236302  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:09.241528  3823 raft_consensus.cc:697] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:09.197633  3880 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:01:09.232848  3745 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:09.107214  2264 rpcz_store.cc:276] 0709 13:01:07.521601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.528577 (+  6976us) service_pool.cc:224] Handling call
0709 13:01:07.613216 (+ 84639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.336042 (+722826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.889202 (+553160us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54006cf554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:08.889415 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1605134720}
I20260709 13:01:09.289376  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:09.238112  4021 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:09.241397  3879 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:09.259284  3952 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:09.231395  3922 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:09.295492  1620 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:09.314489  2272 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:09.238642  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 346319us
I20260709 13:01:09.289990  1442 catalog_manager.cc:5697] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:09.251979  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:09.250123  3885 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:09.247637  1443 rpcz_store.cc:276] 0709 13:01:03.529205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.529504 (+   299us) service_pool.cc:224] Handling call
0709 13:01:09.223940 (+5694436us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:04.986587 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:05.004883 (+ 18296us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:05.004972 (+    89us) write_op.cc:435] Acquired schema lock
0709 13:01:05.005000 (+    28us) tablet.cc:662] Decoding operations
0709 13:01:05.006873 (+  1873us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:05.007305 (+   432us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:05.007350 (+    45us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:01:05.085178 (+ 77828us) tablet.cc:701] Row locks acquired
0709 13:01:05.085217 (+    39us) write_op.cc:260] PREPARE: finished
0709 13:01:05.085573 (+   356us) write_op.cc:270] Start()
0709 13:01:05.086353 (+   780us) write_op.cc:276] Timestamp: P: 1783602065085342 usec, L: 0
0709 13:01:05.086381 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:01:05.100348 (+ 13967us) log.cc:844] Serialized 5173 byte log entry
0709 13:01:05.382727 (+282379us) op_driver.cc:464] REPLICATION: finished
0709 13:01:05.823936 (+441209us) write_op.cc:301] APPLY: starting
0709 13:01:05.824027 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:05.824383 (+   356us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:05.858387 (+ 34004us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:06.160266 (+301879us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:06.160683 (+   417us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:01:06.160745 (+    62us) write_op.cc:312] APPLY: finished
0709 13:01:06.161174 (+   429us) log.cc:844] Serialized 95 byte log entry
0709 13:01:06.161397 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:06.161557 (+   160us) write_op.cc:454] Released schema lock
0709 13:01:06.162074 (+   517us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:06.163842 (+  1768us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:06.163873 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1674,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":440864,"apply.run_cpu_time_us":8026,"apply.run_wall_time_us":339886,"num_ops":13,"prepare.queue_time_us":230075,"prepare.run_cpu_time_us":40562,"prepare.run_wall_time_us":279316,"raft.queue_time_us":115234,"raft.run_cpu_time_us":13189,"raft.run_wall_time_us":167313,"replication_time_us":296182,"thread_start_us":373392,"threads_started":4,"wal-append.queue_time_us":143220,"wal-append.run_cpu_time_us":18602,"wal-append.run_wall_time_us":1899172}]]}
I20260709 13:01:09.290855  3960 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:09.244179  3963 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:01:09.255611  3761 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:09.337800  3875 consensus_meta.cc:287] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.000s
I20260709 13:01:09.316722  1442 catalog_manager.cc:5697] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 2 to 4, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 4 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.324502  2232 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:09.325098  3836 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:09.291157  3801 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:09.331719  2265 raft_consensus.cc:2393] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:01:09.340734  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.343140  2232 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:09.303076  3792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.025s	sys 0.079s
I20260709 13:01:09.254829  1540 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:09.345872  1514 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:09.313189  3745 raft_consensus.cc:697] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:09.346033  1442 catalog_manager.cc:5697] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 3 to 5, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 5 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.350522  1442 catalog_manager.cc:5697] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 3 to 5, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 5 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.349521  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:09.348093  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.348299  2232 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:09.353230  1442 catalog_manager.cc:5697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 1 to 3, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 3 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:09.355561  4027 consensus_queue.cc:1175] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "27308aae2ef347ccba1b27e7f6f04334" responder_term: 4 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: [3.3-3.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:09.356941  4021 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:09.360260  1514 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:09.340176  3960 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:09.348176  3902 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.362623  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:09.361363  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:09.362237  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:09.368721  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 127782us
I20260709 13:01:09.368376  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:09.370676  1546 raft_consensus.cc:2410] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:09.375957  1547 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:09.379067  1543 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:09.382558  1548 raft_consensus.cc:2410] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:09.384517  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:09.350840  3792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.025s	sys 0.080s
I20260709 13:01:09.347523  3972 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:09.497462  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 126808us
I20260709 13:01:09.498018  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:09.502494  1586 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:09.500232  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 140040us
W20260709 13:01:09.497092  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.500864  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:09.501695  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 400608us
I20260709 13:01:09.504305  1547 raft_consensus.cc:2376] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3. Re-sending same reply.
I20260709 13:01:09.505581  1663 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:09.505716  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:09.506804  1547 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:09.360561  2267 raft_consensus.cc:2393] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:09.508844  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:09.517253  1544 raft_consensus.cc:2393] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:09.511075  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:09.339915  3939 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:01:09.291563  3973 consensus_queue.cc:260] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:09.359969  3977 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:09.359724  3839 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:09.548046  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:09.549243  1546 raft_consensus.cc:2376] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5. Re-sending same reply.
I20260709 13:01:09.550694  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:09.521334  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.522356  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:09.533063  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:09.361815  3898 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:09.560561  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:09.561650  2271 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:09.368925  3801 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.540187  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:09.541256  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:09.520283  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:09.574126  1663 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:09.574636  1547 raft_consensus.cc:2410] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:09.566890  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:09.845968  1544 raft_consensus.cc:2376] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6. Re-sending same reply.
W20260709 13:01:09.781243  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 432999us
I20260709 13:01:09.848284  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 498) took 2067 ms. Trace:
I20260709 13:01:09.848875  2272 rpcz_store.cc:276] 0709 13:01:07.780627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.848519 (+ 67892us) service_pool.cc:224] Handling call
0709 13:01:09.111882 (+1263363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.314997 (+203115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.558494 (+243497us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54004d6cd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:09.848005 (+289511us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54004d6cd0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:09.848197 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3369520640}
W20260709 13:01:09.838140  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.619220  1548 raft_consensus.cc:3055] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:09.857355  1548 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:09.608073  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:09.666124  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 455141us
W20260709 13:01:09.858845  1661 connection.cc:256] RPC call timeout handler was delayed by -1.89343170799998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260709 13:01:09.859164  1661 connection.cc:256] RPC call timeout handler was delayed by -1.752131707999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260709 13:01:09.859556  1661 connection.cc:256] RPC call timeout handler was delayed by -1.6792317079999748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 13:01:09.859969  1661 connection.cc:256] RPC call timeout handler was delayed by -1.638731708000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
I20260709 13:01:09.577481  1663 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:09.636330  3833 consensus_queue.cc:1059] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:09.860378  1661 connection.cc:256] RPC call timeout handler was delayed by -1.5892317079999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 13:01:09.766355  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 426955us
I20260709 13:01:09.765477  3980 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:09.522097  3738 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:01:09.569608  3951 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:09.613715  3963 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:09.563318  4032 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:09.501010  3902 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:09.890281  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:09.525364  3879 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.611776  3761 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:09.577062  3885 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:09.760131  4025 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.436s	user 0.003s	sys 0.000s
I20260709 13:01:09.623065  3839 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.530755  3857 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:09.540038  3875 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:09.734647  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 232196us
I20260709 13:01:09.567212  3888 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:01:09.361246  3823 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:09.544117  3977 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.831298  1546 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:09.580623  2263 consensus_meta.cc:287] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.544s	user 0.005s	sys 0.006s
I20260709 13:01:09.541199  3972 raft_consensus.cc:697] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:09.843130  1511 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:01:09.763353  3859 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.026s	sys 0.015s
I20260709 13:01:09.770720  4038 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:09.880673  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.882133  1541 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:01:09.979869  1541 pending_rounds.cc:85] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 2
I20260709 13:01:09.935906  3951 raft_consensus.cc:697] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:09.817533  4021 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:09.885071  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.886863  1544 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:09.729182  3745 consensus_queue.cc:237] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:09.557483  4028 consensus_queue.cc:1059] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.334s
I20260709 13:01:09.894510  1547 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:09.837759  4031 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:09.841446  4037 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:01:09.954128  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.886380  3963 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.891737  4042 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.890175  3675 raft_consensus.cc:3055] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:09.898281  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:09.977626  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 134591us
W20260709 13:01:09.978082  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 474313us
I20260709 13:01:09.980159  1541 pending_rounds.cc:107] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:01:09.858191  1548 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:09.929829  4032 raft_consensus.cc:697] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:01:09.981002  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 129626us
W20260709 13:01:09.982642  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 405222us
I20260709 13:01:09.975090  3977 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:09.979310  3859 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.036s	sys 0.022s
I20260709 13:01:09.929186  3879 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:09.963359  3839 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:09.975235  3875 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:09.974898  3857 raft_consensus.cc:697] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:10.169902  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 134977us
I20260709 13:01:09.976439  2263 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:01:10.171938  1541 raft_consensus.cc:2889] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:10.174158  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.176265  1511 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:01:10.176681  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.177618  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54488 (request call id 501) took 1494 ms. Trace:
I20260709 13:01:10.178198  2263 rpcz_store.cc:276] 0709 13:01:08.683667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.684082 (+   415us) service_pool.cc:224] Handling call
0709 13:01:10.177519 (+1493437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.170094  1548 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:09.982349  3849 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:10.159997  4034 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
I20260709 13:01:10.134016  3738 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.170608  1663 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:10.171137  3888 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.177332  3794 raft_consensus.cc:2764] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:01:10.200991  3903 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.006s	sys 0.047s
W20260709 13:01:10.252353  3903 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.210s	user 0.007s	sys 0.049s
I20260709 13:01:10.064872  3972 consensus_queue.cc:237] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.183362  3675 raft_consensus.cc:740] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:10.256074  3857 consensus_queue.cc:237] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.256573  3675 consensus_queue.cc:260] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.258011  3675 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:09.993441  4038 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.989589  4021 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:10.169283  4006 consensus_meta.cc:287] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.080s	user 0.014s	sys 0.001s
I20260709 13:01:10.096582  4050 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:10.176167  3963 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.202081  3849 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:10.275825  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.273002  1548 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:10.096253  4044 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:10.278326  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 89622.2us
I20260709 13:01:10.280565  1548 pending_rounds.cc:85] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 2
I20260709 13:01:10.019076  4046 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.283169  1548 pending_rounds.cc:107] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:10.320425  1548 raft_consensus.cc:2889] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:10.311472  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 128504us
I20260709 13:01:10.322985  1661 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:10.326141  2272 raft_consensus.cc:1240] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:10.264196  3902 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:10.334654  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:10.282738  3849 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:10.343240  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.167668  3951 consensus_queue.cc:237] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:10.326658  4034 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:01:10.196764  4037 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.243798  3738 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:10.352188  2231 leader_election.cc:336] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.802s (SENT)
I20260709 13:01:10.278313  4050 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.196518  4042 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:10.271512  3888 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:10.322214  4058 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:01:10.399967  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 162153us
I20260709 13:01:10.381974  4057 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:10.403187  1587 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:10.385666  4047 log.cc:927] Time spent T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:01:10.280941  4006 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:10.405175  4049 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:01:10.327296  4044 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:10.409531  4048 log.cc:927] Time spent T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:01:10.411312  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 319) took 1057 ms. Trace:
I20260709 13:01:10.411710  4066 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.263901  4038 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.412457  4066 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:10.414954  4062 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.415781  4062 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.418744  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2273) took 1038 ms. Trace:
I20260709 13:01:10.420485  1693 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:10.419269  1540 rpcz_store.cc:276] 0709 13:01:09.380552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.709936 (+329384us) service_pool.cc:224] Handling call
0709 13:01:09.710423 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.737585 (+ 27162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.737632 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.768535 (+ 30903us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.029685 (+261150us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:10.029755 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.029885 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.418468 (+388583us) raft_consensus.cc:1685] finished
0709 13:01:10.418495 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.418672 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29598,"raft.queue_time_us":49640,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":8671,"thread_start_us":190046,"threads_started":1,"wal-append.queue_time_us":443415}
I20260709 13:01:10.411798  1539 rpcz_store.cc:276] 0709 13:01:09.354261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.354411 (+   150us) service_pool.cc:224] Handling call
0709 13:01:09.354737 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.524101 (+169364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.524140 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.576578 (+ 52438us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.957235 (+380657us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:09.975453 (+ 18218us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.975707 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.975770 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.410983 (+435213us) raft_consensus.cc:1685] finished
0709 13:01:10.411006 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.411216 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":184267,"prepare.queue_time_us":17993,"prepare.run_wall_time_us":40,"raft.queue_time_us":231018,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":129,"spinlock_wait_cycles":22872064,"thread_start_us":319241,"threads_started":1,"wal-append.queue_time_us":514670}
W20260709 13:01:10.415288  1588 leader_election.cc:336] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Timed out: RequestConsensusVote RPC to 127.0.107.132:39517 timed out after 1.663s (SENT)
W20260709 13:01:10.391642  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 57734us
I20260709 13:01:10.421754  1588 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:10.396869  4055 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.384567  3902 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:01:10.391961  4031 raft_consensus.cc:697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:10.435916  1661 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:10.447656  4067 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:10.488138  3857 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:10.488963  3857 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.449056  4065 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:10.492362  4065 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:10.487326  4031 consensus_queue.cc:237] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:10.462616  3888 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:10.394073  3761 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:01:10.472887  4038 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:10.475673  3839 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:10.331575  3875 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:10.329165  4046 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:10.479689  3960 consensus_meta.cc:287] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.983s	user 0.010s	sys 0.004s
I20260709 13:01:10.437101  4058 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:01:10.466909  4042 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:10.489851  4067 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.498378  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2257) took 1135 ms. Trace:
I20260709 13:01:10.398731  4050 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.477095  4044 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:10.421234  4006 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:10.512472  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 131147us
I20260709 13:01:10.516825  1542 rpcz_store.cc:276] 0709 13:01:09.363020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.364537 (+  1517us) service_pool.cc:224] Handling call
0709 13:01:09.364926 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.524366 (+159440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.524393 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.552354 (+ 27961us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.977838 (+425484us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:09.988719 (+ 10881us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.025824 (+ 37105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.025933 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.498105 (+472172us) raft_consensus.cc:1685] finished
0709 13:01:10.498133 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.498302 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47562,"prepare.queue_time_us":10100,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":33994,"raft.queue_time_us":86283,"raft.run_cpu_time_us":614,"raft.run_wall_time_us":75261,"spinlock_wait_cycles":12994432,"thread_start_us":327898,"threads_started":1,"wal-append.queue_time_us":618438}
I20260709 13:01:10.528565  2234 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:10.485898  3895 consensus_meta.cc:287] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.397s	user 0.009s	sys 0.004s
W20260709 13:01:10.519049  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 348497us
I20260709 13:01:10.377144  4032 consensus_queue.cc:237] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:10.532277  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 410725us
W20260709 13:01:10.537456  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 134337us
W20260709 13:01:10.540730  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 104977us
I20260709 13:01:10.544354  1661 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:10.545480  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:10.546941  1587 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:10.405212  4064 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:01:10.543977  1663 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:10.553580  1587 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:10.523576  3880 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:10.588640  1662 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:10.427678  4057 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.532084  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 618) took 1220 ms. Trace:
W20260709 13:01:10.608718  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 64811.1us
I20260709 13:01:10.552706  4038 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:10.552979  4063 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:10.563720  4065 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:10.542479  4072 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:10.516328  3960 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.616011  1663 leader_election.cc:400] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6.
I20260709 13:01:10.617054  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:10.617878  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 73617.9us
I20260709 13:01:10.618403  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:10.619927  4066 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:10.620899  3738 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:10.588096  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:10.617883  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:10.567198  4067 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:10.558089  4042 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:10.559643  3902 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.609586  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2260) took 1245 ms. Trace:
W20260709 13:01:10.600178  3801 consensus_meta.cc:287] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.010s	user 0.010s	sys 0.005s
W20260709 13:01:10.628278  1543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.019s	sys 0.041s
W20260709 13:01:10.632889  3952 consensus_meta.cc:287] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 1.309s	user 0.013s	sys 0.002s
I20260709 13:01:10.626230  4063 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:10.565992  3880 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.509238  4055 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.624715  4077 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:10.614869  2264 rpcz_store.cc:276] 0709 13:01:09.311920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.330287 (+1018367us) service_pool.cc:224] Handling call
0709 13:01:10.399556 (+ 69269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.436436 (+ 36880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.442902 (+  6466us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.504247 (+ 61345us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:10.509540 (+  5293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.512926 (+  3386us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.526956 (+ 14030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.584654  4021 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:10.555006  4073 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 13:01:10.721351  1587 leader_election.cc:336] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.601s (SENT)
I20260709 13:01:10.722052  1587 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:10.617771  3879 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:10.663725  1663 leader_election.cc:403] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:01:10.664842  1661 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:10.613822  4051 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:10.625180  4006 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:10.669402  1541 rpcz_store.cc:276] 0709 13:01:09.364217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.576342 (+212125us) service_pool.cc:224] Handling call
0709 13:01:09.881768 (+305426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.172691 (+290923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.609362 (+436671us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54000a8cd0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:10.609528 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701435136}
W20260709 13:01:10.675346  1543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.020s	sys 0.041s
I20260709 13:01:10.690198  4063 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:10.632393  3895 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.726770  4061 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.732275  3895 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.688498  4042 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:10.736123  4042 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:10.736737  3849 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.738231  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:10.738627  4042 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:10.708978  2263 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:10.677713  4046 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:10.680570  3857 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:10.680981  3960 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:10.681123  3902 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.682561  3977 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:10.682888  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:10.633216  4072 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:10.751067  2265 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.751153  4072 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:10.752535  3977 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:10.630137  3885 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:10.760347  3885 raft_consensus.cc:697] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:10.761910  3885 consensus_queue.cc:237] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:10.684552  3936 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:10.712297  4058 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:10.713025  4037 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:10.715819  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2362) took 1679 ms. Trace:
I20260709 13:01:10.766579  1693 rpcz_store.cc:276] 0709 13:01:09.035960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.040287 (+  4327us) service_pool.cc:224] Handling call
0709 13:01:09.040710 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.432501 (+1391791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.715525 (+283024us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540039e4d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:10.715746 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3139736320}
I20260709 13:01:10.716930  3922 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:10.695187  3880 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:10.629503  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 214242us
W20260709 13:01:10.724325  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 108394us
W20260709 13:01:10.725224  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 60424.8us
I20260709 13:01:10.690497  3952 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:10.727334  4031 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:10.742560  1587 leader_election.cc:336] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.780s (SENT)
I20260709 13:01:10.744879  3895 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:10.727053  4006 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.723516  4081 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:10.708580  4057 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:10.774201  1661 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:10.774968  1663 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:01:10.780496  1587 leader_election.cc:336] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.794s (SENT)
W20260709 13:01:10.792158  1587 leader_election.cc:336] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.027s (SENT)
I20260709 13:01:10.792770  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:10.782512  1622 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:10.785595  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:10.794181  1620 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:10.809224  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:10.810356  1622 raft_consensus.cc:2393] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:10.812570  1661 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:10.816726  3875 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:10.818838  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:10.820555  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:10.821429  1616 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:01:10.789902  4006 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:10.840023  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 47892.2us
I20260709 13:01:10.840137  3849 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:10.840838  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 65954.4us
I20260709 13:01:10.844857  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:10.846050  1688 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:10.847694  1661 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:10.807210  4058 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:10.851086  1691 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:10.853493  1697 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:10.822059  4052 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:10.867779  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:10.855404  1661 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:10.859238  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:10.859570  1688 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:10.861023  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:10.861093  1697 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:10.862206  1616 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:10.868566  1688 pending_rounds.cc:85] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 1
I20260709 13:01:10.868521  1690 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.869028  1688 pending_rounds.cc:107] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:10.862841  1696 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:01:10.869340  1688 raft_consensus.cc:2889] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:10.863642  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:10.820299  4074 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:10.866685  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:10.872907  1587 leader_election.cc:336] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.238s (SENT)
W20260709 13:01:10.874030  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.877589  2234 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:10.877727  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:10.880638  1619 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:10.881276  1614 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:10.825820  4081 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:10.882488  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:10.883510  1623 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:10.884400  2234 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:10.888641  1694 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:10.891177  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:10.913745  1690 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:10.917704  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:10.865824  4031 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:10.926083  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:10.901688  2234 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:10.921227  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:10.926113  1614 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:10.927671  1696 raft_consensus.cc:2410] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:10.929097  1663 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:10.929152  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:10.929806  1690 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.877202  4055 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:10.898892  3823 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:10.867730  4052 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:10.921033  4003 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.631s	user 0.008s	sys 0.014s
I20260709 13:01:10.946285  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:10.945165  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 43592.4us
I20260709 13:01:10.901970  3875 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:10.959602  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:10.964846  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:10.966670  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:10.972258  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:10.949620  3823 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.956990  4052 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:10.975767  3823 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.976809  3794 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:10.900588  4089 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:01:10.981451  4050 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:10.984155  1662 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:10.985983  1662 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:10.987740  1695 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:10.989493  4046 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:10.990267  4051 consensus_queue.cc:1059] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:10.990067  4046 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:10.991119  4062 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:10.991345  4038 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:10.943571  4075 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:10.992830  4046 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:10.987283  1662 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:01:10.956671  4003 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.688s	user 0.009s	sys 0.014s
I20260709 13:01:10.936034  3885 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.000705  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:10.956314  4064 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:10.993366  4075 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.008697  1690 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:11.012486  1696 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 2.
I20260709 13:01:10.991053  4051 consensus_queue.cc:1243] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer e37b8013aec24431a6672a857806329e log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:11.019538  4038 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:10.939327  4074 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.157s
I20260709 13:01:10.926631  4081 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:11.145900  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:11.148442  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 972142us
I20260709 13:01:11.086187  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:11.173511  1696 raft_consensus.cc:2376] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 2. Re-sending same reply.
I20260709 13:01:11.003345  2265 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
W20260709 13:01:11.121886  1587 leader_election.cc:336] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.487s (SENT)
I20260709 13:01:11.176281  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:11.147791  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 977267us
I20260709 13:01:11.180948  2271 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:11.182022  4098 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.228s	user 0.003s	sys 0.000s
I20260709 13:01:11.184706  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:11.185884  1688 raft_consensus.cc:2393] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:11.185961  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:11.187394  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:11.187634  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:11.188803  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 66985us
W20260709 13:01:11.145810  3963 consensus_meta.cc:287] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.826s	user 0.017s	sys 0.001s
I20260709 13:01:11.004623  4031 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.202299  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:11.005040  4003 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:11.209738  1587 leader_election.cc:336] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.570s (SENT)
I20260709 13:01:11.019809  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:11.017458  3885 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:11.222375  3859 raft_consensus.cc:2764] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:11.221712  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:11.017015  4064 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:11.030747  4075 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:11.268263  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 94293.9us
I20260709 13:01:11.277668  1511 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:11.268451  1688 raft_consensus.cc:2376] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 7. Re-sending same reply.
I20260709 13:01:11.197034  4061 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6.
I20260709 13:01:11.134687  4030 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.202001  4062 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:11.279126  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:11.240685  3879 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:11.241076  4050 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:11.024744  3880 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:11.299885  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:11.300756  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 876822us
W20260709 13:01:11.260982  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 51309.7us
I20260709 13:01:11.300704  1688 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:11.275480  4072 consensus_meta.cc:287] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.004s
I20260709 13:01:11.281526  1696 raft_consensus.cc:2410] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:11.263649  2267 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
W20260709 13:01:11.296274  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 118239us
I20260709 13:01:11.313457  1623 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:11.295328  4030 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:11.276849  4064 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:11.318908  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:11.241053  4059 consensus_queue.cc:1059] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 13:01:11.320353  1691 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:11.309167  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:11.321039  1617 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.280547  4067 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:11.317771  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:11.241753  3963 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:11.326002  4050 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:11.326715  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:11.327458  1618 raft_consensus.cc:2393] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:11.327448  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:11.328507  4044 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:11.299515  3879 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:11.329882  4024 log.cc:927] Time spent T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 2.157s	user 0.004s	sys 0.004s
I20260709 13:01:11.330945  3879 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:11.325132  2270 raft_consensus.cc:2368] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6.
W20260709 13:01:11.331533  4091 log.cc:927] Time spent T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Append to log took a long time: real 0.242s	user 0.002s	sys 0.000s
I20260709 13:01:11.332397  3823 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:11.326886  3963 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:11.366551  3885 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:11.367913  1616 raft_consensus.cc:1275] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:01:11.368162  4063 consensus_meta.cc:287] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.630s	user 0.004s	sys 0.009s
I20260709 13:01:11.333722  3902 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:11.333372  4003 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:11.344790  3675 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:01:11.316771  4072 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:11.338464  2270 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:11.339129  3960 raft_consensus.cc:3055] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:11.324401  4067 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:11.308593  3801 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:11.276655  4029 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:01:11.659840  1662 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:11.433264  1694 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:11.664337  1695 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
W20260709 13:01:11.467828  1587 leader_election.cc:336] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.772s (SENT)
W20260709 13:01:11.669931  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 202139us
I20260709 13:01:11.462888  1617 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:11.673408  1514 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:01:11.488688  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.465121  4094 log.cc:927] Time spent T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:01:11.353451  3952 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:11.716511  1587 leader_election.cc:336] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 3.081s (SENT)
I20260709 13:01:11.523170  3973 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:11.616055  3945 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.243s	user 0.010s	sys 0.006s
I20260709 13:01:11.683359  3960 raft_consensus.cc:740] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:11.396221  4043 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:11.688244  1688 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:11.326778  4030 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:11.695667  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.696872  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:11.689815  4059 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.682179  4072 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:11.717592  1587 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:11.764909  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 48452.3us
W20260709 13:01:11.765874  1587 leader_election.cc:336] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 3.128s (SENT)
I20260709 13:01:11.703712  4050 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 13:01:11.749987  3945 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.422s	user 0.010s	sys 0.009s
I20260709 13:01:11.401522  3879 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.354s
W20260709 13:01:11.761149  4052 consensus_meta.cc:287] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.785s	user 0.014s	sys 0.000s
W20260709 13:01:11.696803  4097 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 13:01:11.750864  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 407150us
I20260709 13:01:11.664397  3801 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.706669  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:11.392484  3963 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.357s
I20260709 13:01:11.392231  4063 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:11.771972  4030 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:11.700703  2270 raft_consensus.cc:1240] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:11.755131  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:11.757725  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:11.755998  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:11.760761  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:11.761924  2268 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:11.688426  3761 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:11.396118  4033 raft_consensus.cc:3055] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:11.562580  3857 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:11.776671  4104 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.754688  4043 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.796550  3801 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.688741  4062 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:01:11.796182  1697 raft_consensus.cc:2393] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:11.750285  3738 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:01:11.695827  4058 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:01:11.400310  4044 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:11.790921  4103 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
I20260709 13:01:11.789674  3849 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.796849  3978 raft_consensus.cc:2764] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:11.805891  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:11.773597  4059 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:11.852916  4044 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:11.855221  3823 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:11.856871  4063 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:11.835861  4038 consensus_queue.cc:1048] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:01:11.857234  4081 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:11.843991  3761 raft_consensus.cc:697] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:11.790887  4052 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:11.814198  3960 consensus_queue.cc:260] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:11.816140  4033 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:11.844563  4043 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:11.866362  4006 consensus_meta.cc:287] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.009s	user 0.011s	sys 0.005s
W20260709 13:01:11.868448  4031 consensus_meta.cc:287] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.580s	user 0.007s	sys 0.004s
I20260709 13:01:11.881021  4031 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:11.885382  4064 consensus_meta.cc:287] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.000s
I20260709 13:01:11.885866  4064 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:11.887511  4052 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:11.888134  4064 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:11.888433  3880 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:11.882999  4044 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:11.395841  4021 raft_consensus.cc:2955] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:01:11.889699  4044 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.894527  3960 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.846968  4104 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:11.865355  3849 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:11.791070  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 117826us
I20260709 13:01:11.993485  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:11.874513  3761 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:11.788378  1511 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:11.779551  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:12.000321  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.000003  1541 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:01:12.004137  1546 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:12.010655  1539 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:12.012313  1587 leader_election.cc:336] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 3.214s (SENT)
I20260709 13:01:12.015794  1548 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:12.022903  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:11.828579  1663 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:12.027057  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 384) took 1028 ms. Trace:
W20260709 13:01:12.028836  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 362014us
I20260709 13:01:12.029911  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 265) took 1140 ms. Trace:
I20260709 13:01:11.816027  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:12.022918  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:12.056617  2266 raft_consensus.cc:1240] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:12.079952  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:12.057547  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:12.081339  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 267) took 1191 ms. Trace:
I20260709 13:01:12.062711  3794 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:01:12.048010  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.055877  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:12.076758  3738 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:12.082705  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 294271us
I20260709 13:01:12.089005  3849 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:12.037153  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1470) took 1191 ms. Trace:
I20260709 13:01:12.037298  1620 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:12.038226  1690 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:12.041610  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:11.833387  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:12.081773  1695 rpcz_store.cc:276] 0709 13:01:10.890189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.079308 (+1189119us) service_pool.cc:224] Handling call
0709 13:01:12.081001 (+  1693us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:12.089982  1622 rpcz_store.cc:276] 0709 13:01:10.998526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.998777 (+   251us) service_pool.cc:224] Handling call
0709 13:01:10.999103 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:10.999451 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.999483 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:11.008476 (+  8993us) log.cc:844] Serialized 26 byte log entry
0709 13:01:11.526557 (+518081us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b18004016e0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de0d1 00007f5c6aaf9a0f
0709 13:01:11.763544 (+236987us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:11.763607 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.763699 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.026412 (+262713us) raft_consensus.cc:1685] finished
0709 13:01:12.026464 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.026848 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74703,"raft.queue_time_us":4536,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8965,"spinlock_wait_cycles":96058752,"thread_start_us":236524,"threads_started":1,"wal-append.queue_time_us":830583}
I20260709 13:01:12.092726  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1365) took 1225 ms. Trace:
I20260709 13:01:12.051020  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 287) took 1062 ms. Trace:
I20260709 13:01:12.109300  1689 rpcz_store.cc:276] 0709 13:01:10.845280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.845462 (+   182us) service_pool.cc:224] Handling call
0709 13:01:10.845980 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:10.853270 (+  7290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.853302 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:10.853784 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:01:11.009239 (+155455us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:11.022424 (+ 13185us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.196433 (+174009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.196523 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.036596 (+840073us) raft_consensus.cc:1685] finished
0709 13:01:12.036646 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.036923 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":186462,"prepare.queue_time_us":14119,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":43,"raft.queue_time_us":185202,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":57252,"thread_start_us":145563,"threads_started":1,"wal-append.queue_time_us":399192}
I20260709 13:01:12.146173  1696 rpcz_store.cc:276] 0709 13:01:10.987580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.175757 (+188177us) service_pool.cc:224] Handling call
0709 13:01:12.049612 (+873855us) spinlock_profiling.cc:243] Waited 78.1 ms on lock 0x7b5400147b54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:12.050027 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179730176}
I20260709 13:01:12.146904  1691 raft_consensus.cc:2376] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 7. Re-sending same reply.
I20260709 13:01:12.094467  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:12.147289  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:12.083662  1661 leader_election.cc:336] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.600s (SENT)
I20260709 13:01:12.148077  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:12.148202  1661 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:12.148295  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:12.149379  1695 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:12.150053  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 269) took 1259 ms. Trace:
I20260709 13:01:12.150388  1695 rpcz_store.cc:276] 0709 13:01:10.890930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.148471 (+1257541us) service_pool.cc:224] Handling call
0709 13:01:12.149026 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.149804 (+   778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.149984 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:12.150944  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:12.152009  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 271) took 1260 ms. Trace:
I20260709 13:01:12.152694  1691 rpcz_store.cc:276] 0709 13:01:10.891495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.150152 (+1258657us) service_pool.cc:224] Handling call
0709 13:01:12.150827 (+   675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.151519 (+   692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.151556 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:12.151638 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:12.151707 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.151810 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.151951 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:12.154963  4030 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:12.157720  4030 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:12.159735  4030 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:12.162614  4030 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:12.034687  1616 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:12.087576  1617 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:12.164052  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 337240us
I20260709 13:01:12.165023  4072 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:12.165875  4072 raft_consensus.cc:697] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:12.083197  3794 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:12.170140  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 86649us
I20260709 13:01:12.170864  3794 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:12.084040  2271 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.880120  4006 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:11.940037  4059 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:11.946498  4067 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:11.932403  4075 consensus_meta.cc:287] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.641s	user 0.014s	sys 0.000s
I20260709 13:01:12.261852  1689 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:01:12.261417  4043 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:12.262259  1689 pending_rounds.cc:85] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 6
I20260709 13:01:12.262518  1689 pending_rounds.cc:107] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:01:12.262979  1689 raft_consensus.cc:2889] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:12.262341  4075 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:12.034698  2232 leader_election.cc:336] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.591s (SENT)
I20260709 13:01:12.085214  1694 rpcz_store.cc:276] 0709 13:01:10.889245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.889631 (+   386us) service_pool.cc:224] Handling call
0709 13:01:12.028775 (+1139144us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b5400378cd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:12.029308 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848596352}
I20260709 13:01:12.086467  1587 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:12.047837  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:12.142546  1697 raft_consensus.cc:2376] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 3. Re-sending same reply.
I20260709 13:01:12.083745  1541 pending_rounds.cc:85] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 5
I20260709 13:01:12.289708  1541 pending_rounds.cc:107] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:01:12.155221  1691 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:12.085144  3675 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:12.171939  4107 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:12.085085  3738 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:12.151880  1696 raft_consensus.cc:2376] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 6. Re-sending same reply.
W20260709 13:01:12.187788  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 98714.5us
I20260709 13:01:11.906373  4033 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:12.152263  1615 rpcz_store.cc:276] 0709 13:01:10.866714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.866827 (+   113us) service_pool.cc:224] Handling call
0709 13:01:10.877175 (+ 10348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.877394 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:11.246962 (+369568us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.090462 (+843500us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b18001b0fa0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c6a6e64bc 00007f5c67a3448b 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de23a
0709 13:01:12.091358 (+   896us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:12.091528 (+   170us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:12.092008 (+   480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.092154 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.092463 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":443276,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":6810,"raft.queue_time_us":32170,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":420,"spinlock_wait_cycles":53325184,"thread_start_us":458568,"threads_started":2,"wal-append.queue_time_us":527650}
I20260709 13:01:12.235762  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:12.245787  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 74265.4us
I20260709 13:01:12.248423  1692 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:11.941962  4104 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:12.264591  4115 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:12.323378  4115 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:12.324983  3801 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:12.326504  1695 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:12.266220  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:12.266863  4032 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:12.267709  4028 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.271008  4045 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:01:12.274391  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:12.274748  4003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.001s	sys 0.008s
I20260709 13:01:12.276472  4046 consensus_queue.cc:1059] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:12.278326  1616 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:12.279994  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:12.262987  1542 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:12.340068  4033 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:12.290132  1541 raft_consensus.cc:2889] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:12.299294  2270 raft_consensus.cc:2393] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:12.340072  1621 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:12.266242  1513 leader_election.cc:400] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6.
I20260709 13:01:12.343515  1513 leader_election.cc:403] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:01:12.303252  1617 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:12.299533  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 292) took 1024 ms. Trace:
I20260709 13:01:12.300598  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 279) took 1345 ms. Trace:
W20260709 13:01:12.299053  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 204943us
I20260709 13:01:12.320761  4052 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
W20260709 13:01:12.352871  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 283) took 1367 ms (client timeout 1809 ms). Trace:
I20260709 13:01:12.321986  4038 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:12.353616  1690 rpcz_store.cc:269] 0709 13:01:10.985629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.187164 (+201535us) service_pool.cc:224] Handling call
0709 13:01:12.352484 (+1165320us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54001293d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:12.352759 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1954365184}
I20260709 13:01:12.354776  4038 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:12.356081  4028 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:12.356761  1586 leader_election.cc:336] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.565s (SENT)
I20260709 13:01:12.357347  1586 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:12.358984  3879 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:12.360598  4046 raft_consensus.cc:3055] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:12.360750  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 275) took 1441 ms. Trace:
I20260709 13:01:12.361106  4046 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:12.361338  1695 rpcz_store.cc:276] 0709 13:01:10.919869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.152654 (+1232785us) service_pool.cc:224] Handling call
0709 13:01:12.302697 (+150043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.327030 (+ 24333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.360430 (+ 33400us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400378cd0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:12.360652 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344019328}
I20260709 13:01:12.344050  1697 rpcz_store.cc:276] 0709 13:01:11.265194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.040718 (+775524us) service_pool.cc:224] Handling call
0709 13:01:12.289704 (+248986us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:12.299712  3675 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.328155  1694 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:12.329239  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 280) took 1361 ms. Trace:
I20260709 13:01:12.247872  4072 consensus_queue.cc:237] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:12.338131  4003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.001s	sys 0.008s
I20260709 13:01:12.344734  1691 rpcz_store.cc:276] 0709 13:01:10.945721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.154046 (+1208325us) service_pool.cc:224] Handling call
0709 13:01:12.154521 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.290600 (+136079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.291073 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:12.351826  4067 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:12.359192  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 46134.8us
I20260709 13:01:12.372900  1689 rpcz_store.cc:276] 0709 13:01:10.956061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.226626 (+1270565us) service_pool.cc:224] Handling call
0709 13:01:12.261213 (+ 34587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.313371 (+ 52158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.316766 (+  3395us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:12.376539  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 342467us
I20260709 13:01:12.375125  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 282) took 1389 ms. Trace:
I20260709 13:01:12.379747  1694 rpcz_store.cc:276] 0709 13:01:10.985321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.315799 (+1330478us) service_pool.cc:224] Handling call
0709 13:01:12.327273 (+ 11474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.372384 (+ 45111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.375048 (+  2664us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:12.391527  4006 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:12.391746  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1374) took 1036 ms. Trace:
I20260709 13:01:12.393074  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:12.393541  1621 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:12.375785  3675 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:12.406021  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 393926us
I20260709 13:01:12.406862  3738 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:12.392498  1618 rpcz_store.cc:276] 0709 13:01:11.345668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.368881 (+ 23213us) service_pool.cc:224] Handling call
0709 13:01:11.396632 (+ 27751us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:11.397506 (+   874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.397568 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:11.715530 (+317962us) log.cc:844] Serialized 52 byte log entry
0709 13:01:12.266484 (+550954us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:12.266587 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.266696 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.363515 (+ 96819us) raft_consensus.cc:1685] finished
0709 13:01:12.363537 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.381501 (+ 17964us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5480,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":435276,"threads_started":1,"wal-append.queue_time_us":566800}
I20260709 13:01:12.409983  1663 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:12.410415  1587 leader_election.cc:336] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 3.234s (SENT)
I20260709 13:01:12.412648  4095 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:12.414330  4063 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:12.419901  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.421303  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 64161.2us
I20260709 13:01:12.422631  3879 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:12.422284  4031 consensus_queue.cc:1059] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
W20260709 13:01:12.429251  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 163356us
I20260709 13:01:12.362305  4046 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:12.401533  3801 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:12.435828  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 64137.7us
I20260709 13:01:12.403172  4043 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:12.452173  1615 raft_consensus.cc:2393] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:12.454319  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 44513.3us
I20260709 13:01:12.438941  4038 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:12.444818  4032 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:12.471779  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 61128.2us
I20260709 13:01:12.483678  4031 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:12.484608  4031 raft_consensus.cc:697] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:12.451383  3879 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:12.496687  2271 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:12.483939  4104 consensus_queue.cc:1059] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:01:12.515553  4044 consensus_queue.cc:1059] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:01:12.519340  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:12.522333  4031 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:12.523535  4062 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.524430  4062 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:12.527639  3738 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:12.528261  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:12.528463  3738 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:12.530095  1616 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:12.531940  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.535530  4115 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:12.536814  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.537460  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.543831  4043 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:12.544729  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 272) took 1653 ms (client timeout 2099 ms). Trace:
W20260709 13:01:12.545219  1692 rpcz_store.cc:269] 0709 13:01:10.891746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.702744 (+810998us) service_pool.cc:224] Handling call
0709 13:01:12.544469 (+841725us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400148a54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:12.544668 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505863552}
I20260709 13:01:12.546886  3801 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:12.547595  4104 raft_consensus.cc:3055] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:12.548225  4104 raft_consensus.cc:740] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:12.483754  4046 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:12.558367  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:12.559072  4044 consensus_queue.cc:1243] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:12.560052  4044 raft_consensus.cc:3055] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:12.560586  4044 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:12.561975  4044 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:12.553202  1619 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:12.564831  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:12.565713  1619 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:12.567778  4030 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.568068  3951 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:12.568605  4030 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:12.571863  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:12.558367  1696 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:12.570544  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:12.572130  4104 consensus_queue.cc:260] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:12.573537  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:12.573768  3836 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:12.574339  4104 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:12.572788  1543 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:01:12.523032  4075 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:12.580401  3960 consensus_meta.cc:287] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.680s	user 0.008s	sys 0.008s
I20260709 13:01:12.581688  4028 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:12.583803  3879 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:12.585086  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 266659us
W20260709 13:01:12.585901  3973 consensus_meta.cc:287] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.832s	user 0.015s	sys 0.003s
I20260709 13:01:12.592056  3902 raft_consensus.cc:3055] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:12.592643  3902 raft_consensus.cc:740] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:12.593732  3902 consensus_queue.cc:260] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:12.543006  1511 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:12.559377  1616 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:12.575845  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:12.598496  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.601542  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:12.596395  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 53589.4us
I20260709 13:01:12.607878  1693 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:12.598978  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:12.615175  4041 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:12.616007  4030 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:12.599714  4043 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:12.596802  2231 leader_election.cc:336] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.607s (SENT)
I20260709 13:01:12.619593  2263 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:12.605154  4062 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:12.621134  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:12.604997  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.621902  1623 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:12.627152  4095 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.627967  4095 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:12.629310  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1464) took 1786 ms. Trace:
I20260709 13:01:12.629739  1693 rpcz_store.cc:276] 0709 13:01:10.842630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.842827 (+   197us) service_pool.cc:224] Handling call
0709 13:01:10.883090 (+ 40263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.615322 (+1732232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.629016 (+ 13694us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b540022f954. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:12.629250 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3965264128}
I20260709 13:01:12.632115  3885 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:12.639336  4111 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:12.639473  4043 raft_consensus.cc:697] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:12.635238  1616 raft_consensus.cc:2368] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5.
I20260709 13:01:12.630402  4095 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:12.594707  1688 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
W20260709 13:01:12.646067  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 58966.2us
I20260709 13:01:12.652797  1543 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:12.654016  4130 log.cc:927] Time spent T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:01:12.674863  1545 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 2.
I20260709 13:01:12.677743  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 284) took 1676 ms. Trace:
W20260709 13:01:12.677978  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.678267  1696 rpcz_store.cc:276] 0709 13:01:10.985923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.317719 (+1331796us) service_pool.cc:224] Handling call
0709 13:01:12.557941 (+240222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.572662 (+ 14721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.655568 (+ 82906us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400148a50. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:12.662328 (+  6760us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445439232}
I20260709 13:01:12.662834  3902 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:12.697201  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:12.702024  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:12.706312  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 282935us
I20260709 13:01:12.711932  1615 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:12.681072  4095 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:12.687984  4045 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.730100  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:12.731962  1543 raft_consensus.cc:2410] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:12.700634  4044 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:12.733939  1616 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:01:12.680003  4028 consensus_queue.cc:1059] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 13:01:12.743089  1586 leader_election.cc:336] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.963s (SENT)
I20260709 13:01:12.720139  3879 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.756019  1623 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:12.710813  3885 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.755563  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:12.796717  2231 leader_election.cc:336] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.750s (SENT)
I20260709 13:01:13.152575  1615 raft_consensus.cc:2410] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:01:12.825210  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 170625us
I20260709 13:01:12.769560  1586 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:13.184244  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.838836  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:13.242699  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.929499  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.893031  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.837340  2268 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:13.005462  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:13.280699  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.856818  1588 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:13.279557  2231 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:12.757269  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:13.007921  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:13.059784  1661 connection.cc:256] RPC call timeout handler was delayed by -1.6412943769999515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3104s for a response
I20260709 13:01:12.996671  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:12.760490  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:12.796306  3903 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:13.299431  3903 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:12.745309  4032 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6.
I20260709 13:01:12.857048  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:12.837873  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:12.857224  2234 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:13.241820  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:12.858541  4152 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:01:13.297379  1620 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:12.857039  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:13.313807  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:13.316342  1616 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:13.052866  4139 log.cc:927] Time spent T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.358s	user 0.003s	sys 0.002s
W20260709 13:01:12.803735  4021 consensus_meta.cc:287] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.835s	user 0.013s	sys 0.007s
I20260709 13:01:13.333464  1540 raft_consensus.cc:2410] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:13.008986  3978 raft_consensus.cc:3055] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:01:13.275398  4104 consensus_meta.cc:287] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.700s	user 0.013s	sys 0.005s
W20260709 13:01:13.275808  3902 consensus_meta.cc:287] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.563s	user 0.015s	sys 0.000s
I20260709 13:01:13.008803  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:12.761090  4072 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.812299  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:13.343672  1618 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:13.004784  4075 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.142325  4062 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:13.351877  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:13.273702  4044 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.054971  1623 raft_consensus.cc:2955] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:01:13.384956  4089 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:13.374840  4111 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:01:13.385439  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:12.804379  3879 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:13.375305  1543 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
W20260709 13:01:13.399020  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 726832us
I20260709 13:01:13.373493  1546 raft_consensus.cc:2393] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:13.318590  4028 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:13.398432  1548 raft_consensus.cc:2410] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:13.398211  3963 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:13.402297  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:12.944872  3675 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:13.350247  3978 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:12.783973  4045 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:12.777447  4095 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:01:13.409873  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:13.410857  3972 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:13.411319  3903 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:13.488561  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:13.412039  4059 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.490012  4094 log.cc:927] Time spent T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:01:13.489717  4059 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:13.489945  4028 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:13.412837  4153 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:01:13.492599  3879 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:13.493180  3963 raft_consensus.cc:697] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:13.488848  3972 raft_consensus.cc:697] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:13.493580  4075 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:13.494403  3963 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:13.399456  4044 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:13.494877  3972 consensus_queue.cc:237] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:13.496202  4075 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:13.413970  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:13.369541  4030 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:12.874825  4043 consensus_queue.cc:237] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:13.424485  1539 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:01:12.868490  4031 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:13.484596  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:13.502604  1544 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:13.488817  1547 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:13.473901  2267 raft_consensus.cc:2393] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:13.530733  1620 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:13.532949  1543 raft_consensus.cc:2410] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:13.371796  3885 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:13.533769  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 737003us
I20260709 13:01:13.398556  4072 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:13.540864  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:13.509603  4152 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:01:13.448186  4062 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:13.598088  1540 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:13.540941  3879 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.601321  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 185503us
W20260709 13:01:13.599020  1587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.724s (SENT) [suppressed 41 similar messages]
I20260709 13:01:13.505425  4044 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:13.616633  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 878778us
I20260709 13:01:13.619931  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:13.622293  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:13.623597  1693 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:13.631057  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 922697us
I20260709 13:01:13.425669  4118 consensus_queue.cc:1059] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.186s
I20260709 13:01:13.634392  1540 raft_consensus.cc:1240] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:13.638852  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 226636us
I20260709 13:01:13.643330  1546 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:13.641755  2232 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:01:13.658375  2231 leader_election.cc:336] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.756s (SENT)
W20260709 13:01:13.656243  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 341421us
I20260709 13:01:13.666143  1693 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:13.668066  1663 leader_election.cc:400] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5.
W20260709 13:01:13.668552  4159 log.cc:927] Time spent T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:01:13.673550  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 395) took 1132 ms. Trace:
I20260709 13:01:13.674081  1619 rpcz_store.cc:276] 0709 13:01:12.540861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.566914 (+ 26053us) service_pool.cc:224] Handling call
0709 13:01:12.567397 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.690890 (+123493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.690935 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.733255 (+ 42320us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.137192 (+403937us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:13.137247 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.137352 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.673123 (+535771us) raft_consensus.cc:1685] finished
0709 13:01:13.673146 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.673418 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":319317,"threads_started":1,"wal-append.queue_time_us":611404}
I20260709 13:01:13.676911  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:13.675612  2265 raft_consensus.cc:2955] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 3 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:01:13.680802  1619 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:13.682714  1663 leader_election.cc:403] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:01:13.691529  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 281) took 2722 ms (client timeout 2147 ms). Trace:
W20260709 13:01:13.692651  1688 rpcz_store.cc:269] 0709 13:01:10.968628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.755383 (+786755us) service_pool.cc:224] Handling call
0709 13:01:13.691169 (+1935786us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b5400147654. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:13.691358 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1776654592}
I20260709 13:01:13.697184  1546 raft_consensus.cc:1275] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:13.697772  1546 pending_rounds.cc:85] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 2
I20260709 13:01:13.707401  1546 pending_rounds.cc:107] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:13.707800  1546 raft_consensus.cc:2889] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.652000  3903 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:13.652356  3951 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:13.706610  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1386) took 1020 ms. Trace:
I20260709 13:01:13.627939  3973 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:01:13.673795  4062 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:13.721575  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:13.722491  1540 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:13.724546  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.715778  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:13.656492  3879 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:13.712163  1614 rpcz_store.cc:276] 0709 13:01:12.686453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.363060 (+676607us) service_pool.cc:224] Handling call
0709 13:01:13.412197 (+ 49137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.412449 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:13.497175 (+ 84726us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.706213 (+209038us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:13.706280 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:13.706337 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.706408 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.706550 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71513,"prepare.queue_time_us":120793,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":402,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":329,"thread_start_us":165083,"threads_started":1}
I20260709 13:01:13.736054  1688 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:13.714730  3951 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:01:13.745481  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 125646us
I20260709 13:01:13.746515  1514 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:13.742686  1586 connection.cc:256] RPC call timeout handler was delayed by -1.1730362380000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 13:01:13.749282  1586 connection.cc:256] RPC call timeout handler was delayed by -1.1248007200000529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 13:01:13.749831  1586 connection.cc:256] RPC call timeout handler was delayed by -1.0968327950000116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
I20260709 13:01:13.755214  1616 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:13.756631  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1387) took 1033 ms. Trace:
I20260709 13:01:13.757762  1543 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:01:13.760434  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:13.711501  3903 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.757073  1616 rpcz_store.cc:276] 0709 13:01:12.726838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.741301 (+ 14463us) service_pool.cc:224] Handling call
0709 13:01:13.756543 (+1015242us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:13.766486  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 126152us
I20260709 13:01:13.767802  1547 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:13.662982  4031 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:13.713461  3978 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:13.755910  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:13.801301  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:13.802956  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2271) took 4433 ms (client timeout 1794 ms). Trace:
I20260709 13:01:13.803526  4044 consensus_queue.cc:1059] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:01:13.806361  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 59956.9us
I20260709 13:01:13.806862  3879 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:13.807251  1514 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:13.808979  4168 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:13.809152  1514 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:13.812271  4031 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:13.814145  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:13.784217  3903 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:13.816044  3675 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:13.817795  3675 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:13.818110  3973 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:13.818392  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53718 (request call id 336) took 1248 ms. Trace:
I20260709 13:01:13.794662  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:13.753918  3951 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:13.745010  3738 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:13.818842  1544 rpcz_store.cc:276] 0709 13:01:12.569693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.569828 (+   135us) service_pool.cc:224] Handling call
0709 13:01:13.818213 (+1248385us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54000a9bd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:13.818305 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1805241088}
I20260709 13:01:13.741004  3801 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.834627  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:13.834905  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 43953.4us
W20260709 13:01:13.803407  1545 rpcz_store.cc:269] 0709 13:01:09.367304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.384170 (+ 16866us) service_pool.cc:224] Handling call
0709 13:01:13.783504 (+4399334us) spinlock_profiling.cc:243] Waited 3.2 s on lock 0x7b54000c6a54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:13.800944 (+ 17440us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7362743040}
W20260709 13:01:13.856992  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.837343  1693 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:13.847584  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:13.851972  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 185047us
I20260709 13:01:13.860227  1663 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:13.863351  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 91506us
I20260709 13:01:13.856936  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:13.832298  3973 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:13.866243  2234 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:13.832717  4028 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:13.875746  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.871183  1542 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:13.900220  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:13.900036  3879 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.904958  4109 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:13.905805  4095 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:13.833575  4033 consensus_queue.cc:1059] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:01:13.897758  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.034s	sys 0.039s
W20260709 13:01:13.910552  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.034s	sys 0.040s
I20260709 13:01:13.896464  3973 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:13.908468  4111 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:13.904950  3879 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:13.930954  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:13.931770  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:13.931870  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:13.932253  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:13.932649  1694 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:01:13.932858  1688 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:13.933125  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:13.933851  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:13.934437  1691 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:01:13.936059  1690 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:13.931802  1695 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:13.942054  4031 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:13.942143  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:13.943722  1689 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:13.900207  4062 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:13.901700  4045 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:13.874764  3801 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:13.917816  4033 consensus_queue.cc:1243] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer e37b8013aec24431a6672a857806329e log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:13.910099  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:13.915274  3978 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:13.925565  3738 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:13.957321  4171 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:13.957886  4168 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5.
I20260709 13:01:13.956774  3738 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:13.958021  4171 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:13.949023  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:13.950920  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:13.961246  1697 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:13.960402  1690 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
W20260709 13:01:13.964879  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 365871us
W20260709 13:01:13.966869  4156 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.379s	user 0.000s	sys 0.002s
I20260709 13:01:13.968596  4171 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:13.969453  4160 log.cc:927] Time spent T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:01:13.972805  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:13.948077  4072 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:13.978437  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:13.951690  4157 log.cc:927] Time spent T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.237s	user 0.001s	sys 0.002s
I20260709 13:01:13.982105  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:13.978915  3879 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:13.986259  1616 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:13.986920  4143 log.cc:927] Time spent T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 1.053s	user 0.000s	sys 0.006s
I20260709 13:01:13.991942  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:13.993050  1619 raft_consensus.cc:2410] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:13.993741  3973 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:13.996861  1616 raft_consensus.cc:2410] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:13.997634  3973 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:14.004019  4072 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.011390  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:14.003163  1540 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:14.004670  1689 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:14.008579  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1381) took 1435 ms. Trace:
I20260709 13:01:14.014200  1621 rpcz_store.cc:276] 0709 13:01:12.573624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.983545 (+409921us) service_pool.cc:224] Handling call
0709 13:01:12.992207 (+  8662us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:12.992797 (+   590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.992830 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:13.243117 (+250287us) log.cc:844] Serialized 52 byte log entry
0709 13:01:13.837133 (+594016us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:13.837174 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.837238 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.008263 (+171025us) raft_consensus.cc:1685] finished
0709 13:01:14.008286 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.008485 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2992,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":478009,"threads_started":1,"wal-append.queue_time_us":576460}
I20260709 13:01:14.030020  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:14.076872  1615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.004s	sys 0.003s
W20260709 13:01:14.077446  1615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.004s	sys 0.003s
W20260709 13:01:14.078670  1586 leader_election.cc:336] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.187s (SENT)
I20260709 13:01:14.078745  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:14.078378  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 176966us
I20260709 13:01:13.975771  4062 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:14.096077  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:14.093932  1690 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:14.017598  4104 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:14.000653  3903 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:14.096652  1617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.000s	sys 0.008s
W20260709 13:01:14.107870  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.121714  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 475203us
W20260709 13:01:14.099493  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.124570  1587 leader_election.cc:336] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.170s (SENT)
I20260709 13:01:14.028935  4072 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:14.124034  1586 leader_election.cc:336] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.232s (SENT)
I20260709 13:01:14.089318  4067 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:14.098863  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1482) took 1529 ms. Trace:
I20260709 13:01:14.127765  1689 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:14.136833  4095 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:14.137712  4095 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:14.141124  4095 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:14.122519  1617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.000s	sys 0.009s
W20260709 13:01:14.283823  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 185725us
W20260709 13:01:14.213160  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 404070us
I20260709 13:01:14.232985  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1383) took 1658 ms. Trace:
I20260709 13:01:14.181238  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1481) took 1612 ms. Trace:
W20260709 13:01:14.293097  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 49000us
I20260709 13:01:14.109601  3973 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.224171  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 411514us
I20260709 13:01:14.131292  1623 rpcz_store.cc:276] 0709 13:01:12.569031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.825039 (+256008us) service_pool.cc:224] Handling call
0709 13:01:12.880293 (+ 55254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.974031 (+ 93738us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:13.544201 (+570170us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.097891 (+553690us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.098539 (+   648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.098589 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:14.098631 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.098696 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.098807 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4264,"raft.queue_time_us":61871,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":13892,"thread_start_us":403796,"threads_started":1,"wal-append.queue_time_us":489820}
I20260709 13:01:14.143440  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:14.114056  4033 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.181308  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:14.172140  1587 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:14.093338  4046 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:14.294188  1615 rpcz_store.cc:276] 0709 13:01:12.574604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.317005 (+742401us) service_pool.cc:224] Handling call
0709 13:01:13.317445 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.349314 (+ 31869us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:13.460197 (+110883us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.231205 (+771008us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.232154 (+   949us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.232584 (+   430us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:14.232653 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.232746 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.232908 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102432,"prepare.queue_time_us":176578,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":13805,"raft.run_cpu_time_us":607,"raft.run_wall_time_us":51410,"thread_start_us":623923,"threads_started":2,"wal-append.queue_time_us":724655}
I20260709 13:01:14.172191  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:14.326247  2231 leader_election.cc:336] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.809s (SENT)
I20260709 13:01:14.326754  2231 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:14.291321  4181 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:01:14.097505  4021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.004s	sys 0.005s
I20260709 13:01:14.297150  1617 rpcz_store.cc:276] 0709 13:01:12.568767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.834742 (+265975us) service_pool.cc:224] Handling call
0709 13:01:12.934309 (+ 99567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.036150 (+101841us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:13.066559 (+ 30409us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.180832 (+1114273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.180892 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:14.180948 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.181014 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.181170 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11819,"prepare.queue_time_us":20310,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":30434,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":11898,"spinlock_wait_cycles":16436224,"thread_start_us":1001857,"threads_started":1,"wal-append.queue_time_us":1126816}
I20260709 13:01:14.341626  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:14.357012  1689 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:14.180646  4089 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:14.359570  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:14.297793  3801 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:14.128894  4031 raft_consensus.cc:697] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:14.180042  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:14.305001  4095 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.345031  4021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.010s	sys 0.010s
W20260709 13:01:14.405484  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 46986.3us
I20260709 13:01:14.221836  4067 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:14.407924  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.333509  4033 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:14.409993  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:14.412251  1545 raft_consensus.cc:2393] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:14.414070  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 315615us
W20260709 13:01:14.409154  1539 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.012s	sys 0.026s
I20260709 13:01:14.366677  4172 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.384341  3963 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:14.340893  3973 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:14.422839  1539 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.013s	sys 0.026s
I20260709 13:01:14.341135  4046 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:14.409060  3879 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:14.435436  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:14.442169  1545 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:14.432560  1514 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:14.446252  4072 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:14.447229  4021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53706 (request call id 7) took 23158 ms. Trace:
I20260709 13:01:14.398479  4089 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:14.458138  3951 consensus_meta.cc:287] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.003s
I20260709 13:01:14.458819  3951 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:14.461920  4089 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:14.426230  3738 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:14.464154  4062 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:14.465204  3879 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:14.467757  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1389) took 1642 ms. Trace:
I20260709 13:01:14.468189  1620 rpcz_store.cc:276] 0709 13:01:12.825739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.535773 (+710034us) service_pool.cc:224] Handling call
0709 13:01:13.601903 (+ 66130us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.613125 (+ 11222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.617735 (+  4610us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.626508 (+  8773us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.117858 (+491350us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:14.117911 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.118002 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.467549 (+349547us) raft_consensus.cc:1685] finished
0709 13:01:14.467567 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.467700 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13609,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":11017,"thread_start_us":419208,"threads_started":1,"wal-append.queue_time_us":818031}
I20260709 13:01:14.467639  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:14.447762  4021 rpcz_store.cc:276] 0709 13:00:51.289331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.304337 (+ 15006us) service_pool.cc:224] Handling call
0709 13:00:51.549749 (+245412us) log.cc:844] Serialized 506 byte log entry
0709 13:01:14.446937 (+22897188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54287,"raft.queue_time_us":23363,"raft.run_cpu_time_us":2407,"raft.run_wall_time_us":45704,"thread_start_us":141932,"threads_started":1,"wal-append.queue_time_us":153949,"wal-append.run_cpu_time_us":1908,"wal-append.run_wall_time_us":1004307}
W20260709 13:01:14.474226  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.443816  4172 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:14.469780  1548 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:14.409348  4095 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:14.490731  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:14.491566  2265 consensus_meta.cc:287] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.813s	user 0.013s	sys 0.004s
I20260709 13:01:14.492421  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:14.492908  1587 leader_election.cc:336] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.187s (SENT)
I20260709 13:01:14.499716  1587 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:14.444754  3903 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:14.507639  4062 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.508833  4172 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:14.508459  4062 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:14.509896  3978 consensus_meta.cc:287] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.002s
I20260709 13:01:14.432288  4197 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:14.513211  3738 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:14.514385  3738 consensus_queue.cc:1059] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:14.516959  4059 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:14.518899  3885 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:14.494016  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:14.523319  1689 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:14.523208  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:14.526795  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:14.527649  1688 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:14.502502  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:14.496984  1542 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
W20260709 13:01:14.504333  4183 log.cc:927] Time spent T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 13:01:14.504688  4188 log.cc:927] Time spent T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:01:14.511067  4031 consensus_queue.cc:237] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:14.546648  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:14.538738  1541 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:14.538563  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:14.527683  1689 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:14.568275  1693 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:14.497937  4067 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:14.500118  3879 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:14.573019  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:14.573824  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 247610us
I20260709 13:01:14.574985  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:14.576846  1689 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:01:14.577592  3675 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:14.577847  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:14.578176  3675 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:14.578521  1691 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:14.574637  2267 raft_consensus.cc:2410] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:14.580359  3675 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:14.519266  4095 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:14.540743  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:14.541931  4062 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:14.588197  3879 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:14.589457  4159 log.cc:927] Time spent T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.381s	user 0.000s	sys 0.004s
I20260709 13:01:14.589792  4067 raft_consensus.cc:3055] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:14.591172  4033 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:14.592514  2231 leader_election.cc:336] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.949s (SENT)
I20260709 13:01:14.607626  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:14.614313  4067 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:14.619710  4067 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:14.621785  4067 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:14.625837  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1388) took 1873 ms. Trace:
W20260709 13:01:14.629854  4165 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.730s	user 0.000s	sys 0.002s
I20260709 13:01:14.631624  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 521) took 2113 ms. Trace:
W20260709 13:01:14.632664  4190 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:01:14.632288  2271 rpcz_store.cc:276] 0709 13:01:12.518244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.655945 (+137701us) service_pool.cc:224] Handling call
0709 13:01:12.682979 (+ 27034us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.744405 (+ 61426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.744439 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.246774 (+502335us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.607689 (+360915us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:13.607727 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.607795 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.628663 (+1020868us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:14.631153 (+  2490us) raft_consensus.cc:1685] finished
0709 13:01:14.631176 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.631509 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9187,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":9085,"spinlock_wait_cycles":12199808,"thread_start_us":231649,"threads_started":1,"wal-append.queue_time_us":438618}
I20260709 13:01:14.653910  1545 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:14.656489  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:14.660916  4046 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:14.665279  1586 leader_election.cc:336] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 3.221s (SENT)
I20260709 13:01:14.665982  1586 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:14.667793  4046 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:14.659052  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:14.670594  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:14.671311  1545 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:14.672264  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:14.626474  1618 rpcz_store.cc:276] 0709 13:01:12.756765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.399890 (+643125us) service_pool.cc:224] Handling call
0709 13:01:13.420087 (+ 20197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.597971 (+177884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.598016 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.611377 (+ 13361us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.075477 (+464100us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:14.075541 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.625261 (+549720us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400115154. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:14.625333 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.625402 (+    69us) raft_consensus.cc:1685] finished
0709 13:01:14.625423 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.625747 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10348,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":4962,"spinlock_wait_cycles":296850176,"thread_start_us":422388,"threads_started":1,"wal-append.queue_time_us":457083}
I20260709 13:01:14.679874  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:14.680905  1547 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
W20260709 13:01:14.684314  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 149771us
I20260709 13:01:14.685983  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1438) took 1046 ms. Trace:
I20260709 13:01:14.691020  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:14.695516  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.699842  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 107341us
I20260709 13:01:14.702579  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:14.704388  1545 raft_consensus.cc:2410] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:14.703403  1547 raft_consensus.cc:2393] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:14.710991  2231 leader_election.cc:336] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.952s (SENT)
I20260709 13:01:14.711618  2231 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:14.687631  4043 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:14.723508  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:14.724745  1546 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:14.736259  4178 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.518s	user 0.003s	sys 0.000s
I20260709 13:01:14.737165  3939 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:14.740407  4021 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:14.740653  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.741060  4021 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:14.744843  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.750130  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:14.751610  1545 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:14.760802  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:14.761950  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 67447.1us
I20260709 13:01:14.762234  1545 raft_consensus.cc:2393] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:14.743961  4021 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:14.770202  3978 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:14.770084  3801 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:14.784332  4064 raft_consensus.cc:3055] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:14.784454  3801 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:14.750098  4059 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.788122  4059 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:14.789953  4210 log.cc:927] Time spent T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.134s	user 0.003s	sys 0.000s
I20260709 13:01:14.785126  4064 raft_consensus.cc:740] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:14.793376  4064 consensus_queue.cc:260] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:14.794875  4170 log.cc:927] Time spent T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.829s	user 0.000s	sys 0.002s
I20260709 13:01:14.794440  4043 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:14.795620  4043 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:14.775869  4211 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:14.820226  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:14.821638  1543 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:14.823071  4021 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.749732  3675 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.795248  4064 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:14.822950  3903 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.782771  3978 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:14.817600  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54504 (request call id 443) took 1575 ms. Trace:
I20260709 13:01:14.825273  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2373) took 1410 ms. Trace:
I20260709 13:01:15.170608  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 341) took 1044 ms. Trace:
W20260709 13:01:15.203685  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:15.000124  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1430) took 1954 ms (client timeout 2095 ms). Trace:
W20260709 13:01:15.063814  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:15.203579  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 436098us
I20260709 13:01:15.007540  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1490) took 1026 ms. Trace:
I20260709 13:01:14.836962  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.206614  1621 rpcz_store.cc:276] 0709 13:01:13.981361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.026942 (+ 45581us) service_pool.cc:224] Handling call
0709 13:01:14.027364 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.123814 (+ 96450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.123875 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.123953 (+    78us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:14.124009 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.007274 (+883265us) spinlock_profiling.cc:243] Waited 88.3 ms on lock 0x7b5400068954. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:15.007323 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.007484 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203117824}
I20260709 13:01:14.689208  1539 rpcz_store.cc:276] 0709 13:01:13.639619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.645535 (+  5916us) service_pool.cc:224] Handling call
0709 13:01:13.699258 (+ 53723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.709300 (+ 10042us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:14.433393 (+724093us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.685627 (+252234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.685693 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:14.685746 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.685810 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.685927 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1597,"prepare.queue_time_us":875701,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":87,"raft.queue_time_us":83,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5063,"thread_start_us":772301,"threads_started":2}
I20260709 13:01:15.063792  1546 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
W20260709 13:01:15.006039  1663 connection.cc:256] RPC call timeout handler was delayed by -1.0271130230000267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 13:01:14.958524  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.210098  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:14.822907  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:14.999612  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.844856  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1483) took 2275 ms. Trace:
W20260709 13:01:14.892097  2231 leader_election.cc:336] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.099s (SENT)
I20260709 13:01:15.213546  1619 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:15.200181  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 436522us
I20260709 13:01:15.203579  1540 rpcz_store.cc:276] 0709 13:01:14.125897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.126030 (+   133us) service_pool.cc:224] Handling call
0709 13:01:14.126422 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.208185 (+ 81763us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:14.427159 (+218974us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.711522 (+284363us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.715758 (+  4236us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.715942 (+   184us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:14.715982 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.716065 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.170330 (+454265us) raft_consensus.cc:1685] finished
0709 13:01:15.170359 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.170531 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32471,"prepare.queue_time_us":407151,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":31068,"raft.run_cpu_time_us":546,"raft.run_wall_time_us":94780,"thread_start_us":340701,"threads_started":2,"wal-append.queue_time_us":538616}
W20260709 13:01:15.205194  1541 rpcz_store.cc:269] 0709 13:01:13.045553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.353728 (+308175us) service_pool.cc:224] Handling call
0709 13:01:14.999874 (+1646146us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b54000a73d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:15.000045 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257077504}
W20260709 13:01:14.923961  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 51940.7us
I20260709 13:01:15.219588  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:15.219477  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:15.201085  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.211555  1622 rpcz_store.cc:276] 0709 13:01:12.569317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.825002 (+255685us) service_pool.cc:224] Handling call
0709 13:01:12.931868 (+106866us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.240964 (+309096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.240995 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.341812 (+100817us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.866847 (+525035us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:13.924915 (+ 58068us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.925685 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.925797 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.840603 (+914806us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b18002acdc0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:01:14.844469 (+  3866us) raft_consensus.cc:1685] finished
0709 13:01:14.844601 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.844781 (+   180us) inbound_call.cc:177] Queueing success response
0709 13:01:14.850002 (+  5221us) spinlock_profiling.cc:243] Waited 9.87 ms on lock 0x7b18002acdc0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
Metrics: {"mutex_wait_us":6438,"prepare.queue_time_us":58824,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":204165,"raft.run_cpu_time_us":631,"raft.run_wall_time_us":629,"spinlock_wait_cycles":29146880,"thread_start_us":460946,"threads_started":1,"wal-append.queue_time_us":574913}
I20260709 13:01:15.244481  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:15.223537  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2291) took 1061 ms. Trace:
I20260709 13:01:15.246407  1545 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:15.218502  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2292) took 1055 ms. Trace:
I20260709 13:01:15.247653  1547 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:14.849045  4173 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.842s	user 0.003s	sys 0.000s
I20260709 13:01:15.249452  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.253826  1621 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:15.254603  1546 raft_consensus.cc:2376] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7. Re-sending same reply.
I20260709 13:01:15.254801  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:15.246753  1543 rpcz_store.cc:276] 0709 13:01:14.162626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.822573 (+659947us) service_pool.cc:224] Handling call
0709 13:01:15.223477 (+400904us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.249984  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 342) took 1096 ms. Trace:
W20260709 13:01:15.200394  4075 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.235s	user 0.006s	sys 0.011s
W20260709 13:01:15.257706  1661 connection.cc:256] RPC call timeout handler was delayed by -3.0012554779999618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26720000000000005s for a response
W20260709 13:01:15.193922  4067 consensus_meta.cc:287] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.572s	user 0.007s	sys 0.008s
W20260709 13:01:15.160995  4171 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.191s	user 0.020s	sys 0.025s
W20260709 13:01:15.013805  4202 log.cc:927] Time spent T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.497s	user 0.000s	sys 0.003s
I20260709 13:01:15.247934  1548 rpcz_store.cc:276] 0709 13:01:14.162924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.836404 (+673480us) service_pool.cc:224] Handling call
0709 13:01:15.218434 (+382030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.256222  1544 rpcz_store.cc:276] 0709 13:01:14.126857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.127004 (+   147us) service_pool.cc:224] Handling call
0709 13:01:14.180581 (+ 53577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.295993 (+115412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.296027 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.307581 (+ 11554us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.576801 (+269220us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:14.576843 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.576908 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.789189 (+212281us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:14.791323 (+  2134us) raft_consensus.cc:1685] finished
0709 13:01:14.791344 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.223652 (+432308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27388,"raft.queue_time_us":88701,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":35979,"spinlock_wait_cycles":47377792,"thread_start_us":184120,"threads_started":1,"wal-append.queue_time_us":310866}
I20260709 13:01:15.258203  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:15.221762  4164 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:14.826649  4028 raft_consensus.cc:3055] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:14.992676  3801 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:14.836620  4059 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:15.285200  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 526730us
W20260709 13:01:14.907070  4209 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.250s	user 0.000s	sys 0.004s
I20260709 13:01:15.169147  3973 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:15.263772  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:15.260236  4075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.300s	user 0.009s	sys 0.011s
I20260709 13:01:15.290139  1540 raft_consensus.cc:2393] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:14.999099  1446 catalog_manager.cc:5697] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 4 to 5, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 5 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.216529  3972 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:15.022624  4043 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:14.906106  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 633) took 1189 ms. Trace:
I20260709 13:01:15.266772  1619 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:15.192152  4104 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:15.016914  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:15.303251  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:15.272536  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:15.304503  4075 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:15.274178  3963 consensus_queue.cc:1059] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:15.269471  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:15.305476  1539 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:15.306433  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.288362  4030 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:15.203341  1696 rpcz_store.cc:276] 0709 13:01:13.539594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.547832 (+  8238us) service_pool.cc:224] Handling call
0709 13:01:13.616678 (+ 68846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.636070 (+ 19392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.636111 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.651843 (+ 15732us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.833386 (+181543us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:13.833424 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.833505 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.794097 (+960592us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:14.824992 (+ 30895us) raft_consensus.cc:1685] finished
0709 13:01:14.825012 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.825214 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":182136,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"spinlock_wait_cycles":7099776,"thread_start_us":166440,"threads_started":1,"wal-append.queue_time_us":231451}
I20260709 13:01:15.264673  3951 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:15.298617  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.300155  1545 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
W20260709 13:01:15.318318  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.319749  1544 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:15.284523  4028 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:01:15.323077  2231 leader_election.cc:336] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.147s (SENT)
W20260709 13:01:15.324240  2231 leader_election.cc:336] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.184s (SENT)
I20260709 13:01:15.237797  3903 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:15.275218  4211 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:01:15.209417  2265 rpcz_store.cc:276] 0709 13:01:13.241782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.246519 (+  4737us) service_pool.cc:224] Handling call
0709 13:01:13.413501 (+166982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.621597 (+208096us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:14.503953 (+882356us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.809754 (+305801us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.817117 (+  7363us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.817189 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:14.817256 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.817350 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.817518 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7734,"raft.queue_time_us":32369,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":5251,"thread_start_us":152968,"threads_started":2,"wal-append.queue_time_us":151069}
I20260709 13:01:15.304466  2264 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:15.277341  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:15.264748  4171 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.295s	user 0.025s	sys 0.025s
W20260709 13:01:15.307633  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.222893  3675 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:15.309365  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2285) took 1163 ms. Trace:
I20260709 13:01:15.313872  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.339251  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2295) took 1035 ms. Trace:
I20260709 13:01:15.339152  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:15.316555  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:15.287719  4021 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:15.339793  1541 rpcz_store.cc:276] 0709 13:01:14.331196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.313497 (+982301us) service_pool.cc:224] Handling call
0709 13:01:15.339186 (+ 25689us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.341508  1540 rpcz_store.cc:276] 0709 13:01:14.145869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.306039 (+1160170us) service_pool.cc:224] Handling call
0709 13:01:15.309275 (+  3236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.301492  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.325152  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.335338  1546 raft_consensus.cc:2410] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:15.327729  2263 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:15.348917  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.286257  4164 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:15.351887  4164 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:15.353780  2271 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:15.327212  4075 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.355193  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:15.355122  4075 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:15.356199  1619 raft_consensus.cc:2393] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 3: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:15.322120  4030 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:15.360496  4030 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:15.357788  4075 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:15.292243  3972 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:15.364180  3972 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:15.364842  2268 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:15.366201  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 401) took 1279 ms. Trace:
I20260709 13:01:15.366568  1616 rpcz_store.cc:276] 0709 13:01:14.087195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.091267 (+  4072us) service_pool.cc:224] Handling call
0709 13:01:14.108917 (+ 17650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.127014 (+ 18097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.127054 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.143672 (+ 16618us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.368475 (+224803us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:14.368526 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.368592 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.012940 (+644348us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:15.365880 (+352940us) raft_consensus.cc:1685] finished
0709 13:01:15.365906 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.366139 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7904,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":33823,"spinlock_wait_cycles":10400512,"thread_start_us":75660,"threads_started":1,"wal-append.queue_time_us":289554}
I20260709 13:01:15.372995  2234 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:15.375319  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.381376  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:15.381716  1588 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:15.385802  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 61584.8us
I20260709 13:01:15.382421  1616 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:15.401471  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.402187  1544 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:15.301891  2267 rpcz_store.cc:276] 0709 13:01:13.716300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.737416 (+ 21116us) service_pool.cc:224] Handling call
0709 13:01:14.905800 (+1168384us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54006261d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:14.906016 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541713792}
I20260709 13:01:15.399067  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:15.404567  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.404910  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.406700  1544 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:01:15.387001  3951 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:15.408741  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.409521  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.409750  3675 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:15.415896  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.416615  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.316076  4104 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:15.418506  1547 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:15.421737  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2294) took 1137 ms. Trace:
I20260709 13:01:15.424634  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2293) took 1201 ms. Trace:
I20260709 13:01:15.427217  1548 rpcz_store.cc:276] 0709 13:01:14.226484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.394695 (+1168211us) service_pool.cc:224] Handling call
0709 13:01:15.424529 (+ 29834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.426946  1546 rpcz_store.cc:276] 0709 13:01:14.285789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.398205 (+1112416us) service_pool.cc:224] Handling call
0709 13:01:15.421680 (+ 23475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1642112}
W20260709 13:01:15.437255  2231 leader_election.cc:336] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.428s (SENT)
I20260709 13:01:15.384308  3972 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:01:15.447500  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:15.419939  3951 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:15.448648  1541 raft_consensus.cc:2410] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:15.450232  2231 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:15.382958  4028 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:15.457369  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.461769  1548 raft_consensus.cc:2410] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:15.451696  3951 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:15.471529  1542 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:01:15.465008  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2299) took 1055 ms. Trace:
I20260709 13:01:15.480939  1548 rpcz_store.cc:276] 0709 13:01:14.409232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.445894 (+1036662us) service_pool.cc:224] Handling call
0709 13:01:15.464913 (+ 19019us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.466621  4028 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:15.547967  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 128870us
I20260709 13:01:15.488113  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.550952  1541 raft_consensus.cc:2410] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:15.551681  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2280) took 1423 ms. Trace:
I20260709 13:01:15.552175  1541 rpcz_store.cc:276] 0709 13:01:14.129562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.461370 (+1331808us) service_pool.cc:224] Handling call
0709 13:01:15.551589 (+ 90219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.497262  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.481928  3972 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:15.580469  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.581393  1545 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
W20260709 13:01:15.589967  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 380240us
I20260709 13:01:15.468643  4211 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:01:15.635444  1663 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:15.633020  1446 catalog_manager.cc:5697] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 3 to 5, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 5 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:15.638757  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:15.642325  1541 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:15.643087  1540 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:15.643791  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2290) took 1481 ms. Trace:
I20260709 13:01:15.644101  1540 rpcz_store.cc:276] 0709 13:01:14.162270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.572721 (+1410451us) service_pool.cc:224] Handling call
0709 13:01:15.634624 (+ 61903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.643506 (+  8882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.643735 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:15.648466  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 358697us
I20260709 13:01:15.652525  1545 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:15.653820  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 345) took 1479 ms. Trace:
I20260709 13:01:15.654359  1545 rpcz_store.cc:276] 0709 13:01:14.174433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.643298 (+1468865us) service_pool.cc:224] Handling call
0709 13:01:15.652181 (+  8883us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.653250 (+  1069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.653719 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.670604  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 347) took 1371 ms. Trace:
I20260709 13:01:15.671229  1541 rpcz_store.cc:276] 0709 13:01:14.298957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.647467 (+1348510us) service_pool.cc:224] Handling call
0709 13:01:15.670010 (+ 22543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.670180 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.670209 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:15.670265 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:15.670308 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.670376 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.670528 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.692653  1545 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:15.694314  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 348) took 1395 ms. Trace:
I20260709 13:01:15.695202  1545 rpcz_store.cc:276] 0709 13:01:14.299317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.681747 (+1382430us) service_pool.cc:224] Handling call
0709 13:01:15.692043 (+ 10296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.693878 (+  1835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.694224 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:15.700251  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 265589us
W20260709 13:01:15.702905  1586 leader_election.cc:336] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.724s (SENT)
W20260709 13:01:15.703831  1586 leader_election.cc:336] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.725s (SENT)
I20260709 13:01:15.710630  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 349) took 1351 ms. Trace:
I20260709 13:01:15.689349  4171 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:15.699927  3963 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:15.680560  4075 consensus_queue.cc:1059] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:01:15.728634  1539 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
I20260709 13:01:15.734627  1544 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:15.690047  3978 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:15.712466  4021 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:15.711737  1545 rpcz_store.cc:276] 0709 13:01:14.359435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.696697 (+1337262us) service_pool.cc:224] Handling call
0709 13:01:15.709574 (+ 12877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.709801 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.709838 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:15.709894 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:15.709938 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.710200 (+   262us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.710553 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:15.738013  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.718148  4171 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.718217  4043 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:15.734579  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1448) took 1132 ms. Trace:
I20260709 13:01:15.634462  1547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:01:15.753175  1547 raft_consensus.cc:606] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:15.753739  1547 raft_consensus.cc:614] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:15.736259  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 456189us
I20260709 13:01:15.755211  1539 rpcz_store.cc:276] 0709 13:01:14.602106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.259651 (+657545us) service_pool.cc:224] Handling call
0709 13:01:15.734495 (+474844us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.731880  3963 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.760861  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41606 (request call id 6) took 1249 ms. Trace:
I20260709 13:01:15.708990  4118 consensus_queue.cc:1059] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:01:15.741493  4171 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:15.739948  3879 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.773252  4211 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:15.773123  3879 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:15.783757  4104 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:15.761286  1547 rpcz_store.cc:276] 0709 13:01:14.505063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.567866 (+1062803us) service_pool.cc:224] Handling call
0709 13:01:15.754271 (+186405us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:15.787593  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.764484  3963 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:15.788004  1547 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:15.790906  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1458) took 1076 ms. Trace:
I20260709 13:01:15.791329  1547 rpcz_store.cc:276] 0709 13:01:14.714964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.786005 (+1071041us) service_pool.cc:224] Handling call
0709 13:01:15.786945 (+   940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.790418 (+  3473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.790797 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.771536  4225 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:15.794309  4064 consensus_meta.cc:287] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.571s	user 0.012s	sys 0.001s
I20260709 13:01:15.762609  1587 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:01:15.844657  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 82210.2us
I20260709 13:01:15.845808  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:15.757640  1513 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:15.803241  1543 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:01:15.836529  3879 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:15.794193  4171 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:15.851543  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 94803us
I20260709 13:01:15.855042  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:15.855664  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 152965us
W20260709 13:01:15.857402  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:15.850858  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 210803us
I20260709 13:01:15.857626  1545 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
W20260709 13:01:15.865504  1661 leader_election.cc:336] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.942s (SENT)
I20260709 13:01:15.869131  1539 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:15.871050  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 350) took 1375 ms. Trace:
I20260709 13:01:15.865947  1545 pending_rounds.cc:85] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 2
I20260709 13:01:15.890544  1545 pending_rounds.cc:107] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:01:15.891115  1545 raft_consensus.cc:2889] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.892022  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1446) took 1290 ms. Trace:
I20260709 13:01:15.892489  1545 rpcz_store.cc:276] 0709 13:01:14.601373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.759257 (+1157884us) service_pool.cc:224] Handling call
0709 13:01:15.759663 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.891717 (+132054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.891969 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:15.896838  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 222279us
W20260709 13:01:15.904844  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 49899.9us
I20260709 13:01:15.904273  1663 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:15.906270  1587 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:15.907054  1545 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:15.917824  1545 pending_rounds.cc:85] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 2
I20260709 13:01:15.919950  1545 pending_rounds.cc:107] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:15.911731  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:15.855362  3978 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:15.915100  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.924997  1545 raft_consensus.cc:2889] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.901786  1539 rpcz_store.cc:276] 0709 13:01:14.495274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.764064 (+1268790us) service_pool.cc:224] Handling call
0709 13:01:15.856714 (+ 92650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.870789 (+ 14075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.870997 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.910764  1547 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:15.853513  4228 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:15.922041  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:15.930675  4228 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.931223  4228 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:15.933100  4171 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:15.939622  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1461) took 1188 ms. Trace:
I20260709 13:01:15.941263  3903 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:15.945184  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:15.945960  2267 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:15.946846  4067 raft_consensus.cc:3055] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:15.947348  4067 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:15.948240  4230 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:15.948808  4230 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:15.948513  4067 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:15.949198  4230 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:15.949596  4067 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:15.921890  4238 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:15.927142  3978 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:15.953047  3978 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:15.955180  3972 raft_consensus.cc:3055] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:15.956635  3972 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:15.957588  3972 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:15.958595  3972 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:15.916414  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 62152.1us
I20260709 13:01:15.903141  4045 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:15.963795  4045 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:15.880138  4225 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:15.964094  1513 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:15.966957  4045 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:15.929188  3879 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.972995  3903 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:15.973570  3903 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.973937  3903 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:15.976145  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:15.977288  3879 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:15.981832  4226 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.982553  4226 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:15.967110  4225 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:15.990803  1661 leader_election.cc:336] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.122s (SENT)
I20260709 13:01:15.994412  3675 raft_consensus.cc:1064] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:01:15.995374  3879 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:15.997691  4230 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:15.869006  4064 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:15.940582  1547 rpcz_store.cc:276] 0709 13:01:14.751371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.870902 (+1119531us) service_pool.cc:224] Handling call
0709 13:01:15.909545 (+ 38643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.930303 (+ 20758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.939503 (+  9200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:15.991322  1661 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:15.965929  1446 catalog_manager.cc:5697] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 4 to 5, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 5 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:15.987197  4226 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:16.024070  1548 raft_consensus.cc:2410] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:16.025558  4240 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:16.027700  4244 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:16.028095  1446 catalog_manager.cc:5697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.032616  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 344) took 1882 ms. Trace:
I20260709 13:01:16.033355  1544 rpcz_store.cc:276] 0709 13:01:14.149883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.570366 (+1420483us) service_pool.cc:224] Handling call
0709 13:01:15.734448 (+164082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.735238 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.032080 (+296842us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54000a82d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:16.032301 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376366976}
I20260709 13:01:16.035135  1544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "953db44baef24f55a28e65ff051866d1"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:01:16.039134  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:16.070621  1587 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:15.994864  3963 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:16.028456  4109 consensus_queue.cc:1059] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:01:15.947484  4228 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:16.029753  4244 raft_consensus.cc:697] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:16.066932  4211 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:16.016909  4064 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:16.104537  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.106194  1619 raft_consensus.cc:2410] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:16.111610  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:16.099772  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.003s	sys 0.023s
W20260709 13:01:16.100966  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 110271us
I20260709 13:01:16.106244  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:16.113026  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.003s	sys 0.023s
I20260709 13:01:16.113860  1621 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 3.
W20260709 13:01:16.113876  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 736704us
I20260709 13:01:16.086179  4225 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:16.118845  1618 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:16.123805  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.097050  4218 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:16.126932  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.124593  1622 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:16.130661  1614 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
W20260709 13:01:16.135370  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52838 (request call id 252) took 12109 ms (client timeout 15000 ms). Trace:
I20260709 13:01:16.138317  3939 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.138487  1618 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:16.139068  4064 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:16.138911  3939 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:16.139503  4230 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:16.111956  3879 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:01:16.160218  3675 consensus_queue.cc:237] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:16.136720  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53706 (request call id 8) took 1445 ms. Trace:
I20260709 13:01:16.148432  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.161650  1545 rpcz_store.cc:276] 0709 13:01:14.683508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.048335 (+1364827us) service_pool.cc:224] Handling call
0709 13:01:16.129028 (+ 80693us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:16.097774  3903 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:16.163816  3903 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:16.156713  4227 raft_consensus.cc:3055] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:16.164768  4227 raft_consensus.cc:740] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:16.165663  4227 consensus_queue.cc:260] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:16.158004  4244 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:16.161981  1618 raft_consensus.cc:2368] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
W20260709 13:01:16.135897  1442 rpcz_store.cc:269] 0709 13:01:03.849562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.849929 (+   367us) service_pool.cc:224] Handling call
0709 13:01:15.959281 (+12109352us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:10.275927 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:10.516624 (+240697us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:10.525032 (+  8408us) write_op.cc:435] Acquired schema lock
0709 13:01:10.526810 (+  1778us) tablet.cc:662] Decoding operations
0709 13:01:10.708447 (+181637us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:10.719544 (+ 11097us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:10.719575 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:01:10.720211 (+   636us) tablet.cc:701] Row locks acquired
0709 13:01:10.720227 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:01:10.720379 (+   152us) write_op.cc:270] Start()
0709 13:01:10.720525 (+   146us) write_op.cc:276] Timestamp: P: 1783602070720333 usec, L: 0
0709 13:01:10.720543 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:01:10.731203 (+ 10660us) log.cc:844] Serialized 2089 byte log entry
0709 13:01:11.863386 (+1132183us) op_driver.cc:464] REPLICATION: finished
0709 13:01:12.279813 (+416427us) write_op.cc:301] APPLY: starting
0709 13:01:12.280006 (+   193us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:12.280286 (+   280us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:12.280488 (+   202us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:12.318729 (+ 38241us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:12.319156 (+   427us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:01:12.319212 (+    56us) write_op.cc:312] APPLY: finished
0709 13:01:12.375461 (+ 56249us) log.cc:844] Serialized 47 byte log entry
0709 13:01:12.429449 (+ 53988us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:12.503779 (+ 74330us) write_op.cc:454] Released schema lock
0709 13:01:12.510449 (+  6670us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:12.511248 (+   799us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:12.511289 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45368,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":391875,"apply.run_cpu_time_us":5741,"apply.run_wall_time_us":231452,"num_ops":5,"prepare.queue_time_us":689096,"prepare.run_cpu_time_us":36168,"prepare.run_wall_time_us":583358,"raft.queue_time_us":474056,"raft.run_cpu_time_us":23085,"raft.run_wall_time_us":443217,"replication_time_us":1123789,"thread_start_us":1176282,"threads_started":4,"wal-append.queue_time_us":204608,"wal-append.run_cpu_time_us":16314,"wal-append.run_wall_time_us":2629809}]]}
I20260709 13:01:16.167116  4227 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:16.176458  1661 connection.cc:256] RPC call timeout handler was delayed by -2.6358554779999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3078s for a response
W20260709 13:01:16.177011  1494 auto_rebalancer.cc:629] Failed to schedule move for tablet 71ae78eb08484929a4e2f3128c3b5f34: Illegal state: Replica 44c8c572048a40b1a5e71865068ed1bb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
W20260709 13:01:16.177560  1661 connection.cc:256] RPC call timeout handler was delayed by -1.5249872819999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 13:01:16.178149  1661 connection.cc:256] RPC call timeout handler was delayed by -1.2954872820000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 13:01:16.178462  1661 connection.cc:256] RPC call timeout handler was delayed by -1.2333872819999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260709 13:01:16.178761  1661 connection.cc:256] RPC call timeout handler was delayed by -1.2234872820000078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
I20260709 13:01:16.181339  4247 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.182173  4247 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:16.182602  4241 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.182691  3939 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:16.183717  3939 raft_consensus.cc:3055] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:16.184129  3939 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:16.185473  3939 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:16.154646  4228 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:16.179194  1661 connection.cc:256] RPC call timeout handler was delayed by -1.2063872819999801s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
I20260709 13:01:16.213042  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2282) took 2068 ms. Trace:
I20260709 13:01:16.214435  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:16.216424  3951 consensus_meta.cc:287] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.003s
I20260709 13:01:16.213517  1542 rpcz_store.cc:276] 0709 13:01:14.144852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.569502 (+1424650us) service_pool.cc:224] Handling call
0709 13:01:15.635635 (+ 66133us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.645221 (+  9586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.645262 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.651856 (+  6594us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.046369 (+394513us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:16.046425 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.046549 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.212807 (+166258us) raft_consensus.cc:1685] finished
0709 13:01:16.212828 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.212982 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":21164,"thread_start_us":343391,"threads_started":1,"wal-append.queue_time_us":525266}
I20260709 13:01:16.216594  4247 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:16.216984  3951 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:16.209950  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 346) took 2024 ms. Trace:
I20260709 13:01:16.214980  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:16.221222  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.223891  2264 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:16.225975  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.218523  1540 rpcz_store.cc:276] 0709 13:01:14.185614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.644914 (+1459300us) service_pool.cc:224] Handling call
0709 13:01:15.669036 (+ 24122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.669312 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:15.854122 (+184810us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.209311 (+355189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.209491 (+   180us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:16.209566 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.209645 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.209861 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":441899,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":73,"raft.queue_time_us":1857,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":493993,"threads_started":2}
W20260709 13:01:16.213040  4236 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.472s	user 0.007s	sys 0.000s
I20260709 13:01:16.229427  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:16.214564  1661 connection.cc:256] RPC call timeout handler was delayed by -1.1820872819999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
W20260709 13:01:16.231159  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.232021  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:16.240931  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.249944  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:16.252686  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 271461us
I20260709 13:01:16.258555  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:16.259821  1542 raft_consensus.cc:2393] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:16.266436  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:16.183314  4241 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:16.262128  4028 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.271337  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:16.272279  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:16.273878  1545 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:16.275979  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:16.280663  1542 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:16.281320  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:16.283774  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2281) took 2139 ms. Trace:
I20260709 13:01:16.284313  1546 rpcz_store.cc:276] 0709 13:01:14.144504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.568542 (+1424038us) service_pool.cc:224] Handling call
0709 13:01:15.635139 (+ 66597us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:15.679580 (+ 44441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.679634 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:15.701429 (+ 21795us) log.cc:844] Serialized 52 byte log entry
0709 13:01:16.042251 (+340822us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:16.042293 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.042366 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.283459 (+241093us) raft_consensus.cc:1685] finished
0709 13:01:16.283493 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.283695 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2391,"raft.queue_time_us":10497,"raft.run_cpu_time_us":453,"raft.run_wall_time_us":18174,"thread_start_us":304658,"threads_started":1,"wal-append.queue_time_us":502458}
I20260709 13:01:16.251268  4111 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.269585  2232 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:16.279645  1547 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:16.298168  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:16.299203  1545 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:16.299892  1586 leader_election.cc:336] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.722s (SENT)
I20260709 13:01:16.300661  1586 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:16.301008  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:16.307374  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:16.298226  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 394049us
I20260709 13:01:16.311273  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:16.320122  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.333317  1621 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:16.333169  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:16.316794  1661 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:16.338279  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:16.338802  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.339128  1546 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:16.340339  1622 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:16.341115  1586 leader_election.cc:336] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.736s (SENT)
I20260709 13:01:16.343092  1619 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:01:16.344722  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.345055  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:16.342989  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 423597us
I20260709 13:01:16.350370  1618 raft_consensus.cc:2410] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:01:16.351670  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.358130  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:16.359059  1547 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:16.362512  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:16.345889  1622 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:16.323733  3879 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:16.337474  4250 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.373001  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.378415  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:16.380523  1546 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
W20260709 13:01:16.382874  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 76001.9us
I20260709 13:01:16.388605  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.379769  1618 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:16.385387  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.385826  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.390569  1617 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:16.385988  1620 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:16.390925  1544 raft_consensus.cc:606] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:16.389894  1615 raft_consensus.cc:2410] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:16.391958  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:16.296545  4028 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:16.393399  1540 raft_consensus.cc:2393] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:16.388830  1661 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:16.346429  3951 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:16.383036  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:16.411880  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.366528  4249 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:01:16.394502  4225 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:16.415827  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:16.416025  1614 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
W20260709 13:01:16.397471  1586 leader_election.cc:336] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.807s (SENT)
I20260709 13:01:16.417309  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:16.428869  1618 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:16.418318  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.424508  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:16.425981  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:16.429701  1621 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:16.433333  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:16.375185  4227 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:16.434921  4254 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:16.443169  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:16.444244  4245 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:01:16.444425  1540 raft_consensus.cc:2410] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:01:16.447793  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.451912  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.452852  1623 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:16.394910  4250 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:16.455823  1619 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:16.462430  4241 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:16.463299  3951 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:16.311353  4111 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:16.467765  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 85614.8us
W20260709 13:01:16.435907  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 47255.1us
W20260709 13:01:16.468745  1662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.009s	sys 0.020s
W20260709 13:01:16.478394  1662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.010s	sys 0.020s
I20260709 13:01:16.478704  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:16.479763  1548 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:16.476512  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.483081  1619 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:16.487088  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:16.489089  1692 raft_consensus.cc:2410] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:16.497763  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.427248  3972 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 13:01:16.499379  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.490774  4211 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:16.441175  4225 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:16.535518  1586 leader_election.cc:336] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.936s (SENT)
W20260709 13:01:16.538852  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 240403us
W20260709 13:01:16.517123  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 368855us
I20260709 13:01:16.484943  3951 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:01:16.546324  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:16.549670  1619 raft_consensus.cc:2410] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:16.551167  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.545993  2234 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:16.562919  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 71784.4us
I20260709 13:01:16.565138  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.565424  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 356) took 1200 ms. Trace:
I20260709 13:01:16.566008  1541 rpcz_store.cc:276] 0709 13:01:15.364982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.997029 (+632047us) service_pool.cc:224] Handling call
0709 13:01:15.997601 (+   572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.997920 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:16.381587 (+383667us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.564975 (+183388us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.565058 (+    83us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:16.565117 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.565202 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.565352 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142539,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":556040,"threads_started":2}
I20260709 13:01:16.578907  1621 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:16.573630  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:16.579707  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 355) took 1267 ms. Trace:
I20260709 13:01:16.581024  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:16.580314  1543 rpcz_store.cc:276] 0709 13:01:15.312827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.970307 (+657480us) service_pool.cc:224] Handling call
0709 13:01:16.008936 (+ 38629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.009441 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:16.376020 (+366579us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.579236 (+203216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.579307 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:16.579368 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.579509 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.579633 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8345,"prepare.queue_time_us":131203,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":560520,"threads_started":2}
I20260709 13:01:16.582182  1661 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:16.582818  4028 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:16.583945  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:16.584904  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:16.539142  4257 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:16.592571  1697 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:16.550920  4249 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:16.568909  4109 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:16.600667  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.607456  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.593331  4241 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:16.605283  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:16.606033  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:16.612957  1616 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:16.612936  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 354) took 1363 ms. Trace:
W20260709 13:01:16.589432  3978 consensus_meta.cc:287] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.631s	user 0.015s	sys 0.000s
I20260709 13:01:16.613444  1690 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:16.608206  1615 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:16.614488  1539 rpcz_store.cc:276] 0709 13:01:15.249456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.942922 (+693466us) service_pool.cc:224] Handling call
0709 13:01:15.943304 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.943599 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:16.393081 (+449482us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.612556 (+219475us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.612615 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:16.612661 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.612744 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.612872 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1269,"prepare.queue_time_us":171716,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":1840,"thread_start_us":666776,"threads_started":2}
I20260709 13:01:16.575822  2264 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:16.617978  1541 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:16.624969  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.625662  1614 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:16.626788  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.627395  1617 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:16.637375  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:16.638288  1620 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:16.651212  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.481739  4205 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:01:16.713701  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.612318  4109 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:16.728125  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:16.615309  4241 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:16.730499  1513 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:16.729058  1615 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:16.613804  4249 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:16.733363  1691 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:01:16.634644  4118 raft_consensus.cc:2764] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 13:01:16.737965  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 154080us
I20260709 13:01:16.615226  4261 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:16.693585  4227 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:16.746917  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.748009  1616 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:16.749255  1618 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:16.764004  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:16.730487  4109 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:16.625525  3978 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:16.773739  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 133121us
I20260709 13:01:16.740031  4241 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:16.610188  4257 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:16.793596  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 81333.4us
I20260709 13:01:16.784898  1691 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:16.787606  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:16.751717  4261 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.765527  4274 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:16.771534  4250 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:16.850078  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:16.793179  3939 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:16.858083  1622 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
W20260709 13:01:16.882365  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 111287us
I20260709 13:01:16.773290  4227 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:16.890244  4262 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
W20260709 13:01:16.892341  4269 log.cc:927] Time spent T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:01:16.846395  4261 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:16.903575  1548 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
W20260709 13:01:16.905444  4265 log.cc:927] Time spent T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:01:16.856511  4244 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:16.923688  4225 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:16.979610  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:16.856316  4111 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:16.917761  1695 raft_consensus.cc:2955] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:01:16.861006  4274 raft_consensus.cc:697] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:16.942296  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:16.941303  1691 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:17.001459  3963 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:17.001606  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:17.002730  1691 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:17.006127  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.007212  1691 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:16.942780  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:16.941825  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:16.979614  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 365050us
I20260709 13:01:17.008162  1688 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:17.008349  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:17.009770  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.989789  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 76986us
I20260709 13:01:16.958954  4227 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:17.014107  1661 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:17.016880  1694 raft_consensus.cc:2393] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:16.996518  4075 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:17.040309  1693 raft_consensus.cc:2410] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:17.037832  1620 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:17.043720  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:17.044641  4249 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:17.057042  2264 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:17.057884  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:16.976300  4254 consensus_queue.cc:1048] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:01:17.062294  4227 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:17.078327  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:17.065271  4274 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:17.068996  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:16.987231  4244 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:01:17.076134  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:17.080354  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.083025  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:17.093232  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.096925  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:17.080348  4254 consensus_queue.cc:1243] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:17.097747  1620 raft_consensus.cc:2376] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3. Re-sending same reply.
I20260709 13:01:17.101332  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:17.102002  1545 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
W20260709 13:01:17.100410  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 89173.1us
I20260709 13:01:17.080986  4227 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:17.113773  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:17.113667  2231 leader_election.cc:336] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.774s (SENT)
I20260709 13:01:17.101295  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:17.119305  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:17.120402  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:17.115549  2263 raft_consensus.cc:2393] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:17.122300  1548 raft_consensus.cc:2410] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:17.108430  4227 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:17.124593  1661 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:17.109933  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:17.128602  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:17.130218  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.128608  4240 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:17.132448  1696 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:17.134630  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.138399  1694 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:17.118333  4075 consensus_queue.cc:1059] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:01:17.128189  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:17.164379  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:17.166863  2232 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:17.167881  4279 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:17.168397  4279 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.168742  4279 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.134439  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:17.139506  4273 log.cc:927] Time spent T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:01:17.176700  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 51498.4us
W20260709 13:01:17.178764  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 65116.5us
I20260709 13:01:17.179307  1661 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:17.177000  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.180800  1694 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:01:17.181561  4254 raft_consensus.cc:3055] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:17.181949  4254 raft_consensus.cc:740] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:17.182258  2267 raft_consensus.cc:2410] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:17.182747  4254 consensus_queue.cc:260] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:17.183302  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:17.184170  4254 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.184671  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:17.185596  1620 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:17.200578  4300 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:17.201727  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.202620  1694 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
W20260709 13:01:17.204800  1514 leader_election.cc:336] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.878s (SENT)
W20260709 13:01:17.207237  4289 log.cc:927] Time spent T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:01:17.214144  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:17.217533  4279 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:17.220870  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.221575  4045 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:17.222987  1661 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:17.223395  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:17.224727  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:17.224897  1615 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:17.223816  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:17.225325  1622 raft_consensus.cc:2376] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5. Re-sending same reply.
I20260709 13:01:17.225768  1619 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:17.222105  4045 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:17.226230  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:17.226786  1661 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:17.227941  4045 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:17.231315  4300 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:17.231909  4300 raft_consensus.cc:697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:17.232609  4257 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:17.233085  4300 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:17.234887  4261 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:17.236011  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:17.236225  3978 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:17.236613  1547 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.233119  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:17.228415  4279 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:17.246483  1690 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.001s
I20260709 13:01:17.250485  1539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1f748970c74ef290462d25b2975815"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:01:17.250427  1661 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:17.251498  1539 raft_consensus.cc:606] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:17.247290  1690 raft_consensus.cc:2410] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:17.254390  4075 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:17.257800  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.259879  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:17.260918  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.261819  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.262131  4244 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:17.262472  1694 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:17.263460  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.264067  1696 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:01:17.267524  4045 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.268649  1539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:01:17.269973  1539 raft_consensus.cc:606] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:17.250363  4109 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:17.270274  1547 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:17.268605  4045 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:17.271162  2270 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.272552  4109 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:17.272663  4045 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:17.273896  1514 leader_election.cc:336] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.948s (SENT)
I20260709 13:01:17.275864  2232 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:17.273756  1588 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:17.274591  2234 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:17.290210  4211 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:17.291441  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:17.292991  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 44907.4us
W20260709 13:01:17.293418  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.294042  1661 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:17.294621  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:17.295720  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:17.296010  1618 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:17.296664  1620 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:01:17.299315  4111 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:17.300604  4109 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:17.301707  4109 raft_consensus.cc:697] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:17.302642  4109 consensus_queue.cc:237] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:17.295248  2270 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:17.304809  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.306933  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:17.306509  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.307670  2234 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:17.313004  1661 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:17.313824  1661 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:17.316035  4244 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:17.300400   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:01:17.296558  4296 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.110s	user 0.004s	sys 0.000s
I20260709 13:01:17.317688  1696 raft_consensus.cc:2410] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:17.323026  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:17.307724  1617 raft_consensus.cc:2376] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4. Re-sending same reply.
I20260709 13:01:17.299885  4111 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:17.316430  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:17.328606  1620 raft_consensus.cc:1240] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:17.335971  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.341009  1694 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:17.310532  4254 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:17.331067  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:17.319562  4075 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:17.346303  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:17.316669  4244 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:17.352182  1618 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.356179  1588 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:17.327261  4256 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:17.358355  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.362799  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.363760  1696 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:17.337441  4111 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:17.366928  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.368408  1690 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:01:17.370186  1511 leader_election.cc:336] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.521s (SENT)
I20260709 13:01:17.371845  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:17.342814  4294 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:17.374717  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 43731.5us
I20260709 13:01:17.368374  2234 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:17.380573  1618 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:17.381564  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:17.375497  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 51025.8us
I20260709 13:01:17.383033  1661 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:17.349354  2267 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:17.357976  4075 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:17.387248  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 165568us
I20260709 13:01:17.394219  2234 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:17.367688  4250 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:17.361786  4211 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:17.409687  4211 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:17.400417  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:17.358237  4244 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:17.405678  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:17.374212  4295 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:17.408281  1513 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:17.409077   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:17.413404  1696 raft_consensus.cc:2410] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:17.391661  3963 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:17.381358  4256 raft_consensus.cc:697] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:17.414635  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:17.415128  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.399259  2266 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 3 LEARNER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:01:17.403172  1586 leader_election.cc:336] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.071s (SENT)
I20260709 13:01:17.404634  4075 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:17.422039  1586 leader_election.cc:336] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.126s (SENT)
I20260709 13:01:17.405984  4302 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:17.429687  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.430712  1690 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:17.415083  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:17.416667  4292 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:17.417260  4295 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:17.421320  4274 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:17.441263  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 59751.3us
I20260709 13:01:17.442909  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.419255  3939 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:17.448215  1695 raft_consensus.cc:2410] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:17.448050  1587 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:01:17.495500  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 47565us
I20260709 13:01:17.496186  1587 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:17.496342  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.497473  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:17.497643  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:17.498647  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.498945  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:17.420902  3951 consensus_queue.cc:1059] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:01:17.499677  4250 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:17.500159  4250 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:17.500608  4250 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:17.502328  4294 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:17.503782  4225 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:17.437219  4300 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:17.445250  4295 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:17.476624  4256 consensus_queue.cc:237] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:17.436816  4254 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:01:17.445748  4274 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.484495  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:17.485033  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.422261  4211 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:17.486838  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:17.424620  4261 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:17.487701  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:17.488341  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.489382  1692 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:17.490513  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.494156  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:17.435818  4302 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:17.506172  1586 leader_election.cc:336] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.457s (SENT)
I20260709 13:01:17.504181  4225 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:17.521108  1694 raft_consensus.cc:2410] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:17.534471  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.504540  3939 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:17.512302  4300 raft_consensus.cc:697] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:17.528470  1586 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:17.528765  4302 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.529352  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.539197  1690 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:17.512799  3963 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:17.538242  3939 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:17.540823  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.524334  4274 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.541184  4300 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:17.530754  4227 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:17.554198  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 55307.8us
I20260709 13:01:17.576493  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.537267  4225 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.580646  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:17.577015  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 68562.4us
W20260709 13:01:17.577073  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 138830us
I20260709 13:01:17.594362  1661 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:17.594794  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.577356  1587 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:17.603991  1695 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:01:17.578002  4241 consensus_meta.cc:287] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.732s	user 0.012s	sys 0.000s
I20260709 13:01:17.607105  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:17.608006  1697 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:17.630400  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.601990  4317 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:17.633364  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 56725.4us
I20260709 13:01:17.634435  1587 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:17.628302  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.636417  1690 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:17.630491  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.637611  1697 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:17.601310  4254 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:01:17.644857  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:17.645519  4309 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:01:17.645532  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 139389us
I20260709 13:01:17.646349  4314 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:17.671922  1586 leader_election.cc:336] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.609s (SENT)
I20260709 13:01:17.613831  4241 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:17.672537  1586 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:17.672819  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 418) took 1071 ms. Trace:
W20260709 13:01:17.673682  1586 leader_election.cc:336] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.658s (SENT)
I20260709 13:01:17.674188  4241 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:17.610108  4244 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:17.673313  1623 rpcz_store.cc:276] 0709 13:01:16.601677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.601815 (+   138us) service_pool.cc:224] Handling call
0709 13:01:17.185802 (+583987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.186058 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:17.337506 (+151448us) log.cc:844] Serialized 14 byte log entry
0709 13:01:17.427500 (+ 89994us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:17.427559 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:17.427615 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.427686 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.671319 (+243633us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b18001899a0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a1f2a6 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4
0709 13:01:17.672669 (+  1350us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54000d20d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:17.672766 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71057,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":93,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":10098,"spinlock_wait_cycles":1301353216,"thread_start_us":239045,"threads_started":2,"wal-append.queue_time_us":186040}
I20260709 13:01:17.677610  4244 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:17.680696  1691 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:17.636946  4317 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.683933  4317 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:17.604265  4261 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:01:17.660805  4227 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:17.624886  4316 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:17.706023  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 111765us
I20260709 13:01:17.636173  4302 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:17.687264  4292 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:17.692164  1514 leader_election.cc:336] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.521s (SENT)
I20260709 13:01:17.713063  1514 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:17.647809  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.708575  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:17.717067  1689 raft_consensus.cc:2410] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:01:17.709870  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:17.711102  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:17.720594  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.725769  1695 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:17.727907  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:17.728494  4274 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:17.731912  4305 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:01:17.705453  4271 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.733222  4271 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:17.733799  4295 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:17.736215  1692 raft_consensus.cc:1240] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:17.740083  1690 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:17.740962  1691 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:17.751341  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.741338  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:17.745187  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 53086.3us
I20260709 13:01:17.759824  1696 raft_consensus.cc:2393] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:01:17.745793  1511 leader_election.cc:336] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.709s (SENT)
I20260709 13:01:17.748080  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:17.761053  1511 leader_election.cc:336] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.715s (SENT)
I20260709 13:01:17.753507  1697 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:17.761504  1511 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:17.767899  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.768785  1689 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:17.768134  1695 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:17.770982  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:17.723042  4292 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:17.736994  4308 log.cc:927] Time spent T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:01:17.780329  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:17.781482  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:17.789312  1539 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:17.789798  1693 raft_consensus.cc:2410] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:01:17.783062  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.784323  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.784508  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.791095  1692 raft_consensus.cc:2376] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 7. Re-sending same reply.
I20260709 13:01:17.794705  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:17.736780  4230 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:17.800071  1663 connection.cc:256] RPC call timeout handler was delayed by -2.3077876610000203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
I20260709 13:01:17.751392  4045 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:17.735391  4271 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:17.797721  1619 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:17.780606  1689 raft_consensus.cc:2393] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:17.814764  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:17.805572  1663 connection.cc:256] RPC call timeout handler was delayed by -2.1331885899999747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
I20260709 13:01:17.806562  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.758811  4274 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:17.809602  4045 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:17.809957  4302 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:17.816306  1663 connection.cc:256] RPC call timeout handler was delayed by -1.8621175680000306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
I20260709 13:01:17.834184  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.751152  3978 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:01:17.737620  3675 consensus_queue.cc:1059] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:01:17.801481  4316 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:17.788733  4064 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:01:17.814795  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:17.854081  1663 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:17.796130  4321 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:17.860662  1663 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:17.803264  3939 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:17.886162  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 100913us
I20260709 13:01:17.858137  3675 consensus_queue.cc:1243] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:17.868355  2266 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.878888  4256 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:17.913383  1586 leader_election.cc:336] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 3.112s (SENT)
I20260709 13:01:17.914127  1586 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:01:17.916371  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 55794.7us
I20260709 13:01:17.879572  4241 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:17.917209  1663 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:17.919926  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 158878us
I20260709 13:01:17.924325  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:17.907739  4295 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:17.867844  4250 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:17.938194  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:17.973066  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 59733.6us
I20260709 13:01:17.922282  4230 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:17.956622  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:17.986176  1586 leader_election.cc:336] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 3.142s (SENT)
W20260709 13:01:18.001300  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 62319.9us
I20260709 13:01:18.001730  1586 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:17.927034  4256 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:17.984964  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.010272  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:18.011220  1697 raft_consensus.cc:2376] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5. Re-sending same reply.
W20260709 13:01:17.961241  4310 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:18.003031  1689 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:18.008164  1618 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:01:17.945183  4111 consensus_meta.cc:287] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.560s	user 0.013s	sys 0.000s
I20260709 13:01:18.014456  4111 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:18.015498  1697 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:18.016848  4111 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:18.017202  1619 raft_consensus.cc:1240] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:17.938735  4315 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:18.020088  1511 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:18.025400  1511 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:17.965750  4323 log.cc:927] Time spent T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:18.035223  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.036031  1697 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:17.981964  4250 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:17.936231  4274 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.087s
W20260709 13:01:18.042439  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 125303us
I20260709 13:01:18.045288  1663 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:18.001322  4314 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:18.046394  1663 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:18.034596  3978 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:18.018498  4295 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.053967  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:18.056720  1511 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:18.041430  3675 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:18.042908  2265 raft_consensus.cc:1240] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:18.032645  4315 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:18.074023  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.075791  1689 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:18.083066  1663 leader_election.cc:400] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
I20260709 13:01:18.087815  4324 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:18.088661  4324 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:18.089221  4324 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:18.061425  4075 consensus_meta.cc:287] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.003s
I20260709 13:01:18.092566  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:18.093415  1689 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.057276  3978 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.098203  1697 raft_consensus.cc:2376] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5. Re-sending same reply.
I20260709 13:01:18.084010  3675 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:18.116444  3675 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:18.073653  4315 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:18.117063  3675 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.120200  2266 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:18.102615  4336 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:18.121608  4336 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:18.121963  4336 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.113726  3939 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:18.126883  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.101619  3978 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:18.062582  4295 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:18.111379  4244 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:18.043877  4226 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 13:01:18.214159  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 157514us
I20260709 13:01:18.217216  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:18.226370  1689 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:18.226944  1618 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:18.226370  1511 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:18.228035  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.229377  1689 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:18.100116  4075 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:18.234030  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:18.240012  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.252329  1618 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
W20260709 13:01:18.252312  1514 leader_election.cc:336] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.709s (SENT)
I20260709 13:01:18.255578  1514 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:18.254729  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 268563us
I20260709 13:01:18.123027  4317 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:18.260370  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.256212  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.264513  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:18.214619  4244 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:18.266120  1539 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:01:18.267788  1586 leader_election.cc:336] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.608s (SENT)
W20260709 13:01:18.269126  1586 leader_election.cc:336] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.671s (SENT)
I20260709 13:01:18.269658  1586 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.271562  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.214108  4337 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.130s
I20260709 13:01:18.272305  1689 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:18.272611  1694 raft_consensus.cc:2393] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:18.125159  4292 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:18.275532  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.276288  1689 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:18.277093  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.278384  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.279198  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.281399  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.282142  1689 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:18.268994  4244 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:18.272967  4225 consensus_meta.cc:287] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.000s
I20260709 13:01:18.271243  4330 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:18.286700  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.288142  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.288971  1689 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:18.289952  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:18.292838  1494 auto_rebalancer.cc:629] Failed to schedule move for tablet 7a83a11e6c2348918b88fe74b7ee7361: Illegal state: Replica c20847a6dcea4c2a9cbaf35a2171e33d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:01:18.293377  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:18.294206  1689 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:18.289816  4331 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:18.304961  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.013s	sys 0.017s
W20260709 13:01:18.305336  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.013s	sys 0.017s
W20260709 13:01:18.305886  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 671483us
I20260709 13:01:18.306628  1587 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:18.337733  1689 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
W20260709 13:01:18.340545  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 84583.9us
I20260709 13:01:18.340675  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.342319  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.342571  4352 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:18.343129  1689 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:18.344547  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.342564  1511 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:18.294993  4226 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:18.291698  4274 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:18.351766  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 45212.4us
I20260709 13:01:18.352561  1587 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:18.292007  4225 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:18.356173  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 69189.1us
I20260709 13:01:18.345343  1689 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:18.358964  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:18.362886  1586 leader_election.cc:336] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 3.256s (SENT)
I20260709 13:01:18.363644  1586 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:18.366304  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.367897  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.366206  1511 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:18.369405  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:18.361845  4226 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:18.355405  4333 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:18.371853  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.362309  4331 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:18.410883  4331 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.411312  4331 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.396154  4226 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:18.412532  4226 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:18.413045  4226 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:18.397540  4340 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:01:18.398860  4341 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:01:18.399231  4354 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:18.400296  4292 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:18.406154  1586 leader_election.cc:336] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.133s (SENT)
I20260709 13:01:18.416450  1586 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.416868  4225 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:18.418033  4225 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:18.418589  4353 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:18.372509  4352 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:18.393252  4295 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:18.372977  1511 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.409859  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.423177  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:18.423344  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 59184.9us
W20260709 13:01:18.425621  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 52685.5us
I20260709 13:01:18.425617  1618 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:18.426767  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:18.427636  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.430259  4357 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:18.431141  4357 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:18.431730  4357 raft_consensus.cc:697] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:18.426237  1587 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:18.402961  4321 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:18.435699  4274 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:18.437700  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.434522  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:18.446494  1689 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:18.420423  4317 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:18.424356  4352 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.448074  1587 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.454066  1618 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:18.432801  4357 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:18.448213  4345 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:18.460512  4256 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:18.464445  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.453125  4352 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.466560  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.451838  4321 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:18.468267  1587 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:18.471524  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:18.498914  1543 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.486694  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.487946  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:18.489329  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:18.495258  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:18.499136  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:18.501672  1548 raft_consensus.cc:2376] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6. Re-sending same reply.
I20260709 13:01:18.457098  4316 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:18.503731  1540 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:18.464251  4345 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:18.508090  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:18.508142  1545 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:18.509672  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.510637  4336 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:18.513180  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:18.538652  1541 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:18.539093  1544 pending_rounds.cc:85] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 1
I20260709 13:01:18.516458  4226 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:18.522262  4329 log.cc:927] Time spent T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.542s	user 0.005s	sys 0.008s
I20260709 13:01:18.525920  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.527652  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.530383  1696 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:18.535766  1689 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:18.503087  4354 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:18.499758  4249 raft_consensus.cc:3055] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:18.561868  1546 raft_consensus.cc:1240] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:18.563395  1544 pending_rounds.cc:107] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:18.579698  1544 raft_consensus.cc:2889] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:18.536918  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 284641us
I20260709 13:01:18.484630  4321 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.478911  4333 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:01:18.561028  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:18.589776  1541 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.565840  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:18.554554  4345 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:18.567186  1619 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:18.572705  1620 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:18.574589  1690 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:18.598260  1689 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:18.574770  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:18.561880  1586 leader_election.cc:336] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.907s (SENT)
I20260709 13:01:18.563882  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:18.600101  1545 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.599989  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.577080  1621 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:18.565438  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:18.583096  1514 leader_election.cc:336] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.759s (SENT)
I20260709 13:01:18.585638  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.562554  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:18.601529  1514 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:18.601785  1695 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:18.602308  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:18.595896  2234 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:18.564266  1618 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:18.603569  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:18.594516  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:18.606734  2234 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:18.608073  4256 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:18.608457  4256 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.609162  4256 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.609411  1543 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:18.611518  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.611660  3939 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:18.613534  3939 consensus_queue.cc:1059] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:18.615201  3939 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:18.620373  3939 raft_consensus.cc:697] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:18.622162  1695 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:18.622205  1514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.825s (SENT) [suppressed 92 similar messages]
W20260709 13:01:18.623497  1514 leader_election.cc:336] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.969s (SENT)
I20260709 13:01:18.623786  1695 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:18.623926  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:01:18.625747  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 63927.8us
I20260709 13:01:18.625988  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:18.626278  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:18.626866  1546 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:18.622155  1614 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:18.628402  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:18.626293  1622 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:18.628852  1695 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:18.629570  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:18.611058  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:18.630373  1543 raft_consensus.cc:2368] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
I20260709 13:01:18.630718  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:18.633594  1621 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:01:18.634810  1540 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:18.571730  4226 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:18.589421  4321 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.577287  4249 raft_consensus.cc:740] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:18.622412  3675 consensus_meta.cc:287] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.505s	user 0.013s	sys 0.000s
I20260709 13:01:18.569828  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54504 (request call id 466) took 1267 ms. Trace:
I20260709 13:01:18.641064  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.633141  4230 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:18.643963  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:18.604099  4354 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:18.625682  4317 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:18.649387  1586 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:18.627205  4274 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:18.672478  1541 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:18.676214  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:18.677184  1622 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:18.678371  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:18.678921  1622 raft_consensus.cc:2376] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4. Re-sending same reply.
I20260709 13:01:18.679152  1546 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:18.680598  1621 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:18.681001  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.683210  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:18.683771  1663 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.684335  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:18.686810  1618 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:18.687741  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:18.688462  1618 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:18.688689  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:18.689016  1617 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:18.689316  1663 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.690697  1622 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:18.693825  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:18.694788  1621 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:18.650051  4333 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:18.704825  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:18.705107  1545 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:18.705024  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:18.649727  4360 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:18.703809  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 71430.7us
I20260709 13:01:18.708283  1661 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:18.709061  1614 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:18.709872  1617 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:18.714069  1545 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:18.715556  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 108882us
I20260709 13:01:18.715224  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:18.674015  4317 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:18.736519  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.722043  2234 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:18.723048  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.723193  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.723778  4354 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:18.724202  4336 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:18.725476  4315 consensus_meta.cc:287] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.003s
I20260709 13:01:18.725804  3939 consensus_queue.cc:237] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:18.717015  4249 consensus_queue.cc:260] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:18.647710  3675 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:18.706368  4347 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:18.710693  4333 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:18.706580  4314 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:01:18.645596  2265 rpcz_store.cc:276] 0709 13:01:17.302218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.306478 (+  4260us) service_pool.cc:224] Handling call
0709 13:01:17.325862 (+ 19384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.084502 (+758640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.569572 (+485070us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54005a0354. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:18.569765 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1594615168}
I20260709 13:01:18.744500  4292 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:18.684218  4357 consensus_queue.cc:1059] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
W20260709 13:01:18.742908  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 93612.4us
I20260709 13:01:18.744633  1545 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:01:18.752056  1663 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.755460  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:18.740082  4064 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:18.766451  4339 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:18.766718  4368 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.768143  4361 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:18.768323  3675 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:18.769162  4292 raft_consensus.cc:697] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:18.769600  4227 consensus_queue.cc:1059] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:18.762633  4333 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.759099  4358 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:18.775182  1586 leader_election.cc:336] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 3.972s (SENT)
I20260709 13:01:18.773015  1545 pending_rounds.cc:85] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 4
I20260709 13:01:18.834199  1545 pending_rounds.cc:107] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:01:18.834627  1545 raft_consensus.cc:2889] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:18.782632  1690 raft_consensus.cc:2393] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:18.796690  4339 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:18.794909  4064 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:18.801213  4317 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:18.778298  3978 consensus_meta.cc:287] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.002s
I20260709 13:01:18.802592  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 311) took 1074 ms. Trace:
I20260709 13:01:18.779721  4360 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:18.793212  4314 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:18.817320  4322 consensus_queue.cc:1059] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:01:18.765728  4256 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:18.820406  4344 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:18.824012  4352 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:18.750586  4315 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:01:18.835829  1586 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:18.762871  4336 consensus_queue.cc:1059] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:01:18.849830  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:18.805872  4241 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:18.806084  4249 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.859946  1692 rpcz_store.cc:276] 0709 13:01:17.728368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.791924 (+ 63556us) service_pool.cc:224] Handling call
0709 13:01:17.792335 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:17.814969 (+ 22634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.814999 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:18.493016 (+678017us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b1800448a20. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a1f2a6 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a
0709 13:01:18.493753 (+   737us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b2c000d1b28. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:01:18.494433 (+   680us) log.cc:844] Serialized 26 byte log entry
0709 13:01:18.622812 (+128379us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:18.646551 (+ 23739us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.646858 (+   307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.646951 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.800533 (+153582us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b1800448a20. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:01:18.802356 (+  1823us) raft_consensus.cc:1685] finished
0709 13:01:18.802377 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.802534 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37303,"prepare.queue_time_us":14011,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":27327,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":37678,"spinlock_wait_cycles":48313216,"thread_start_us":127958,"threads_started":1,"wal-append.queue_time_us":233566}
I20260709 13:01:18.814841  4371 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:01:18.877521  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 85550.5us
I20260709 13:01:18.879844  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:18.807549  4368 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:18.891361  1663 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:01:18.900380  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 73336.4us
W20260709 13:01:18.903466  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 128333us
I20260709 13:01:18.904273  1586 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:18.905205  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:01:18.879914  4378 log.cc:927] Time spent T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:01:18.900555  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 156968us
I20260709 13:01:18.874378  4254 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:18.917639  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:18.913378  1663 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:18.916606  1586 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:01:18.919960  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 196827us
I20260709 13:01:18.921386  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:18.883795  4250 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:18.863224  3978 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:18.924067  1586 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:18.885179  4317 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:18.936956  1586 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:18.942173  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:18.946035  1692 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:18.948853  4256 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:18.919698  4230 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:18.918121  4347 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:18.952003  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:18.925938  4320 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:18.984766  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:18.985405  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:18.986290  1545 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:18.994899  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.995280  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.945075  4211 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:18.860294  4339 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:18.920620  4357 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.063s
W20260709 13:01:19.023501  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 115416us
I20260709 13:01:19.025864  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:19.025985  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:19.038287  1545 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:19.038475  2231 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:19.028548  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:19.041200  1544 raft_consensus.cc:2368] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8.
I20260709 13:01:19.042625  1545 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:19.045188  1545 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:18.952327  4225 consensus_meta.cc:287] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260709 13:01:18.929352  4292 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:19.046525  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 310091us
W20260709 13:01:19.048172  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 96257.7us
I20260709 13:01:18.985597  4347 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.060523  1587 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:19.065752  1690 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:19.068738  1514 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:19.070451  1514 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:19.073612  2231 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:19.077235  1587 leader_election.cc:400] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8.
I20260709 13:01:19.077708  1587 leader_election.cc:403] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:19.089252  1695 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:01:19.090636  1695 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:19.095533  2231 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:19.015074  4250 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:01:19.067221  4347 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:19.065080  4225 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:19.107796  1695 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:01:19.065517  4230 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:19.024590  4367 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:01:19.089625  4361 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:19.103605  4211 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:19.052009  4345 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.102964  3675 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:19.102757  4111 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:19.144590  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 206592us
W20260709 13:01:19.159896  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 78678.5us
I20260709 13:01:19.092481  4109 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:01:19.135465  4385 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:19.166726  1620 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:19.154812  4369 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:19.169232  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 98833.5us
I20260709 13:01:19.171403  1514 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:19.126160  4320 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:01:19.141021  4225 consensus_queue.cc:1059] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:01:19.182842  1690 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:19.168223  4342 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.168751  4064 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:19.174672  1514 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:19.170123  4315 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:19.159305  4357 consensus_queue.cc:1059] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:01:19.208168  4387 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:01:19.207962  4374 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:19.208565  4325 consensus_queue.cc:1059] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.123s
I20260709 13:01:19.209290  4267 raft_consensus.cc:2764] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:01:19.209746  4365 log.cc:927] Time spent T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.281s	user 0.000s	sys 0.002s
I20260709 13:01:19.219174  1514 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:19.210105  4324 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:19.211928  3978 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:19.177649  4352 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:19.237305  4390 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.236361  1514 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:19.172639  4366 consensus_queue.cc:1059] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.265s
W20260709 13:01:19.248142  4244 consensus_meta.cc:287] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.957s	user 0.011s	sys 0.003s
I20260709 13:01:19.249449  4361 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:19.208202  4380 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:19.235733  4342 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.220364  4369 raft_consensus.cc:2764] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:19.249816  4360 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.264807  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:19.224560  4368 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:19.238358  4374 raft_consensus.cc:697] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:19.281669  1542 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:19.256771  4324 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.264020  4267 raft_consensus.cc:3055] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:19.289516  4380 raft_consensus.cc:697] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:19.250047  4390 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.305696  4390 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:19.282969  4342 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:19.307891  4382 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:01:19.308423  4342 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:19.310604  4393 consensus_queue.cc:1059] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:01:19.312498  4345 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:19.312067  4374 consensus_queue.cc:237] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.317363  4322 raft_consensus.cc:3055] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:19.317929  4322 raft_consensus.cc:740] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:19.320024  3675 raft_consensus.cc:3055] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:19.320525  3675 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:19.321853  3675 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.264819  4244 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.323501  1695 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:19.323787  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1536) took 1756 ms (client timeout 1932 ms). Trace:
W20260709 13:01:19.324218  1694 rpcz_store.cc:269] 0709 13:01:17.567351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.571567 (+  4216us) service_pool.cc:224] Handling call
0709 13:01:19.323555 (+1751988us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54000e92d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:19.323723 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591448960}
I20260709 13:01:19.324584  4244 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:19.298390  4267 raft_consensus.cc:740] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:19.326762  1689 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:01:19.322494  4331 consensus_meta.cc:287] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.911s	user 0.008s	sys 0.003s
I20260709 13:01:19.333484  1544 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:19.288707  4339 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:19.329947  3939 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.355551  3939 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.356511  2263 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:19.333411  4366 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:19.325893  4267 consensus_queue.cc:260] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.333248  4324 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.339032  4331 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.303085  4380 consensus_queue.cc:237] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.353720  2266 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:19.353961  4321 consensus_meta.cc:287] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.673s	user 0.012s	sys 0.000s
I20260709 13:01:19.354370  4358 raft_consensus.cc:3055] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:19.355034  4227 raft_consensus.cc:3055] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:19.358695  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 313) took 1629 ms. Trace:
I20260709 13:01:19.335026  4342 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:19.318957  4322 consensus_queue.cc:260] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:19.364025  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 127748us
I20260709 13:01:19.370296  1623 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:19.374181  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:19.375455  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:19.361549  3939 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:19.366927  4317 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:19.364886  1693 rpcz_store.cc:276] 0709 13:01:17.728898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.805180 (+ 76282us) service_pool.cc:224] Handling call
0709 13:01:17.805655 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:17.814428 (+  8773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.814456 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:18.518523 (+704067us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b2c000d1b28. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:01:18.518996 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:01:18.697463 (+178467us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:18.721862 (+ 24399us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.803598 (+ 81736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.803701 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.344729 (+541028us) raft_consensus.cc:1685] finished
0709 13:01:19.358430 (+ 13701us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.358614 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18475,"prepare.queue_time_us":24228,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":62,"raft.queue_time_us":25196,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":5148,"spinlock_wait_cycles":13088512,"thread_start_us":241115,"threads_started":2,"wal-append.queue_time_us":287406}
I20260709 13:01:19.385454  4325 raft_consensus.cc:3055] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:19.385138  4317 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.386338  1693 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:19.386276  4361 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:19.386602  4324 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:19.387737  1693 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:19.385893  4325 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:19.392696  1514 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:19.363509  4358 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:19.367027  4345 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.364636  4227 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:19.409866  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:19.445760  1620 raft_consensus.cc:2410] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:01:19.414626  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:19.446378  1622 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:19.362617  4366 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.415544  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:19.449815  1618 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:19.416481  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:19.417425  4075 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:19.421205  4331 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:19.450737  4377 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:19.428169  4317 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:19.428001  4325 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.452332  4325 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:19.392544  4367 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:19.424126  4368 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:01:19.429518  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:19.430099  4211 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8.
I20260709 13:01:19.369053  4347 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.457568  4104 raft_consensus.cc:3055] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:19.458002  4104 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:19.424357  4361 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:19.468220  4361 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:19.469349  4361 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:19.459801  4377 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.470235  4377 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:19.473392  1617 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:19.442720  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 310) took 1714 ms. Trace:
I20260709 13:01:19.425660  4345 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.458747  4104 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.476903  4104 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:19.477605  4345 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:19.456439  4366 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:19.459026  1615 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:01:19.479018  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.469413  4347 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:19.383085  4267 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.481077  4358 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.481699  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2430) took 1343 ms. Trace:
I20260709 13:01:19.482101  1689 rpcz_store.cc:276] 0709 13:01:18.138129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.612866 (+474737us) service_pool.cc:224] Handling call
0709 13:01:19.326521 (+713655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:19.327350 (+   829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.481501 (+154151us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54000e92d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:19.481638 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1640486656}
W20260709 13:01:19.483075  4332 log.cc:927] Time spent T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 1.344s	user 0.005s	sys 0.000s
I20260709 13:01:19.485033  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 309) took 1758 ms. Trace:
I20260709 13:01:19.485379  1691 rpcz_store.cc:276] 0709 13:01:17.727542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.772833 (+ 45291us) service_pool.cc:224] Handling call
0709 13:01:17.787585 (+ 14752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:17.787974 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.788003 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:17.799551 (+ 11548us) log.cc:844] Serialized 26 byte log entry
0709 13:01:17.888743 (+ 89192us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:17.920776 (+ 32033us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.033829 (+113053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.033938 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.311335 (+1277397us) spinlock_profiling.cc:243] Waited 7.29 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:19.484771 (+173436us) raft_consensus.cc:1685] finished
0709 13:01:19.484866 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.484974 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2902,"prepare.queue_time_us":181108,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3409,"raft.queue_time_us":42595,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":56016,"spinlock_wait_cycles":16759168,"thread_start_us":205890,"threads_started":3,"wal-append.queue_time_us":233238}
I20260709 13:01:19.481659  1514 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:19.490059  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:19.491159  1544 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:01:19.492056  1547 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:19.492563  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:19.493316  1547 raft_consensus.cc:1240] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:19.493707  4249 consensus_meta.cc:287] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.595s	user 0.013s	sys 0.000s
I20260709 13:01:19.495031  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:19.495678  1541 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:19.495795  4333 consensus_meta.cc:287] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.001s
I20260709 13:01:19.483186  4225 raft_consensus.cc:3055] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:19.503572  4225 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:19.505713  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:19.482163  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 318) took 1752 ms. Trace:
I20260709 13:01:19.510040  1696 rpcz_store.cc:276] 0709 13:01:17.730229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.829554 (+ 99325us) service_pool.cc:224] Handling call
0709 13:01:18.530208 (+700654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.577493 (+ 47285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.481998 (+904505us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b54000979d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:19.482112 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576741120}
I20260709 13:01:19.475634  1688 rpcz_store.cc:276] 0709 13:01:17.728096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.791490 (+ 63394us) service_pool.cc:224] Handling call
0709 13:01:17.791938 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:17.809270 (+ 17332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.809299 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:18.822752 (+1013453us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b2c000d1b28. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:01:18.823463 (+   711us) log.cc:844] Serialized 26 byte log entry
0709 13:01:18.873605 (+ 50142us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:18.918992 (+ 45387us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.442162 (+523170us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b18002ad2a0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c679cbc0a 00007f5c7110b219 00007f5c67a53a40 00007f5c67a4e4e4 00007f5c67a4e455 00007f5c6ab36060 00007f5c6ab48716 00007f5c6ab59287 00007f5c6ab59208
0709 13:01:19.442363 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.442443 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.442487 (+    44us) raft_consensus.cc:1685] finished
0709 13:01:19.442500 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.442658 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16881,"prepare.queue_time_us":48892,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":6609,"raft.queue_time_us":545197,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":5288,"spinlock_wait_cycles":30598784,"thread_start_us":49676,"threads_started":1,"wal-append.queue_time_us":238883}
I20260709 13:01:19.520943  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2418) took 1469 ms. Trace:
I20260709 13:01:19.521396  1697 rpcz_store.cc:276] 0709 13:01:18.051524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.052445 (+   921us) service_pool.cc:224] Handling call
0709 13:01:19.520756 (+1468311us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b54000974d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:19.520879 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95745408}
I20260709 13:01:19.522706  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1486) took 1008 ms. Trace:
I20260709 13:01:19.526089  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:19.527307  2266 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:19.527808  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:19.530202  4322 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:19.523274  1540 rpcz_store.cc:276] 0709 13:01:18.516385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.636609 (+120224us) service_pool.cc:224] Handling call
0709 13:01:18.636890 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.704516 (+ 67626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:18.704568 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:18.705037 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:01:19.522122 (+817085us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b18003545e0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c6a6e64bc 00007f5c67a3448b 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de0d1
0709 13:01:19.522272 (+   150us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:19.522310 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.522385 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.522428 (+    43us) raft_consensus.cc:1685] finished
0709 13:01:19.522439 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.522645 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56864,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":15612,"spinlock_wait_cycles":4008192,"thread_start_us":73713,"threads_started":2,"wal-append.queue_time_us":84727}
I20260709 13:01:19.535076  1541 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:19.541932  1542 raft_consensus.cc:2393] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 4: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:19.364529  4321 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.384014  4342 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.544849  4045 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:19.547564  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:19.549201  4384 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.393s	user 0.003s	sys 0.000s
I20260709 13:01:19.551198  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1480) took 1048 ms. Trace:
I20260709 13:01:19.551555  1548 rpcz_store.cc:276] 0709 13:01:18.503537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.537465 (+ 33928us) service_pool.cc:224] Handling call
0709 13:01:18.562333 (+ 24868us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.633471 (+ 71138us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:18.846868 (+213397us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.934108 (+ 87240us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:18.944591 (+ 10483us) log.cc:844] Serialized 26 byte log entry
0709 13:01:18.944730 (+   139us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:18.944912 (+   182us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.945407 (+   495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.945477 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.548516 (+603039us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:19.550984 (+  2468us) raft_consensus.cc:1685] finished
0709 13:01:19.551017 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.551145 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":332167,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":4461,"raft.queue_time_us":21648,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":52020,"spinlock_wait_cycles":81027328,"thread_start_us":204487,"threads_started":2,"wal-append.queue_time_us":229334}
I20260709 13:01:19.557515  4230 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:19.557972  4230 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:19.562813  1619 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:01:19.558787  4230 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.564035  4321 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:19.564520  4230 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.565884  4342 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:19.566583  4227 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.504693  4225 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:19.589835  4392 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.322s	user 0.003s	sys 0.000s
I20260709 13:01:19.590181  4225 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:19.591204  4366 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:19.591760  4366 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.595156  4366 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:19.567940  4227 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:19.596530  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 50079.2us
I20260709 13:01:19.597651  2232 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:19.598420  3939 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:19.599849  3939 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:19.599776  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:19.605245  4377 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.609166  1614 raft_consensus.cc:2410] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:19.609568  4358 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.658104  4377 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:19.610843  2232 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:18.488060   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:19.659819  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 49068us
I20260709 13:01:19.662073  2232 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:19.496201  4333 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.625061  4045 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:19.698380  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 641675us
I20260709 13:01:19.650238  4361 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.709730  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:19.711617  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:19.712975  1541 raft_consensus.cc:2410] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:19.715443  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:19.718291  1511 leader_election.cc:336] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.932s (SENT)
I20260709 13:01:19.718910  1511 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:19.720919  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:19.710412  1542 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
W20260709 13:01:19.723554  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 241956us
I20260709 13:01:19.716423  1540 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:19.695462  4389 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:19.704457  4045 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:19.756028  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:19.728864  1514 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:01:19.744756  1543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.016s	sys 0.024s
W20260709 13:01:19.757206  1543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.016s	sys 0.024s
I20260709 13:01:19.758095  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1484) took 1245 ms. Trace:
I20260709 13:01:19.703754  4385 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:19.747994  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:19.750392  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:19.761173  1539 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:19.761173  1541 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:19.758523  1543 rpcz_store.cc:276] 0709 13:01:18.512900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.632446 (+119546us) service_pool.cc:224] Handling call
0709 13:01:18.634330 (+  1884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.737747 (+103417us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:18.925073 (+187326us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.223347 (+298274us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:19.241910 (+ 18563us) log.cc:844] Serialized 26 byte log entry
0709 13:01:19.242126 (+   216us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:19.242411 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.453716 (+211305us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b180038bfc0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a51522 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:01:19.589404 (+135688us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b24004169a8. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c678d79c4 00007f5c678d5acb 00007f5c67a90dc9 00007f5c67a90a55 00007f5c67a9009d 00007f5c6a6c210e 00007f5c6a6d988c 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221
0709 13:01:19.757653 (+168249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.757761 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.757821 (+    60us) raft_consensus.cc:1685] finished
0709 13:01:19.757841 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.758020 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13298,"prepare.queue_time_us":215211,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":85,"raft.queue_time_us":117792,"raft.run_cpu_time_us":522,"raft.run_wall_time_us":24481,"spinlock_wait_cycles":15199488,"thread_start_us":971560,"threads_started":5,"wal-append.queue_time_us":213979}
I20260709 13:01:19.707947  4352 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:19.773514  1623 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:19.778240  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:19.699141  3939 consensus_queue.cc:1059] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:01:19.703900  4249 consensus_queue.cc:1059] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:01:19.796903  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.798069  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:19.798847  1619 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:19.744427  4104 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:19.804370  1617 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:19.727556  4369 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:19.752657  4360 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:19.812487  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 286862us
I20260709 13:01:19.816691  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:19.761651  4226 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:19.818404  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:19.819552  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 90773.9us
W20260709 13:01:19.820384  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.768021  4389 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:19.824571  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 911217us
W20260709 13:01:19.828317  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 98147us
I20260709 13:01:19.836457  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:19.837334  1615 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:19.829342  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:19.832911  1446 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52824 (request call id 227) took 10715 ms. Trace:
I20260709 13:01:19.804203  4104 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.849086  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2454) took 1148 ms. Trace:
I20260709 13:01:19.744666  4379 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:01:19.864079  1514 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:19.807507  4336 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.801122  4385 raft_consensus.cc:697] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:19.867282  1542 raft_consensus.cc:1240] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:19.868752  1587 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:19.865597  1695 rpcz_store.cc:276] 0709 13:01:18.700771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.326032 (+625261us) service_pool.cc:224] Handling call
0709 13:01:19.326276 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.326470 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:19.343170 (+ 16700us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.842630 (+499460us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.848549 (+  5919us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.848612 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:19.848794 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.848880 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.849018 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20905,"prepare.queue_time_us":17621,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":40944,"thread_start_us":477833,"threads_started":1}
W20260709 13:01:19.878036  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 48776us
I20260709 13:01:19.879078  1661 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:19.880373  1587 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:19.880959  1514 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:19.865023  4367 consensus_queue.cc:1059] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:01:19.884670  4377 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.886998  4300 consensus_queue.cc:1059] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:19.886682  4385 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.888602  4294 consensus_queue.cc:1059] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:19.889429  4294 consensus_queue.cc:1243] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer e37b8013aec24431a6672a857806329e log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:19.890211  4294 raft_consensus.cc:3055] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:19.890625  4294 raft_consensus.cc:740] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:19.837059  4226 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.893263  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:19.894210  4315 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:19.894762  4315 raft_consensus.cc:697] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:19.896189  1661 leader_election.cc:400] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
I20260709 13:01:19.828949  4389 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:19.896621  1661 leader_election.cc:403] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:19.864770  4104 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:19.842818  4325 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.901337  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:19.849272  4324 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:19.843283  4405 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:19.937611  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.840293  4075 consensus_queue.cc:1059] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:01:19.822824  4369 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.899447  4330 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:19.899016  4360 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:19.895156  4226 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:19.957484  2271 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:19.901911  4241 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.900115  4390 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:19.877137  4244 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:01:19.939673  4230 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:19.879825  4250 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:01:19.943145  4325 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:19.978415  4406 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:01:19.899879  4337 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:01:19.950639  4352 raft_consensus.cc:3055] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:19.944684  4321 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:19.954164  4380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.009s	sys 0.009s
I20260709 13:01:19.983021  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:19.997792  1619 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:19.877699  4336 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:19.841101  1446 rpcz_store.cc:276] 0709 13:01:09.117025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.172445 (+ 55420us) service_pool.cc:224] Handling call
0709 13:01:19.832814 (+10660369us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:16.589292 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:16.946744 (+357452us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:16.946821 (+    77us) write_op.cc:435] Acquired schema lock
0709 13:01:16.946846 (+    25us) tablet.cc:662] Decoding operations
0709 13:01:16.948044 (+  1198us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:16.948222 (+   178us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:16.948255 (+    33us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:01:16.949401 (+  1146us) tablet.cc:701] Row locks acquired
0709 13:01:16.949460 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:01:16.949699 (+   239us) write_op.cc:270] Start()
0709 13:01:16.949903 (+   204us) write_op.cc:276] Timestamp: P: 1783602076949598 usec, L: 0
0709 13:01:16.949926 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:01:17.051709 (+101783us) log.cc:844] Serialized 1691 byte log entry
0709 13:01:17.604533 (+552824us) op_driver.cc:464] REPLICATION: finished
0709 13:01:17.931578 (+327045us) write_op.cc:301] APPLY: starting
0709 13:01:17.939890 (+  8312us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:17.983699 (+ 43809us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:17.983844 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:17.984461 (+   617us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:17.984820 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:01:17.984869 (+    49us) write_op.cc:312] APPLY: finished
0709 13:01:17.992380 (+  7511us) log.cc:844] Serialized 41 byte log entry
0709 13:01:17.992587 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:17.992689 (+   102us) write_op.cc:454] Released schema lock
0709 13:01:17.992736 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:17.993132 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:17.993159 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":643563,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":295162,"apply.run_cpu_time_us":3070,"apply.run_wall_time_us":68266,"num_ops":4,"prepare.queue_time_us":381174,"prepare.run_cpu_time_us":17711,"prepare.run_wall_time_us":607144,"raft.queue_time_us":332729,"raft.run_cpu_time_us":37418,"raft.run_wall_time_us":323775,"replication_time_us":618480,"thread_start_us":693798,"threads_started":4,"wal-append.queue_time_us":139364,"wal-append.run_cpu_time_us":27230,"wal-append.run_wall_time_us":1810245}]]}
I20260709 13:01:19.981874  1443 catalog_manager.cc:5697] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:20.023455  1622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.010s	sys 0.013s
I20260709 13:01:19.975914  4390 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:20.087028  1513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.052s	sys 0.102s
W20260709 13:01:20.084854  1622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.010s	sys 0.013s
I20260709 13:01:19.999980  4230 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.981506  4360 raft_consensus.cc:697] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:01:20.089785  1513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.052s	sys 0.102s
W20260709 13:01:20.108456  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 1.01813e+06us
W20260709 13:01:20.048724  4380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.010s	sys 0.009s
I20260709 13:01:19.958123  4324 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:19.981791  4396 consensus_queue.cc:1059] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:01:20.096560  4390 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:20.172462  4369 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:20.027722  4352 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:20.049726  4315 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.174031  4352 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.175374  4352 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.041275  4333 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:20.183526  4361 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:20.185688  4325 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:20.185930  4336 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:20.106509  4230 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:20.172624  4322 consensus_meta.cc:287] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.001s
W20260709 13:01:20.196197  4412 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:01:20.203694  4368 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:20.032908  4321 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:20.207366  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:20.225010  1615 raft_consensus.cc:2393] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:19.947561  4294 consensus_queue.cc:260] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:20.099246  4225 consensus_meta.cc:287] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:01:20.105094  1443 catalog_manager.cc:5697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 2 to 3, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 3 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.234375  1443 catalog_manager.cc:5697] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 3 to 4, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 4 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:20.236302  1443 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 2 to 4, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 4 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:20.228096  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:20.238205  1443 catalog_manager.cc:5697] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.265379  1615 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:01:20.230777  4354 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.025s	sys 0.057s
I20260709 13:01:20.273388  1443 catalog_manager.cc:5697] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 4 to 5, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 5 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.285239  1443 catalog_manager.cc:5697] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 2 to 3, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 3 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:20.292092  1694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.024s	sys 0.072s
W20260709 13:01:20.293175  1694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.024s	sys 0.072s
I20260709 13:01:20.231643  4321 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.309382  1443 catalog_manager.cc:5697] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.319615  1443 catalog_manager.cc:5697] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:20.299292  4358 consensus_meta.cc:287] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.003s
W20260709 13:01:20.300096  4354 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.025s	sys 0.057s
I20260709 13:01:20.204479  4368 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:20.331192  1547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.031s	sys 0.054s
I20260709 13:01:20.293357  4361 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.305967  4294 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:20.334252  1443 catalog_manager.cc:5697] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 2 to 6, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 6 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:20.339740  1547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.031s	sys 0.054s
I20260709 13:01:20.348578  1443 catalog_manager.cc:5697] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 2, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 2 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:20.334224  4418 raft_consensus.cc:3055] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:20.336944  3939 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.334955  4250 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.379953  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.351763  1443 catalog_manager.cc:5697] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129), VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130), VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131), NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 3 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:01:20.321089  4404 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:01:20.397019  1443 catalog_manager.cc:5697] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 2, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 2 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.399382  1443 catalog_manager.cc:5697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.362654  4418 raft_consensus.cc:740] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:20.404953  4249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.025s	sys 0.053s
W20260709 13:01:20.426491  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 471280us
I20260709 13:01:20.352627  4361 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.408547  4380 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:20.341560  4360 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.390146  3939 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.433283  4418 consensus_queue.cc:260] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.434428  3939 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:20.434713  4418 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.434973  4380 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.437214  4389 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.437665  4380 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:20.434500  4361 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:20.430896  2234 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:20.442241  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:20.443663  1622 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:20.444643  3675 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.446787  3939 consensus_queue.cc:1059] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:20.453959  3939 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:20.429044  4385 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.013s	sys 0.039s
I20260709 13:01:20.452811  4321 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:20.424614  4249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.025s	sys 0.053s
I20260709 13:01:20.393743  4250 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.460093  4321 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:20.456333  4385 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.013s	sys 0.040s
I20260709 13:01:20.484238  4366 raft_consensus.cc:3055] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:20.500679  4366 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:20.501511  4250 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:20.501720  4366 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.487951  4324 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:20.489849  4368 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:20.504359  4366 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:20.505605  4104 consensus_meta.cc:287] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.004s
I20260709 13:01:20.506047  4104 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.508759  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:20.510442  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:20.521726  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.541600  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.495070  4390 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.547844  4250 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.548429  4250 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.549299  4390 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:20.550549  4250 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:20.552594  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:20.552847  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1549) took 1896 ms. Trace:
I20260709 13:01:20.553354  2265 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:20.554347  2263 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:20.556058  4390 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.557053  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:20.556907  4344 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:20.558653  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.558609  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 662509us
W20260709 13:01:20.559338  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 655552us
W20260709 13:01:20.562863  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1415) took 1965 ms (client timeout 2237 ms). Trace:
I20260709 13:01:20.561889  1692 rpcz_store.cc:276] 0709 13:01:18.656758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.030596 (+373838us) service_pool.cc:224] Handling call
0709 13:01:19.062962 (+ 32366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:19.726335 (+663373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.726368 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:19.731082 (+  4714us) log.cc:844] Serialized 26 byte log entry
0709 13:01:20.222627 (+491545us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:20.222737 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.222890 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:20.552632 (+329742us) raft_consensus.cc:1685] finished
0709 13:01:20.552655 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.552787 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":690533,"raft.queue_time_us":651707,"raft.run_cpu_time_us":481,"raft.run_wall_time_us":16768,"thread_start_us":410231,"threads_started":1,"wal-append.queue_time_us":780490}
I20260709 13:01:20.455072  4267 raft_consensus.cc:3055] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:20.576671  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:20.691668  1586 leader_election.cc:336] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.716s (SENT)
I20260709 13:01:20.524174  4321 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:20.579787  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:20.722774  1586 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:20.723145  1622 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
W20260709 13:01:20.612447  1693 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.025s	sys 0.092s
W20260709 13:01:20.724378  1693 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.027s	sys 0.094s
I20260709 13:01:20.581188  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:20.725325  2271 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
W20260709 13:01:20.699931  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.726756  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.572152  4349 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:01:20.572454  4377 consensus_queue.cc:1059] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:01:20.732503  2272 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:01:20.690078  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2453) took 1989 ms. Trace:
I20260709 13:01:20.689292  4295 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.709764  1616 rpcz_store.cc:269] 0709 13:01:18.577644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.599677 (+ 22033us) service_pool.cc:224] Handling call
0709 13:01:20.543003 (+1943326us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54003a0a54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:20.543244 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3959940992}
I20260709 13:01:20.577550  4230 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.717938  1661 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:20.721071  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:20.558131  4404 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:20.603696  2232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.018s	sys 0.046s
I20260709 13:01:20.744314  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:20.744905  2232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.018s	sys 0.054s
I20260709 13:01:20.745141  1616 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:20.745322  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 812847us
I20260709 13:01:20.748620  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:20.750270  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:20.750907  1539 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:20.751804  1622 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:20.727049  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:20.603549  4390 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.731287  1514 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:20.706563  4225 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.701599  4249 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.695014  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.739070  1619 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.706775  4347 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:01:20.740793  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 49175.5us
I20260709 13:01:20.749372  1543 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:20.561511  4254 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
I20260709 13:01:20.733433  1694 rpcz_store.cc:276] 0709 13:01:18.700528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.325256 (+624728us) service_pool.cc:224] Handling call
0709 13:01:19.325576 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.325779 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:19.326075 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:01:20.689506 (+1363431us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:20.689607 (+   101us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:20.689691 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.689799 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.689987 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":382112,"prepare.queue_time_us":16351,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":395725,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2792,"thread_start_us":967384,"threads_started":1,"wal-append.queue_time_us":1395695}
I20260709 13:01:20.721963  4250 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.756664  1540 raft_consensus.cc:1240] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:20.722512  4267 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:20.769443  1539 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:20.736061  4371 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:20.778214  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 450) took 1013 ms. Trace:
I20260709 13:01:20.778803  4390 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:20.801865  4344 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:20.802701  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:20.803341  1622 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:20.804481  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:20.805094  4390 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.806248  4344 raft_consensus.cc:697] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:20.807600  4344 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.807964  4315 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:20.808779  4315 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.776647  2232 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:20.811573  2232 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:20.786137  1542 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:20.812922  4423 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:20.744439  4354 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:20.813642  4423 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.814244  4423 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:20.816416  4429 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:20.734378  4321 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:20.797500  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 79668.6us
I20260709 13:01:20.823968  1661 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:20.826633  1661 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:20.798723  1618 rpcz_store.cc:276] 0709 13:01:19.765052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.765859 (+   807us) service_pool.cc:224] Handling call
0709 13:01:19.766051 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.766212 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:20.258547 (+492335us) log.cc:844] Serialized 14 byte log entry
0709 13:01:20.776984 (+518437us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:20.777059 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:20.777977 (+   918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.778059 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.778161 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28951,"prepare.queue_time_us":582363,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":29164,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":980428,"threads_started":2}
I20260709 13:01:20.801234  4254 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:20.806066  4390 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.773655  4337 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.820565  1619 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:20.779596  1616 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
W20260709 13:01:20.788661  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 348179us
I20260709 13:01:20.782773  4244 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:20.787566  4314 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:20.751165  4295 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.836978  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:20.832240  4377 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:20.784027  4347 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.849156  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:20.759262  4404 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.851706  1618 raft_consensus.cc:2368] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5.
I20260709 13:01:20.839915  4261 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:20.771003  4225 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.821360  4315 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:20.774462  4249 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.818647  3675 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:20.800045  4250 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.905405  1618 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:20.834414  4104 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:20.820232  4371 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.908172  1616 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:20.908468  1511 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.002s	sys 0.031s
I20260709 13:01:20.824025  4385 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:01:20.832609  4427 consensus_queue.cc:1059] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:01:20.918917  1622 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:20.921927  1511 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.002s	sys 0.031s
I20260709 13:01:20.840036  4300 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:01:20.843725  4244 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:20.839730  4254 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:20.932864  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 537483us
I20260709 13:01:20.915082  4354 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.847651  4337 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.843727  4349 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:01:20.899850  4302 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:01:20.916743  4377 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:20.975670  4377 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:20.922854  3675 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:20.977768  3675 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.901252  4267 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:20.982091  4426 log.cc:927] Time spent T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260709 13:01:20.983628  4425 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:01:20.985641  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2461) took 2278 ms. Trace:
I20260709 13:01:20.986097  1693 rpcz_store.cc:276] 0709 13:01:18.707049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.388688 (+681639us) service_pool.cc:224] Handling call
0709 13:01:19.411462 (+ 22774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:19.806810 (+395348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.806854 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:19.820150 (+ 13296us) log.cc:844] Serialized 26 byte log entry
0709 13:01:20.729746 (+909596us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:20.765730 (+ 35984us) log.cc:844] Serialized 14 byte log entry
0709 13:01:20.782246 (+ 16516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.782360 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:20.985345 (+202985us) raft_consensus.cc:1685] finished
0709 13:01:20.985370 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.985555 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":451468,"prepare.queue_time_us":30642,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":3366,"raft.queue_time_us":424128,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":17399,"thread_start_us":851501,"threads_started":1,"wal-append.queue_time_us":895647}
I20260709 13:01:20.989233  4295 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:20.991482  4249 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:20.992574  4249 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:20.993222  4249 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:20.997046  4225 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:20.999600  4250 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:20.949004  4241 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:21.004590  4241 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.007354  4371 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:21.008237  4357 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.008750  4357 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.010771  4357 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:20.959681  4354 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.012270  4227 raft_consensus.cc:3055] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:21.012833  4227 raft_consensus.cc:740] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:21.012964  4354 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.013805  4227 consensus_queue.cc:260] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.027940  4380 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:21.030382  1513 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:21.030887  4414 raft_consensus.cc:3055] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:21.031924  4414 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:21.033562  4414 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.031284  4357 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:21.074813  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 343590us
I20260709 13:01:20.946024  4324 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.971385  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.081415  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.015332  4227 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:21.099442  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.100281  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:21.099263  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 325946us
W20260709 13:01:21.101500  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 259575us
I20260709 13:01:21.036185  4414 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:21.105631  1586 leader_election.cc:336] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.977s (SENT)
I20260709 13:01:21.100869  1542 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:01:21.114606  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 392) took 1513 ms. Trace:
W20260709 13:01:21.114614  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.118700  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.115407  1547 rpcz_store.cc:276] 0709 13:01:19.601059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.609487 (+  8428us) service_pool.cc:224] Handling call
0709 13:01:19.609880 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:19.722549 (+112669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.722593 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:19.730934 (+  8341us) log.cc:844] Serialized 52 byte log entry
0709 13:01:20.349204 (+618270us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:20.739131 (+389927us) log.cc:844] Serialized 14 byte log entry
0709 13:01:21.094771 (+355640us) log.cc:844] Serialized 14 byte log entry
0709 13:01:21.114277 (+ 19506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.114349 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:21.114390 (+    41us) raft_consensus.cc:1685] finished
0709 13:01:21.114402 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.114550 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160598,"prepare.queue_time_us":563442,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3908,"raft.queue_time_us":126329,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":18018,"spinlock_wait_cycles":7197568,"thread_start_us":1260376,"threads_started":3,"wal-append.queue_time_us":964549}
I20260709 13:01:21.070374  4104 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:21.083559  4424 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.075963  4357 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:21.129321  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.155049  1545 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:21.131187  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:21.107496  4230 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.065907  4435 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.177s
I20260709 13:01:21.117434  4371 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.119611  1540 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:21.078858  4225 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:21.109674  2271 raft_consensus.cc:2955] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:21.091117  4429 raft_consensus.cc:697] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:21.091674  4345 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.165740  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:21.203862  1539 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:21.176177  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.209688  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:21.210574  1543 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.160152  4357 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:21.104893  4360 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:01:21.218924  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.220062  1545 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:21.183586  1622 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
W20260709 13:01:21.188841  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.097283  4324 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.192219  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:21.322690  1539 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:21.140244  4104 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.416862  4104 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.391110  4361 consensus_queue.cc:1059] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:21.219846  4261 raft_consensus.cc:697] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:21.160836  4407 consensus_queue.cc:1059] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.168s
I20260709 13:01:21.123931  4244 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.324555  4439 consensus_queue.cc:1059] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.173s
W20260709 13:01:21.392690  4431 log.cc:927] Time spent T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
W20260709 13:01:21.402652  4423 consensus_meta.cc:287] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.000s
I20260709 13:01:21.193356  4225 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:21.404731  4437 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:01:21.405489  4347 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.408847  4292 raft_consensus.cc:3055] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:21.403200  4422 log.cc:927] Time spent T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.624s	user 0.001s	sys 0.001s
W20260709 13:01:21.411247  4430 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.606s	user 0.001s	sys 0.003s
I20260709 13:01:21.325474  4360 consensus_queue.cc:1243] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer e37b8013aec24431a6672a857806329e log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:21.318537  4345 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.422617  3675 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.163321  4424 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:21.426874  2231 leader_election.cc:336] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.572s (SENT)
I20260709 13:01:21.430506  1622 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:21.432396  4428 log.cc:927] Time spent T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.624s	user 0.002s	sys 0.000s
I20260709 13:01:21.535285  4423 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:21.432986  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.450169  1616 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:21.460440  4393 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:01:21.465754  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 363248us
I20260709 13:01:21.531641  4292 raft_consensus.cc:740] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:21.565825  2234 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:21.440069  4250 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:21.456669  4230 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:21.479203  4294 consensus_meta.cc:287] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.126s	user 0.014s	sys 0.000s
I20260709 13:01:21.471334  4449 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:21.499563  1586 leader_election.cc:336] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.723s (SENT)
I20260709 13:01:21.464015  4349 consensus_queue.cc:1059] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:01:21.484968  4404 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:21.410909  4045 consensus_meta.cc:287] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.632s	user 0.016s	sys 0.000s
W20260709 13:01:21.522382  4440 log.cc:927] Time spent T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:01:21.382659  4249 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.579752  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1561) took 1033 ms. Trace:
I20260709 13:01:21.523059  4344 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.185256  4371 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.493510  4321 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.493777  4396 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.528596  1543 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
W20260709 13:01:21.527944  1661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.025s	sys 0.075s
I20260709 13:01:21.572037  4460 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:21.578245  4418 consensus_meta.cc:287] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 1.143s	user 0.012s	sys 0.002s
I20260709 13:01:21.526533  4441 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:21.549705  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 122888us
I20260709 13:01:21.591333  4405 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:21.596473  4405 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.598263  4321 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:21.488152  4429 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.598879  4321 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:21.453972  4436 log.cc:927] Time spent T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:01:21.576630  4225 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:21.576527  4424 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.569821  4445 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:21.574242  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 74724.1us
I20260709 13:01:21.576857  4345 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:21.592118  4450 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:01:21.585794  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:21.583676  1615 rpcz_store.cc:276] 0709 13:01:20.546793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.553263 (+  6470us) service_pool.cc:224] Handling call
0709 13:01:20.553639 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:20.554353 (+   714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:20.554398 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:20.554974 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:01:20.853035 (+298061us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:20.853092 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.854818 (+  1726us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:21.579547 (+724729us) raft_consensus.cc:1685] finished
0709 13:01:21.579567 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.579700 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3025,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":297646,"threads_started":1,"wal-append.queue_time_us":567488}
I20260709 13:01:21.569990  4336 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:21.591475  1661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.025s	sys 0.075s
W20260709 13:01:21.624784  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 717819us
I20260709 13:01:21.529285  4104 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.578454  4267 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:21.598418  4254 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:21.640331  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:21.542414  4442 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.641600  4442 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.643831  4442 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.573328  4447 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:21.644459  4447 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:21.645218  4447 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.646746  2264 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:21.566978  4361 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.647789  4361 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.649350  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54504 (request call id 476) took 1103 ms. Trace:
I20260709 13:01:21.649809  2264 rpcz_store.cc:276] 0709 13:01:20.545474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.552183 (+  6709us) service_pool.cc:224] Handling call
0709 13:01:21.649162 (+1096979us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54004e0554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:21.649285 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2368121216}
I20260709 13:01:21.650393  4361 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.584551  4300 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.651110  4300 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.585047  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1553) took 2103 ms. Trace:
I20260709 13:01:21.655637  1620 rpcz_store.cc:276] 0709 13:01:19.481262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.492565 (+ 11303us) service_pool.cc:224] Handling call
0709 13:01:19.492874 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:19.761754 (+268880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.761783 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:19.772341 (+ 10558us) log.cc:844] Serialized 52 byte log entry
0709 13:01:20.304642 (+532301us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:20.819238 (+514596us) log.cc:844] Serialized 14 byte log entry
0709 13:01:20.820744 (+  1506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.820827 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:21.402438 (+581611us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:21.580231 (+177793us) raft_consensus.cc:1685] finished
0709 13:01:21.584848 (+  4617us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.584980 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":284504,"prepare.queue_time_us":76567,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":10289,"raft.queue_time_us":270351,"raft.run_cpu_time_us":934,"raft.run_wall_time_us":109203,"spinlock_wait_cycles":12650368,"thread_start_us":965226,"threads_started":2,"wal-append.queue_time_us":948940}
I20260709 13:01:21.578532  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.574966  4324 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.599263  4405 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:21.588080  4439 raft_consensus.cc:3055] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:21.583841  4230 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.592109  4407 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:21.632320  4445 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.678886  1513 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:21.639446  4371 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:21.599974  4396 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.579195  4250 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:21.671638  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 76083.3us
I20260709 13:01:21.605927  4451 raft_consensus.cc:3055] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:21.586066  4045 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.573149  4393 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.671123  4254 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:21.674708  4361 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.678134  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.678141  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.578624  4261 consensus_queue.cc:237] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.636689  4336 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:21.706568  4414 consensus_meta.cc:287] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.003s
I20260709 13:01:21.707182  4321 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:21.679194  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.699460  4465 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.708338  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.585774  4449 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:21.719902  4453 log.cc:927] Time spent T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:21.721210  4449 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.639451  4455 raft_consensus.cc:3055] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:21.721879  4455 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:21.721997  4449 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.722671  4449 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.724368  4390 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.725690  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.726308  2270 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:21.727066  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.727746  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.728089  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.728832  2270 raft_consensus.cc:2393] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:21.729362  4423 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:21.729547  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.731319  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.732522  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.733316  4257 raft_consensus.cc:3055] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:21.733762  4257 raft_consensus.cc:740] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:21.736037  4449 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:21.737679   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:21.740408  3675 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.742214  4405 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:21.742985  4405 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.744679  4396 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:21.745206  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.745627  4462 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:21.747444  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:21.750120  1543 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:01:21.751173  1543 pending_rounds.cc:85] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 1
I20260709 13:01:21.751045  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:21.751794  1543 pending_rounds.cc:107] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:01:21.752130  1618 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:21.688488  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:21.751101  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.690371  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.677346  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.673416  4377 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.755319  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.670522  4339 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:21.757758  1546 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:21.757988  1620 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:21.671676  4439 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:21.694381  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.759228  2272 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:21.690052  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.761044  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.623862  4460 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.697649  2271 pending_rounds.cc:85] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Aborting all ops after (but not including) 6
I20260709 13:01:21.762265  2271 pending_rounds.cc:107] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Aborting uncommitted NO_OP operation due to leader change: 5.7
W20260709 13:01:21.762403  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.762637  2271 raft_consensus.cc:2889] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:21.674762  4300 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:21.690493  4451 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:21.685343  4442 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:21.701071  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.625142  4292 consensus_queue.cc:260] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.694994  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.703285  4250 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:21.704370  4230 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:21.681734  4407 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.705232  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1547) took 2294 ms. Trace:
I20260709 13:01:21.604029  4441 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.671324  4345 consensus_queue.cc:1059] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:01:21.669441  4104 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.715647  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.821691  1621 rpcz_store.cc:276] 0709 13:01:19.410752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.411212 (+   460us) service_pool.cc:224] Handling call
0709 13:01:19.411462 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:19.695788 (+284326us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:19.902178 (+206390us) log.cc:844] Serialized 14 byte log entry
0709 13:01:20.514333 (+612155us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b180035c140. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c6a6e64bc 00007f5c67a3448b 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de23a
0709 13:01:20.524602 (+ 10269us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:20.613264 (+ 88662us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4800150258. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6fa67aa1 00007f5c6fa5eb37 00007f5c6fa5e9ca 00007f5c6fb5626f 00007f5c6fb55f37 00007f5c6fb6a55c 00007f5c6fb6a508 00007f5c6fb6a488 00007f5c6fb6a443 00007f5c6fb696ec 00007f5c6ea93a96
0709 13:01:20.830003 (+216739us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b180035c140. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a1f2a6 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a
0709 13:01:21.423591 (+593588us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b2c0005b5c8. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:01:21.424397 (+   806us) log.cc:844] Serialized 26 byte log entry
0709 13:01:21.424578 (+   181us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:21.424624 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.424717 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:21.431755 (+  7038us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:21.704997 (+273242us) raft_consensus.cc:1685] finished
0709 13:01:21.705015 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.705173 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":380475,"prepare.queue_time_us":557538,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":20768,"raft.queue_time_us":296628,"raft.run_cpu_time_us":1414,"raft.run_wall_time_us":79249,"spinlock_wait_cycles":141211136,"thread_start_us":569108,"threads_started":2,"wal-append.queue_time_us":828225}
I20260709 13:01:21.699659  4361 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.826920  2267 raft_consensus.cc:2393] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:21.716305  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.716509  4336 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:21.752194  1543 raft_consensus.cc:2889] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:21.830752  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.832312  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.833007  1543 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:21.834347  1543 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:01:21.753724  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:21.592547  4344 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.755043  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.774711  2268 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:21.775606  1689 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:21.837416  1539 raft_consensus.cc:2368] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5.
I20260709 13:01:21.838280  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.723229  4455 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.777949  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.780764  1694 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
W20260709 13:01:21.688549  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.778178  1588 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:21.784984  1544 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:21.786768  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:21.787838  1614 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:21.789011  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:21.793099  1697 raft_consensus.cc:2410] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:21.775779  2232 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:21.805923  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:21.806666  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.745524  4405 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.710430  4445 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:21.734799  4257 consensus_queue.cc:260] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.814486  1695 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:21.818336  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.708703  4465 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.863765  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.858139  1691 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:21.697917  4254 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.790668  4368 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.866391  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.867154  1695 raft_consensus.cc:2393] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:21.839342  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.678746  4294 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:21.867504  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.747015  4357 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.839391  1539 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:21.840417  1546 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:21.841154  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:21.844348  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 66267.7us
I20260709 13:01:21.872881  1694 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:21.873603  1588 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:21.837868  4230 raft_consensus.cc:3055] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:21.846158  1541 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.846864  1548 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:21.847201  1692 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:21.842538  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:21.854287  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 78591.6us
I20260709 13:01:21.811372  4442 raft_consensus.cc:697] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:21.820967  4292 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:21.784929  4339 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.893085  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:21.862391  1543 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:21.785770  4377 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.868468  1697 raft_consensus.cc:2393] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:21.819471  4449 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:01:21.855255  2264 raft_consensus.cc:2393] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:21.870494  2269 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:01:21.870808  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.746205  4462 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.878569  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.879285  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:21.905606  1694 raft_consensus.cc:2376] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5. Re-sending same reply.
I20260709 13:01:21.881012  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:21.881893  4464 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:21.907793  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:21.882087  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.882485  4230 raft_consensus.cc:740] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:21.915544  4337 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:21.916190  4230 consensus_queue.cc:260] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.917650  4230 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.882095  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.918372  1691 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:21.883594  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.888315  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.853747  4345 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:21.875166  4455 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:21.863662  4424 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:21.897248  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.898604  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.900750  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.895624  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:21.933177  1697 raft_consensus.cc:2410] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:21.933377  1615 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:21.908435  1620 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:21.906368  1540 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:21.910463  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.876598  4257 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:21.922577  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:21.934732  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.894170  4250 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:21.925794  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.926546  1696 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:21.928812  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:21.941159  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.941728  1546 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:21.889756  4294 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.938769  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.947664  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.948036  1697 raft_consensus.cc:2376] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7. Re-sending same reply.
I20260709 13:01:21.948450  1692 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:21.875438  4368 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.944658  1586 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:21.934772  4441 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:21.952581  1661 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:21.953157  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.931191  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:21.940614  4227 consensus_meta.cc:287] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.827s	user 0.018s	sys 0.000s
I20260709 13:01:21.946491  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:21.957018  1615 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:21.950093  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.950438  1586 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:21.944875  1541 raft_consensus.cc:2410] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:21.950018  2231 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:21.954576  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.909719  4447 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.960081  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.960726  1695 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:21.961405  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.961591  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.932512  4424 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.964597  1661 leader_election.cc:400] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5.
I20260709 13:01:21.964962  1661 leader_election.cc:403] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:21.944119  2232 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:21.958547  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.961616  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:21.962023  1546 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:21.939646  4250 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.968726  4250 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:21.962486  1695 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:21.963157  1690 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:21.950804  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:21.972339  1692 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:21.973191  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.974063  1692 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:21.974246  2264 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:21.965627  1548 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:21.974975  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.966841  1586 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:21.870146  4451 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:21.979666  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.968067  4390 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:21.976150  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.967293  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.980436  1697 raft_consensus.cc:2410] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:21.981189  1586 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:21.984802  1695 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:21.985411  4321 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:21.985885  4321 raft_consensus.cc:697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:21.985939  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.987103  1541 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:21.987197  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.986816  4321 consensus_queue.cc:237] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:21.988639  1541 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:21.990590  1541 raft_consensus.cc:1240] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:21.991523  1586 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:21.992483  4354 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:21.993618  1586 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:21.981897  1661 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:21.982554  1692 raft_consensus.cc:2410] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:21.994534  4358 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:21.981961  1548 raft_consensus.cc:1240] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:21.994915  4358 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.995342  4358 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:21.996106  1541 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:21.996276  4354 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:21.997454  1541 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:21.997612  1586 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:21.998569  4354 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:22.000332  4404 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.000432  1586 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:22.000963  4404 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:22.001483  1586 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:22.001334  4354 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:21.958271  4361 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.003825  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.007061  1586 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:21.994906  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.962455  4314 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:21.955453  4345 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:21.956923  4045 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:21.960475  4429 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:21.976090  4424 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:21.933300  4464 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:22.039681  1697 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:22.043749  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:22.043962  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.051455  1693 raft_consensus.cc:2410] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:01:22.044663  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:21.956550  4336 consensus_queue.cc:1059] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:01:21.957566  4261 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:01:21.983930  4347 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:22.103015  1691 raft_consensus.cc:2410] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:21.979215  4423 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:22.055936  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.113051  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.076929  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.052003  1586 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:21.984427  4390 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:22.106523  4467 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5.
I20260709 13:01:22.107110  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.043779  4345 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.046773  4314 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.121681  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:22.107450  4468 log.cc:927] Time spent T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:01:22.107885  4464 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:21.983300  4227 consensus_queue.cc:1059] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 13:01:22.109135  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:22.126022  1691 raft_consensus.cc:2376] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 7. Re-sending same reply.
I20260709 13:01:22.015056  4225 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:22.096212  4324 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:22.003605  4300 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 13:01:22.126245  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.099066  4454 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.122502  1692 raft_consensus.cc:2376] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 4. Re-sending same reply.
I20260709 13:01:22.128418  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:22.052426  4461 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:22.096045  4294 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:22.040185  4358 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:22.151094  4344 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:22.112609  4423 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.171030  4447 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:22.123786  4390 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.152009  4454 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:22.172937  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.175365  4254 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:22.138765  4324 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:22.184983  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:22.151835  4337 consensus_queue.cc:1059] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:01:22.176069  4377 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:22.176419  4339 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:22.177402  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.190645  1691 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:22.175649  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:49328
I20260709 13:01:22.191795  1692 raft_consensus.cc:606] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:22.178124  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:22.125774  4345 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.120898  4393 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:22.124361  4314 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.125531  4104 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.003350  4442 consensus_queue.cc:237] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:22.152302  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:22.185721  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:22.186177  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 134277us
I20260709 13:01:22.183490  4225 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:22.203289  1586 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:22.186836  4324 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:22.182392  4423 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.206559  4465 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.214167  1693 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:01:22.203553  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.197527  4475 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:01:22.186944  4407 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.197225  4337 consensus_queue.cc:1243] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Peer e37b8013aec24431a6672a857806329e log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:22.224920  1586 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:22.226133  1691 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:22.217471  4267 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 13:01:22.236567  1693 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:22.237699  4404 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.215909  4225 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:22.240466  4485 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:22.241030  2266 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:22.226963  4320 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:22.212226  4460 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:22.231882  4347 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:22.254961  4347 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:22.249491  4320 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.256564  4320 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.250604  4358 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:22.259891  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.269335  4393 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:22.269963  4393 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:22.272257  4393 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:22.261839  4485 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:22.273819  4485 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:22.276937  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:22.247259  4225 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.283727  4481 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:22.260082  4460 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.289621  4345 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:22.299279  4454 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:22.306535  4357 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:22.307683  4389 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.302387  4388 raft_consensus.cc:2955] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:22.317970  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:22.301119  4250 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:22.300413  4424 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:22.303462  4347 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.314905  4485 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.326704  4368 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.327183  4389 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:22.331210  4250 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:22.328637  4424 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.330917  4439 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:22.336684  4241 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:22.337021  4439 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.341444  4244 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.345573  4451 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:22.347183  4414 raft_consensus.cc:3055] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:22.303108  4460 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:22.347381  4462 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:22.350956  4389 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:22.330153  4354 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:22.351436  4414 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:22.322175  4390 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:22.356828  4460 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.357769  4390 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.357970  4423 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:22.358739  4414 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:22.359525  4429 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:22.359965  4423 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:22.359972  4414 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:22.247757  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.427807  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.433298  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.436546  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.438632  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.440574  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.441557  1541 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:22.442983  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2358) took 1310 ms. Trace:
I20260709 13:01:22.445605  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.453091  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33072 (request call id 133) took 7709 ms. Trace:
I20260709 13:01:22.456629  1544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:01:22.543740  1588 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:22.544325  1544 raft_consensus.cc:606] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:22.545058  1544 raft_consensus.cc:614] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:22.545192  4241 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.546114  4241 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:22.546622  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.457264  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.457957  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.463568  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.466010  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.473351  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.472582  1442 catalog_manager.cc:5697] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.292181  1587 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:22.482162  1618 raft_consensus.cc:2393] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:22.500200  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:22.502468  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:22.503700  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.504835  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.506387  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:22.509102  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.510565  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.324919  2231 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:22.524256  1513 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:22.530225  2264 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:22.532222  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:22.532357  4227 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:22.533574  4230 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:22.538786  2269 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:22.553968  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:22.540895  1540 rpcz_store.cc:276] 0709 13:01:21.175666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.175850 (+   184us) service_pool.cc:224] Handling call
0709 13:01:22.442488 (+1266638us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b540033d954. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:22.442759 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604221696}
I20260709 13:01:22.551776  4347 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:01:22.558133  1544 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:22.565688  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.623694  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:22.567389  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:22.582403  4393 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:22.541496  1443 rpcz_store.cc:276] 0709 13:01:14.743880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.744190 (+   310us) service_pool.cc:224] Handling call
0709 13:01:22.452836 (+7708646us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:21.487566 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:21.523518 (+ 35952us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:21.523561 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:01:21.523582 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:21.855692 (+332110us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:21.864100 (+  8408us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:21.866534 (+  2434us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:01:21.886546 (+ 20012us) tablet.cc:701] Row locks acquired
0709 13:01:21.886571 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:01:21.886786 (+   215us) write_op.cc:270] Start()
0709 13:01:21.886935 (+   149us) write_op.cc:276] Timestamp: P: 1783602081886718 usec, L: 0
0709 13:01:21.886968 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:01:21.956353 (+ 69385us) log.cc:844] Serialized 5772 byte log entry
0709 13:01:22.361308 (+404955us) op_driver.cc:464] REPLICATION: finished
0709 13:01:22.363790 (+  2482us) write_op.cc:301] APPLY: starting
0709 13:01:22.363902 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:22.364369 (+   467us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:22.364513 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:22.365921 (+  1408us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:22.366177 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:01:22.366223 (+    46us) write_op.cc:312] APPLY: finished
0709 13:01:22.367042 (+   819us) log.cc:844] Serialized 101 byte log entry
0709 13:01:22.367223 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.367365 (+   142us) write_op.cc:454] Released schema lock
0709 13:01:22.367442 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:22.367817 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.367851 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":204765,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":2263,"apply.run_cpu_time_us":3926,"apply.run_wall_time_us":3974,"num_ops":14,"prepare.queue_time_us":847954,"prepare.run_cpu_time_us":31528,"prepare.run_wall_time_us":721194,"raft.queue_time_us":116329,"raft.run_cpu_time_us":1240,"raft.run_wall_time_us":1881,"replication_time_us":474220,"thread_start_us":661386,"threads_started":4,"wal-append.queue_time_us":276867}]]}
W20260709 13:01:22.587528  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.588596  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 296369us
I20260709 13:01:22.589053  1696 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:22.589807  4354 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:22.591491  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 51440.6us
I20260709 13:01:22.592047  1547 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:22.593053  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:22.595578  4358 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.583101  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.625670  1542 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
W20260709 13:01:22.628590  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.637502  4358 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:22.639164  4345 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.639665  4227 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:22.641500  1690 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.642105  1587 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:22.643117  4230 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:22.643674  1691 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:22.644502  4393 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:22.645078  4393 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.645270  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.646137  4230 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.646858  1547 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:22.647748  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.648748  1693 raft_consensus.cc:2393] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:01:22.654580  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 50859.3us
W20260709 13:01:22.655074  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 131234us
I20260709 13:01:22.655608  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:22.654820  1546 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:01:22.657919  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.646888  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:22.650486  1688 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.645537  4393 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:22.628031  4354 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:22.650864  1697 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:22.650094  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:22.677211  2267 raft_consensus.cc:2368] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7.
I20260709 13:01:22.671054  4354 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:22.674474  2271 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
W20260709 13:01:22.690609  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.679387  4324 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:22.702956  4324 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:22.695950  1543 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:22.711738  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.711874  1694 raft_consensus.cc:2410] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:22.715173  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.715744  1539 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:22.698536  1548 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:22.752954  1697 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:22.753603  1618 raft_consensus.cc:1240] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:22.754164  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:22.754401  4320 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:22.703372  4225 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:22.720734  4451 consensus_queue.cc:1059] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:01:22.698797  1442 catalog_manager.cc:5697] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 5, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 5 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.705976  1586 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:22.721765  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:22.755384  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:22.713903  4358 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:22.769304  1539 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:22.779053  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.858795  1618 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:22.851478  1690 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:22.934894  1697 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:22.755923  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.778225  1546 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
W20260709 13:01:22.926753  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 284882us
W20260709 13:01:22.857599  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 215500us
W20260709 13:01:22.797163  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.771211  1688 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:22.777891  1696 raft_consensus.cc:2393] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 4: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:01:22.867749  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 170774us
I20260709 13:01:22.866544  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:22.942240  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:22.770020  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:22.951917  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:22.772768  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 86151.3us
I20260709 13:01:22.866988  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:22.868309  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 543235us
W20260709 13:01:22.778388  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 56991.8us
I20260709 13:01:22.767788  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:22.895756  1692 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:22.997793  4469 raft_consensus.cc:2764] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:22.759692  4315 consensus_queue.cc:1059] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.239s
I20260709 13:01:22.998106  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:22.999111  4439 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.999786  4439 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.002751  4439 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.864163  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:22.756500  4314 consensus_meta.cc:287] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.009s
I20260709 13:01:22.871160  4454 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:23.003290  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 332) took 1321 ms. Trace:
I20260709 13:01:22.757438  4225 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:22.766434  4320 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:22.999341  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.937763  4227 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:22.997800  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:22.939793  4347 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:22.866626  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:23.010816  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:23.011473  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.020597  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.021483  2231 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:23.021893  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:22.866034  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:23.023397  1587 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:22.870131  4292 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 13:01:23.023032  2264 raft_consensus.cc:2376] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8. Re-sending same reply.
I20260709 13:01:23.011265  1544 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 2.
I20260709 13:01:23.015295  1543 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:22.765684  1442 catalog_manager.cc:5697] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.757486  4241 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:22.770524  4354 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:22.860708  4455 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.933765  4324 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:23.015847  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:22.780602  4452 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:23.013460  1694 rpcz_store.cc:276] 0709 13:01:21.682073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.906201 (+224128us) service_pool.cc:224] Handling call
0709 13:01:23.003066 (+1096865us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54001b85d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:23.003220 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535753088}
I20260709 13:01:23.019246  1690 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:22.764374  4451 raft_consensus.cc:3055] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:22.773272  4321 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:23.016830  1697 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 2.
I20260709 13:01:23.025761  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.029011  4439 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:23.054615  1547 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.054332  4324 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.056006  1693 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:23.056571  1661 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:23.057287  1663 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:23.048115  1442 catalog_manager.cc:5697] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 3 to 5, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 5 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:01:23.028407  2266 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.032033  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.013268  4454 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:22.761261  4464 consensus_queue.cc:1059] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.266s
I20260709 13:01:23.033039  1614 raft_consensus.cc:2410] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:23.017365  4314 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.034323  4490 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:23.035169  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:23.023389  4315 raft_consensus.cc:3055] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:23.036031  2232 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:23.036585  2272 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:23.040757  4452 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.043583  1694 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:23.053409  1690 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:23.012895  4393 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.047569  4451 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:23.056761  4324 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:23.030884  1586 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:23.062424  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:23.077152  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.049597  4347 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.108202  1587 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:23.084455  1623 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.060175  1442 catalog_manager.cc:5697] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:23.085140  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.054195  4462 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:23.040622  4424 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:23.088697  4315 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:23.097995  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 71106.1us
I20260709 13:01:23.098783  4418 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:23.099606  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 94050.2us
I20260709 13:01:23.098850  4451 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.099925  1663 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:23.100709  4324 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:23.101696  1692 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:23.102540  1697 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:23.102002  4490 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.102880  4225 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:23.103799  1695 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:23.104629  4314 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:23.091897  4452 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.106889  4393 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:23.087970  4454 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:23.142328  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.114768  1442 catalog_manager.cc:5697] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 5 to 7, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 7 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:01:23.111874  1696 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:23.093324  4227 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:23.114636  4320 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:23.116496  4324 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:23.162840  2232 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:23.163512  4324 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.116407  4358 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:23.167805  4358 raft_consensus.cc:697] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:23.169173  4358 consensus_queue.cc:237] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:23.130016  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 100244us
W20260709 13:01:23.131731  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 47032.4us
I20260709 13:01:23.172191  2231 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:23.173185  1587 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:23.172499  1442 catalog_manager.cc:5697] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index -1 to 2, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added, pending config changed, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:23.174482  4321 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.121692  4315 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.175726  1586 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:23.176204  4315 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:23.176450  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 53472.5us
W20260709 13:01:23.178831  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.133513  4490 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:23.134384  4314 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:23.179665  4320 raft_consensus.cc:697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:23.180014  4314 raft_consensus.cc:697] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:23.175293  1442 catalog_manager.cc:5697] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:23.180852  4320 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.181316  4314 consensus_queue.cc:237] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.182089  1663 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:23.095366  4455 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.183693  1663 leader_election.cc:400] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 5.
I20260709 13:01:23.185273  4455 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:23.129014  4462 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.185436  1663 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:23.186008  4324 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.186661  4393 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:23.187044  4393 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:23.187536  4462 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:23.136363  4354 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:23.137920  1694 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:01:23.188318  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.143556  4244 consensus_meta.cc:287] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.788s	user 0.014s	sys 0.005s
I20260709 13:01:23.117662  4418 raft_consensus.cc:697] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:23.147716  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2495) took 1289 ms. Trace:
I20260709 13:01:23.121688  4225 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:23.086766  4241 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:01:23.119997  4292 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:01:23.171169  4347 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:23.175278  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:23.187793  1442 catalog_manager.cc:5697] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 5, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 5 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:01:23.120782  4451 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.192379  1547 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
W20260709 13:01:23.196019  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 46047.5us
I20260709 13:01:23.206238  1690 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:01:23.201153  1623 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:23.202950  2266 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:23.192039  1695 rpcz_store.cc:276] 0709 13:01:21.858225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.986981 (+128756us) service_pool.cc:224] Handling call
0709 13:01:23.147482 (+1160501us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000974d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:23.147654 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2565386112}
I20260709 13:01:23.189256  4244 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:23.189797  4393 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.210108  4418 consensus_queue.cc:237] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:23.203384  4452 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:23.208634  4337 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.209231  4424 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:23.208470  1442 catalog_manager.cc:5697] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 4, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 4 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:23.209968  1587 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:23.208495  1548 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:23.223567  4424 raft_consensus.cc:697] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:23.259873  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 87906.9us
I20260709 13:01:23.259276  1442 catalog_manager.cc:5697] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 5, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 5 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
W20260709 13:01:23.256635  4345 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.001s	sys 0.006s
I20260709 13:01:23.203493  4227 consensus_queue.cc:1059] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:01:23.253809  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:23.244549  4321 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:23.237991  4347 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:23.223680  4337 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.262476  4452 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:23.277597  4345 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.002s	sys 0.006s
I20260709 13:01:23.277467  1442 catalog_manager.cc:5697] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 4 to 5, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 5 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.262219  4354 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:23.272972  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:23.273393  4315 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:23.280299  4324 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:23.256220  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 198191us
I20260709 13:01:23.286744  4354 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.276849  4225 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.291929  4354 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:23.297155  1620 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.298444  4461 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:23.298892  4461 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:23.299381  4461 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:23.303603  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 47006.1us
I20260709 13:01:23.303332  1442 catalog_manager.cc:5697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 4 to 6, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 6 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:01:23.305521  1442 catalog_manager.cc:5697] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:23.307314  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 53606.1us
I20260709 13:01:23.307085  1442 catalog_manager.cc:5697] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.261253  4424 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:23.313999  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.313508  1442 catalog_manager.cc:5697] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 4 to 5, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 5 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:23.321295  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:23.292443  4257 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:23.296635  4315 raft_consensus.cc:697] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:23.342547  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1501) took 1586 ms (client timeout 2086 ms). Trace:
I20260709 13:01:23.342703  2234 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:23.344703  1542 rpcz_store.cc:269] 0709 13:01:21.755925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.756046 (+   121us) service_pool.cc:224] Handling call
0709 13:01:23.321164 (+1565118us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b54000c6554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:23.342480 (+ 21316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370507136}
I20260709 13:01:23.318687  4227 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:01:23.323325  4257 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:23.313402  4393 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:23.373467  1513 leader_election.cc:400] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7.
I20260709 13:01:23.387524  1513 leader_election.cc:403] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:23.321321  4454 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:23.382087  4244 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:01:23.384482  4499 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.091s	user 0.001s	sys 0.001s
W20260709 13:01:23.386360  4502 log.cc:927] Time spent T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:01:23.370162  4465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.010s	sys 0.014s
I20260709 13:01:23.379562  4321 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:23.391358  4465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.010s	sys 0.015s
I20260709 13:01:23.378803  4461 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:23.391909  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 70705.8us
I20260709 13:01:23.396883  1587 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:23.397794  4347 raft_consensus.cc:2764] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:01:23.394542  4321 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.399076  4321 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:23.393620  4389 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:01:23.434371  2271 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:23.387524  4257 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:23.427985  1689 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
W20260709 13:01:23.427778  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 54531us
W20260709 13:01:23.390614  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 203709us
W20260709 13:01:23.418076  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 468942us
I20260709 13:01:23.388689  4244 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:23.485535  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 51213.7us
I20260709 13:01:23.520565  1620 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:23.413673  4352 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:23.428218  4461 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:23.427373  4460 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:23.472713  4490 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:23.389451  4292 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
W20260709 13:01:23.523468  2231 connection.cc:256] RPC call timeout handler was delayed by -1.0160530139999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
I20260709 13:01:23.534446  1513 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:23.415220  4337 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:23.523207  4439 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.420670  4241 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 13:01:23.531574  4249 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:23.432809  4505 consensus_queue.cc:1059] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.147s
I20260709 13:01:23.529211  4352 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:23.536273  4517 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.419945  4423 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.152s
W20260709 13:01:23.561807  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 240124us
W20260709 13:01:23.546706  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 148487us
I20260709 13:01:23.516269  4320 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:23.565814  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:01:23.566394  1542 raft_consensus.cc:606] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:23.566716  1542 raft_consensus.cc:614] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:23.569193  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.572923  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.577438  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.577898  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.572544  4517 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:23.579648  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 67658.1us
I20260709 13:01:23.579897  2268 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:23.581465  4517 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:23.574455  4366 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.582361  4366 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:23.570698  4462 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:01:23.556161  4460 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:23.585642  4460 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:23.537082  4315 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.567085  4320 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.564102  4249 raft_consensus.cc:697] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:23.595913  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:23.598642  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:23.602682  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:23.615166  2264 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:23.591491  4503 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:01:23.578438  4393 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:23.587374  4045 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:23.629016  4045 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.618417  4241 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:23.630038  4241 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:23.632012  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:23.601367  4454 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:23.629527  4045 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.562641  4439 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.627774  2234 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:23.639971  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 44435.2us
I20260709 13:01:23.601075  4320 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:23.617677  4314 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:23.642915  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 44164.9us
I20260709 13:01:23.607332  4469 consensus_queue.cc:1059] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:01:23.649029  4519 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.650554  4451 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:23.648206  4439 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:23.634892  4462 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:23.661214  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:23.660182  4451 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:23.662037  2266 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:23.662218  4451 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.663280  4523 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:23.574651  4244 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.664726  4244 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:23.636220  4241 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:23.656615  2263 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:23.684167  2264 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:23.686090  1587 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:23.683180  4320 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.694069  4320 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.696740  4320 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:23.689116  4460 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.709753  1511 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:23.667215  4257 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:23.698889  4460 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:23.728174  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 69119.5us
I20260709 13:01:23.660108  4354 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.657230  4314 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:23.736580  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 104616us
I20260709 13:01:23.641984  4249 consensus_queue.cc:237] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:23.684906  4523 consensus_queue.cc:1059] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:01:23.741503  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.747738  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:23.741292  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:23.748963  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 63288.1us
I20260709 13:01:23.751705  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:23.709395  4423 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.748626  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.790262  1696 raft_consensus.cc:2376] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8. Re-sending same reply.
I20260709 13:01:23.801267  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.800099  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.804725  1693 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:23.807030  1662 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:23.741233  4225 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:23.753877  4490 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7.
I20260709 13:01:23.743575  4469 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:23.751786  4354 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:23.803459  1514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.776s (SENT) [suppressed 33 similar messages]
I20260709 13:01:23.813822  1662 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:23.819994  1511 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:23.825310  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2467) took 2141 ms (client timeout 1953 ms). Trace:
W20260709 13:01:23.825753  1689 rpcz_store.cc:269] 0709 13:01:21.683518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.925460 (+241942us) service_pool.cc:224] Handling call
0709 13:01:23.825100 (+1899640us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540035cd54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:23.825228 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3112390528}
I20260709 13:01:23.827562  4452 raft_consensus.cc:3055] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:23.827984  4452 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:23.828502  4414 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:23.829057  4414 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:23.828933  4452 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:23.829947  4452 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:23.830003  4414 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:23.831044  4366 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:23.811549  4225 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.832249  4225 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.832085  4045 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:23.834435  4045 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:23.810748  1661 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:23.749003  4292 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:01:23.838649  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.839623  1692 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:23.820899  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.839958  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.840519  1690 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:23.838546  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.842612  1691 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:23.792176  4462 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:01:23.709139  4519 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:23.843990  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 134074us
I20260709 13:01:23.844967  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:24.045444  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 198153us
I20260709 13:01:23.848007  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:24.069629  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.846552  1695 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
W20260709 13:01:23.879704  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.893989  1688 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:23.909411  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 98708.9us
I20260709 13:01:24.150564  1620 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:23.893217  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:23.904649  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.158429  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:23.908288  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.070448  1623 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:01:24.161136  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:24.161188  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.904893  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.164126  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.165141  1617 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:24.165930  1694 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:24.166617  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:24.166761  4527 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:24.131846  4225 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:24.167237  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:24.109205  4461 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.168314  1690 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:24.170156  4225 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:24.169931  4461 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:24.167346  1548 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:23.838500  4423 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.172061  4461 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:24.068610  4257 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:24.053858  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:24.186405  1621 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.905206  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.173427  1618 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:24.173547  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1576) took 1648 ms. Trace:
I20260709 13:01:23.892700  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.166546  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:23.845230  4490 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:23.900251  4321 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:24.188911  4469 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:24.189200  4241 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:24.189489  4469 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.190872  4321 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:24.192552  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:24.192049  4469 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:24.193233  4358 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.193819  4358 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:24.194756  2263 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:24.195777  4532 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:24.196472  4532 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.198153  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:24.200099  4451 consensus_meta.cc:287] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 13:01:24.200572  4451 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.200941  4337 raft_consensus.cc:3055] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:24.193252  1617 raft_consensus.cc:2368] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7.
I20260709 13:01:24.201376  4337 raft_consensus.cc:740] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:24.202224  2263 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:24.202378  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.202672  4451 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:24.203157  1617 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:24.183597  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.203882  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:24.052354  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.187291  1616 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:24.187706  1688 rpcz_store.cc:276] 0709 13:01:22.509350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.086478 (+577128us) service_pool.cc:224] Handling call
0709 13:01:23.893495 (+807017us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b5800003998. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb17fc0 00007f5c6fb02929 00007f5c6fb023d2 00007f5c69079bd4
0709 13:01:23.893741 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.157151 (+263410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.157491 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5184768}
I20260709 13:01:23.905344  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:24.052187  4528 log.cc:927] Time spent T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:01:24.164078  4460 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:24.172674  4423 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:24.188802  2271 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:24.188651  4315 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.205031  1691 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:23.882031  4523 raft_consensus.cc:3055] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:24.184432  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 370663us
I20260709 13:01:24.181694  2234 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:23.906294  4354 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.166625  4519 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:23.905330  4531 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:24.208074  1622 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:24.213377  1614 raft_consensus.cc:2410] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:24.159552  1692 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:24.202558  4337 consensus_queue.cc:260] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:24.207465  4439 consensus_queue.cc:1059] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:01:24.214430  4315 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.212706  4523 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:24.249838  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.217818  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.218250  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.288053  1623 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:24.287932  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:24.222280  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.200935  4532 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:24.235857  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.200136  4469 consensus_queue.cc:1059] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:01:24.208307  4527 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:24.292155  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 85326us
I20260709 13:01:24.290453  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:24.251776  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 43732.3us
W20260709 13:01:24.285398  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 124564us
I20260709 13:01:24.216005  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:24.287360  1615 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:24.235070  4531 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:24.295490  1614 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:24.287381  1617 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:24.253136  4257 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:24.316783  1615 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:24.317873  2234 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:24.318168  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:24.318496  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:24.319870  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.321544  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:24.322024  1616 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:24.323731  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.324667  1615 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:24.322114  1689 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:24.325716  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 197429us
W20260709 13:01:24.326508  1588 leader_election.cc:336] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Timed out: RequestConsensusVote RPC to 127.0.107.132:39517 timed out after 1.667s (SENT)
I20260709 13:01:24.326910  1588 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:24.282084  4354 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.293282  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:24.331130  1617 raft_consensus.cc:1240] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:24.332273  4527 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:24.314409  4519 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:24.386689  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:24.433452  1615 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:24.435155  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:24.434301  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.346789  1620 raft_consensus.cc:2393] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:24.435976  1688 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:24.436383  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 220553us
I20260709 13:01:24.317493  4531 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:24.410668  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 95920.3us
I20260709 13:01:24.326807  4469 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:24.354423  1622 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:24.441252  1689 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
W20260709 13:01:24.347023  4452 consensus_meta.cc:287] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
I20260709 13:01:24.408859  4320 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:24.467198  1615 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:24.320261  4358 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:24.394711  4534 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.013s	sys 0.024s
I20260709 13:01:24.340459  4315 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:24.346354  4354 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:24.470949  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 156185us
I20260709 13:01:24.445448  4388 raft_consensus.cc:3055] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:24.403167  4523 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.342382  4352 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.448227  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.479105  1618 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 3.
I20260709 13:01:24.409837  4249 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:24.467975  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:24.465219  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:24.469101  1623 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:24.449994  4460 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:24.482498  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 156013us
I20260709 13:01:24.465605  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:24.442595  2263 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:24.449513  4469 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:24.486366  1692 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:24.464658  4532 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.439321  4439 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 13:01:24.450704  4455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.008s	sys 0.004s
I20260709 13:01:24.474014  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:24.476414  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:24.496680  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.471882  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.486894  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:24.401187  4244 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.736s	user 0.003s	sys 0.008s
I20260709 13:01:24.495550  1586 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:24.438895  4519 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.500947  1662 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:24.508397  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:24.472801  4388 raft_consensus.cc:740] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:24.506585  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:24.501833  4455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.008s	sys 0.004s
I20260709 13:01:24.522552  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.525990  1618 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:24.512847  1615 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:24.488399  4469 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.539707  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.496094  4429 raft_consensus.cc:3055] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:24.566639  2232 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:24.494784  4523 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:24.539577  4452 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.505729  4532 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.516402  4315 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:24.505733  4424 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.551812  4519 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:24.552614  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:24.555562  4366 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:24.541244  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:24.540184  4461 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 13:01:24.634770  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 82222.1us
I20260709 13:01:24.559548  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:24.560606  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:24.495538  4249 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:24.563814  1545 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:24.488520  4460 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:24.569959  4388 consensus_queue.cc:260] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.506155  4352 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:24.541656  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:24.546551  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:24.648940  1691 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:24.539978  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:24.546789  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:24.546835  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:24.547338  1623 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:24.542760  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:24.652518  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:24.653493  1689 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:01:24.654502  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:24.551054  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:24.539733  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:24.555323  1621 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
W20260709 13:01:24.598183  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:24.656883  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.541795  1617 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:24.568709  4429 raft_consensus.cc:740] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:24.621068  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 78983us
W20260709 13:01:24.625074  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:24.685372  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.520957  4534 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.625708  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:24.549729  4320 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:24.641534  1688 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:24.628245  4244 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.679526  1546 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:24.655151  1689 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:24.687379  1623 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:24.696151  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.697108  1623 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:24.687796  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 51883us
I20260709 13:01:24.625195  4315 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:24.691709  1694 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:24.624018  4536 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:24.699896  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:24.703428  1688 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:24.646169  4393 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:24.624729  4452 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.706406  1588 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:24.707331  1617 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:24.718895  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.717293  1588 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:24.707751  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.712792  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:24.723332  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.721472  4225 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:24.724888  4225 raft_consensus.cc:697] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:24.725862  4225 consensus_queue.cc:237] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.641412  4366 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.636106  4424 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.729331  4366 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:24.634327  4455 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:01:24.730365  4424 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:24.739553  1623 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:24.731325  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:24.692169  4320 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:24.748718  1688 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:01:24.705502  4315 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:24.756008  1694 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:24.703233  4536 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.701742  4358 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:24.751063  1688 pending_rounds.cc:85] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 4
I20260709 13:01:24.764129  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.764878  1619 raft_consensus.cc:2393] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:24.757706  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.771889  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.713099  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:24.730607  4531 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.753038  4320 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:24.760551  1688 pending_rounds.cc:107] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:01:24.781661  1688 raft_consensus.cc:2889] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:24.702659  4244 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:24.785837  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.789171  1691 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:24.722041  4439 consensus_queue.cc:1059] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:01:24.774017  1623 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:24.760808  4536 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.799304  1689 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:24.701733  4534 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:24.799736  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:24.827870  1694 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:24.989735  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:24.889156  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.801307  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:24.989017  1696 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:01:24.992116  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.998512  1696 pending_rounds.cc:85] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 5
I20260709 13:01:24.998772  1696 pending_rounds.cc:107] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:01:24.998840  1623 raft_consensus.cc:2393] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:24.990370  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:24.999061  1696 raft_consensus.cc:2889] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:24.999332  1691 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.884660  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.878485  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.792119  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:24.806650  1622 raft_consensus.cc:1240] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:24.997570  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 280407us
I20260709 13:01:24.995813  1689 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
W20260709 13:01:24.905503  4418 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.522s	user 0.003s	sys 0.030s
I20260709 13:01:24.892979  4414 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.938071  4527 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.031140  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.005416  1620 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:24.804040  4462 consensus_queue.cc:1059] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.213s
I20260709 13:01:25.040812  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:25.006721  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:24.803577  4455 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.219s
I20260709 13:01:25.042783  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:25.008076  4547 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:01:25.012360  4244 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:25.013859  1691 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
W20260709 13:01:25.002485  4418 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.619s	user 0.008s	sys 0.035s
I20260709 13:01:25.033267  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:25.005270  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:25.005860  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 204004us
I20260709 13:01:25.038662  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:25.035288  2234 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:25.041020  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:24.801141  4545 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.223s
I20260709 13:01:24.806236  4358 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:25.037199  4552 log.cc:927] Time spent T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:01:25.078276  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.092808  1623 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:25.093183  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.030162  4314 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:25.002271  4393 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:25.079980  1620 raft_consensus.cc:2393] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:25.084990  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.088685  1511 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:25.089543  1696 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:25.100262  1586 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:25.074445  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 457086us
I20260709 13:01:25.094758  1619 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:24.773245  4429 consensus_queue.cc:260] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.030548  4414 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.103645  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:24.898850  4249 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.112345  1688 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:25.112385  1690 raft_consensus.cc:1240] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:25.047883  4455 consensus_queue.cc:1243] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:25.085320  4558 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:25.123221  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:25.132184  4439 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:25.042400  4539 consensus_queue.cc:1059] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:01:25.035951  4527 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.135512  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:25.140753  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.137233  1696 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:25.150307  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.264334  1620 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
W20260709 13:01:25.265089  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.269217  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:25.270427  1692 consensus_meta.cc:287] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.756s	user 0.016s	sys 0.011s
I20260709 13:01:25.270890  1692 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
W20260709 13:01:25.223730  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 78102us
W20260709 13:01:25.173519  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 73318us
I20260709 13:01:25.274806  1586 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:25.275645  1586 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:25.278064  1688 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
W20260709 13:01:25.281420  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 508730us
I20260709 13:01:25.283282  1690 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:25.297317  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:25.281005  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 192426us
I20260709 13:01:25.124935  4462 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:25.259287  4541 log.cc:927] Time spent T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.790s	user 0.000s	sys 0.009s
I20260709 13:01:25.303758  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:25.302697  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 146034us
I20260709 13:01:25.304553  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.256803  4568 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.135792  4558 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.305672  1586 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:25.306200  1623 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:25.263659  4544 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.742s	user 0.002s	sys 0.000s
I20260709 13:01:25.257196  4354 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:25.310415  1620 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:25.342763  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:25.343088  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.255239  4555 log.cc:927] Time spent T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:01:25.313616  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:25.280784  4465 raft_consensus.cc:3055] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:25.348034  4465 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:25.348165  4358 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:25.349005  4045 raft_consensus.cc:3055] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:25.349424  4045 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:01:25.319015  4553 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 13:01:25.321092  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2512) took 1006 ms. Trace:
W20260709 13:01:25.346292  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 47258.9us
I20260709 13:01:25.321768  1623 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: [2.2-5.3]
W20260709 13:01:25.323769  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.358654  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.359048  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.324522  4352 consensus_meta.cc:287] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.630s	user 0.012s	sys 0.000s
I20260709 13:01:25.254359  4559 consensus_queue.cc:1059] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:01:25.316365  4558 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:25.325546  4561 log.cc:927] Time spent T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:01:25.325055  2264 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:25.326025  1617 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:01:25.326691  1621 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:01:25.326983  4315 consensus_meta.cc:287] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.000s
I20260709 13:01:25.331769  4393 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.334786  4564 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:25.336352  4460 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:25.337323  4414 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:25.301123  4324 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:25.338733  1586 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:25.338976  4527 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:25.339535  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:25.339744  4570 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.414700  4324 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.418759  4324 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:25.418807  4460 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:25.419574  4460 raft_consensus.cc:697] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:25.420395  4460 consensus_queue.cc:237] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.339898  1622 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:25.422333  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:25.422897  1696 raft_consensus.cc:2376] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6. Re-sending same reply.
I20260709 13:01:25.296383  4532 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:25.111757  4366 consensus_queue.cc:1059] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.198s
I20260709 13:01:25.411556  4315 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.423892  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:25.424137  4366 raft_consensus.cc:3055] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:25.424489  4366 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:25.341491  4550 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 13:01:25.425489  4315 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:25.425355  4366 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.426170  1689 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:25.426585  4366 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:25.426925  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.347656  2266 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:01:25.418651  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 79993us
I20260709 13:01:25.428174  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.351568  4545 consensus_queue.cc:1059] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:01:25.430399  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.355247  4571 consensus_queue.cc:1059] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:25.431524  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.431620  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.431979  4571 raft_consensus.cc:3055] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:25.432116  1616 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:25.432421  4571 raft_consensus.cc:740] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:25.432797  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.433254  4571 consensus_queue.cc:260] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.434538  1621 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:25.434681  4571 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.353681  1693 rpcz_store.cc:276] 0709 13:01:24.314834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.318159 (+  3325us) service_pool.cc:224] Handling call
0709 13:01:24.322851 (+  4692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.323299 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.323327 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.323884 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:01:24.410035 (+ 86151us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:24.410089 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.410299 (+   210us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.262754 (+852455us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:25.320784 (+ 58030us) raft_consensus.cc:1685] finished
0709 13:01:25.320805 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.321035 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2678,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":64066,"spinlock_wait_cycles":16247168,"thread_start_us":85750,"threads_started":1,"wal-append.queue_time_us":149609}
I20260709 13:01:25.435389  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:25.435945  1695 raft_consensus.cc:2376] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6. Re-sending same reply.
I20260709 13:01:25.436070  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:25.436831  1693 raft_consensus.cc:2410] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:25.437101  1695 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:25.437840  1693 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:01:25.357097  4537 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 1.039s	user 0.005s	sys 0.005s
I20260709 13:01:25.439669  4576 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.440184  4576 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.442898  2232 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:25.443776  4352 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.444309  4352 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.445791  1690 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:25.446130  1690 pending_rounds.cc:85] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 2
I20260709 13:01:25.446365  1690 pending_rounds.cc:107] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 13:01:25.325054  4469 consensus_meta.cc:287] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.000s
I20260709 13:01:25.447947  1695 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:25.350704  4045 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.365779  1619 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:25.352133  4462 consensus_queue.cc:1059] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:01:25.456552  4045 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.456722  1621 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:25.456846  4424 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:25.457317  4424 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.457700  4424 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:25.458042  1621 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:25.459110  1621 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:25.460161  1619 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:25.460372  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:25.343849  4354 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.342275  4568 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.376827  1511 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:25.377034  4536 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.382372  4337 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:25.384002  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.133638  4557 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.236s
W20260709 13:01:25.391824  4523 consensus_meta.cc:287] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.773s	user 0.003s	sys 0.007s
I20260709 13:01:25.393323  4569 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.337535  4320 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.349016  4465 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.481003  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:25.482275  1619 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:25.489323  4536 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:25.491647  4569 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.494016  4569 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:25.495558  4573 consensus_queue.cc:1175] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "27308aae2ef347ccba1b27e7f6f04334" responder_term: 5 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:25.497093  4320 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:25.463117  4532 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.411862  2272 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:25.414711  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 68797.3us
I20260709 13:01:25.418653  4570 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.497718  4532 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.499890  4570 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:25.422837  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.300835  4519 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:25.446290  4352 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:25.449005  1690 raft_consensus.cc:2889] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:25.310565  4429 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.361034  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.446996  4469 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.447629  4461 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.375954  4574 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:25.460961  1692 raft_consensus.cc:2376] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5. Re-sending same reply.
I20260709 13:01:25.442623  4576 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:25.535859  4574 raft_consensus.cc:697] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:25.536397  4576 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:25.537065  4469 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:25.537150  4574 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:25.468233  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 113425us
I20260709 13:01:25.496809  4455 consensus_queue.cc:1059] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:01:25.481666  2268 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:25.470602  4354 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:25.529350  2231 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:25.535691  4461 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.464104  1586 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:25.539872  1511 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:25.475116  1514 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:25.500018  4532 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:25.551524  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 87503.5us
I20260709 13:01:25.555999  1586 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:25.556492  2231 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:25.405725  1663 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:25.557632  2231 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:25.578372  4534 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:25.583860  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.507616  4531 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:25.612411  1619 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:01:25.613659  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 73853.8us
W20260709 13:01:25.613996  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 56434.2us
I20260709 13:01:25.660420  1511 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:25.500036  4292 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:01:25.544296  4249 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:01:25.616737  4565 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:01:25.626952  4389 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:25.630111  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.671733  1511 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:25.612264  4225 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:25.632486  4257 raft_consensus.cc:3055] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:25.633431  4579 raft_consensus.cc:3055] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:25.633848  4517 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:25.500073  4454 consensus_queue.cc:1059] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:01:25.635627  4352 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:25.644496  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.525699  4519 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.646363  4354 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:25.658273  4583 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.103s	user 0.003s	sys 0.000s
W20260709 13:01:25.660982  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 105045us
W20260709 13:01:25.667294  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 261680us
I20260709 13:01:25.671305  4389 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.693404  1545 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:25.719113  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:25.729511  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:25.726477  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:25.629891  4461 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:25.741218  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 270170us
I20260709 13:01:25.673800  4532 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:25.689365  4455 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:25.694681  4393 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:25.751536  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 295621us
I20260709 13:01:25.688607  4579 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:01:25.752223  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 58633.6us
I20260709 13:01:25.765760  2231 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:01:25.752964  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 81334.8us
I20260709 13:01:25.755312  1618 raft_consensus.cc:2368] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7.
I20260709 13:01:25.688244  4257 raft_consensus.cc:740] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:25.738924  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:25.524485  4558 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.771651  1545 raft_consensus.cc:1240] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:25.759799  1617 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:25.760878  1514 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:25.752071  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:25.726389  4352 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.753551  4389 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.767012  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54504 (request call id 502) took 1283 ms. Trace:
I20260709 13:01:25.688784  4534 consensus_queue.cc:1059] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:01:25.756842  4532 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.735224  4519 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:25.690860  4045 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.787196  1615 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:25.801075  1697 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:25.774176  1586 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:25.791859  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.792413  4568 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:25.795169  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 349) took 1094 ms. Trace:
I20260709 13:01:25.783334  4393 raft_consensus.cc:697] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:25.758236  4460 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.795598  4575 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.759649  4324 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.768029  4576 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:01:25.788230  2272 rpcz_store.cc:276] 0709 13:01:24.478221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.485296 (+  7075us) service_pool.cc:224] Handling call
0709 13:01:24.485592 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.497876 (+1012284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.761169 (+263293us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b5400620f54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:25.761335 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129699584}
I20260709 13:01:25.799896  1511 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:25.763475  4522 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:25.753499  4573 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:25.805850  4532 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:25.767159  4571 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:25.814059  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.816229  1662 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:25.819059  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:25.782336  4536 consensus_queue.cc:1059] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:01:25.809772  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:25.821640  1691 rpcz_store.cc:276] 0709 13:01:24.700702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.123596 (+422894us) service_pool.cc:224] Handling call
0709 13:01:25.308564 (+184968us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.364243 (+ 55679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.364294 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.364864 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.694079 (+329215us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:25.694103 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.694144 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.794882 (+100738us) raft_consensus.cc:1685] finished
0709 13:01:25.794911 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.795104 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50885,"raft.queue_time_us":51034,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":89,"thread_start_us":229327,"threads_started":1,"wal-append.queue_time_us":377653}
W20260709 13:01:25.823899  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 58990us
I20260709 13:01:25.787640  4352 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:25.859817  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:25.861474  1616 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 4. Current term is 6. Ops: []
I20260709 13:01:25.782095  4454 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:25.782796  4531 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:25.830101  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:25.807816  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1461) took 1003 ms. Trace:
I20260709 13:01:25.834139  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:25.866098  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.836769  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 68221.7us
I20260709 13:01:25.770144  4562 consensus_queue.cc:1059] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:01:25.839437  1689 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:25.831043  4320 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:25.839926  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 79114.7us
I20260709 13:01:25.839439  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:25.874432  1695 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:25.824296  4045 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.805523  4455 raft_consensus.cc:697] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:25.845492  4393 consensus_queue.cc:237] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.799300  4424 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.825935  4337 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:01:25.849931  4452 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:25.865929  1543 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:25.823123  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:25.865850  1620 rpcz_store.cc:276] 0709 13:01:24.804222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.342805 (+538583us) service_pool.cc:224] Handling call
0709 13:01:25.354121 (+ 11316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.413561 (+ 59440us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:25.452145 (+ 38584us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.807502 (+355357us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.807547 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:25.807584 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.807667 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.807769 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2489,"prepare.queue_time_us":48051,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1502,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":16846,"thread_start_us":327769,"threads_started":1}
I20260709 13:01:25.866710  1690 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:25.878667  1663 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:25.876834  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1591) took 1671 ms. Trace:
I20260709 13:01:25.881040  1514 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:25.884056  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 84236.4us
I20260709 13:01:25.927253  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:01:25.896121  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.912240  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:25.828529  4429 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:01:25.828203  4523 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:01:25.838423  4490 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:25.931077  1545 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:25.825974  4460 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.864451  4569 raft_consensus.cc:2764] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:01:25.862063  4522 raft_consensus.cc:697] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:25.942487  4522 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.943717  4573 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:25.943935  4565 raft_consensus.cc:3055] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:25.944425  4565 raft_consensus.cc:740] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:25.945281  4565 consensus_queue.cc:260] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:25.952163  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:25.952798  1695 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.921109  1688 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:25.841467  4534 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:25.929620  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.871165  4321 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:25.872154  4531 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.832333  4575 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:25.851217  4585 raft_consensus.cc:2764] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:01:25.990306  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 121567us
I20260709 13:01:25.990760  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:25.936480  1689 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:25.955662  1688 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:25.913627  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 87358us
W20260709 13:01:25.968406  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.979221  4588 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:26.000088  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 119107us
I20260709 13:01:25.925700  1614 rpcz_store.cc:276] 0709 13:01:24.194865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.318446 (+123581us) service_pool.cc:224] Handling call
0709 13:01:24.347490 (+ 29044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.386454 (+ 38964us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:24.760480 (+374026us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.545061 (+784581us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b18000bd520. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de23a 00007f5c6ab48a2a
0709 13:01:25.865543 (+320482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.865591 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:25.865635 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.865698 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.865805 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22124,"prepare.queue_time_us":373697,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":13695,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":102,"spinlock_wait_cycles":157804416,"thread_start_us":676938,"threads_started":3,"wal-append.queue_time_us":1063974}
I20260709 13:01:25.865037  4564 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:01:25.911653  4320 raft_consensus.cc:697] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:25.922575  4454 raft_consensus.cc:697] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:25.991477  1690 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:01:26.001128  1514 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:25.932852  4490 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:26.018492  1511 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:25.980952  4337 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:26.034857  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:26.035663  1663 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:26.037061  1663 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:26.037421  4337 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.039597  4452 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:25.990792  4573 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:26.042586  4424 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:26.045745  4569 consensus_queue.cc:1059] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:26.046810  4570 raft_consensus.cc:3055] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:26.047257  4570 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:26.046876  4320 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:26.048403  4570 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:26.051306  4558 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:26.051769  4337 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:26.025902  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:26.028604  1543 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:26.029820  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:26.030601  1514 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:26.058211  4519 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:26.059430  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:26.061223  1514 leader_election.cc:400] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7.
I20260709 13:01:26.061733  4469 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:26.062153  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:26.031575  4584 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:26.063428  4584 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:26.063796  4584 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:26.064131  4584 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.001358  4565 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.068578  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:26.071550  4462 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.031204  4576 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:26.075763  4517 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:26.076538  4517 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.077181  4517 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:26.077817  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:26.079759  1690 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:26.087978  4590 log.cc:927] Time spent T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:01:26.039836  4388 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:26.053754  1663 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:26.001591  4534 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:26.090353  4534 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:25.980928  4531 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.033027  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:26.033689  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:26.081269  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:26.091404  2266 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:26.092013  2268 raft_consensus.cc:2368] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
I20260709 13:01:26.000264  4588 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.092366  2264 raft_consensus.cc:2368] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:01:26.094157  1689 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:26.099606  1542 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:26.093684  4045 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:26.103523  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 81173.7us
I20260709 13:01:26.104959  2232 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:26.007434  4562 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.107074  4562 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:26.107877  4337 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:26.109568  4460 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:26.110464  1662 leader_election.cc:400] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
I20260709 13:01:26.110781  1662 leader_election.cc:403] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:26.110739  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 351) took 1378 ms. Trace:
I20260709 13:01:26.112502  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:26.113276  1545 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:26.108021  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 54939.3us
I20260709 13:01:26.115015  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:26.114394  1663 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:26.017988  4490 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.113454  1689 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:26.117430  1662 leader_election.cc:400] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:01:26.117792  1662 leader_election.cc:403] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:26.118728  1543 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:01:26.120390  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 47047.2us
I20260709 13:01:26.125082  1690 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:26.127843  1690 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:26.033985  4389 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:26.111326  1696 rpcz_store.cc:276] 0709 13:01:24.732181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.424821 (+692640us) service_pool.cc:224] Handling call
0709 13:01:25.425122 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.466503 (+ 41381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.466550 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.479522 (+ 12972us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.857770 (+378248us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:25.857829 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.857925 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.110539 (+252614us) raft_consensus.cc:1685] finished
0709 13:01:26.110557 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.110689 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27709,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":182909,"threads_started":1,"wal-append.queue_time_us":551592}
W20260709 13:01:26.134555  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 132610us
I20260709 13:01:26.136140  1511 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:26.138170  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:26.141582  1690 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:26.142222  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:26.143347  1691 raft_consensus.cc:2410] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:01:26.096721  4588 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:25.980634  4455 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:26.128688  4337 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
I20260709 13:01:26.163507  1696 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:26.160204  1511 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:26.165306  4045 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:26.165709  1691 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:26.165768  4045 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:26.166277  4045 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:26.170288  4573 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.170675  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:26.170872  4573 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:26.172394  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:26.173117  1539 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:26.173655  4573 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:26.173915  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.176148  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:26.176568  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:26.176175  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.177445  4045 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:26.180941  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:26.182052  1546 raft_consensus.cc:2368] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:01:26.146688  4388 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.184577  4045 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:26.132613  4599 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:26.192610  4423 raft_consensus.cc:3055] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:26.193017  4599 raft_consensus.cc:697] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:26.194043  4599 consensus_queue.cc:237] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:26.197340  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:26.198839  4571 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:26.200511  4579 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:26.201557  4579 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:26.193120  4423 raft_consensus.cc:740] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:26.141530  4532 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:26.149104  4462 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:26.148042  4585 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:26.148506  4523 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:01:26.173707  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:26.204396  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:26.260103  1546 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:26.231657  1541 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:26.231762  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:26.262339  1622 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:26.232036  1511 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35704 dropped due to backpressure: service queue is full with 50 items
I20260709 13:01:26.234163  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:26.236572  1697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2511) took 1941 ms (client timeout 1510 ms). Trace:
I20260709 13:01:26.232586  1614 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:01:26.269994  2268 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:01:26.266695  1697 rpcz_store.cc:269] 0709 13:01:24.295468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.297754 (+  2286us) service_pool.cc:224] Handling call
0709 13:01:26.236346 (+1938592us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400148554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:26.236482 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3405044608}
I20260709 13:01:26.294332  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:26.295050  1546 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:26.357585  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:26.235863  4544 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:01:26.235395  4593 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260709 13:01:26.212823  4545 raft_consensus.cc:3055] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:26.215133  4569 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:26.361513  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:26.372922  1540 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:26.396205  1616 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:26.209307  4575 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:26.361683  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:26.233314  4354 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:26.203972  4465 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:26.388243  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.212729  4519 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:26.230767  4531 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:26.420475  4490 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:26.235729  4585 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:26.238188  4429 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.398783  1542 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:26.226137  4452 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:01:26.207782  4324 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:26.282841  1695 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:26.405884  2266 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:26.367703  4462 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.218178  4532 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:26.224639  4562 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:26.220496  4570 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.158509  4454 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:26.430406  1616 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:26.229560  4469 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:26.433749  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.393056  4292 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:01:26.215904  4389 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:26.288924  4352 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:26.437944  1547 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:26.422401  4388 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:26.465106  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:26.472077  1692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.007s	sys 0.033s
I20260709 13:01:26.389683  4545 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:01:26.490218  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 378471us
I20260709 13:01:26.475817  4585 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:26.556417  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:26.556988  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.531926  1622 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:26.239355  1512 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:53718 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2378)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2396)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1543)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1550)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1551)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1552)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1553)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2382)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2393)
W20260709 13:01:26.533800  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 410349us
I20260709 13:01:26.203377  4584 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:26.218113  4257 consensus_queue.cc:260] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:26.431077  4531 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:26.389405  4597 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.141s
W20260709 13:01:26.533833  4586 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:01:26.552330  1692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.008s	sys 0.033s
W20260709 13:01:26.580240  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 518105us
I20260709 13:01:26.211031  4423 consensus_queue.cc:260] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:26.583130  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.557765  1662 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:26.583891  1543 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:26.565048  1586 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:26.568020  1539 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:26.587121  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:26.571987  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52808 (request call id 199) took 7494 ms. Trace:
I20260709 13:01:26.573494  2231 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:26.542137  4505 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:26.576591  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:26.590710  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:26.529696  4429 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:26.595353  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 480936us
I20260709 13:01:26.600972  1693 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:26.589498  2231 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:26.607012  1663 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:26.612273  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:26.612540  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:26.543284  4462 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:26.613188  1688 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:26.606184  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:26.590451  1586 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:26.612141  4324 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:26.629369  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:26.630283  1614 raft_consensus.cc:2393] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:26.630690  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:26.631217  1697 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:26.587886  1442 rpcz_store.cc:276] 0709 13:01:19.077946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.086180 (+  8234us) service_pool.cc:224] Handling call
0709 13:01:19.314484 (+228304us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b5400002210. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a1a640 00007f5c708f1b76 00007f5c709fbc3e 00007f5c6eebc2a4 00007f5c6eebc232 00007f5c6eebc161 00007f5c6eebc0dc 00007f5c6eebb392 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:26.571900 (+7257416us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:23.751953 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:23.752639 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:23.752693 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:01:23.752706 (+    13us) tablet.cc:662] Decoding operations
0709 13:01:23.754147 (+  1441us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:23.754233 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:23.754268 (+    35us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:01:23.854096 (+ 99828us) tablet.cc:701] Row locks acquired
0709 13:01:23.909579 (+ 55483us) write_op.cc:260] PREPARE: finished
0709 13:01:24.067635 (+158056us) write_op.cc:270] Start()
0709 13:01:24.067841 (+   206us) write_op.cc:276] Timestamp: P: 1783602084067521 usec, L: 0
0709 13:01:24.067870 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:01:24.068775 (+   905us) log.cc:844] Serialized 6647 byte log entry
0709 13:01:24.897317 (+828542us) op_driver.cc:464] REPLICATION: finished
0709 13:01:25.340285 (+442968us) write_op.cc:301] APPLY: starting
0709 13:01:25.340382 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:25.340755 (+   373us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:25.340885 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:25.385878 (+ 44993us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:25.386300 (+   422us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:01:25.386362 (+    62us) write_op.cc:312] APPLY: finished
0709 13:01:25.386754 (+   392us) log.cc:844] Serialized 113 byte log entry
0709 13:01:25.386971 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:25.387190 (+   219us) write_op.cc:454] Released schema lock
0709 13:01:25.387254 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:25.455644 (+ 68390us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:25.460082 (+  4438us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":288876,"reported_tablets":34,"spinlock_wait_cycles":12976384,"child_traces":[["op",{"apply.queue_time_us":442578,"apply.run_cpu_time_us":5057,"apply.run_wall_time_us":69700,"num_ops":16,"prepare.queue_time_us":100750,"prepare.run_cpu_time_us":28090,"prepare.run_wall_time_us":569010,"raft.queue_time_us":273525,"raft.run_cpu_time_us":11437,"raft.run_wall_time_us":243311,"replication_time_us":815952,"thread_start_us":482129,"threads_started":4,"wal-append.queue_time_us":246346,"wal-append.run_cpu_time_us":27027,"wal-append.run_wall_time_us":2070679}]]}
I20260709 13:01:26.635006  1615 raft_consensus.cc:2368] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6.
I20260709 13:01:26.634780  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:26.642861  1542 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:26.643934  1619 raft_consensus.cc:2376] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6. Re-sending same reply.
W20260709 13:01:26.650563  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 60162.3us
I20260709 13:01:26.655148  1694 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:26.599924  4532 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:26.629407  4604 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:01:26.582916  4557 consensus_queue.cc:1059] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:01:26.628055  4523 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:26.664988  4490 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:26.665506  4324 raft_consensus.cc:697] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:26.666474  1586 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:26.737875  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 71491.2us
I20260709 13:01:26.667555  4462 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:26.668666  4354 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:26.670236  4575 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:26.671478  4321 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:26.675822  4545 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:26.677348  2266 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:26.579825  4562 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:01:26.680786  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 73738.8us
I20260709 13:01:26.683615  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:26.688377  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:26.781963  1696 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:26.720975  1688 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
W20260709 13:01:26.726949  1545 consensus_meta.cc:287] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.000s
I20260709 13:01:26.623587  4522 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:26.782910  1545 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:26.689523  4579 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:26.678771  4532 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.787827  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:26.790249  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:26.793838  1547 raft_consensus.cc:2393] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:01:26.772979  4517 consensus_meta.cc:287] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.695s	user 0.009s	sys 0.004s
W20260709 13:01:26.796268  1690 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.030s	sys 0.035s
W20260709 13:01:26.807303  1690 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.030s	sys 0.035s
I20260709 13:01:26.762506  4557 consensus_queue.cc:1243] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [NON_LEADER]: Peer 27308aae2ef347ccba1b27e7f6f04334 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:26.762184  4531 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:26.776432  4523 raft_consensus.cc:697] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:26.807320  4522 raft_consensus.cc:697] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:26.818150  4469 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:26.825810  4523 consensus_queue.cc:237] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:26.825810  4522 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:26.830482  4588 consensus_meta.cc:287] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.000s
I20260709 13:01:26.818085  4615 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:26.819119  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:26.885262  1697 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:26.820163  4352 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:26.821581  4605 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:01:26.785606  4461 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:01:26.773594  4519 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:26.889060  4519 raft_consensus.cc:697] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:26.807529  4545 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:26.893006  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:26.894320  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:26.823519  4613 consensus_queue.cc:1059] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:26.792212  4579 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:26.896052  4579 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:26.824739  4531 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.899654  4531 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:26.899892  1541 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:26.901221  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:26.806790  4532 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.901963  1541 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:26.910792  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:26.911527  1620 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:26.911653  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:26.907123  1542 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:26.909273  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:26.920244  1614 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:26.922377  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:26.815191  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 131605us
I20260709 13:01:26.850461  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:26.925686  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:01:26.872026  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 264095us
W20260709 13:01:26.927467  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 75260.9us
I20260709 13:01:26.927892  1545 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:26.928246  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:26.928819  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:26.929463  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 189187us
I20260709 13:01:26.930089  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:26.930961  1541 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:26.934149  1545 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 3.
I20260709 13:01:26.936735  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:26.937866  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:26.939966  1697 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:26.890528  4519 consensus_queue.cc:237] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:26.957711  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:26.929639  2232 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:26.945976  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:26.960551  1616 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.832669  4584 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:26.941550  4337 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:01:26.963893  4292 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:26.964483  4292 raft_consensus.cc:697] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:26.964799  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.965489  4292 consensus_queue.cc:237] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:26.950488  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:26.968775  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:26.953644  4610 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:26.977181  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:26.991247  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 439) took 1194 ms. Trace:
I20260709 13:01:26.991379  1618 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:26.832883  4517 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:26.967720  4615 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:26.952674  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:26.983435  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 375401us
I20260709 13:01:26.983505  1514 leader_election.cc:400] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6.
I20260709 13:01:26.994064  1514 leader_election.cc:403] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:26.994200  1614 raft_consensus.cc:2410] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:26.987033  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:26.995379  2231 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:26.865391  4588 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:26.986893  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:26.989740  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:27.000504  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.991844  1620 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:26.942003  4352 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.999298  1623 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:27.005997  1545 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:27.007550  1697 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:26.935441  4452 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:01:26.991726  1544 rpcz_store.cc:276] 0709 13:01:25.797082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.809331 (+ 12249us) service_pool.cc:224] Handling call
0709 13:01:25.830168 (+ 20837us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.849772 (+ 19604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.849809 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.850320 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:01:26.140027 (+289707us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:26.140067 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.140156 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.991020 (+850864us) raft_consensus.cc:1685] finished
0709 13:01:26.991048 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.991183 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11301,"raft.queue_time_us":12785,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":21587,"spinlock_wait_cycles":30592,"thread_start_us":289229,"threads_started":1,"wal-append.queue_time_us":538550}
I20260709 13:01:27.011082  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.010202  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:27.012326  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 55223.3us
I20260709 13:01:27.013578  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:27.014231  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.014640  1545 raft_consensus.cc:2393] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:27.013447  1514 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:27.016258  2264 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:27.017968  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:27.019356  1545 raft_consensus.cc:2368] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
I20260709 13:01:27.024221  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:27.026541  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.027598  1541 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:27.028945  1514 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:27.027356  1545 raft_consensus.cc:2368] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:01:27.031735  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:27.033219  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.032352  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.036711  1545 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:27.003888  4249 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:27.011835  4469 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:27.042250  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.044654  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.059610  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.059474  1547 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:27.060413  1545 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:27.028113  4388 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:26.984570  4324 consensus_queue.cc:237] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:27.067922  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.070485  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.071784  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:27.103145  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.069653  4388 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.129037  1541 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
W20260709 13:01:27.138387  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 209024us
I20260709 13:01:27.141093  1663 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:27.145056  1663 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:27.015805  1616 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:27.175462  1542 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:27.110123  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.039568  4569 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:27.033758  4606 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:27.218150  1545 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:27.222640  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.241899  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2376) took 1044 ms. Trace:
I20260709 13:01:27.070196  4321 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.147s
I20260709 13:01:27.242699  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2400) took 1012 ms. Trace:
I20260709 13:01:27.126551  4584 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:27.222198  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:27.221653  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.248227  1547 rpcz_store.cc:276] 0709 13:01:26.230255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.061016 (+830761us) service_pool.cc:224] Handling call
0709 13:01:27.242629 (+181613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.250492  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.254797  1541 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:27.255468  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1548) took 1074 ms. Trace:
I20260709 13:01:27.257266  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.258431  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2392) took 1039 ms. Trace:
I20260709 13:01:27.217056  4388 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:27.243076  1542 rpcz_store.cc:276] 0709 13:01:26.197317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.222208 (+1024891us) service_pool.cc:224] Handling call
0709 13:01:27.241820 (+ 19612us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.255865  1541 rpcz_store.cc:276] 0709 13:01:26.181329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.221424 (+1040095us) service_pool.cc:224] Handling call
0709 13:01:27.255370 (+ 33946us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.258908  1545 rpcz_store.cc:276] 0709 13:01:26.219482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.256747 (+1037265us) service_pool.cc:224] Handling call
0709 13:01:27.258359 (+  1612us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.266285  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:27.221396  4569 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:27.267197  1623 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:27.281672  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1561) took 1091 ms. Trace:
I20260709 13:01:27.282238  1544 rpcz_store.cc:276] 0709 13:01:26.190591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.072981 (+882390us) service_pool.cc:224] Handling call
0709 13:01:27.281596 (+208615us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.275969  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2385) took 1068 ms. Trace:
I20260709 13:01:27.283476  1540 rpcz_store.cc:276] 0709 13:01:26.207164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.102444 (+895280us) service_pool.cc:224] Handling call
0709 13:01:27.275884 (+173440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.299849  1541 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:27.301184  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1542) took 1121 ms. Trace:
I20260709 13:01:27.301753  1541 rpcz_store.cc:276] 0709 13:01:26.179717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.268440 (+1088723us) service_pool.cc:224] Handling call
0709 13:01:27.292248 (+ 23808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.300676 (+  8428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.301089 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:27.305670  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 273990us
I20260709 13:01:27.264488  4584 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.306741  1514 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:27.308244  1542 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:27.310884  1540 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:27.311897  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1541) took 1132 ms. Trace:
I20260709 13:01:27.312378  1542 rpcz_store.cc:276] 0709 13:01:26.179448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.271831 (+1092383us) service_pool.cc:224] Handling call
0709 13:01:27.273923 (+  2092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.311432 (+ 37509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.311833 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.311123  1514 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:01:27.317399  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 172389us
I20260709 13:01:27.313573  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1550) took 1131 ms. Trace:
I20260709 13:01:27.323913  1540 rpcz_store.cc:276] 0709 13:01:26.181862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.284299 (+1102437us) service_pool.cc:224] Handling call
0709 13:01:27.310278 (+ 25979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.311548 (+  1270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.313513 (+  1965us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.361091  1540 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:27.313064  4584 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:27.372367  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.374320  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1552) took 1191 ms. Trace:
I20260709 13:01:27.374816  1542 rpcz_store.cc:276] 0709 13:01:26.182423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.313443 (+1131020us) service_pool.cc:224] Handling call
0709 13:01:27.338929 (+ 25486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.373846 (+ 34917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.373889 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:27.373956 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:27.374003 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.374095 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.374247 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.376487  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:27.421948  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 110904us
W20260709 13:01:27.424209  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:27.424839  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:27.414672  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.328265  4606 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:27.433993  1696 consensus_meta.cc:287] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.000s
I20260709 13:01:27.434553  1696 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:27.444131  1513 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:01:27.421339  4532 consensus_meta.cc:287] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.005s
W20260709 13:01:27.404894  4625 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:01:27.373256  4632 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:27.454576  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:27.451090  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 442) took 1259 ms. Trace:
W20260709 13:01:27.449029  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 130708us
W20260709 13:01:27.414155  4608 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.410s	user 0.000s	sys 0.002s
I20260709 13:01:27.372119  4517 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:27.412235  4613 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.424458  4588 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:27.449806  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1553) took 1267 ms. Trace:
I20260709 13:01:27.452286  4621 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:27.508037  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 446524us
I20260709 13:01:27.486018  1542 rpcz_store.cc:276] 0709 13:01:26.191520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.445913 (+1254393us) service_pool.cc:224] Handling call
0709 13:01:27.449814 (+  3901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.450084 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.450131 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:27.450370 (+   239us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:27.450430 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.450522 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.451001 (+   479us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.442728  4606 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.521229  2266 raft_consensus.cc:2393] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:27.444957  4462 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:27.530289  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:27.538625  1542 raft_consensus.cc:2393] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:27.528784  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 84773us
I20260709 13:01:27.525549  1540 rpcz_store.cc:276] 0709 13:01:26.182702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.327092 (+1144390us) service_pool.cc:224] Handling call
0709 13:01:27.360630 (+ 33538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.361813 (+  1183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.449723 (+ 87910us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:27.545014  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1535) took 1369 ms (client timeout 1762 ms). Trace:
I20260709 13:01:27.545198  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:01:27.532896  4619 log.cc:927] Time spent T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.452s	user 0.001s	sys 0.000s
W20260709 13:01:27.548107  4629 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:01:27.526208  4633 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
W20260709 13:01:27.550489  4628 log.cc:927] Time spent T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:01:26.263797  1511 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35704 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2378)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2387)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2381)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2383)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2388)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2396)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2384)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2386)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2385)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1543)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1550)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1551)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1552)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1553)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2380)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2382)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2393)
I20260709 13:01:27.554778  1620 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:27.561388  4642 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:27.562047  4642 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:27.563405  4579 consensus_meta.cc:287] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.667s	user 0.005s	sys 0.004s
W20260709 13:01:27.545446  1539 rpcz_store.cc:269] 0709 13:01:26.175745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.175904 (+   159us) service_pool.cc:224] Handling call
0709 13:01:27.544845 (+1368941us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b540027b5d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:27.544961 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":899698048}
I20260709 13:01:27.566280  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 367) took 1485 ms. Trace:
I20260709 13:01:27.566671  1689 rpcz_store.cc:276] 0709 13:01:26.080920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.116863 (+ 35943us) service_pool.cc:224] Handling call
0709 13:01:26.117175 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:26.559267 (+442092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.559301 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:26.584448 (+ 25147us) log.cc:844] Serialized 52 byte log entry
0709 13:01:27.042894 (+458446us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:27.069260 (+ 26366us) log.cc:844] Serialized 14 byte log entry
0709 13:01:27.069452 (+   192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.069537 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:27.566069 (+496532us) raft_consensus.cc:1685] finished
0709 13:01:27.566088 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.566224 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74152,"prepare.queue_time_us":28370,"prepare.run_cpu_time_us":4133,"prepare.run_wall_time_us":14329,"raft.queue_time_us":357108,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":16603,"thread_start_us":830841,"threads_started":2,"wal-append.queue_time_us":820627}
W20260709 13:01:27.582357  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 138802us
I20260709 13:01:27.582912  1540 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:27.585194  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2380) took 1386 ms. Trace:
I20260709 13:01:27.587010  1540 rpcz_store.cc:276] 0709 13:01:26.198463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.542318 (+1343855us) service_pool.cc:224] Handling call
0709 13:01:27.582609 (+ 40291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.584809 (+  2200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.585120 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:27.548122  4570 consensus_meta.cc:287] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.999s	user 0.012s	sys 0.001s
I20260709 13:01:27.444675  4569 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:27.565094  4465 consensus_meta.cc:287] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.150s	user 0.014s	sys 0.000s
I20260709 13:01:27.589208  2232 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:27.563867  4579 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:27.593304  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.595551  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1609) took 1009 ms. Trace:
I20260709 13:01:27.596060  1622 rpcz_store.cc:276] 0709 13:01:26.586402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.600263 (+ 13861us) service_pool.cc:224] Handling call
0709 13:01:26.604723 (+  4460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:26.635511 (+ 30788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.635542 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:26.649919 (+ 14377us) log.cc:844] Serialized 26 byte log entry
0709 13:01:27.025799 (+375880us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:27.025843 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.025920 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:27.595247 (+569327us) raft_consensus.cc:1685] finished
0709 13:01:27.595275 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.595477 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17135,"raft.queue_time_us":26143,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":15779,"thread_start_us":249135,"threads_started":1,"wal-append.queue_time_us":561307}
I20260709 13:01:27.592109  4462 raft_consensus.cc:697] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:27.531186  4606 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:27.533007  4613 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:27.581664  4565 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:27.482452  4532 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:27.604843  4455 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:01:27.645560  4532 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:27.608515  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:27.601331  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 76209.6us
I20260709 13:01:27.656118  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:27.657971  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:27.660406  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:27.661963  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:27.651620  4565 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:27.637686  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.667623  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:27.668648  1539 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.609340  1618 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:27.647378  1540 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:27.593840  4588 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:27.586241  4632 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:27.672668  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.674527  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:27.665638  4352 consensus_meta.cc:287] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.656s	user 0.013s	sys 0.000s
I20260709 13:01:27.676424  4352 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:27.663326  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:27.605273  4257 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:27.608373  4490 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.537137  4621 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:27.636375  4570 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.636885  4564 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:27.690675  4632 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:27.730654  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1547) took 1549 ms. Trace:
W20260709 13:01:27.708482  1690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.007s	sys 0.021s
I20260709 13:01:27.706040  4579 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:27.669986  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:27.749094  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:27.694568  4292 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:27.700260  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:27.691689  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 102581us
W20260709 13:01:27.740881  1690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.007s	sys 0.021s
I20260709 13:01:27.740649  1544 rpcz_store.cc:276] 0709 13:01:26.181064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.283067 (+1102003us) service_pool.cc:224] Handling call
0709 13:01:27.309630 (+ 26563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.309887 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:27.590130 (+280243us) log.cc:844] Serialized 14 byte log entry
0709 13:01:27.730142 (+140012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:27.730224 (+    82us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:27.730291 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.730384 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.730556 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62217,"prepare.queue_time_us":253963,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"thread_start_us":282932,"threads_started":2,"wal-append.queue_time_us":117630}
I20260709 13:01:27.687353  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:27.755404  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1540) took 1576 ms. Trace:
I20260709 13:01:27.755066  1620 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:27.732023  4648 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.757047  4635 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:27.760383  4648 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:27.761032  4642 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:27.761593  4613 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:27.694967  4602 log.cc:927] Time spent T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 1.139s	user 0.008s	sys 0.001s
I20260709 13:01:27.763557  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:27.702991  4545 consensus_meta.cc:287] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.811s	user 0.003s	sys 0.010s
I20260709 13:01:27.693100  4569 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:27.765838  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 434) took 2006 ms. Trace:
I20260709 13:01:27.766230  1548 rpcz_store.cc:276] 0709 13:01:25.759148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.768671 (+  9523us) service_pool.cc:224] Handling call
0709 13:01:25.784604 (+ 15933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.784882 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.784919 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.807498 (+ 22579us) log.cc:844] Serialized 26 byte log entry
0709 13:01:26.150112 (+342614us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:26.150168 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.150235 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:27.694398 (+1544163us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:27.765527 (+ 71129us) raft_consensus.cc:1685] finished
0709 13:01:27.765549 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.765779 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15596928,"thread_start_us":310487,"threads_started":1,"wal-append.queue_time_us":566578}
I20260709 13:01:27.768077  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.768872  1544 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:27.768077  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:27.769963  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.770391  1548 raft_consensus.cc:2376] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7. Re-sending same reply.
I20260709 13:01:27.771353  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:27.772264  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.746388  1539 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:27.771358  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.774097  1544 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
W20260709 13:01:27.747225  1587 leader_election.cc:336] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.510s (SENT)
I20260709 13:01:27.703289  4490 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:27.752043  1622 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:27.757498  1614 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:27.746347  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.775251  1539 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:01:27.775816  1587 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:27.777457  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 185018us
I20260709 13:01:27.776630  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:27.762840  4648 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:27.691922  4523 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:27.798133  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 50951.3us
I20260709 13:01:27.798731  1544 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:27.698961  4621 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:27.805338  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:27.772003  4292 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:27.755887  1547 rpcz_store.cc:276] 0709 13:01:26.179185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.268983 (+1089798us) service_pool.cc:224] Handling call
0709 13:01:27.304327 (+ 35344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.304601 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:27.507479 (+202878us) log.cc:844] Serialized 14 byte log entry
0709 13:01:27.750268 (+242789us) log.cc:844] Serialized 14 byte log entry
0709 13:01:27.754225 (+  3957us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:27.754728 (+   503us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:27.754982 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.755229 (+   247us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.755351 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52806,"prepare.queue_time_us":259186,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":78,"raft.queue_time_us":53181,"spinlock_wait_cycles":2742528,"thread_start_us":374773,"threads_started":2}
I20260709 13:01:27.603296  4462 consensus_queue.cc:237] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:27.821638  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.822314  1547 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
W20260709 13:01:27.802945  1587 leader_election.cc:336] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.547s (SENT)
I20260709 13:01:27.804358  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2391) took 1585 ms. Trace:
I20260709 13:01:27.801751  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2393) took 1582 ms. Trace:
I20260709 13:01:27.823575  1544 rpcz_store.cc:276] 0709 13:01:26.219762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.774829 (+1555067us) service_pool.cc:224] Handling call
0709 13:01:27.775076 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.800853 (+ 25777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.801683 (+   830us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.824741  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:27.825122  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:27.825376  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:27.825629  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.825325  1694 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:27.825718  1539 rpcz_store.cc:276] 0709 13:01:26.219168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.773231 (+1554063us) service_pool.cc:224] Handling call
0709 13:01:27.774928 (+  1697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.798498 (+ 23570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.804301 (+  5803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.799382  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:27.805361  4579 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:27.810913  4531 consensus_meta.cc:287] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.911s	user 0.011s	sys 0.002s
I20260709 13:01:27.755478  4570 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:27.865757  4584 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:27.819404  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:27.820468  1692 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:01:27.772006  4632 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:27.822916  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:27.832962  1544 raft_consensus.cc:2393] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:27.758920  4564 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:27.833189  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:27.836079  1614 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:27.822588  4292 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:27.856952  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:27.880875  1691 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:27.857604  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:27.859567  1546 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:27.831313  4565 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:27.882923  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 685) took 1641 ms. Trace:
W20260709 13:01:27.833386  4585 consensus_meta.cc:287] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.254s	user 0.013s	sys 0.000s
I20260709 13:01:27.800899  4523 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.773862  4388 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:27.866954  1688 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:27.867561  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:27.868767  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.872031  1547 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
W20260709 13:01:27.875460  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 72523.5us
I20260709 13:01:27.888212  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:27.877044  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:27.889003  1587 leader_election.cc:336] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.555s (SENT)
I20260709 13:01:27.878196  1692 pending_rounds.cc:85] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 2
I20260709 13:01:27.829676  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:27.889433  1587 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:27.889710  1692 pending_rounds.cc:107] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:01:27.890138  1692 raft_consensus.cc:2889] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:27.879241  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.889034  1547 raft_consensus.cc:2376] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5. Re-sending same reply.
I20260709 13:01:27.883440  2264 rpcz_store.cc:276] 0709 13:01:26.241932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.242347 (+   415us) service_pool.cc:224] Handling call
0709 13:01:26.242619 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.016653 (+774034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.882659 (+866006us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b5400572e54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:27.882865 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1768226176}
I20260709 13:01:27.892675  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:27.895481  1693 raft_consensus.cc:2393] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 3: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:27.901646  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:27.900583  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 70960.9us
I20260709 13:01:27.902357  1547 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:27.903127  1663 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:27.881584  4354 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:27.907197  1545 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:27.895140  4523 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:27.870092  4531 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:27.913733  1539 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:01:27.915644  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 446) took 1308 ms. Trace:
I20260709 13:01:27.916143  1539 rpcz_store.cc:276] 0709 13:01:26.607065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.897791 (+1290726us) service_pool.cc:224] Handling call
0709 13:01:27.913446 (+ 15655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.915231 (+  1785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.915557 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:27.899539  4579 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:27.899160  4613 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:27.920501  2268 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:01:27.898618  4564 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:27.926039  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.928376  2268 pending_rounds.cc:85] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Aborting all ops after (but not including) 5
I20260709 13:01:27.928774  2268 pending_rounds.cc:107] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:01:27.929034  2268 raft_consensus.cc:2889] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:27.929747  1663 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:27.896051  4585 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:27.941409  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:27.942464  1539 raft_consensus.cc:2393] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:27.940356  1547 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:27.912755  4532 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:27.939949  1689 raft_consensus.cc:2368] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9.
I20260709 13:01:27.943596  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:27.946216  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:27.946928  1539 raft_consensus.cc:2376] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8. Re-sending same reply.
I20260709 13:01:27.948318  1547 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:27.953122  1539 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:01:27.939119  4469 consensus_meta.cc:287] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.882s	user 0.006s	sys 0.008s
I20260709 13:01:27.957753  1542 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:27.958951  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2565) took 1025 ms. Trace:
I20260709 13:01:27.937633  4648 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:27.959578  1690 rpcz_store.cc:276] 0709 13:01:26.933830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.934182 (+   352us) service_pool.cc:224] Handling call
0709 13:01:26.934521 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:26.962795 (+ 28274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.962828 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:26.963308 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:01:27.753332 (+790024us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:27.753369 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.753434 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:27.958612 (+205178us) raft_consensus.cc:1685] finished
0709 13:01:27.958630 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.958864 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6998,"raft.queue_time_us":50323,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5371,"thread_start_us":761368,"threads_started":1,"wal-append.queue_time_us":918896}
I20260709 13:01:27.969152  1539 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:27.971122  1663 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:27.954159  4570 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:27.977344  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:27.960832  4469 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6.
I20260709 13:01:28.000059  1663 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:28.000422  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:28.001267  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.001627  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:28.002686  1547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1f748970c74ef290462d25b2975815"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:01:28.005785  1544 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:28.006515  1539 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:28.008791  1539 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:28.010087  1661 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:28.003401  1547 raft_consensus.cc:606] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:28.010847  1547 raft_consensus.cc:614] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:28.011356  1539 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:28.012236  4452 consensus_queue.cc:1059] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:28.012714  1663 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:28.013391  4613 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:28.014218  4613 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.014513  4648 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.014662  4613 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.013376  4452 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:28.019397  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:28.020090  4452 raft_consensus.cc:697] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:28.020293  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:28.020884  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:28.021327  4452 consensus_queue.cc:237] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.022528  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:28.023713  1697 raft_consensus.cc:2410] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:28.023293  1690 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:28.025167  1547 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:28.027150  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:28.027884  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:28.029031  1693 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:28.009745  1544 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:28.031916  1544 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:28.034276  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:28.037889  1693 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:28.060341  1690 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:28.028317  4532 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:28.044821  4570 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.066829  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:28.080693  1690 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:28.036136  4648 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:28.082355  4648 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:28.082991  4648 consensus_queue.cc:1243] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:01:28.086833  1543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2387) took 1879 ms (client timeout 1605 ms). Trace:
W20260709 13:01:28.087284  1543 rpcz_store.cc:269] 0709 13:01:26.207829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.086634 (+1878805us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:28.086764 (+   130us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:28.090571  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:28.093291  1548 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:28.093355  4570 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.097997  4632 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:28.112973  4667 log.cc:927] Time spent T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:01:28.113729  1693 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:28.114570  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 443) took 1899 ms. Trace:
I20260709 13:01:28.115546  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:28.116364  1543 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:28.117900  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:28.119380  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:28.120071  1543 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:28.121397  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.122022  1543 raft_consensus.cc:2368] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:01:28.123057  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.123770  1543 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:28.124827  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:28.124884  4666 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:01:28.125480  1543 raft_consensus.cc:2368] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
I20260709 13:01:28.126995  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:28.127789  1539 raft_consensus.cc:2393] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 3: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:28.127820  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:28.128966  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 88463.8us
I20260709 13:01:28.129110  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.094033  4584 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:28.128469  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.094230  4388 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:28.115077  1540 rpcz_store.cc:276] 0709 13:01:26.214965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.675477 (+1460512us) service_pool.cc:224] Handling call
0709 13:01:27.675825 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.752180 (+ 76355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.752217 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.752716 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:01:27.896801 (+144085us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:27.896840 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.898277 (+  1437us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.114316 (+216039us) raft_consensus.cc:1685] finished
0709 13:01:28.114344 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.114501 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71055,"raft.queue_time_us":71265,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9246,"thread_start_us":90217,"threads_started":1,"wal-append.queue_time_us":155262}
I20260709 13:01:28.145004  1543 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
W20260709 13:01:28.149814  1546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2381) took 1951 ms (client timeout 1627 ms). Trace:
W20260709 13:01:28.150290  1546 rpcz_store.cc:269] 0709 13:01:26.198751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.892729 (+693978us) service_pool.cc:224] Handling call
0709 13:01:28.149566 (+1256837us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54000a69d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:28.149730 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020360448}
I20260709 13:01:28.153800  4632 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:28.154842  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1543) took 1974 ms. Trace:
I20260709 13:01:28.155880  4632 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:28.155730  1545 rpcz_store.cc:276] 0709 13:01:26.179989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.265246 (+1085257us) service_pool.cc:224] Handling call
0709 13:01:27.270005 (+  4759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.907925 (+637920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.154516 (+246591us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54000aa0d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:28.154763 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464845568}
I20260709 13:01:28.156553  4632 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.159556  4632 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:28.144655  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.160809  4613 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.162957  4613 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:28.162578  4632 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:28.163825  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.163895  2232 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:28.165566  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.182020  4257 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:28.182482  4257 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.182828  4257 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.166278  4429 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:28.132421  4531 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:28.170006  4606 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.184556  1541 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:28.186167  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1551) took 2004 ms. Trace:
I20260709 13:01:28.186549  1541 rpcz_store.cc:276] 0709 13:01:26.182146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.302799 (+1120653us) service_pool.cc:224] Handling call
0709 13:01:27.321341 (+ 18542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.184910 (+863569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.185926 (+  1016us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b54000c6554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:28.186110 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984782592}
W20260709 13:01:28.170809  4640 log.cc:927] Time spent T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.350s	user 0.000s	sys 0.002s
I20260709 13:01:28.171118  4389 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:28.188230  4579 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.175670  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.189064  1545 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:28.189540  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1619) took 1264 ms. Trace:
I20260709 13:01:28.194447  1622 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:28.189997  1617 rpcz_store.cc:276] 0709 13:01:26.925262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.925373 (+   111us) service_pool.cc:224] Handling call
0709 13:01:26.943707 (+ 18334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:26.983746 (+ 40039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.983777 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:26.984347 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:01:27.452052 (+467705us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:27.615764 (+163712us) log.cc:844] Serialized 14 byte log entry
0709 13:01:27.644640 (+ 28876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.644837 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.169808 (+524971us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:28.189239 (+ 19431us) raft_consensus.cc:1685] finished
0709 13:01:28.189336 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.189481 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39423,"prepare.queue_time_us":104818,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":42102,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":4507,"spinlock_wait_cycles":4900224,"thread_start_us":557903,"threads_started":2,"wal-append.queue_time_us":811176}
I20260709 13:01:28.198740  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.201922  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:28.202616  2266 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:28.203006  4570 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:28.203641  4585 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:28.203572  4621 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:28.204488  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.204831  4429 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:28.205090  1540 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:28.188868  4389 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.209125  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.212919  1540 raft_consensus.cc:2393] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:28.215045  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.218772  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.219172  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.219400  1539 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:28.219473  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.220064  1546 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:28.220259  1543 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:28.188956  4579 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.221176  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:28.221871  1541 raft_consensus.cc:2368] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:01:28.221916  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.222671  1543 raft_consensus.cc:2393] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 6: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:28.222595  4249 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:28.222895  4579 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:28.223969  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:28.224043  4558 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:28.224597  1543 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.224646  4389 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:28.218094  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:28.225232  1623 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:28.225476  1540 raft_consensus.cc:2368] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
W20260709 13:01:28.226461  4614 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 1.305s	user 0.000s	sys 0.002s
I20260709 13:01:28.227666  4257 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.230866  4257 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:28.232239  1540 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:28.233575  4621 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:28.240696  4606 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:28.241497  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.260435  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:28.242440  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:28.243391  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:28.233577  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.263630  1693 raft_consensus.cc:2393] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:28.258170  1511 leader_election.cc:336] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.662s (SENT)
I20260709 13:01:28.263672  1545 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:28.263005  1541 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:28.249281  1690 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:28.250826  1543 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:28.254299  1622 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:28.254478  1661 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:28.262859  2266 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.265304  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:28.266217  1661 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:28.266346  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:28.268371  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:28.270967  1619 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:28.276201  2266 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:28.277213  1661 leader_election.cc:400] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:01:28.277486  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:28.278241  1690 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:28.278780  1691 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:28.279013  1661 leader_election.cc:400] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
I20260709 13:01:28.280428  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:28.280678  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:28.281268  1617 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:28.281706  1661 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:28.278108  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:28.284562  1694 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 3.
I20260709 13:01:28.284631  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:28.285214  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:28.285353  1693 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.285933  2271 raft_consensus.cc:2393] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:28.286289  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:28.255445  4623 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.289000  1661 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:28.291189  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:28.256043  4621 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:28.293450  1588 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:28.296056  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:28.296957  1540 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.296156  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:28.268472  4452 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:28.302871  1693 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:28.299921  1661 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:28.271770  4632 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:28.301352  1662 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:28.309561  1661 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:28.289548  4613 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:28.264376  4641 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:01:28.289532  4531 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:28.321496  1690 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:28.322163  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:28.303673  4562 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:28.327560  4562 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:28.328001  4562 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:28.328284  4677 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.328528  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1627) took 1395 ms. Trace:
I20260709 13:01:28.329035  4677 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:28.328984  1618 rpcz_store.cc:276] 0709 13:01:26.933110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.992093 (+ 58983us) service_pool.cc:224] Handling call
0709 13:01:27.009447 (+ 17354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.671685 (+662238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.328301 (+656616us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b540016fb54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:28.328472 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375713152}
I20260709 13:01:28.289469  4570 consensus_queue.cc:1059] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:01:28.330936  4523 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.333436  4523 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:28.337024  4490 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:28.300443  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:28.329667  4677 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.284910  4659 consensus_queue.cc:1059] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:01:28.326637  2271 raft_consensus.cc:1240] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:01:28.310897  4610 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:28.302544  4635 consensus_queue.cc:1059] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:01:28.331125  4570 raft_consensus.cc:3055] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:28.345012  4423 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:28.346769  4337 raft_consensus.cc:3055] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:28.321161  4532 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:28.320829  4505 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:28.296128  4558 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:01:28.321787  4613 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:28.340257  4632 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:28.311669  4429 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:01:28.296725  4623 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:28.363236  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.321936  4389 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:01:28.386098  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 67424.3us
I20260709 13:01:28.388054  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:28.388940  1541 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:28.353349  4570 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:28.360101  4505 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.357821  4337 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:28.403119  4681 log.cc:927] Time spent T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:01:28.405781  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:28.373891  4613 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:28.407356  4677 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:28.398600  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:28.414817  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 99937.1us
I20260709 13:01:28.418444  4687 raft_consensus.cc:3055] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:28.419029  4687 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:28.418848  4570 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.420102  4570 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.419898  4687 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.421547  4687 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.428401  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:28.428541  4337 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.429941  4337 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.397960  4532 raft_consensus.cc:697] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:28.434111  4532 consensus_queue.cc:237] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.399237  4569 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.374320  4632 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:28.426968  4613 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.436146  4569 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.437332  4632 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:28.416087  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 151521us
I20260709 13:01:28.397511  4490 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.457335  2234 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:28.438624  1587 leader_election.cc:336] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.585s (SENT)
I20260709 13:01:28.471110  1541 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:28.474045  1587 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:28.475240  2232 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:28.476641  1511 leader_election.cc:336] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.753s (SENT)
I20260709 13:01:28.477399  1511 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:28.411046  4505 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:28.482522  1511 leader_election.cc:336] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.974s (SENT)
I20260709 13:01:28.483100  4654 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:28.486617  4643 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:28.487613  4623 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:28.483269  4569 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:28.484894  1511 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:28.485605  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 47049.6us
W20260709 13:01:28.489548  1587 leader_election.cc:336] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.605s (SENT)
W20260709 13:01:28.490412  1587 leader_election.cc:336] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.627s (SENT)
W20260709 13:01:28.491252  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:28.485867  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:28.492954  1587 leader_election.cc:336] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.665s (SENT)
I20260709 13:01:28.488484  4320 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:28.359345  4621 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.497116  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:28.479187  4694 log.cc:927] Time spent T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:01:28.499140  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:28.499462  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:28.500505  4584 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:28.498472  4654 raft_consensus.cc:697] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:28.502828  1511 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:28.505235  1663 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:28.505882  1540 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 4.
I20260709 13:01:28.514310  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:28.522567  4613 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:28.484329  4585 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.484122  4490 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.480429  4659 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:28.543076  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:28.543395  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.544973  4337 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:28.544996  4584 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:28.473963  4562 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.549744  4565 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.565639  4654 consensus_queue.cc:237] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.568678  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2382) took 2369 ms. Trace:
I20260709 13:01:28.608180  1542 rpcz_store.cc:276] 0709 13:01:26.199039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.543663 (+1344624us) service_pool.cc:224] Handling call
0709 13:01:27.566431 (+ 22768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.958280 (+391849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.568427 (+610147us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54003b5454. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:28.568615 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":899457280}
I20260709 13:01:28.579799  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:28.609655  1619 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:28.580470  4670 consensus_queue.cc:1059] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:01:28.592108  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 51851.2us
I20260709 13:01:28.596230  2232 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:28.599141  1511 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:28.615257  1511 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:28.592108  4659 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:28.616830  1618 raft_consensus.cc:1240] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:28.618227  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 308772us
W20260709 13:01:28.619333  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.604699  4452 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.625406  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:28.623823  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:49328
W20260709 13:01:28.628105  1587 leader_election.cc:336] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.678s (SENT)
I20260709 13:01:28.628443  1692 raft_consensus.cc:606] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:28.629036  1587 leader_election.cc:336] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.698s (SENT)
I20260709 13:01:28.605275  4635 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.632467  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:28.637825  1511 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:28.642267  1511 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:28.624555  4641 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:28.624133  4659 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:28.648293  1661 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:28.647921  1511 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:28.623823  4465 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:28.650714  4469 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:28.651302  4469 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:28.651777  4469 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:28.654584  4632 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.659353  4632 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:28.660460  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:28.661629  4655 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:28.662278  4655 raft_consensus.cc:697] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:28.663427  4655 consensus_queue.cc:237] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.669381  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:28.610049  4565 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.672392  1661 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:28.640113  4584 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.647059  4585 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.679625  4641 raft_consensus.cc:697] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:28.646879  4531 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:28.686045  1661 leader_election.cc:400] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:01:28.689846  1661 leader_election.cc:400] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
I20260709 13:01:28.648628  4588 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:28.635643  4452 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.687568  4569 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:28.643172  4635 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:28.696795  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 67780.5us
I20260709 13:01:28.698166  4584 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:28.699822  4597 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.701684  4588 raft_consensus.cc:697] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:28.725253  4523 raft_consensus.cc:3055] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:28.725170  4588 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.727209  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 688) took 2430 ms. Trace:
I20260709 13:01:28.703658  4570 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.727677  2268 rpcz_store.cc:276] 0709 13:01:26.297360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.361724 (+ 64364us) service_pool.cc:224] Handling call
0709 13:01:26.392779 (+ 31055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.929731 (+1536952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.726902 (+797171us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400567054. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:28.727092 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3512557952}
I20260709 13:01:28.728138  4570 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.717362  1619 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:28.725663  4523 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:28.716753  4672 log.cc:927] Time spent T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.706s	user 0.005s	sys 0.000s
I20260709 13:01:28.750559  1586 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:28.748816  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:28.752324  1586 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:28.755887  4452 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:28.757795  4635 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:28.758647  4635 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:28.759239  4393 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:28.715281  4641 consensus_queue.cc:237] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.759806  4393 raft_consensus.cc:697] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:28.758685  4562 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:28.700881  4337 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:28.770252  4337 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.770736  4337 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.707525  4490 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:28.704131  4569 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:28.718365  4505 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.740587  4584 raft_consensus.cc:697] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:28.771296  4635 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.730540  4570 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:28.760758  4393 consensus_queue.cc:237] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.806620  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:28.809643  2231 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:28.771713  4597 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:28.820533  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 58922.1us
I20260709 13:01:28.780052  4569 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.824617  4659 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.828963  1619 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:28.824749  4424 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:28.825840  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:28.839053  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:28.779714  4321 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:01:28.819813  4490 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:28.888864  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:28.889303  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:28.934356  1621 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.936574  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:28.937433  1623 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:28.938859  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:28.939877  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1493) took 1049 ms. Trace:
I20260709 13:01:28.940402  1614 rpcz_store.cc:276] 0709 13:01:27.890794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.891972 (+  1178us) service_pool.cc:224] Handling call
0709 13:01:27.892361 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.901090 (+  8729us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:27.919177 (+ 18087us) log.cc:844] Serialized 14 byte log entry
0709 13:01:28.007708 (+ 88531us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.059041 (+ 51333us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.059272 (+   231us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:28.059325 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.059451 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.715858 (+656407us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:28.939490 (+223632us) raft_consensus.cc:1685] finished
0709 13:01:28.939622 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.939805 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38926,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":1565,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":15714,"spinlock_wait_cycles":40405888,"thread_start_us":57902,"threads_started":1,"wal-append.queue_time_us":71124}
I20260709 13:01:28.942695  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:28.891981  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:28.830128  4597 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:28.944409  4597 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.945809  4490 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.892053  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:28.929761  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:28.949362  1619 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:28.948995  4490 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:28.846693  2231 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:28.963483  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 116886us
I20260709 13:01:28.842936  4469 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:28.982502  1621 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
W20260709 13:01:28.986765  4691 log.cc:927] Time spent T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:01:29.012914  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.980655  4688 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:28.893038  4584 consensus_queue.cc:237] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:28.981328  4635 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:28.995266  4623 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:29.025740   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:29.044488  4461 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:29.045825   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:29.052868  4424 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:29.058097  4659 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:29.028764  4505 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:29.061889  4469 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:29.063532  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:29.082588  4558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.012s	sys 0.024s
W20260709 13:01:29.092350  4558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.012s	sys 0.025s
W20260709 13:01:29.122983  1622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.027s	sys 0.018s
W20260709 13:01:29.124261  1622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.027s	sys 0.019s
I20260709 13:01:29.080049  4337 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:29.143852  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:29.144726  2266 raft_consensus.cc:2393] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 5: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:29.147428  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:29.148530  1619 raft_consensus.cc:2393] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:29.152082  1622 raft_consensus.cc:2955] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:29.185480  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 691) took 1658 ms. Trace:
W20260709 13:01:29.193686  2232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.010s	sys 0.021s
W20260709 13:01:29.194195  2232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.010s	sys 0.021s
W20260709 13:01:29.194541  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 577534us
I20260709 13:01:29.186275  2269 rpcz_store.cc:276] 0709 13:01:27.531479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.531845 (+   366us) service_pool.cc:224] Handling call
0709 13:01:27.532324 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.581260 (+ 48936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.581307 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.404776 (+823469us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b2c000bc158. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:01:28.405129 (+   353us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.733961 (+328832us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:28.733997 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.734074 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:29.163883 (+429809us) raft_consensus.cc:1685] finished
0709 13:01:29.163910 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.185373 (+ 21463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68275,"raft.queue_time_us":49039,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5195,"spinlock_wait_cycles":12957568,"thread_start_us":328481,"threads_started":1,"wal-append.queue_time_us":682638}
I20260709 13:01:29.230823  4469 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.233210  4469 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:29.242638  1539 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:29.247114  4337 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:29.258015  4598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.013s	sys 0.013s
W20260709 13:01:29.219904  4522 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.014s	sys 0.031s
I20260709 13:01:29.270450  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:29.280165  2264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.001s	sys 0.020s
W20260709 13:01:29.283061  2264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.002s	sys 0.020s
I20260709 13:01:29.259095  4558 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:29.285338  4388 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.007s	sys 0.024s
W20260709 13:01:29.286686  1661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.014s	sys 0.009s
W20260709 13:01:29.311497  1661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.015s	sys 0.009s
I20260709 13:01:29.319307  1692 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:01:29.276721  4598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.013s	sys 0.014s
W20260709 13:01:29.284770  4522 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.014s	sys 0.031s
W20260709 13:01:29.283455  4655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.012s	sys 0.011s
W20260709 13:01:29.276925  4632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.004s	sys 0.027s
W20260709 13:01:29.288892  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.019s	sys 0.006s
W20260709 13:01:29.384320  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.020s	sys 0.007s
I20260709 13:01:29.371126  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:29.307864  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.017s	sys 0.016s
I20260709 13:01:29.263988  4688 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:01:29.331727  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 382691us
W20260709 13:01:29.317854  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 351389us
I20260709 13:01:29.382890  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2410) took 1679 ms. Trace:
I20260709 13:01:29.385654  1696 raft_consensus.cc:2410] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:01:29.415441  4703 consensus_queue.cc:1059] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:29.385639  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.017s	sys 0.017s
W20260709 13:01:29.417148  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 747780us
W20260709 13:01:29.306576  4654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.011s	sys 0.018s
W20260709 13:01:29.418190  4701 log.cc:927] Time spent T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:01:29.418525  4654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.011s	sys 0.018s
W20260709 13:01:29.354224  4388 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.007s	sys 0.024s
W20260709 13:01:29.419453  4698 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.182s	user 0.001s	sys 0.001s
I20260709 13:01:29.394328  1548 rpcz_store.cc:276] 0709 13:01:27.703452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.771078 (+ 67626us) service_pool.cc:224] Handling call
0709 13:01:29.382504 (+1611426us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b540023fad4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:29.382765 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607023104}
I20260709 13:01:29.297302  4558 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:29.413933  1689 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:01:29.384819  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 613926us
W20260709 13:01:29.370673  4655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.013s	sys 0.011s
I20260709 13:01:29.388386  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:29.478981  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.384260  4632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.008s	sys 0.027s
W20260709 13:01:29.490677  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 102416us
W20260709 13:01:29.485910  4588 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.003s	sys 0.023s
I20260709 13:01:29.508477  4597 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:29.370566  4702 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.203s
I20260709 13:01:29.598304  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1635) took 1101 ms. Trace:
I20260709 13:01:29.589541  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:29.420681  4562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.014s	sys 0.022s
I20260709 13:01:29.598978  1620 rpcz_store.cc:276] 0709 13:01:28.497076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.497200 (+   124us) service_pool.cc:224] Handling call
0709 13:01:28.497479 (+   279us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:28.507620 (+ 10141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.507672 (+    52us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:28.535986 (+ 28314us) log.cc:844] Serialized 78 byte log entry
0709 13:01:28.849133 (+313147us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:29.500212 (+651079us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.508404 (+  8192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.508495 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:29.508544 (+    49us) raft_consensus.cc:1685] finished
0709 13:01:29.508560 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.598203 (+ 89643us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43781,"prepare.queue_time_us":165984,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":2694,"raft.queue_time_us":12501,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":31765,"thread_start_us":783295,"threads_started":2,"wal-append.queue_time_us":824389}
W20260709 13:01:29.563081  4321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.012s	sys 0.020s
I20260709 13:01:29.622855  1695 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:29.626935  1514 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:29.555306  4588 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.003s	sys 0.024s
W20260709 13:01:29.531697  4670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.007s	sys 0.024s
W20260709 13:01:29.748524  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 121698us
I20260709 13:01:29.780032  4716 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:29.780239  4532 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:01:29.656137  4321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.013s	sys 0.020s
I20260709 13:01:29.793052  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:29.792326  4699 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.335s	user 0.002s	sys 0.000s
I20260709 13:01:29.655926  4598 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.310s
I20260709 13:01:29.756347  2231 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:30.411732  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 822397us
W20260709 13:01:29.962049  1589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.005s	sys 0.079s
I20260709 13:01:30.423870  1694 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:01:30.424361  1589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.832s	user 0.006s	sys 0.090s
I20260709 13:01:29.907232  1696 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:30.228467  1544 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.019s	sys 0.042s
I20260709 13:01:29.958889  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:30.425676  1544 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.194s	user 0.024s	sys 0.045s
W20260709 13:01:29.936148  1514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.594s (SENT) [suppressed 80 similar messages]
I20260709 13:01:29.751128  4597 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:29.656512  4469 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:30.489562  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 64250.5us
I20260709 13:01:30.570323  1587 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:30.364579  4711 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:01:30.312987  4709 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.532s	user 0.000s	sys 0.000s
I20260709 13:01:29.808689  2269 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:29.765736  4570 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:30.582015  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:30.350255  4714 log.cc:927] Time spent T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
W20260709 13:01:30.366967  4569 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.524s	user 0.011s	sys 0.004s
I20260709 13:01:29.780704  4388 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:29.655393  4606 consensus_queue.cc:1059] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.921s
I20260709 13:01:30.558040  4249 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:29.747788  4706 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.557085  1692 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.217s	user 0.000s	sys 0.044s
W20260709 13:01:30.679641  1692 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.353s	user 0.001s	sys 0.045s
W20260709 13:01:29.628811  4562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.014s	sys 0.023s
W20260709 13:01:30.558931  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 802694us
I20260709 13:01:29.750162  4633 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.563627  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 147747us
I20260709 13:01:29.804996  4611 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.798530  1693 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:29.792858  4648 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.805615  4337 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.793768  4490 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:30.407058  4621 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:29.872643  4505 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:30.133445  4655 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.554167  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.573392  4717 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:01:29.872697  4716 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:29.912406  4588 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:30.590794  4565 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:30.555517  4393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.517s	user 0.022s	sys 0.064s
I20260709 13:01:30.595335  1696 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:30.624478  4641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.550s	user 0.023s	sys 0.056s
I20260709 13:01:30.632762   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:30.651610  1689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.018s	sys 0.032s
W20260709 13:01:30.661916  2232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.356s	user 0.006s	sys 0.034s
W20260709 13:01:29.779300  4670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.009s	sys 0.033s
W20260709 13:01:30.666795  1662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.020s	sys 0.031s
W20260709 13:01:30.770300  1689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.021s	sys 0.032s
W20260709 13:01:30.770411  1662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.020s	sys 0.031s
I20260709 13:01:30.771025  1696 raft_consensus.cc:1240] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:01:30.771514  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.668406  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 524) took 2120 ms. Trace:
I20260709 13:01:30.577309  4324 consensus_queue.cc:1059] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:01:30.694101  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 693) took 2502 ms. Trace:
I20260709 13:01:30.628000  4597 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:29.871991  4532 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.707186  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:30.622146  1587 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:30.661448  4388 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.755722  4655 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.778102  4388 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.780123  4655 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:30.708354  4713 raft_consensus.cc:993] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:01:30.616431  4570 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:30.666474  4606 raft_consensus.cc:3055] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:30.624501  4569 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:30.769845  2232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.464s	user 0.009s	sys 0.034s
W20260709 13:01:30.813651  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 1.52434e+06us
I20260709 13:01:30.815243  2232 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:30.738978  4704 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:30.818974  4704 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:30.816944  4597 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:30.820436  4597 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.821234  4704 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:30.738562  4633 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:30.769932  4393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.731s	user 0.023s	sys 0.064s
I20260709 13:01:30.773011  2264 rpcz_store.cc:276] 0709 13:01:28.191607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.191799 (+   192us) service_pool.cc:224] Handling call
0709 13:01:28.192110 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.206725 (+ 14615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.206756 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.209399 (+  2643us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.729104 (+519705us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b18001be260. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de0d1 00007f5c6aaf9a0f
0709 13:01:29.287116 (+558012us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:29.287174 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.287277 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.670137 (+1382860us) raft_consensus.cc:1685] finished
0709 13:01:30.670179 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.693900 (+ 23721us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14221,"raft.queue_time_us":15318,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7862,"spinlock_wait_cycles":14689664,"thread_start_us":556463,"threads_started":1,"wal-append.queue_time_us":1657122}
I20260709 13:01:30.771889  1615 rpcz_store.cc:276] 0709 13:01:28.541214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.541685 (+   471us) service_pool.cc:224] Handling call
0709 13:01:28.542042 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.542400 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.542431 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.546525 (+  4094us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.888735 (+342210us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:28.888887 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.888960 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.661270 (+1772310us) raft_consensus.cc:1685] finished
0709 13:01:30.661296 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.661449 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51660,"raft.queue_time_us":903,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":15230,"thread_start_us":341811,"threads_started":1,"wal-append.queue_time_us":610307}
W20260709 13:01:30.772701  4641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.699s	user 0.026s	sys 0.056s
I20260709 13:01:30.744773  4611 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.743031  4337 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:30.744647  4648 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.777554  4532 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:30.781038  1697 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:30.781137  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 159193us
I20260709 13:01:30.832726  1691 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:30.833220  1587 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:30.819340  2269 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:30.759196  4598 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:01:30.780158  4388 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:30.747341  4505 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:30.817296  4702 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:30.814266  4606 raft_consensus.cc:740] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:30.742425  4706 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.826227  4257 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:30.826743  4632 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.009s	sys 0.017s
W20260709 13:01:30.896420  1690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.361s	user 0.025s	sys 0.032s
W20260709 13:01:30.896865  1690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.362s	user 0.025s	sys 0.032s
I20260709 13:01:30.839185  4393 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:30.772011  4588 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.823179  4633 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:30.826227  4615 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.850389  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.057s	user 0.045s	sys 0.074s
W20260709 13:01:30.911896  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.118s	user 0.046s	sys 0.075s
I20260709 13:01:30.756672  4490 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:30.898201  1697 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
W20260709 13:01:30.847296  4321 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.021s	sys 0.039s
I20260709 13:01:30.845224  4532 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.854315  1622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.615s	user 0.015s	sys 0.013s
W20260709 13:01:30.948817  1622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.710s	user 0.016s	sys 0.013s
W20260709 13:01:30.904676  4632 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.009s	sys 0.018s
I20260709 13:01:30.844201  4704 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:01:30.908638  4579 raft_consensus.cc:3055] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:30.953043  4532 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.959862  4337 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:30.960717  4337 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:30.960932  4532 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:30.961547  4532 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:30.961272  4337 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:30.962122  4532 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.962769  4611 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:30.964588  4532 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:30.961618  4505 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:30.910893  4732 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.968092  4732 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.968801  4490 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:30.884629  4324 consensus_queue.cc:1059] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
W20260709 13:01:30.946709  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 1.01049e+06us
I20260709 13:01:30.984064  2268 raft_consensus.cc:1240] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:30.945222  4321 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.022s	sys 0.040s
I20260709 13:01:30.985327  4388 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.950773  4615 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:01:30.985894  4388 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.980736  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2569) took 1171 ms. Trace:
I20260709 13:01:30.987516  4615 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:30.989135  4707 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.989480  4337 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:30.965147  4606 consensus_queue.cc:260] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.989795  4707 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:30.990972  4606 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.991562  4469 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.992401  4469 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.993384  4465 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.994205  4465 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.994946  4655 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.995520  4655 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:30.974891  4732 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:30.975392  4588 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:30.953184  4393 consensus_queue.cc:1059] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:01:30.997942  4655 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:30.978129  4716 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:30.998607  4716 raft_consensus.cc:3055] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:30.998976  4716 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:30.999208  4562 raft_consensus.cc:3055] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:30.979693  4569 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:30.884980  4670 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:01:30.956208  4633 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:30.980847  4570 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:30.988086  1689 rpcz_store.cc:276] 0709 13:01:29.809167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.809532 (+   365us) service_pool.cc:224] Handling call
0709 13:01:29.873108 (+ 63576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.873618 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.873666 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:29.874334 (+   668us) log.cc:844] Serialized 26 byte log entry
0709 13:01:30.770695 (+896361us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:30.770733 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.770791 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.980406 (+209615us) raft_consensus.cc:1685] finished
0709 13:01:30.980437 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.980635 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":605069,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":28723,"thread_start_us":895962,"threads_started":1,"wal-append.queue_time_us":972113}
I20260709 13:01:30.955852  4713 raft_consensus.cc:1081] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
W20260709 13:01:30.973119  4726 log.cc:927] Time spent T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:01:31.000945  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:30.989810  4718 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.357s	user 0.003s	sys 0.000s
W20260709 13:01:31.004866  1663 connection.cc:256] RPC call timeout handler was delayed by -1.268984458000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 13:01:30.988644  4388 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:31.002259  4562 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:30.994858  4469 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:30.958302  4579 raft_consensus.cc:740] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:01:31.020491  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 313355us
I20260709 13:01:30.997254  4465 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:31.021961  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 385) took 1696 ms. Trace:
I20260709 13:01:31.022909  4633 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:31.028524  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 162661us
I20260709 13:01:31.013123  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 469) took 1809 ms. Trace:
W20260709 13:01:31.034271  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.023s	sys 0.020s
I20260709 13:01:31.013672  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 386) took 1681 ms. Trace:
I20260709 13:01:31.054006  4388 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.055032  4655 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:31.079867  1661 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:31.033192  1663 connection.cc:256] RPC call timeout handler was delayed by -1.1921563289999426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260709 13:01:31.085666  1512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.012s	sys 0.028s
I20260709 13:01:31.022424  4706 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:31.082696  1692 rpcz_store.cc:276] 0709 13:01:29.325887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.326040 (+   153us) service_pool.cc:224] Handling call
0709 13:01:29.326411 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.326672 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:30.705495 (+1378823us) log.cc:844] Serialized 14 byte log entry
0709 13:01:31.021401 (+315906us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:31.021483 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:31.021596 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.021688 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.021870 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31747,"prepare.queue_time_us":1479083,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2358,"raft.queue_time_us":16463,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":16891,"thread_start_us":1655060,"threads_started":2}
I20260709 13:01:31.023051  4732 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:31.038972  4490 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.040982  4585 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.141780  1512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.015s	sys 0.028s
I20260709 13:01:31.141482  1690 rpcz_store.cc:276] 0709 13:01:29.327354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.327560 (+   206us) service_pool.cc:224] Handling call
0709 13:01:29.328002 (+   442us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:29.328796 (+   794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.328837 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:29.375062 (+ 46225us) log.cc:844] Serialized 78 byte log entry
0709 13:01:30.897220 (+1522158us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:30.945279 (+ 48059us) log.cc:844] Serialized 14 byte log entry
0709 13:01:30.972164 (+ 26885us) log.cc:844] Serialized 14 byte log entry
0709 13:01:30.976076 (+  3912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.976159 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:31.003397 (+ 27238us) raft_consensus.cc:1685] finished
0709 13:01:31.007997 (+  4600us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.008306 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":211853,"prepare.queue_time_us":69501,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":18103,"raft.run_cpu_time_us":862,"raft.run_wall_time_us":71342,"spinlock_wait_cycles":1807744,"thread_start_us":1362322,"threads_started":1,"wal-append.queue_time_us":1476110}
W20260709 13:01:31.088212  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.024s	sys 0.020s
W20260709 13:01:31.144917  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.087221  1544 rpcz_store.cc:276] 0709 13:01:29.203992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.204445 (+   453us) service_pool.cc:224] Handling call
0709 13:01:29.204861 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.205149 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:30.552187 (+1347038us) log.cc:844] Serialized 14 byte log entry
0709 13:01:31.003987 (+451800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:31.004064 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:31.012074 (+  8010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.012649 (+   575us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.013040 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7941,"prepare.queue_time_us":1541211,"prepare.run_cpu_time_us":4332,"prepare.run_wall_time_us":27202,"raft.queue_time_us":103,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":1932,"thread_start_us":1646316,"threads_started":2}
I20260709 13:01:31.082084  4632 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.147440  4655 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:31.149950  1587 connection.cc:256] RPC call timeout handler was delayed by -2.5133789419999744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26940000000000003s for a response
W20260709 13:01:31.081102  4709 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:01:31.154443  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 74691.6us
I20260709 13:01:31.155261  4737 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.154675  4732 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:31.155611  4570 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:31.155731  4469 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:31.156270  4706 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:31.181694  4706 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.150473  4388 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.185709  4706 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:31.156124  4562 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.186275  4388 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:31.187202  4562 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.157260  4588 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:31.158337  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:31.159175  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:31.159806  4337 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.171536  4597 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:31.087899  4615 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.159600  4579 consensus_queue.cc:260] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:31.160670  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:31.162200  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 74553.2us
W20260709 13:01:31.084144  4728 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:01:31.170342  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:31.150097  4655 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:31.164875  4465 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.030898  4716 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.179302  4733 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:31.174474  4632 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:31.180987  1661 connection.cc:256] RPC call timeout handler was delayed by -1.0321916820000183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 13:01:31.180338  4557 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:31.191052  4713 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:31.191337  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:31.241007  1693 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:31.096118  4569 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.198241  1692 raft_consensus.cc:2410] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:31.197125  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:31.205650  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:31.159662  4744 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.091881  4633 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.204655  1662 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:31.216688  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1783323439999549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
W20260709 13:01:31.253392  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1108323439999594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:01:31.253517  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 48971.7us
I20260709 13:01:31.151644  4719 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:31.219583  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:31.226449  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:31.191601  4505 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.152760  4585 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.153074  4490 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.236147  4461 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.248392  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:31.248461  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:31.192085  4707 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:31.250444  1694 raft_consensus.cc:2410] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:31.205775  4570 raft_consensus.cc:697] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:31.255450  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 526) took 2711 ms. Trace:
I20260709 13:01:31.256812  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.229451  4579 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:31.257279  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.323969  1621 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:31.325433  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:31.258312  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.274718  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.257620  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.276974  4719 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:31.177241  4737 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.278538  4748 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.278885  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:31.307150  4721 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.567s	user 0.003s	sys 0.000s
I20260709 13:01:31.343078  2264 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:31.278962  4739 consensus_queue.cc:1059] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:01:31.259683  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.281338  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.281944  4632 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:31.283861  1623 raft_consensus.cc:3055] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:31.274833  4611 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:31.285986  4585 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:31.274930  4532 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:31.349504  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.349810  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:31.350523  1621 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:31.349560  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:31.251145  4713 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:31.293390  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.252856  4569 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.295327  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:31.298211  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:31.297655  1587 leader_election.cc:336] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.565s (SENT)
I20260709 13:01:31.191797  4588 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:31.408672  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 247020us
I20260709 13:01:31.221298  4615 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:31.194906  4597 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:31.318758  1622 rpcz_store.cc:276] 0709 13:01:28.543624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.543794 (+   170us) service_pool.cc:224] Handling call
0709 13:01:28.544156 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.125400 (+581244us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:29.209047 (+ 83647us) log.cc:844] Serialized 14 byte log entry
0709 13:01:30.957811 (+1748764us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:30.993131 (+ 35320us) log.cc:844] Serialized 26 byte log entry
0709 13:01:30.993332 (+   201us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:30.993373 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.993457 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:31.255115 (+261658us) raft_consensus.cc:1685] finished
0709 13:01:31.255143 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.255322 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2205,"raft.queue_time_us":97705,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":6785,"thread_start_us":2243817,"threads_started":2,"wal-append.queue_time_us":1740525}
I20260709 13:01:31.448978  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:31.450398  1622 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:31.319327  1620 raft_consensus.cc:2410] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:01:31.235136  4702 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:31.233250  4465 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:31.328953  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.278249  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:31.347563  1619 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:31.347615  1623 raft_consensus.cc:740] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:01:31.358269  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.193251  4337 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.461161  4465 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:31.461719  4588 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:31.462368  1692 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:31.270961  4744 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.463618  4713 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:31.465296  4744 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:31.466027  4744 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:31.466509  4744 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:31.349999  4748 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.469937  4748 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:31.474888  4722 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.701s	user 0.000s	sys 0.003s
W20260709 13:01:31.359937  4621 consensus_meta.cc:287] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.617s	user 0.004s	sys 0.007s
I20260709 13:01:31.476663  4702 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.477255  1615 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:31.235955  4733 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.480170  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:31.481163  4733 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:31.481954  4569 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:31.482658  2271 raft_consensus.cc:2410] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:01:31.483695  1616 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:31.484709  4597 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:31.310832  4461 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.323164  4707 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:31.363492  4737 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:31.366055  4490 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:31.367022  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.502033  1614 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:31.457321  1623 consensus_queue.cc:260] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.405833  1587 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:31.354951  4611 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:31.406025  4739 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.206931  4469 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:31.363067  4719 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:31.293960  4505 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.366299  4570 consensus_queue.cc:237] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:31.445832  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:31.368737  1547 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:31.367990  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.449263  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.278822  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:31.451794  1690 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:31.371773  4532 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:31.485411  2271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54504 (request call id 515) took 3119 ms (client timeout 1877 ms). Trace:
I20260709 13:01:31.486603  1689 raft_consensus.cc:2368] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4.
I20260709 13:01:31.474642  4755 raft_consensus.cc:3055] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:31.366797  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2572) took 1459 ms. Trace:
I20260709 13:01:31.503039  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.512195  1622 raft_consensus.cc:2410] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:01:31.521728  1621 raft_consensus.cc:2410] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:31.521521  1623 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:31.522936  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.485841  4454 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.351972  4523 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:31.525194  4737 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.525207  4739 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:31.934809  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 388) took 2555 ms. Trace:
I20260709 13:01:32.085884  1539 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:32.086699  4755 raft_consensus.cc:740] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:32.085968  1688 rpcz_store.cc:276] 0709 13:01:29.329348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.329565 (+   217us) service_pool.cc:224] Handling call
0709 13:01:29.583515 (+253950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.764762 (+181247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.764809 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:31.289131 (+1524322us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b2c000d1b28. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:01:31.289560 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:01:31.741913 (+452353us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:31.741987 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.742074 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:31.809699 (+ 67625us) raft_consensus.cc:1685] finished
0709 13:01:31.809719 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.884875 (+ 75156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180773,"raft.queue_time_us":182129,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":24368,"spinlock_wait_cycles":31894400,"thread_start_us":321797,"threads_started":1,"wal-append.queue_time_us":278301}
I20260709 13:01:32.088028  4755 consensus_queue.cc:260] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:32.088740  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:32.089264  4755 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:32.091567  4739 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:32.003273  4648 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:31.504154  4707 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:31.736975  4724 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.965s	user 0.003s	sys 0.000s
I20260709 13:01:31.504072  4611 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.826116  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:31.601409  4719 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:32.096784  1541 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:32.096896  4719 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:32.098214  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:32.098476  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.098941  1541 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.099222  1542 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:31.600437  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:32.100148  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:32.100234  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:31.610761  1662 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:32.101109  1621 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:31.807830  1693 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:32.102332  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:32.102978  1621 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:31.369068  4585 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:31.746191  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.712627  4558 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:31.824899  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:32.104879  4585 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:32.119484  1690 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:31.461190  4337 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:31.715339  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.106536  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:31.810575  1697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2573) took 1903 ms (client timeout 1763 ms). Trace:
I20260709 13:01:32.107280  4454 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:31.504612  4597 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:31.741827  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 444169us
I20260709 13:01:31.714321  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.007745  1443 catalog_manager.cc:5697] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.094924  4707 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:32.140290  1587 leader_election.cc:336] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.640s (SENT)
I20260709 13:01:32.103358  4505 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:31.659730  4465 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.651477  4588 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.641892  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 183546us
W20260709 13:01:31.862594  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.762224  4469 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:32.113859  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.761737  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 467) took 3372 ms. Trace:
W20260709 13:01:31.580227  4715 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.695s	user 0.000s	sys 0.005s
I20260709 13:01:32.114821  1618 raft_consensus.cc:2393] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 4: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:31.856618  4720 log.cc:927] Time spent T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 1.113s	user 0.001s	sys 0.001s
I20260709 13:01:31.743762  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:32.115890  1540 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:31.853817  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:31.772454  4606 consensus_meta.cc:287] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.781s	user 0.012s	sys 0.003s
W20260709 13:01:31.530977  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.981856  1513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.003s	sys 0.015s
I20260709 13:01:31.772804  4732 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:31.858764  4633 consensus_meta.cc:287] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.002s
I20260709 13:01:31.762939  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 392) took 1996 ms. Trace:
I20260709 13:01:32.105975  1691 rpcz_store.cc:276] 0709 13:01:29.907072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.907216 (+   144us) service_pool.cc:224] Handling call
0709 13:01:29.907548 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.838959 (+931411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.366455 (+527496us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b540022f954. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:31.366720 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2127258368}
I20260709 13:01:32.083869  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:31.860658  4716 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:32.130892  1697 rpcz_store.cc:269] 0709 13:01:29.907477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.908590 (+  1113us) service_pool.cc:224] Handling call
0709 13:01:31.769085 (+1860495us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54000988d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:31.810455 (+ 41370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":814636288}
I20260709 13:01:31.743276  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:31.658865  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:32.131459  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:32.108816  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:32.129451  1614 raft_consensus.cc:2410] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:32.138890  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:32.129988  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.653810  1545 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:32.193730  4719 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:01:31.767488  4615 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:32.270797  1692 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:32.185058  2264 raft_consensus.cc:1240] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
W20260709 13:01:32.614840  1513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.302s	user 0.008s	sys 0.023s
I20260709 13:01:32.615465  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53718 (request call id 486) took 1247 ms. Trace:
I20260709 13:01:32.125417  4737 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:32.140174  4249 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:32.137307  1693 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:32.644410  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2582) took 1410 ms. Trace:
W20260709 13:01:32.103551  2271 rpcz_store.cc:269] 0709 13:01:28.366429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.366687 (+   258us) service_pool.cc:224] Handling call
0709 13:01:31.485099 (+3118412us) spinlock_profiling.cc:243] Waited 3.06 s on lock 0x7b5400620f54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:31.485282 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7047320960}
I20260709 13:01:32.620054  1663 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:32.644848  1693 rpcz_store.cc:276] 0709 13:01:31.234192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.103434 (+869242us) service_pool.cc:224] Handling call
0709 13:01:32.136635 (+ 33201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.644152 (+507517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.644355 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.645951  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:32.646732  1693 raft_consensus.cc:2410] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:01:32.400195  4724 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.243s	user 0.000s	sys 0.000s
I20260709 13:01:32.620791  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1520) took 1334 ms. Trace:
I20260709 13:01:32.650008  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 393) took 1416 ms. Trace:
I20260709 13:01:32.650698  1617 rpcz_store.cc:276] 0709 13:01:31.285943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.108545 (+822602us) service_pool.cc:224] Handling call
0709 13:01:32.620724 (+512179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.650736  1692 rpcz_store.cc:276] 0709 13:01:31.233547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.009551 (+776004us) service_pool.cc:224] Handling call
0709 13:01:32.270527 (+260976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.630687 (+360160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.649802 (+ 19115us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54001b85d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:32.649945 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599208192}
I20260709 13:01:32.622020  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.270584  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1631) took 1104 ms. Trace:
I20260709 13:01:32.653461  1690 rpcz_store.cc:276] 0709 13:01:31.166968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.205370 (+ 38402us) service_pool.cc:224] Handling call
0709 13:01:32.270324 (+1064954us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54001b85d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:32.270501 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474599680}
I20260709 13:01:32.653133  1545 raft_consensus.cc:2410] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:32.654757  1690 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:32.654960  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.177742  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:32.185752  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 575152us
I20260709 13:01:32.193137  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:32.655952  1689 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:32.656080  1690 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:32.273226  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:32.397461  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:31.843029  4562 consensus_meta.cc:287] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.655s	user 0.017s	sys 0.000s
W20260709 13:01:32.625825  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 398) took 1256 ms (client timeout 1666 ms). Trace:
W20260709 13:01:32.658224  1694 rpcz_store.cc:269] 0709 13:01:31.369712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.742945 (+373233us) service_pool.cc:224] Handling call
0709 13:01:32.625763 (+882818us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.623817  1543 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:32.195721  1443 catalog_manager.cc:5697] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 5 to 6, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 6 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.653700  4569 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.985s
I20260709 13:01:32.139626  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:31.865119  4725 log.cc:927] Time spent T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.905s	user 0.004s	sys 0.000s
I20260709 13:01:32.628341  1615 raft_consensus.cc:2410] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:01:32.630033  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1519) took 1338 ms (client timeout 1770 ms). Trace:
W20260709 13:01:32.664060  1618 rpcz_store.cc:269] 0709 13:01:31.285680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.367731 (+ 82051us) service_pool.cc:224] Handling call
0709 13:01:32.612421 (+1244690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.664369  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:32.664824  1547 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:32.333025  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1645) took 1074 ms. Trace:
I20260709 13:01:32.632881  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1647) took 1373 ms. Trace:
I20260709 13:01:32.616521  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:32.665751  1544 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:32.632242  1540 rpcz_store.cc:276] 0709 13:01:31.368230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.369003 (+   773us) service_pool.cc:224] Handling call
0709 13:01:32.615372 (+1246369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.667222  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.667927  1540 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:32.668910  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:32.670181  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.659152  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:32.664974  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:32.625041  4717 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:32.623255  1546 rpcz_store.cc:276] 0709 13:01:28.389050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.389895 (+   845us) service_pool.cc:224] Handling call
0709 13:01:28.390196 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.595514 (+205318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.595558 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.599550 (+  3992us) log.cc:844] Serialized 26 byte log entry
0709 13:01:30.911143 (+2311593us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b180012a600. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de0d1 00007f5c6aaf9a0f
0709 13:01:31.085091 (+173948us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:31.085148 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.761429 (+676281us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54003b5954. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:31.761477 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:31.761521 (+    44us) raft_consensus.cc:1685] finished
0709 13:01:31.761534 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.761672 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10319,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7004,"spinlock_wait_cycles":464681088,"thread_start_us":173691,"threads_started":1,"wal-append.queue_time_us":2592685,"wal-append.run_cpu_time_us":1477,"wal-append.run_wall_time_us":1001526}
I20260709 13:01:32.665447  1623 rpcz_store.cc:276] 0709 13:01:31.258834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.259000 (+   166us) service_pool.cc:224] Handling call
0709 13:01:31.283727 (+ 24727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.332104 (+1048377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:32.332150 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:32.332203 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:32.332276 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.332763 (+   487us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.332938 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":891,"raft.queue_time_us":476,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":59052}
I20260709 13:01:32.679495  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.680300  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:32.680365  1546 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:32.681071  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1522) took 1394 ms. Trace:
I20260709 13:01:32.681543  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:32.682924  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.681422  1623 rpcz_store.cc:276] 0709 13:01:31.287029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.680072 (+1393043us) service_pool.cc:224] Handling call
0709 13:01:32.681016 (+   944us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:32.630759  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 492625us
I20260709 13:01:31.765374  4461 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:32.638784  1542 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:32.619841  1695 rpcz_store.cc:276] 0709 13:01:29.767031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.767548 (+   517us) service_pool.cc:224] Handling call
0709 13:01:29.872870 (+105322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:30.889072 (+1016202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.889103 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:30.907975 (+ 18872us) log.cc:844] Serialized 26 byte log entry
0709 13:01:31.143648 (+235673us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:31.143687 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.762577 (+618890us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b54001293d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:31.762619 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:31.762661 (+    42us) raft_consensus.cc:1685] finished
0709 13:01:31.762673 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.762878 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33429,"raft.queue_time_us":104926,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":2258530176,"thread_start_us":181272,"threads_started":1,"wal-append.queue_time_us":282305,"wal-append.run_cpu_time_us":2001,"wal-append.run_wall_time_us":1067308}
W20260709 13:01:32.631739  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 1.3192e+06us
I20260709 13:01:32.641186  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1530) took 1350 ms. Trace:
W20260709 13:01:32.603524  4570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.000s	sys 0.019s
W20260709 13:01:32.204095  4762 log.cc:927] Time spent T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:01:32.712319  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2581) took 2296 ms. Trace:
I20260709 13:01:32.712828  1696 rpcz_store.cc:276] 0709 13:01:30.415615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.771833 (+356218us) service_pool.cc:224] Handling call
0709 13:01:30.772082 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.830554 (+ 58472us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:30.865676 (+ 35122us) log.cc:844] Serialized 14 byte log entry
0709 13:01:31.742224 (+876548us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b1800321a60. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de23a 00007f5c6ab48a2a
0709 13:01:32.228774 (+486550us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:32.228851 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:32.615087 (+386236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.712019 (+ 96932us) spinlock_profiling.cc:243] Waited 58.2 ms on lock 0x7b54001284d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:32.712083 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.712255 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11950,"prepare.queue_time_us":35069,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":11644,"raft.queue_time_us":127,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":105,"spinlock_wait_cycles":180810880,"thread_start_us":486183,"threads_started":1}
W20260709 13:01:32.397271  4321 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:01:32.617615  1619 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:32.716500  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1524) took 1428 ms. Trace:
I20260709 13:01:32.716940  1619 rpcz_store.cc:276] 0709 13:01:31.287806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.113559 (+825753us) service_pool.cc:224] Handling call
0709 13:01:32.716439 (+602880us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.718182  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:32.719077  1619 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:32.140302  1548 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:32.720286  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1593) took 1021 ms. Trace:
I20260709 13:01:32.720669  1548 rpcz_store.cc:276] 0709 13:01:31.699285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.714048 (+ 14763us) service_pool.cc:224] Handling call
0709 13:01:32.720208 (+1006160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.721601  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.722702  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:32.543730  4733 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.008s	sys 0.019s
W20260709 13:01:32.514982  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.730397  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.612578  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 472270us
W20260709 13:01:32.732638  1587 leader_election.cc:336] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.809s (SENT)
W20260709 13:01:32.734283  1587 leader_election.cc:336] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.874s (SENT)
I20260709 13:01:32.657303  1690 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:32.473558  1541 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:32.743245  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.660125  1443 catalog_manager.cc:5697] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 6 to 7, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 7 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.748708  1443 catalog_manager.cc:5697] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 5 to 6, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 6 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.617523  2267 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:32.629944  4648 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:32.195433  4532 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:32.161230  4654 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:32.650161  4702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.003s	sys 0.018s
I20260709 13:01:32.672292  1618 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:32.797041  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1526) took 1508 ms. Trace:
I20260709 13:01:32.797636  1618 rpcz_store.cc:276] 0709 13:01:31.288673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.664761 (+1376088us) service_pool.cc:224] Handling call
0709 13:01:32.796957 (+132196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.671377  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:32.800742  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.633653  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1513) took 1349 ms. Trace:
I20260709 13:01:32.675659  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.801908  1545 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:32.802455  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1604) took 1047 ms. Trace:
I20260709 13:01:32.677752  1622 rpcz_store.cc:276] 0709 13:01:31.259571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.131108 (+871537us) service_pool.cc:224] Handling call
0709 13:01:32.632800 (+501692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.803294  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1651) took 1542 ms. Trace:
I20260709 13:01:32.637697  1621 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:32.803041  1545 rpcz_store.cc:276] 0709 13:01:31.754972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.675339 (+920367us) service_pool.cc:224] Handling call
0709 13:01:32.802396 (+127057us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.804945  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1518) took 1519 ms. Trace:
I20260709 13:01:32.686314  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1511) took 1405 ms. Trace:
I20260709 13:01:32.805478  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.805634  1615 rpcz_store.cc:276] 0709 13:01:31.280810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.138620 (+857810us) service_pool.cc:224] Handling call
0709 13:01:32.686251 (+547631us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.806241  1545 raft_consensus.cc:2393] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:32.686993  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.689663  1614 rpcz_store.cc:276] 0709 13:01:31.290478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.502759 (+212281us) service_pool.cc:224] Handling call
0709 13:01:32.641099 (+1138340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.684650  2232 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:32.807516  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:32.686407  4745 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:32.649348  4732 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:32.672206  1692 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:32.699422  1547 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:32.812683  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1602) took 1058 ms. Trace:
I20260709 13:01:32.813081  1547 rpcz_store.cc:276] 0709 13:01:31.754376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.664177 (+909801us) service_pool.cc:224] Handling call
0709 13:01:32.812622 (+148445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.813944  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.814039  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.814910  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1608) took 1003 ms. Trace:
I20260709 13:01:32.650466  4597 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:32.527908  4611 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:32.704698  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:32.707178  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:32.821431  1617 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:32.689543  4562 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.119s
W20260709 13:01:32.704736  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 333641us
I20260709 13:01:32.117201  4744 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:32.723356  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1599) took 1021 ms. Trace:
I20260709 13:01:32.825232  1548 rpcz_store.cc:276] 0709 13:01:31.701705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.722485 (+1020780us) service_pool.cc:224] Handling call
0709 13:01:32.723306 (+   821us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.826522  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.696533  4717 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:32.726698  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:32.632215  4633 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:32.663389  4747 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:32.630613  4588 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:32.828142  1623 raft_consensus.cc:2410] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:01:32.770027  1587 leader_election.cc:336] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.943s (SENT)
I20260709 13:01:32.829898  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:32.774897  1543 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
W20260709 13:01:32.755069  1514 leader_election.cc:336] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.594s (SENT)
W20260709 13:01:32.692345  2263 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.004s	sys 0.021s
I20260709 13:01:32.783141  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:32.783620  1544 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:32.783494  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:32.649220  4249 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:32.710824  4570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.000s	sys 0.020s
I20260709 13:01:32.792589  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54488 (request call id 588) took 1153 ms. Trace:
I20260709 13:01:32.629690  4465 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:32.679328  4585 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:32.803906  1618 rpcz_store.cc:276] 0709 13:01:31.260541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.798642 (+1538101us) service_pool.cc:224] Handling call
0709 13:01:32.799155 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.802633 (+  3478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:32.802814 (+   181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:32.802910 (+    96us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:32.802975 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.803056 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.803221 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:32.730072  4733 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.008s	sys 0.020s
W20260709 13:01:32.808072  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 123490us
I20260709 13:01:32.808585  1622 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:32.691901  1689 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:32.841876  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1510) took 1561 ms. Trace:
I20260709 13:01:32.801679  1616 rpcz_store.cc:276] 0709 13:01:31.284045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.005856 (+721811us) service_pool.cc:224] Handling call
0709 13:01:32.633568 (+627712us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.809865  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1515) took 1525 ms. Trace:
I20260709 13:01:32.805274  1621 rpcz_store.cc:276] 0709 13:01:31.285426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.102052 (+816626us) service_pool.cc:224] Handling call
0709 13:01:32.804886 (+702834us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:32.796559  4702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.003s	sys 0.019s
I20260709 13:01:32.708050  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:32.821960  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1521) took 1535 ms. Trace:
I20260709 13:01:32.817312  4257 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:32.759761  4517 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:32.759925  4454 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:32.817425  4461 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.840335  1691 raft_consensus.cc:1240] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:32.838546  2267 rpcz_store.cc:276] 0709 13:01:31.598899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.599124 (+   225us) service_pool.cc:224] Handling call
0709 13:01:32.752060 (+1152936us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:32.834574  2263 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.004s	sys 0.021s
I20260709 13:01:32.823385  4597 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:32.819739  4745 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:32.854725  2232 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:32.844687  4532 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.808681  4654 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:32.848315  4257 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.858698  4702 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:32.867326  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.836655  4747 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:32.873131  4737 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:32.873023  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:32.852751  4517 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:32.876933  2270 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:32.865955  4257 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.871057  4429 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:32.877727  4717 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:32.864920  4532 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:32.857257  4461 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:32.862901  4534 consensus_queue.cc:1059] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:01:32.880721  4523 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:32.883703  4588 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:32.881340  4429 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:32.965303  4429 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:32.967756  4249 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:32.895589  4648 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:32.833004  1514 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:32.970124  4648 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:32.970769  4461 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:32.973526  4465 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:32.814635  1545 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:33.037144  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.038571  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.832782  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1594) took 1133 ms. Trace:
I20260709 13:01:32.835495  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1596) took 1134 ms. Trace:
I20260709 13:01:32.808112  1546 raft_consensus.cc:2376] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7. Re-sending same reply.
I20260709 13:01:32.815299  1547 rpcz_store.cc:276] 0709 13:01:31.811945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.813794 (+1001849us) service_pool.cc:224] Handling call
0709 13:01:32.814853 (+  1059us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.827365  1548 raft_consensus.cc:2376] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6. Re-sending same reply.
I20260709 13:01:33.051702  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.052062  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:33.052937  1547 raft_consensus.cc:2393] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:32.831689  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 207391us
W20260709 13:01:32.833246  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 97941.2us
W20260709 13:01:33.060488  1587 leader_election.cc:336] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.962s (SENT)
I20260709 13:01:33.060837  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.061182  1587 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:33.061852  1547 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:32.842228  1622 rpcz_store.cc:276] 0709 13:01:31.280396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.803937 (+1523541us) service_pool.cc:224] Handling call
0709 13:01:32.804425 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.841607 (+ 37182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.841823 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.830410  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1648) took 1570 ms. Trace:
I20260709 13:01:32.842533  1614 rpcz_store.cc:276] 0709 13:01:31.284632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.807115 (+1522483us) service_pool.cc:224] Handling call
0709 13:01:32.807405 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.809500 (+  2095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:32.809526 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:32.809568 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:32.809612 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.809664 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.809799 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.127868  1620 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:33.127750  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:33.128913  4716 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:33.129010  1614 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:32.842905  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:33.145216  1616 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:33.145561  4389 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.146696  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:33.146437  4389 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:33.149329  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1603) took 1394 ms (client timeout 1770 ms). Trace:
I20260709 13:01:32.846529  1617 rpcz_store.cc:276] 0709 13:01:31.286256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.672040 (+1385784us) service_pool.cc:224] Handling call
0709 13:01:32.821900 (+149860us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.152642  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:33.153424  4773 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.323s	user 0.001s	sys 0.005s
I20260709 13:01:32.840507  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:33.156512  4389 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:32.724184  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1650) took 1463 ms. Trace:
I20260709 13:01:32.873585  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:32.879180  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:33.160284  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 397) took 1818 ms. Trace:
I20260709 13:01:33.160768  1691 rpcz_store.cc:276] 0709 13:01:31.341907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.638514 (+1296607us) service_pool.cc:224] Handling call
0709 13:01:32.661696 (+ 23182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:32.854640 (+192944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.159717 (+305077us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400147654. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:33.160078 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410036992}
I20260709 13:01:33.161751  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:33.162149  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 510207us
I20260709 13:01:33.159870  1619 rpcz_store.cc:276] 0709 13:01:31.260300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.717878 (+1457578us) service_pool.cc:224] Handling call
0709 13:01:32.724002 (+  6124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.960875  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 394) took 1726 ms. Trace:
I20260709 13:01:33.163591  1688 rpcz_store.cc:276] 0709 13:01:31.233876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.140986 (+907110us) service_pool.cc:224] Handling call
0709 13:01:32.141353 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:32.191041 (+ 49688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:32.191227 (+   186us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:32.267772 (+ 76545us) log.cc:844] Serialized 26 byte log entry
0709 13:01:32.728335 (+460563us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:32.728375 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.728439 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:32.959965 (+231526us) raft_consensus.cc:1685] finished
0709 13:01:32.960017 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.960455 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51331,"raft.queue_time_us":49937,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":143,"thread_start_us":322269,"threads_started":1,"wal-append.queue_time_us":544209}
I20260709 13:01:33.168998  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.170130  1691 raft_consensus.cc:2393] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:32.891288  4690 raft_consensus.cc:3055] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:33.179965  4690 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:33.180637  4648 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:32.820474  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.882510  4745 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:32.884037  4747 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:32.780685  1443 catalog_manager.cc:5697] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 4 to 5, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 5 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.985508  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:33.184017  1541 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:33.184967  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1626) took 1006 ms. Trace:
I20260709 13:01:33.185400  1541 rpcz_store.cc:276] 0709 13:01:32.178889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.744595 (+565706us) service_pool.cc:224] Handling call
0709 13:01:33.184857 (+440262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:32.981240  4654 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:33.183063  4648 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:32.978139  4633 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:32.975950  4588 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:32.993991  4780 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:01:32.896454  4611 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:33.019920  4778 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:32.975106  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 219991us
I20260709 13:01:33.005923  4717 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:33.009362  4249 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:32.942207  1539 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:33.045646  1545 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:33.046177  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:33.046882  1544 rpcz_store.cc:276] 0709 13:01:31.700727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.616251 (+915524us) service_pool.cc:224] Handling call
0709 13:01:32.835431 (+219180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.039291  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:33.023082  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:33.047612  1543 rpcz_store.cc:276] 0709 13:01:31.699658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.699987 (+   329us) service_pool.cc:224] Handling call
0709 13:01:32.832706 (+1132719us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.053843  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.942219  1540 raft_consensus.cc:2376] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4. Re-sending same reply.
W20260709 13:01:33.222271  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 138466us
I20260709 13:01:33.223372  1586 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:33.062501  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1607) took 1306 ms. Trace:
I20260709 13:01:33.117940  4257 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:33.224711  1547 rpcz_store.cc:276] 0709 13:01:31.767598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.057777 (+1290179us) service_pool.cc:224] Handling call
0709 13:01:33.062441 (+  4664us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.225816  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.227133  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.227936  1547 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:33.122143  4517 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:33.122902  1623 rpcz_store.cc:276] 0709 13:01:31.259825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.684500 (+1424675us) service_pool.cc:224] Handling call
0709 13:01:32.830283 (+145783us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.228623  2267 raft_consensus.cc:2393] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 9: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:33.125607  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:33.173588  4532 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:33.174356  4321 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.884104  4597 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:33.237118  4690 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:33.237910  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 56594us
I20260709 13:01:33.238338  1443 catalog_manager.cc:5697] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.130997  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:33.177896  4755 consensus_meta.cc:287] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.088s	user 0.014s	sys 0.006s
I20260709 13:01:33.161697  1622 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:33.161629  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:33.236402  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.000365  1662 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:33.239071  4690 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:33.150897  1542 rpcz_store.cc:269] 0709 13:01:31.754683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.099971 (+345288us) service_pool.cc:224] Handling call
0709 13:01:33.148384 (+1048413us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b540033e854. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:33.149070 (+   686us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236841728}
I20260709 13:01:33.223757  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:32.843796  1621 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:01:33.247995  4633 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:33.248373  1621 pending_rounds.cc:85] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 6
I20260709 13:01:33.248651  4633 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.248850  1621 pending_rounds.cc:107] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:01:33.249529  1621 raft_consensus.cc:2889] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:33.250612  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.252245  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.253751  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.186833  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.241098  1548 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
W20260709 13:01:33.247566  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 288150us
I20260709 13:01:33.258014  4321 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:33.260012  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.262341  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1512) took 1978 ms. Trace:
I20260709 13:01:33.236896  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.228201  4257 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:33.251298  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1517) took 1966 ms. Trace:
I20260709 13:01:33.271872  1621 rpcz_store.cc:276] 0709 13:01:31.285169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.843170 (+1558001us) service_pool.cc:224] Handling call
0709 13:01:32.843462 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.250634 (+407172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.251153 (+   519us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.239739  1697 raft_consensus.cc:2955] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:33.263480  4461 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:33.275527  4787 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:01:33.275856  4461 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:33.277545  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:33.278568  2232 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:33.234795  4249 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:33.279870  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.280701  1542 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:33.281517  4249 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:33.281641  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.282263  4249 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:33.282359  1542 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:33.282668  2265 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:33.283761  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.284725  1546 raft_consensus.cc:2410] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:33.285171  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1623) took 1167 ms. Trace:
W20260709 13:01:33.285629  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 62459.5us
I20260709 13:01:33.286621  4717 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:33.289218  4717 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:33.290052  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:33.290678  1543 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:33.290915  1548 raft_consensus.cc:2368] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6.
I20260709 13:01:33.264254  1541 raft_consensus.cc:2376] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5. Re-sending same reply.
I20260709 13:01:33.291743  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.292667  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.293483  1541 raft_consensus.cc:2376] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6. Re-sending same reply.
I20260709 13:01:33.293751  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 399) took 1805 ms. Trace:
I20260709 13:01:33.294262  1662 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:33.294174  1693 rpcz_store.cc:276] 0709 13:01:31.488685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.655128 (+1166443us) service_pool.cc:224] Handling call
0709 13:01:32.655389 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.655625 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:33.064965 (+409340us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.230654 (+165689us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.243673 (+ 13019us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:33.293290 (+ 49617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.293410 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.293575 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2574,"prepare.queue_time_us":514778,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":150,"raft.queue_time_us":17121,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":19266,"thread_start_us":551033,"threads_started":2,"wal-append.queue_time_us":223619}
I20260709 13:01:33.249229  4633 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:33.296366  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1598) took 1594 ms. Trace:
I20260709 13:01:33.295866  4611 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:33.297489  4611 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:33.285483  1546 rpcz_store.cc:276] 0709 13:01:32.117656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.268924 (+1151268us) service_pool.cc:224] Handling call
0709 13:01:33.285086 (+ 16162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.297936  4611 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:33.299115  1546 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:33.299692  1540 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:33.299973  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1605) took 1544 ms. Trace:
I20260709 13:01:33.300609  1546 rpcz_store.cc:276] 0709 13:01:31.755261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.298331 (+1543070us) service_pool.cc:224] Handling call
0709 13:01:33.298739 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.299544 (+   805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.299804 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.300735  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35704
I20260709 13:01:33.240626  1443 catalog_manager.cc:5697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.303879  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:33.304945  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:33.308184  4321 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:33.266168  1615 rpcz_store.cc:276] 0709 13:01:31.283627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.806257 (+1522630us) service_pool.cc:224] Handling call
0709 13:01:32.806529 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.952242 (+145713us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:32.953228 (+   986us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.198707 (+245479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.198811 (+   104us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:33.198928 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.246395 (+ 47467us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400067554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:33.246436 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.262189 (+ 15753us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37624,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":57022,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":177,"spinlock_wait_cycles":332531968,"thread_start_us":235660,"threads_started":2,"wal-append.queue_time_us":113418}
I20260709 13:01:33.330003  2232 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:33.315815  1544 raft_consensus.cc:2393] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:33.331580  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1622) took 1252 ms. Trace:
I20260709 13:01:33.332070  1544 rpcz_store.cc:276] 0709 13:01:32.079381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.253367 (+1173986us) service_pool.cc:224] Handling call
0709 13:01:33.331489 (+ 78122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.291765  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:33.297180  1541 rpcz_store.cc:276] 0709 13:01:31.701381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.294107 (+1592726us) service_pool.cc:224] Handling call
0709 13:01:33.294503 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.294712 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.294737 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.294795 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:33.295942 (+  1147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.296006 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.296133 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.322577  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.324396  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:33.329093  1540 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:33.334700  1540 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:33.329306  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1655) took 2045 ms (client timeout 1938 ms). Trace:
I20260709 13:01:33.309945  4793 consensus_queue.cc:1059] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:33.335250  1620 rpcz_store.cc:269] 0709 13:01:31.279829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.479801 (+199972us) service_pool.cc:224] Handling call
0709 13:01:33.263451 (+1783650us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b540016e754. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:33.325284 (+ 61833us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3768531840}
I20260709 13:01:33.282691  4249 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.342772  1586 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:33.340946  1548 pending_rounds.cc:85] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 1
I20260709 13:01:33.345309  1548 pending_rounds.cc:107] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:33.346211  4249 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:33.357458  1513 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:33.358820  4755 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:33.345655  1548 raft_consensus.cc:2889] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:33.378326  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.253785  4778 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:33.381664  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.378060  1443 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 2 to 4, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 4 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.367359  4429 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:33.387948  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 66129.9us
I20260709 13:01:33.388296  2267 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:33.387995  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.389948  1543 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:33.391861  4321 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:33.393235  1545 raft_consensus.cc:2393] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 6: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:33.395900  1544 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:33.347468  4717 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:01:33.391688  4793 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:33.364897  4755 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:33.395324  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 490) took 1262 ms. Trace:
W20260709 13:01:33.400626  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 340337us
I20260709 13:01:33.406860  1543 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
W20260709 13:01:33.408128  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.406706  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 489) took 1270 ms. Trace:
I20260709 13:01:33.385725  1443 catalog_manager.cc:5697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 3 to 4, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 4 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.408520  1541 rpcz_store.cc:276] 0709 13:01:32.132555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.341545 (+1208990us) service_pool.cc:224] Handling call
0709 13:01:33.375899 (+ 34354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.402275 (+ 26376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.402316 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.402378 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:33.402432 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.402511 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.402644 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.406643  1545 rpcz_store.cc:276] 0709 13:01:32.132890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.394117 (+1261227us) service_pool.cc:224] Handling call
0709 13:01:33.394616 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.394878 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.394922 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.394982 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:33.395019 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.395095 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.395249 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.412633  4424 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:33.413112  4424 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.413460  4424 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:33.415724  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 396) took 2113 ms. Trace:
I20260709 13:01:33.413825  1443 catalog_manager.cc:5697] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 2 to 3, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 3 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:33.409301  4755 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:33.416386  1697 rpcz_store.cc:276] 0709 13:01:31.302618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.639667 (+1337049us) service_pool.cc:224] Handling call
0709 13:01:32.640384 (+   717us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:32.647869 (+  7485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:32.647900 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:32.690304 (+ 42404us) log.cc:844] Serialized 590 byte log entry
0709 13:01:33.205744 (+515440us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:33.348258 (+142514us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.365307 (+ 17049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.379383 (+ 14076us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.379456 (+    73us) raft_consensus.cc:1685] finished
0709 13:01:33.379469 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.415639 (+ 36170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6813,"raft.queue_time_us":36149,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":17454,"thread_start_us":280046,"threads_started":1,"wal-append.queue_time_us":352962}
I20260709 13:01:33.398986  4778 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:33.418618  1547 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:33.419373  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.424001  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.424746  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 491) took 1291 ms. Trace:
I20260709 13:01:33.467783  1542 rpcz_store.cc:276] 0709 13:01:32.133429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.406351 (+1272922us) service_pool.cc:224] Handling call
0709 13:01:33.423977 (+ 17626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.424299 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.424330 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.424398 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:33.424441 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.424498 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.424644 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.469395  1542 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:33.461164  1545 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:33.425213  1693 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:33.432416  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.432371  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.469408  1547 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:33.418712  4461 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:33.430693  4429 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:33.530897  1540 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:33.535445  1543 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:33.528358  1542 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:01:33.543699  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 274312us
I20260709 13:01:33.437043  4249 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:33.521214  4321 raft_consensus.cc:697] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:33.565454  1540 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:33.565702  1545 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:01:33.573233  1547 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:01:33.576910  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:35704 (request call id 1612) took 1712 ms. Trace:
I20260709 13:01:33.579200  1539 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:33.577343  1540 rpcz_store.cc:276] 0709 13:01:31.854153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.300516 (+1446363us) service_pool.cc:224] Handling call
0709 13:01:33.565994 (+265478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.588320  1443 catalog_manager.cc:5697] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:33.599174  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:33.607649  2267 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
W20260709 13:01:33.622571  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 128939us
I20260709 13:01:33.575645  4633 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:33.631177  4633 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:33.632704  1690 raft_consensus.cc:2393] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:33.635360  4702 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:33.639549  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.639909  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:33.641415  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:33.642058  1621 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:33.643954  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1625) took 1487 ms. Trace:
I20260709 13:01:33.644368  1543 rpcz_store.cc:276] 0709 13:01:32.156454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.460743 (+1304289us) service_pool.cc:224] Handling call
0709 13:01:33.473519 (+ 12776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.536117 (+ 62598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.643683 (+107566us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b540027b0d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:33.643858 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141762304}
W20260709 13:01:33.619146  1514 leader_election.cc:336] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.701s (SENT)
I20260709 13:01:33.652808  1514 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:33.661022  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:33.667703  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:33.676151  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:33.724396  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 52675.3us
I20260709 13:01:33.643959  4321 consensus_queue.cc:237] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:33.734411  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.731900  4454 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:33.732822  1693 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:33.741132  4249 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:33.755136  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.756224  1697 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:33.756618  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.757999  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.688351  4633 consensus_queue.cc:1059] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:01:33.779625  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 488) took 1630 ms. Trace:
I20260709 13:01:33.780205  1544 rpcz_store.cc:276] 0709 13:01:32.132174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.340293 (+1208119us) service_pool.cc:224] Handling call
0709 13:01:33.395555 (+ 55262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.396307 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.758863 (+362556us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b54000a9bd0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:33.761981 (+  3118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14726016}
W20260709 13:01:33.791997  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 186719us
I20260709 13:01:33.796075  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1628) took 1529 ms. Trace:
I20260709 13:01:33.798321  1692 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:33.800158  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.806653  1695 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:33.803969  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:33.809326  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.809374  1619 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:33.811738  4812 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:01:33.812613  1697 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:33.813710  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:33.814455  4802 log.cc:927] Time spent T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:01:33.814700  1697 raft_consensus.cc:2410] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:33.796773  1541 rpcz_store.cc:276] 0709 13:01:32.267433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.409537 (+1142104us) service_pool.cc:224] Handling call
0709 13:01:33.435911 (+ 26374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.436448 (+   537us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:33.567906 (+131458us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.684986 (+117080us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.740589 (+ 55603us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18000056e0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:01:33.794881 (+ 54292us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.795003 (+   122us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:33.795175 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.795378 (+   203us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.795928 (+   550us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23464,"prepare.queue_time_us":199787,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":11941,"raft.run_wall_time_us":15177,"spinlock_wait_cycles":35396864,"thread_start_us":314116,"threads_started":4,"wal-append.queue_time_us":127340}
I20260709 13:01:33.821077  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.829865  1692 raft_consensus.cc:2410] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:33.753314  4454 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:33.852382  1693 raft_consensus.cc:2393] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:33.852670  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.854815  1694 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:33.871436  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.872532  1693 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:33.883703  4818 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:33.884276  4809 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.137s	user 0.001s	sys 0.001s
W20260709 13:01:33.889087  1511 connection.cc:256] RPC call timeout handler was delayed by -2.0160903169999642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 13:01:33.889647  1511 connection.cc:256] RPC call timeout handler was delayed by -1.998090316999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 13:01:33.889989  1511 connection.cc:256] RPC call timeout handler was delayed by -1.9701903169999468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 13:01:33.890301  1511 connection.cc:256] RPC call timeout handler was delayed by -1.9422903169999586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 13:01:33.890615  1511 connection.cc:256] RPC call timeout handler was delayed by -1.9071903169999587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 13:01:33.890976  1511 connection.cc:256] RPC call timeout handler was delayed by -1.7424903169999766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
I20260709 13:01:33.895627  1619 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
W20260709 13:01:33.891290  1511 connection.cc:256] RPC call timeout handler was delayed by -1.5507903169999508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2198s for a response
I20260709 13:01:33.899032  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.894130  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.894685  1692 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 13:01:33.918224  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 48456.9us
W20260709 13:01:33.893443  4611 consensus_meta.cc:287] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.595s	user 0.014s	sys 0.000s
I20260709 13:01:33.895229  1661 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:33.922060  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:01:33.926328  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1615) took 2071 ms (client timeout 1546 ms). Trace:
I20260709 13:01:33.937026  4454 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:33.937546  4816 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.150s	user 0.002s	sys 0.000s
W20260709 13:01:33.939319  4755 consensus_meta.cc:287] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.004s
W20260709 13:01:33.940363  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 211507us
I20260709 13:01:33.942410  1621 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
W20260709 13:01:33.941733  1539 rpcz_store.cc:269] 0709 13:01:31.855406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.088453 (+233047us) service_pool.cc:224] Handling call
0709 13:01:33.925984 (+1837531us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b5400303254. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:33.926217 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1960060800}
I20260709 13:01:33.917289  1692 pending_rounds.cc:85] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 4
I20260709 13:01:33.947002  4747 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:33.946713  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 51587.7us
I20260709 13:01:34.292809  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:33.994396  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:34.032163  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.249616  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 543) took 1222 ms. Trace:
W20260709 13:01:34.291112  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 275307us
W20260709 13:01:34.293853  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 376212us
I20260709 13:01:34.025096  1694 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:34.012771  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:33.994768  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:33.966569  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 222377us
I20260709 13:01:33.947351  1692 pending_rounds.cc:107] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:01:34.300853  1692 raft_consensus.cc:2889] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:33.952940  1586 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:01:33.967025  1514 leader_election.cc:336] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.877s (SENT)
I20260709 13:01:34.302227  2232 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:34.090058   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:34.091547  4597 raft_consensus.cc:3055] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:34.303768  4523 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:01:34.304328  4597 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:34.305568  4597 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.306804  4597 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.312163  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:01:34.037290  4811 log.cc:927] Time spent T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.217s	user 0.002s	sys 0.000s
I20260709 13:01:34.313733  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:34.314141  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.167265  4828 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:01:34.097077  4424 consensus_meta.cc:287] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.007s
I20260709 13:01:33.994326  4517 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.947600  4747 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.993912  4824 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.228325  4818 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.323675  1690 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:34.180639  4570 raft_consensus.cc:3055] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:34.328286  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.298432  1616 rpcz_store.cc:276] 0709 13:01:33.026899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.177002 (+150103us) service_pool.cc:224] Handling call
0709 13:01:33.177398 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.398320 (+220922us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:33.398708 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.574011 (+175303us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.574217 (+   206us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:33.574479 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.249146 (+674667us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54000d25d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:34.249219 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.249448 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":705,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":1190,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":23922,"spinlock_wait_cycles":507439872,"thread_start_us":173186,"threads_started":1,"wal-append.queue_time_us":262277}
I20260709 13:01:33.947192  4562 consensus_queue.cc:1059] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.366s
I20260709 13:01:34.332120  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.328125  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.337314  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.332828  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.338804  1696 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:34.339330  4517 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:33.945896  4389 consensus_queue.cc:1059] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.380s
I20260709 13:01:33.946266  4611 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.342754  4517 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:34.343593  2234 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:34.343819  4562 raft_consensus.cc:3055] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:34.344172  4562 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:34.345036  4562 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.346326  4562 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.340744  1697 raft_consensus.cc:2410] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:01:34.318356  4795 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:34.347862  4795 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:34.348241  4795 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:34.349004  1661 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:34.349596  4257 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:34.350852  4805 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:34.325014  4793 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:34.351281  4805 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:34.351792  4793 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.353003  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1597) took 2652 ms. Trace:
I20260709 13:01:34.353842  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:34.354909  4793 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:34.354981  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:34.328894  4454 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:34.328627  4588 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:34.355835  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:33.966540  4755 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.340023  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.343103  4611 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:34.370205  4611 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:34.370638  4611 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.371019  4611 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.359792  1543 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 6: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:34.358038  1689 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:34.329049  4747 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:34.373270  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.374787  1691 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:34.362242  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 409464us
I20260709 13:01:34.361012  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.364665  4633 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:34.379943  4818 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.380466  4633 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.381291  4702 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:34.382138  4818 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:34.364854  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:34.352758  4805 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:34.365121  4813 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.587s	user 0.000s	sys 0.003s
W20260709 13:01:34.365753  4829 log.cc:927] Time spent T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 13:01:34.365996  4454 raft_consensus.cc:697] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:34.367627  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 421418us
I20260709 13:01:34.369223  1540 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.379185  1691 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:34.385111  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:34.391666  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.353482  1548 rpcz_store.cc:276] 0709 13:01:31.701075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.292689 (+1591614us) service_pool.cc:224] Handling call
0709 13:01:33.328564 (+ 35875us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:33.436183 (+107619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.436214 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:33.436846 (+   632us) log.cc:844] Serialized 52 byte log entry
0709 13:01:33.606671 (+169825us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:33.659033 (+ 52362us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.659745 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.659934 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.938879 (+278945us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:34.351189 (+412310us) raft_consensus.cc:1685] finished
0709 13:01:34.351299 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.352807 (+  1508us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b54000a87d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:34.352921 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20367,"prepare.queue_time_us":98716,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":171963,"raft.run_cpu_time_us":538,"raft.run_wall_time_us":69260,"spinlock_wait_cycles":113712256,"thread_start_us":204339,"threads_started":2,"wal-append.queue_time_us":267214}
I20260709 13:01:34.334589  4570 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:34.326123  4424 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.384407  4805 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.405977  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.405560  1546 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:34.385288  4824 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:34.416956  1689 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:34.383594  4717 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:01:34.424083  1511 leader_election.cc:400] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4.
I20260709 13:01:34.424424  1511 leader_election.cc:403] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:01:34.405230  4558 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:34.423338  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.383392  4702 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:01:34.404237  4633 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:34.434216  1691 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:34.435880  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2454) took 1488 ms. Trace:
I20260709 13:01:34.393522  4818 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:01:34.438210  1542 rpcz_store.cc:276] 0709 13:01:32.945987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.560212 (+614225us) service_pool.cc:224] Handling call
0709 13:01:33.568876 (+  8664us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:33.569322 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.569352 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:33.579855 (+ 10503us) log.cc:844] Serialized 26 byte log entry
0709 13:01:33.618084 (+ 38229us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:33.618134 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.618225 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:34.364438 (+746213us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:34.433756 (+ 69318us) raft_consensus.cc:1685] finished
0709 13:01:34.433781 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.433976 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12204288,"thread_start_us":14636,"threads_started":1,"wal-append.queue_time_us":79867}
I20260709 13:01:34.443648  4454 consensus_queue.cc:237] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.451208  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1613) took 2596 ms. Trace:
I20260709 13:01:34.451905  1546 rpcz_store.cc:276] 0709 13:01:31.854500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.337609 (+1483109us) service_pool.cc:224] Handling call
0709 13:01:33.387764 (+ 50155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.420573 (+1032809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.450823 (+ 30250us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000a73d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:34.451111 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2327725824}
I20260709 13:01:34.454916  4570 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.456383  4570 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.430456  4824 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 3. Current term is 4.
I20260709 13:01:34.466228  1540 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:34.467592  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:34.468484  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.473346  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:34.480718  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:34.492475  4424 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:34.540355  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:34.540620  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 191665us
W20260709 13:01:34.534195  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 187152us
I20260709 13:01:34.544872  2234 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:34.543709  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 56867.7us
I20260709 13:01:34.506557  4755 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:34.542467  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 201517us
I20260709 13:01:34.535938  4611 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.552371  1661 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:34.553040  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 137358us
I20260709 13:01:34.556195  4840 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:34.564749  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 183797us
I20260709 13:01:34.556246  4523 raft_consensus.cc:3055] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:34.561223  4558 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:34.568113  1514 leader_election.cc:336] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.938s (SENT)
I20260709 13:01:34.571867  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:34.572926  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:34.574522  1623 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:34.574785  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:34.575980  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:34.577365  4838 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:34.567310  4523 raft_consensus.cc:740] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:34.570262  4840 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:34.578536  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:34.579912  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 190277us
I20260709 13:01:34.579387  4523 consensus_queue.cc:260] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.579698  4840 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:34.587196  1587 leader_election.cc:336] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.057s (SENT)
I20260709 13:01:34.592458  4517 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:34.604346  1587 leader_election.cc:336] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.100s (SENT)
I20260709 13:01:34.593729  4523 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:34.594092  4558 consensus_queue.cc:1175] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "44c8c572048a40b1a5e71865068ed1bb" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 7 index: 8 } }
W20260709 13:01:34.605471  1587 leader_election.cc:336] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.107s (SENT)
I20260709 13:01:34.608649  2234 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:34.611107  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:34.596421  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.599530  1694 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:34.595536  4611 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:34.613904  1511 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:34.609405  4838 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.615406  2266 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:34.618369  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:34.618443  4747 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.619175  1540 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:34.620438  1696 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:34.621608  4747 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:34.625500  1511 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:34.626406  4818 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:34.626931  4818 raft_consensus.cc:697] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:34.627635  4755 consensus_queue.cc:1059] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:34.628381  1587 leader_election.cc:336] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.189s (SENT)
I20260709 13:01:34.628602  4755 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:34.629060  4755 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:34.628851  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:34.629629  4755 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.629941  4822 raft_consensus.cc:3055] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:34.630370  4822 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:01:34.630520  1587 leader_election.cc:336] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.203s (SENT)
I20260709 13:01:34.631646  4805 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:34.631323  4822 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.632328  4805 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.632637  4822 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.632897  4805 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.635015  4805 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:34.627933  4818 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.616685  4517 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:34.635866  4517 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.636204  4517 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.639323  4588 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:01:34.640992  4846 log.cc:927] Time spent T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:01:34.653997  4795 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.655206  1621 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:34.655293  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 76920.1us
I20260709 13:01:34.656438  1661 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:34.658198  4805 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:34.664438  4838 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:34.664988  4838 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.665355  4838 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.658346  1514 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:34.644512  1511 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:34.667246  1514 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:34.667261  4824 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:34.667930  4824 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.668303  4824 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:34.668967  4588 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:34.612978  4843 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:34.672158  4843 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.672608  4843 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:34.674376  1587 leader_election.cc:336] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.221s (SENT)
I20260709 13:01:34.674840  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:34.675171  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.675582  4805 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:34.675714  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.678334  1663 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:34.679292  4611 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:34.679834  4611 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:34.680022  4321 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.680274  4611 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.680609  4321 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.682251  2231 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:01:34.682937  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.683347  4321 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:34.683923  4523 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:34.684490  4523 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:34.684981  4523 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:34.687474  1511 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:34.675805  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 44371.1us
I20260709 13:01:34.689373  4845 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:34.690507  4845 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.690932  4845 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.697664  2231 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:34.698563  4454 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:34.700263  4465 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:34.704466  1587 leader_election.cc:336] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.243s (SENT)
I20260709 13:01:34.678100  4824 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.658491  4795 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:34.711084  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:34.716405  1587 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:34.717393  1587 connection.cc:256] RPC call timeout handler was delayed by -2.1266263969999386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.317s for a response
W20260709 13:01:34.718680  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.718732  4429 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.720201  4805 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:34.721987  4588 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:34.707520  4321 consensus_queue.cc:1059] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:01:34.728093  4321 raft_consensus.cc:3055] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:34.728473  4321 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:34.729473  4429 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:34.729368  4321 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.713305  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:34.732963  1540 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:34.733594  4824 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:34.713855  1586 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:34.714213  1663 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:34.735149  4454 consensus_queue.cc:1059] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:01:34.735672  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.735612  4747 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:34.730827  4321 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.736416  4747 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:34.736987  4747 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.738732  4429 raft_consensus.cc:3055] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:34.739213  4429 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:34.724045  4845 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.726538  4523 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.740614  4570 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:34.740788  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:34.740994  4633 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:34.704299  4838 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:34.742479  1587 connection.cc:256] RPC call timeout handler was delayed by -1.9754263969999215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33380000000000004s for a response
I20260709 13:01:34.743247  1586 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:34.747715  2231 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:34.748358  1661 connection.cc:256] RPC call timeout handler was delayed by -1.2221175710000693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 13:01:34.758119  1540 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:34.734654  4517 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.763216  4611 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:34.774749  1587 leader_election.cc:336] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.900s (SENT)
I20260709 13:01:34.775319  1587 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:34.775378  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.768618  2232 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:34.784921  4755 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.786168  4621 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:34.787992  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:34.789208  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:34.789760  1540 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.789985  1586 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:34.755914  4805 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:34.791543  1661 leader_election.cc:336] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.546s (SENT)
I20260709 13:01:34.780771  4588 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:34.794348  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 53644.2us
I20260709 13:01:34.795336  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:34.778295  4424 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.791070  4257 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.792819  4621 raft_consensus.cc:697] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:34.802918  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.801684  1442 catalog_manager.cc:5697] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.808295  1691 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:34.782554  4717 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:34.809216  1514 leader_election.cc:336] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 2.198s (SENT)
I20260709 13:01:34.792471  4805 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:34.811766  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:34.765354  4795 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:01:34.839322  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:34.843398  1697 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:34.844319  1692 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:34.803404  4702 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:34.846701  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 51445.6us
I20260709 13:01:34.809294  1442 catalog_manager.cc:5697] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 5 to 6, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 6 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.813160  4793 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:34.848619  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52838 (request call id 253) took 9006 ms. Trace:
W20260709 13:01:34.854947  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 45769.5us
W20260709 13:01:34.857690  1514 leader_election.cc:336] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 2.414s (SENT)
I20260709 13:01:34.858093  1514 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:34.814073  4257 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.859910  1511 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:34.854350  4793 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.856737  1442 catalog_manager.cc:5697] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 9, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 9 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:34.860770  4793 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.861691  4257 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:34.861610  1442 catalog_manager.cc:5697] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 2 to 4, term changed from 3 to 5, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to <none>, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129), VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130), VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131), VOTER e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:34.864341  1442 catalog_manager.cc:5697] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 2 to 3, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 3 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:34.865336  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 90631us
W20260709 13:01:34.872282  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.863685  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:34.879405  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:34.888305  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.878885  1442 catalog_manager.cc:5697] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 5 to 8, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 8 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.849813  4755 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:34.902493  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 96613.8us
I20260709 13:01:34.891017  1442 catalog_manager.cc:5697] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 3 to 4, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 4 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:34.837828  4818 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:34.902566  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.906148  1442 catalog_manager.cc:5697] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 3 to 4, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 4 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:34.836668  4621 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.918450  1693 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:34.921227  4597 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.921865  4597 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.924790  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:34.907033  1540 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:34.863870  4465 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:34.912825  1442 catalog_manager.cc:5697] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:34.840387  4805 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.888134  4588 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:34.807757  4429 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:34.948328  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:34.936612  1442 catalog_manager.cc:5697] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:34.878409  4824 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:01:34.958909  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:34.959754  1615 raft_consensus.cc:2376] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7. Re-sending same reply.
I20260709 13:01:34.934803  4465 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.963178  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:34.854519  1443 rpcz_store.cc:276] 0709 13:01:25.842507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.845618 (+  3111us) service_pool.cc:224] Handling call
0709 13:01:34.848516 (+9002898us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:33.808822 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:33.885003 (+ 76181us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:33.885053 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:01:33.885083 (+    30us) tablet.cc:662] Decoding operations
0709 13:01:33.886355 (+  1272us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:33.886440 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:33.886474 (+    34us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:01:33.889290 (+  2816us) tablet.cc:701] Row locks acquired
0709 13:01:33.889340 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:01:33.889529 (+   189us) write_op.cc:270] Start()
0709 13:01:33.889678 (+   149us) write_op.cc:276] Timestamp: P: 1783602093889464 usec, L: 0
0709 13:01:33.889699 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:01:33.890459 (+   760us) log.cc:844] Serialized 4412 byte log entry
0709 13:01:34.433155 (+542696us) op_driver.cc:464] REPLICATION: finished
0709 13:01:34.538237 (+105082us) write_op.cc:301] APPLY: starting
0709 13:01:34.538389 (+   152us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:34.538713 (+   324us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:34.538867 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:34.604266 (+ 65399us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:34.604705 (+   439us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:01:34.604751 (+    46us) write_op.cc:312] APPLY: finished
0709 13:01:34.605183 (+   432us) log.cc:844] Serialized 83 byte log entry
0709 13:01:34.612252 (+  7069us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:34.615299 (+  3047us) write_op.cc:454] Released schema lock
0709 13:01:34.615369 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:34.615905 (+   536us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:34.615953 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":229794,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":62016,"apply.run_cpu_time_us":8820,"apply.run_wall_time_us":95601,"num_ops":11,"prepare.queue_time_us":124260,"prepare.run_cpu_time_us":15436,"prepare.run_wall_time_us":207139,"raft.queue_time_us":144393,"raft.run_cpu_time_us":8182,"raft.run_wall_time_us":36355,"replication_time_us":543267,"thread_start_us":247245,"threads_started":4,"wal-append.queue_time_us":196022}]]}
I20260709 13:01:34.962244  1621 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:34.964416  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:34.966223  1615 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.966090  4465 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.969700  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:34.970381  1618 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:34.970953  4855 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:34.972440  4611 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:34.975044  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:34.975720  1695 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:34.948630  4818 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:34.957616  4717 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.980741  1619 raft_consensus.cc:2376] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9. Re-sending same reply.
I20260709 13:01:35.005229  1615 raft_consensus.cc:2410] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:35.006198  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:34.927520  4843 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:34.982574  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:34.987356  4853 log.cc:927] Time spent T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:01:35.013936  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.019202  1618 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:34.952530  1442 catalog_manager.cc:5697] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 4 to 5, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 5 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:34.980161  4429 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:35.036317  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:35.010612  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 268528us
I20260709 13:01:35.021013  2232 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:35.026237  1442 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 4 to 6, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 6 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:35.059501  1614 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:35.060081  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.060535  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.039841  1442 catalog_manager.cc:5697] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:35.069583  1691 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:35.072821  1442 catalog_manager.cc:5697] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 4 to 6, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 6 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:01:35.081372  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.082893  1621 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:35.051318  4523 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:35.055743  4597 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:35.088686  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.061357  4841 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:35.098883  1619 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
W20260709 13:01:35.106029  1661 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.173s (SENT) [suppressed 56 similar messages]
I20260709 13:01:35.104696  1618 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:35.105361  1688 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:01:35.095659  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 237969us
I20260709 13:01:35.059635  4845 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:35.109828  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:35.109278  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.111639  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.005144  4717 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:35.118043  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:35.118718  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.115509  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 209274us
I20260709 13:01:35.121299  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:35.117128  2231 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:35.124895  1623 raft_consensus.cc:2393] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:35.101567  4838 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:35.134296  1663 leader_election.cc:336] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.602s (SENT)
I20260709 13:01:35.134702  4855 consensus_queue.cc:1059] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:35.135764  1663 leader_election.cc:336] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.619s (SENT)
I20260709 13:01:35.135941  4795 raft_consensus.cc:3055] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:35.136289  1663 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:35.136353  4795 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:35.137149  4570 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:35.139142  1586 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:35.137331  4795 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:35.148814  4795 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:35.151705  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:49328
I20260709 13:01:35.152683  1691 raft_consensus.cc:606] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:35.152756  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:35.153090  1691 raft_consensus.cc:614] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:35.154090  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:35.154372  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:35.155241  1617 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:35.155773  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.156527  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.157933  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.158104  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.151805  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:35.164932  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.157985  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.166052  1661 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:35.166069  4747 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:35.168258  4843 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:35.171110  4863 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:35.175088  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.160410  4851 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:01:35.180611  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.126912  4597 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:35.184453  4597 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:35.184914  4597 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:35.190845  4838 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:35.129930  4844 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.241s
I20260709 13:01:35.196310  1694 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:35.132786  4841 raft_consensus.cc:697] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:35.199064  4747 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:35.182665  1623 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:35.145344  4793 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:35.202121  4793 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:35.209825  4702 raft_consensus.cc:3055] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:35.210704  4702 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:35.177103  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:35.212745  1622 raft_consensus.cc:2376] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7. Re-sending same reply.
I20260709 13:01:35.198937  4841 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:35.229043  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:35.243357  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.245273  1696 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:35.247445  4857 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:35.246809  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 52138.9us
W20260709 13:01:35.252545  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 113462us
I20260709 13:01:35.247960  4857 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:35.177641  4717 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:35.270292  1586 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:35.271559  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.273360  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.273361  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:35.244694  4845 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.226135  4855 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:35.288409  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.289778  1539 raft_consensus.cc:2393] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:35.277670  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.278399  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.292855  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.293569  1618 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:35.293016  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:35.272866  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 356927us
I20260709 13:01:35.273700  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.281252  4465 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:35.295183  1542 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:35.294425  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.273617  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.296981  1543 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:35.279829  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:35.286145  1546 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:35.281922  4857 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:35.275529  4793 consensus_queue.cc:1059] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:01:35.278070  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:35.300457  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 164725us
I20260709 13:01:35.273437  1548 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:35.305068  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.312067  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.339910  1616 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:35.299646  1623 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:35.310797  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.342267  1540 raft_consensus.cc:2393] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 9: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:35.297451  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.343818  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.344569  1621 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:35.345381  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:35.345929  1621 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:35.346684  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 45231.8us
I20260709 13:01:35.347611  1617 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
W20260709 13:01:35.350890  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.353701  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 51536.3us
I20260709 13:01:35.366107  1619 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:35.368049  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.368968  1540 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:35.273958  4859 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:35.276592  4424 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:35.374997  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.375298  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.379908  1539 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
W20260709 13:01:35.374998  1663 leader_election.cc:336] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.622s (SENT)
I20260709 13:01:35.304700  4863 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:35.378876  2268 raft_consensus.cc:1240] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:35.303385  4861 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:35.390240  4861 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.390610  4861 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:35.392051  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:35.393172  1547 raft_consensus.cc:2410] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:35.353183  4855 raft_consensus.cc:3055] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:35.380036  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.382643  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.396364  1540 raft_consensus.cc:2410] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:35.383555  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:35.397807  1542 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:35.385089  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.398372  1621 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
W20260709 13:01:35.387017  1663 leader_election.cc:336] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.860s (SENT)
I20260709 13:01:35.400326  1663 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:35.387729  4805 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:35.398717  1619 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:35.408275  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:35.410585  1695 raft_consensus.cc:2393] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:35.300164  4845 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:35.412827  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:35.413636  1694 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:35.416272  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:35.406023  2231 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:35.420981  1691 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:35.378542  4570 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:35.423761  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.422859  1615 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:35.426977  1692 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:35.428089  1546 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:35.428547  1539 raft_consensus.cc:2410] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:35.431834  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:35.436031  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 49027.2us
I20260709 13:01:35.436288  4633 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:35.437024  1663 leader_election.cc:336] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.930s (SENT)
I20260709 13:01:35.453573  1622 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:35.400671  4855 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:35.464259  2272 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
W20260709 13:01:35.465854  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 59963us
I20260709 13:01:35.469890  1586 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:35.417645  4824 consensus_queue.cc:1059] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:01:35.409582  4465 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:35.481210  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:35.286450  4702 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:35.507297  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:35.508345  1539 raft_consensus.cc:2376] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9. Re-sending same reply.
I20260709 13:01:35.391489  4859 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:35.507297  2231 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:35.510387  1619 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:35.513258  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.513525  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:35.515854  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.516857  1546 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:35.517158  4793 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:35.513362  4588 raft_consensus.cc:3055] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:35.518349  4588 raft_consensus.cc:740] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:35.518556  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:35.518844  4690 consensus_queue.cc:1059] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:35.399592  4611 consensus_queue.cc:1059] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:01:35.423956  4857 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.164s
I20260709 13:01:35.587718  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:35.568809  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.590446  1540 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:35.508838  4717 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:35.586616  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:35.586900  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.592072  1546 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:35.592201  1542 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:35.592555  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:35.591636  4717 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.593438  1696 raft_consensus.cc:2410] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:35.593364  4717 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:35.508566  4429 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:35.519555  4588 consensus_queue.cc:260] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:35.596503  4429 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:35.558841  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:35.597254  4588 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:35.597527  4429 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:35.522073  4517 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:35.572312  1620 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:35.572770  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.562628  4855 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:35.600859  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.601233  4855 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:35.587288  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:35.528622  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:35.603062  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:35.525179  4841 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:35.604460  4841 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.551388  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:35.529888  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:35.606377  1689 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:35.606504  1691 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:01:35.519308  1694 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:35.519920  4690 raft_consensus.cc:3055] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:35.607968  4690 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:35.608351  4857 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:35.609417  4857 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:35.608896  4690 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:35.610008  4857 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:35.610999  4690 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:35.537948  4597 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:35.527431  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:35.613803  1616 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:35.570534  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.615558  4597 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:35.605188  4841 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:35.552904  4805 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:35.604033  4611 raft_consensus.cc:3055] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:35.553689  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 51955.2us
I20260709 13:01:35.619050  4611 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:35.620098  4611 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:35.621896  4611 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:35.511307  4562 consensus_queue.cc:1059] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:01:35.526388  4570 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:35.623566  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:35.591180  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.672736  1615 raft_consensus.cc:1240] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 4. Current term is 6. Ops: []
I20260709 13:01:35.515975  1622 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:35.595181  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:35.578125  4702 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:35.533843  4845 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:35.565865  4859 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:35.673224  4570 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:35.679692  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:35.680346  1539 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:35.665459  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.683676  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:35.684700  1543 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:35.684926  1696 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:35.611159  4857 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:35.668596  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 45632.6us
I20260709 13:01:35.675758  1622 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:35.702812  1615 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:01:35.685817  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 219645us
I20260709 13:01:35.667281  1623 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
W20260709 13:01:35.692123  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.698715  1546 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:35.700062  1616 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:35.704813  1692 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
W20260709 13:01:35.670374  4868 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.103s	user 0.004s	sys 0.000s
I20260709 13:01:35.712517  1691 raft_consensus.cc:1240] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:35.674420  4873 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.089s	user 0.001s	sys 0.002s
I20260709 13:01:35.730280  1692 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:35.733296  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.734252  1586 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:35.741884  1539 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:35.536571  4861 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:35.747997  4861 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:35.749877  4870 log.cc:927] Time spent T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.111s	user 0.002s	sys 0.002s
I20260709 13:01:35.751770  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:35.758394  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:35.767436  1692 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:35.759155  1696 raft_consensus.cc:2410] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:01:35.763171  1663 leader_election.cc:336] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 2.007s (SENT)
I20260709 13:01:35.771181  1663 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:35.805956  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.815021  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 53002.2us
I20260709 13:01:35.760565  4793 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:35.762216  4859 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.844501  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.785769  4857 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:35.855635  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.858376  1623 raft_consensus.cc:2393] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
W20260709 13:01:35.858881  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.837193  1694 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
W20260709 13:01:35.888336  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 125188us
I20260709 13:01:35.889231  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.889899  1539 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
W20260709 13:01:35.898175  4877 log.cc:927] Time spent T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.003s
I20260709 13:01:35.881474  4793 raft_consensus.cc:697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:01:35.899387  4881 log.cc:927] Time spent T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:01:35.903483  4871 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:01:35.859740  4841 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:35.905910  4841 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:35.883517  4597 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.907845  4597 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:35.911952  1586 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:35.913422  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.914425  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.914889  4861 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:35.915557  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.917758  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.918279  1539 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:35.915753  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.844203  4747 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:35.916531  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.909853  4597 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:35.936573  1615 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:01:35.922792  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.940503  1663 leader_election.cc:336] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 2.104s (SENT)
I20260709 13:01:35.942785  1663 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:35.941267  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.943953  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:35.945147  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.945776  1540 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
W20260709 13:01:35.903270  4876 log.cc:927] Time spent T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.110s	user 0.000s	sys 0.004s
I20260709 13:01:35.971941  1697 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:35.972530  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.973579  1622 raft_consensus.cc:2410] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:35.977631  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:35.978649  1620 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:35.981246  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:35.882061  4859 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:35.963558  4861 raft_consensus.cc:697] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:36.024498  4861 consensus_queue.cc:237] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:36.031625  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:36.032371  1694 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:36.034409  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:36.035317  1540 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
I20260709 13:01:36.039628  1543 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
W20260709 13:01:36.040490  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.016s	sys 0.045s
W20260709 13:01:36.041043  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.016s	sys 0.045s
W20260709 13:01:36.043467  2232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.007s	sys 0.010s
I20260709 13:01:35.987802  4838 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:36.052551  2232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.007s	sys 0.010s
W20260709 13:01:36.065788  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 723701us
I20260709 13:01:35.986004  4465 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:36.076186  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:36.089134  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.090376  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.094139  2268 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:36.052562  4876 log.cc:927] Time spent T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:36.089831  1620 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:36.098045  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:36.115172  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.129101  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.158275  1544 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:01:36.159349  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.125295  4880 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:01:36.173148  1661 leader_election.cc:336] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.630s (SENT)
I20260709 13:01:36.183081  1661 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:36.209641  1694 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:36.250691  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:36.256944  1539 raft_consensus.cc:2393] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:36.250880  1692 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
W20260709 13:01:36.266969  1511 connection.cc:256] RPC call timeout handler was delayed by -1.1604460739999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
I20260709 13:01:36.272100  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:36.278736  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.280697  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.281227  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.282907  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.125088  4465 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:36.224627  4747 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:36.256016  2268 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:36.297686  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1572) took 1010 ms. Trace:
W20260709 13:01:36.301996  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 149132us
I20260709 13:01:36.298105  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.303707  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.304162  1620 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:36.304457  1615 raft_consensus.cc:2368] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:01:36.096683  4793 consensus_queue.cc:237] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:36.305915  1544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
W20260709 13:01:36.293107  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 125114us
W20260709 13:01:36.317934  1661 leader_election.cc:336] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.597s (SENT)
W20260709 13:01:36.182574  4633 consensus_meta.cc:287] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.746s	user 0.013s	sys 0.012s
I20260709 13:01:36.318215  1544 raft_consensus.cc:606] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:36.318892  1544 raft_consensus.cc:614] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:36.319906  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:36.301179  1618 rpcz_store.cc:276] 0709 13:01:35.286906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.355809 (+ 68903us) service_pool.cc:224] Handling call
0709 13:01:35.356671 (+   862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.357269 (+   598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.357315 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.358139 (+   824us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.760050 (+401911us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:35.842632 (+ 82582us) log.cc:844] Serialized 14 byte log entry
0709 13:01:35.842941 (+   309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.843041 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:35.912661 (+ 69620us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b1800338200. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:01:36.278762 (+366101us) raft_consensus.cc:1685] finished
0709 13:01:36.288889 (+ 10127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.297633 (+  8744us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":84461,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":1663,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":9849,"spinlock_wait_cycles":19159808,"thread_start_us":345503,"threads_started":1,"wal-append.queue_time_us":594072}
W20260709 13:01:36.234498  4717 consensus_meta.cc:287] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.017s
I20260709 13:01:36.329136  1541 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:36.336814  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 396311us
I20260709 13:01:36.339111  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:36.351503  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.352900  2234 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:36.363024  4424 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:36.346771  4838 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:36.370332  4838 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:36.371800  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:49328
I20260709 13:01:36.372534  1692 raft_consensus.cc:606] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:36.326973  4633 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:36.372906  1692 raft_consensus.cc:614] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:36.372855  4875 raft_consensus.cc:3055] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:01:36.374887  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 226272us
W20260709 13:01:36.348804  4588 consensus_meta.cc:287] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.019s
W20260709 13:01:36.378719  1514 leader_election.cc:336] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.579s (SENT)
W20260709 13:01:36.354429  4570 consensus_meta.cc:287] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.007s
I20260709 13:01:36.385906  1514 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:36.401628  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 208942us
I20260709 13:01:36.411039  2268 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:36.419176  4845 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:36.420053  4558 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:36.420885  4890 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:01:36.422449  4465 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:36.424048  4886 log.cc:927] Time spent T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:01:36.378049  4875 raft_consensus.cc:740] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:36.425570  4875 consensus_queue.cc:260] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:36.426671  4875 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:36.428193  4795 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:36.428795  4795 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:36.429678  4321 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:36.430765  4321 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:36.430912  4795 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:36.432399  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.436640  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.438575  1614 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:01:36.440186  4894 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:01:36.390669  4570 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:36.445158  4570 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:36.375610  4747 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:01:36.447976  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:36.448833  1688 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:36.449820  1620 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:36.349257  4717 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:36.453873  1618 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:36.458362  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:36.374979  4869 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:01:36.420648  4845 consensus_queue.cc:1059] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:01:36.467190  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 128131us
I20260709 13:01:36.468315  1548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:01:36.431136  4321 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:36.472364  1661 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:36.470664  1548 raft_consensus.cc:606] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:36.473459  1548 raft_consensus.cc:614] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:36.473814  1661 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:36.475199  1661 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:36.392352  4424 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:01:36.480726  4906 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:36.481444  4906 raft_consensus.cc:697] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:36.420696  4558 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:36.482456  4906 consensus_queue.cc:237] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:36.480732  4570 raft_consensus.cc:2764] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:36.483886  4321 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:36.485333  4558 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:36.485543  4321 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:36.486598  1619 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:36.488080  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:36.495085  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:36.489794  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 111113us
I20260709 13:01:36.491969  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.497503  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:36.499063  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 106712us
W20260709 13:01:36.500222  4888 log.cc:927] Time spent T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:01:36.495733  4570 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:36.456333  4747 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:36.505381  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 144386us
I20260709 13:01:36.498535  1661 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:36.511823  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:36.520654  4588 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.521028  4911 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.521310  4588 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:36.521551  4911 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:36.523913  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.524616  4911 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:36.527403  4588 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:36.534803  1620 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:36.536595  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:36.537285  1546 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:36.539008  2234 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:36.541694  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:36.548032  1514 leader_election.cc:336] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.675s (SENT)
I20260709 13:01:36.548592  1616 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:36.548664  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:36.548602  1514 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:36.542763  1548 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:01:36.548755  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.543356  1661 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:36.542105  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:36.551088  2272 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:36.547889  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c033fce18c634feb995adf2f2422308c"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:49328
I20260709 13:01:36.552508  1693 raft_consensus.cc:606] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:36.531461  4845 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.553185  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:36.553481  2232 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:36.553880  1540 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:36.518847  4465 raft_consensus.cc:3055] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:36.529300  4865 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:36.555230  1663 connection.cc:256] RPC call timeout handler was delayed by -1.0389855789999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3169s for a response
I20260709 13:01:36.528769  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:36.529699  4570 raft_consensus.cc:697] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:36.560037  4558 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:36.560377  4389 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:36.560817  4389 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.561146  4389 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:36.515457  4424 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:01:36.556813  4588 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:36.564196  4845 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:36.566706  4845 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:36.569276  1514 leader_election.cc:336] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.780s (SENT)
I20260709 13:01:36.569818  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:36.529373  4690 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:01:36.578032  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:36.578444  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:36.555757  4465 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:36.579470  4845 consensus_queue.cc:1059] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:36.579682  4465 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:36.579885  4570 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:36.581396  4465 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:36.582055  4885 log.cc:927] Time spent T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:01:36.532986  4747 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:36.584693  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:36.585561  4747 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:36.586917  4717 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:36.558359  4865 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.588068  4865 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:36.588481   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:36.556650  4900 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:36.589286  4900 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:36.589619  4900 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:36.590574   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:36.592032  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:36.577518  4588 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:36.594259  1661 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:36.595068  4895 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:36.595196  1661 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:36.596139  4895 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:36.596736  4895 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:36.596885  4747 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:36.597545  4747 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:36.597215  4895 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:36.598663  4611 consensus_meta.cc:287] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.933s	user 0.015s	sys 0.000s
W20260709 13:01:36.584929  4855 consensus_meta.cc:287] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.983s	user 0.013s	sys 0.013s
I20260709 13:01:36.598579  4747 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:36.597254  4857 consensus_meta.cc:287] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.000s
I20260709 13:01:36.599779  1621 raft_consensus.cc:2410] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:36.600360  1623 raft_consensus.cc:2410] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:36.600834  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1662) took 1030 ms. Trace:
I20260709 13:01:36.601248  1621 rpcz_store.cc:276] 0709 13:01:35.570109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.570265 (+   156us) service_pool.cc:224] Handling call
0709 13:01:36.600616 (+1030351us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b54000d2ad4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:36.600757 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2262723328}
I20260709 13:01:36.602008  1614 raft_consensus.cc:2410] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:36.596343  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:36.606950  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.612679  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:36.617877  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.622193  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.623611  1621 raft_consensus.cc:2393] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:36.625138  1615 raft_consensus.cc:2410] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:01:36.627516  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 58280.9us
I20260709 13:01:36.631825  1693 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:01:36.634229  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:36.635588  1692 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:36.636675  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:36.639004  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.640384  1619 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:36.640985  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:36.642238  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.643750  1616 raft_consensus.cc:2410] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:01:36.628404  1514 leader_election.cc:336] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.813s (SENT)
I20260709 13:01:36.644693  1514 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:36.642349  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 71544.3us
I20260709 13:01:36.646085  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:36.645839  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:36.646981  1692 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:36.647359  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:36.648674  1693 raft_consensus.cc:2410] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:36.650839  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:36.651338  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:36.652093  1695 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
W20260709 13:01:36.653244  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 57018.1us
I20260709 13:01:36.652678  1691 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:36.658864  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:36.659900  1696 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:36.624243  4906 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:36.624684  4588 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:36.664445  1514 leader_election.cc:336] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.817s (SENT)
I20260709 13:01:36.675858  1514 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:36.666615  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 113293us
I20260709 13:01:36.684772  4621 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:36.695780  2232 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:36.703243  1696 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:36.708052  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 169121us
W20260709 13:01:36.708353  1587 connection.cc:256] RPC call timeout handler was delayed by -2.9891836740000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2811s for a response
W20260709 13:01:36.707254  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 60724.5us
I20260709 13:01:36.714577  4918 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:36.720731  1588 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:36.701574  4690 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:36.723760  2231 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:36.724771  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:36.729148  1541 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:36.725040  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:36.723904  1663 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:36.730602  2266 raft_consensus.cc:2376] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8. Re-sending same reply.
W20260709 13:01:36.727061  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 62823.3us
W20260709 13:01:36.731675  1514 leader_election.cc:336] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.835s (SENT)
I20260709 13:01:36.732038  1514 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:36.740784  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:36.740937  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:36.742897  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:36.740934  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:36.754195  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.753674  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 44927.2us
I20260709 13:01:36.772346  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:36.742075  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:36.779735  1539 raft_consensus.cc:2393] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:36.780340  1541 raft_consensus.cc:2410] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:36.784040  1696 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:36.779616  1663 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:36.780972  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 49324.9us
W20260709 13:01:36.784950  1514 leader_election.cc:336] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.925s (SENT)
I20260709 13:01:36.775511  4898 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:36.782491  1546 raft_consensus.cc:2368] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7.
I20260709 13:01:36.777205  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:36.794673  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:36.786038  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:36.793835  1514 leader_election.cc:336] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 2.070s (SENT)
I20260709 13:01:36.800447  1514 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:36.802191  1540 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:36.730070  4861 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:36.727632  4690 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.812938  1663 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:36.741000  4633 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:36.818847  1587 leader_election.cc:336] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.971s (SENT)
I20260709 13:01:36.787710  4429 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:36.822590  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:36.823215  1546 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:36.826110  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:36.826316  1543 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:36.826759  1547 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:36.828101  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:36.829001  1545 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:36.829607  1587 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:36.831295  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:36.832365  1546 raft_consensus.cc:2393] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:36.833568  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:36.834285  1546 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:36.742525  4588 consensus_queue.cc:1059] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:01:36.817127  4857 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.842080  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:36.842721  1547 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:36.842660  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:36.843206  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.821514  4690 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:36.825192  4747 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:36.891893  1546 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:36.813194  4389 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:36.840051  4429 raft_consensus.cc:697] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:36.897342  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.901257  4906 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:36.850062  4857 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:36.839890  4321 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:36.919199  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 106337us
I20260709 13:01:36.941354  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:36.947165  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:36.923354  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 120157us
I20260709 13:01:36.954409  1692 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:36.925305  4913 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.202s
I20260709 13:01:36.927973  4429 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:36.933205  4611 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.932770  4633 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:36.853858  4865 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:36.937841  4389 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:37.010427  1688 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:37.013384  1692 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
W20260709 13:01:37.013000  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 219175us
I20260709 13:01:37.017124  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:37.017961  1690 raft_consensus.cc:2376] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 7. Re-sending same reply.
W20260709 13:01:37.019479  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.989418  4321 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.989439  4861 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:37.076941  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.070333  1547 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
W20260709 13:01:37.072010  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 130756us
I20260709 13:01:37.082017  4843 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:01:37.070698  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 129332us
I20260709 13:01:37.084156  1663 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:37.067497  1587 leader_election.cc:336] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.135s (SENT)
W20260709 13:01:37.085166  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.093286  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.087795  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:37.093899  1695 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:37.087996  1588 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:37.088971  1623 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:37.089594  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:37.016139  4906 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:37.112888  1587 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:37.113698  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:37.116817  1688 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:37.064976  4918 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:37.112980  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:37.128454  1513 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:36.994586  4611 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:37.125092  1663 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:37.147601  1663 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:37.136387  1545 raft_consensus.cc:3055] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:37.148958  1586 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:37.149060  1545 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:37.086599  4857 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:37.084466  4845 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:37.115805  4747 raft_consensus.cc:2764] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:01:37.123553  4875 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:37.145862  4465 consensus_meta.cc:287] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.564s	user 0.014s	sys 0.000s
I20260709 13:01:37.084820  4321 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:37.138818  4859 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:37.158044  1545 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:37.194375  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 106535us
I20260709 13:01:37.194087  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:37.098068  4861 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:37.155071  4793 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:37.169492  4855 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:37.210711  1544 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:37.156626  4911 raft_consensus.cc:3055] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:37.123837  4621 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:01:37.164985  4857 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:37.209290  4895 consensus_meta.cc:287] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.002s
I20260709 13:01:37.222390  4855 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:37.197093  4875 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:37.223138  1545 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:37.194059  4570 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:37.246659  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 97807.4us
I20260709 13:01:37.228129  4911 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:37.227787  4523 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.223982  4389 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:37.260450  1586 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:37.269191  1514 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:37.232107  4588 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:37.282157  1514 leader_election.cc:400] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:01:37.282814  1514 leader_election.cc:403] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:37.285049  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 137485us
I20260709 13:01:37.286722  1663 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:37.289363  4843 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:37.246608  4857 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.235723  4465 consensus_queue.cc:1059] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:01:37.242775  4895 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:37.244248  4859 consensus_queue.cc:1059] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:01:37.326937  1663 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:37.300705  4919 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:37.299202  4922 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:37.300889  4931 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:37.300972  4935 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:37.340906  1697 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:37.333490  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:37.280463  4523 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:37.311512  4901 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.279099  4389 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:37.301472  4865 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:37.308748  4857 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:37.301016  4923 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:37.296105  4588 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:37.386472  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 59946.1us
I20260709 13:01:37.334218  4939 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:01:37.351609  4924 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.206s	user 0.000s	sys 0.002s
W20260709 13:01:37.358440  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 87976.8us
I20260709 13:01:37.353145  1548 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:37.348487  4935 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.348677  4928 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:37.348935  4919 raft_consensus.cc:697] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:37.402527  1514 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:37.400473  4920 log.cc:927] Time spent T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.283s	user 0.000s	sys 0.002s
I20260709 13:01:37.386798  4923 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.369717  4930 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:37.421736  1695 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:37.420869  1663 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:37.432417  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.435158  1539 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:37.407972  4935 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:37.427328  4937 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:37.416291  4321 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:37.362498  4901 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:37.426816  4946 log.cc:927] Time spent T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:37.424418  4940 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:37.461367  1663 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:37.444360  4793 raft_consensus.cc:697] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:37.426023  4861 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:37.477227  1539 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:37.424645  4923 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:37.405741  4939 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:37.457954  4588 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:37.484347  4861 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.491093  4942 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:37.491290  4861 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:37.484611  4936 log.cc:927] Time spent T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:01:37.486963  4928 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:37.488731  4940 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:37.490371  4895 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:37.491786  4942 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:37.484817  4793 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:37.490419  1663 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:37.492700  4389 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:37.496855  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:37.510548  2266 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
W20260709 13:01:37.499293  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.510996  4943 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:37.512082  4943 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:37.513274  4943 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:37.513852  4857 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:37.516270  4940 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:37.460978  1546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.010s	sys 0.029s
I20260709 13:01:37.517201  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:37.508980  4939 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:37.491317  4855 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:37.518013  1546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.011s	sys 0.029s
I20260709 13:01:37.482389  4321 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:37.520051  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.521706  1663 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:37.499459  4861 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:37.524961  1588 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:37.516607  4928 raft_consensus.cc:697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:37.522617  4895 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:37.532183  4939 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:37.544814  4523 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:37.547118  4912 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.744s	user 0.008s	sys 0.000s
W20260709 13:01:37.547861  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 541040us
W20260709 13:01:37.548669  1587 leader_election.cc:336] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 3.170s (SENT)
I20260709 13:01:37.549065  1587 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:37.549288  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 583) took 1011 ms. Trace:
I20260709 13:01:37.549561  4855 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:37.550073  4855 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:37.550577  4855 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:37.551806  4939 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:37.555881  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:37.557777  4895 raft_consensus.cc:697] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:37.558873  4895 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:37.500946  4919 consensus_queue.cc:237] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:37.562951  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:37.563633  1689 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:37.564554  4901 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:37.564721  1692 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:37.567459  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:37.567812  4901 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.568415  4901 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:37.571092  1547 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:37.571300  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:37.571696  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:37.572228  1539 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:37.571288  4901 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:37.574447  4690 consensus_meta.cc:287] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.002s
I20260709 13:01:37.574920  4690 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:37.576179  1540 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:37.572115  1541 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:37.549754  1618 rpcz_store.cc:276] 0709 13:01:36.538242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.538403 (+   161us) service_pool.cc:224] Handling call
0709 13:01:36.540468 (+  2065us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:36.540928 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:36.540960 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:36.541638 (+   678us) log.cc:844] Serialized 26 byte log entry
0709 13:01:36.629097 (+ 87459us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:36.629142 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.629228 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.546464 (+917236us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:37.548942 (+  2478us) raft_consensus.cc:1685] finished
0709 13:01:37.548964 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.549216 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2694,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":7512960,"thread_start_us":86914,"threads_started":1,"wal-append.queue_time_us":165032}
I20260709 13:01:37.578226  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:37.572499  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 52675.6us
I20260709 13:01:37.579953  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:37.588136  1544 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:37.568128  1688 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:37.602334  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:37.571899  4942 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:37.608693  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 348304us
W20260709 13:01:37.850466  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.809219  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 207146us
I20260709 13:01:37.640538  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:37.972555  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:37.972605  1621 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:37.616291  2231 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:37.640102  4954 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:37.973937  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:37.974824  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:37.975275  1695 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:37.641453  4747 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.339s
I20260709 13:01:37.809787  1548 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:37.640911  4570 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.336s
I20260709 13:01:37.626564  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:37.979853  1616 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:37.614115  1539 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:37.542976  4321 raft_consensus.cc:697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:01:37.893244  4958 log.cc:927] Time spent T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:01:37.984540  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 368326us
I20260709 13:01:37.990849  4429 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:37.990563  4321 consensus_queue.cc:237] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:37.991283  4429 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:37.991729  4429 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:37.992605  4934 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:37.993227  4934 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:37.903847  4935 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:37.986608  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:37.987864  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 535) took 1093 ms. Trace:
W20260709 13:01:37.988098  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 439425us
W20260709 13:01:37.858376  4900 consensus_meta.cc:287] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.268s	user 0.016s	sys 0.000s
I20260709 13:01:37.765980  4928 consensus_queue.cc:237] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:37.989713  2234 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:37.964465  4916 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 1.028s	user 0.004s	sys 0.000s
W20260709 13:01:38.000342  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.013213  1587 leader_election.cc:336] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 3.338s (SENT)
I20260709 13:01:37.989647  2231 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:37.985625  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:38.005184  1542 rpcz_store.cc:276] 0709 13:01:36.894016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.115548 (+221532us) service_pool.cc:224] Handling call
0709 13:01:37.154598 (+ 39050us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.520009 (+365411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.520041 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.533805 (+ 13764us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.957347 (+423542us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:37.957404 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.957514 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.987655 (+ 30141us) raft_consensus.cc:1685] finished
0709 13:01:37.987675 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.987809 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39633,"raft.queue_time_us":140951,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":23629,"thread_start_us":652938,"threads_started":2,"wal-append.queue_time_us":396476}
I20260709 13:01:37.822584  4690 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:38.004139  4558 consensus_queue.cc:1059] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:01:38.022868  4389 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:37.897938  4855 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:37.896852  4923 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:38.092708  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 44679.9us
W20260709 13:01:38.218152  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 228589us
I20260709 13:01:38.092423  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1661) took 1358 ms. Trace:
W20260709 13:01:38.041512  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.220392  1546 rpcz_store.cc:276] 0709 13:01:36.733538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.917704 (+184166us) service_pool.cc:224] Handling call
0709 13:01:36.918191 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.525824 (+607633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.525871 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.549882 (+ 24011us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.704634 (+154752us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:37.704677 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.704775 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.092167 (+387392us) raft_consensus.cc:1685] finished
0709 13:01:38.092192 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.092341 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27691,"raft.queue_time_us":248316,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":35903,"thread_start_us":756844,"threads_started":2,"wal-append.queue_time_us":540095}
I20260709 13:01:38.223011  1586 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:38.023643  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:38.219936  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:38.230077  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 152835us
W20260709 13:01:38.232895  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 219707us
W20260709 13:01:38.234335  1663 leader_election.cc:336] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.570s (SENT)
I20260709 13:01:38.211954  4321 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.984745  4570 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.243933  1618 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:38.224586  4841 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:38.103786  4959 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.217319  4389 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.022933  4967 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:38.242274  4523 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:38.023164  4861 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.225s
I20260709 13:01:38.251619  4389 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:38.247563  4570 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.085685  4949 consensus_queue.cc:1059] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.163s
I20260709 13:01:38.247370  4841 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:38.262944  1587 connection.cc:256] RPC call timeout handler was delayed by -1.5566896210000323s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 13:01:38.264264  1587 connection.cc:256] RPC call timeout handler was delayed by -1.4243896209999889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 13:01:38.264698  1587 connection.cc:256] RPC call timeout handler was delayed by -1.3838896210000371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 13:01:38.265019  1587 connection.cc:256] RPC call timeout handler was delayed by -1.0886896210000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2264s for a response
I20260709 13:01:38.015396  4900 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.266335  1693 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:38.252980  4967 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.272171  1587 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:38.257638  4523 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.246556  4321 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:38.272965  1663 leader_election.cc:336] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.588s (SENT)
I20260709 13:01:38.250521  4981 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:38.278587  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:38.288887  1663 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:38.291594  1691 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:38.269294  4841 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:38.268615  4861 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:38.251207  4959 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.290844  4523 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:38.312516  4934 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:38.313694  4935 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:38.315526  4929 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:01:38.315856  4570 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:38.316247  4944 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:38.316462  4429 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.316814  4932 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:38.317215  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 914679us
I20260709 13:01:38.317770  4465 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:38.330704  4923 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:38.370785  4611 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:38.371580  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:38.372071  4855 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:38.373013  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:38.262300  4793 consensus_queue.cc:1059] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:01:38.279028  4967 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:38.373832  2267 raft_consensus.cc:2393] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:38.374429  4900 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:38.331960  4943 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:38.375831  2265 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:01:38.376497  4321 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:38.376953  4935 raft_consensus.cc:3055] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:38.377414  4935 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:38.378499  4935 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.360767  4941 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.380126  4959 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:38.380481  4941 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.364496  4861 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.382901  4861 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:38.382992  4941 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:38.386905  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 784593us
I20260709 13:01:38.377534  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2480) took 1646 ms. Trace:
W20260709 13:01:38.360581  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 88496.1us
W20260709 13:01:38.397918  1663 leader_election.cc:336] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.644s (SENT)
I20260709 13:01:38.403864  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:38.403316  1545 rpcz_store.cc:276] 0709 13:01:36.731535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.837062 (+105527us) service_pool.cc:224] Handling call
0709 13:01:36.851924 (+ 14862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.136211 (+284287us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000d96a0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6aab5dc0 00007f5c6ab401c0 00007f5c6ab41231 00007f5c6ab3dd8f 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c
0709 13:01:38.377228 (+1241017us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:38.377258 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.377296 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:38.377327 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.377390 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.377484 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":851495,"raft.queue_time_us":852268,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"spinlock_wait_cycles":347001728}
I20260709 13:01:38.392277  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:38.390518  4918 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:01:38.395056  1697 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:38.376987  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1659) took 1643 ms. Trace:
I20260709 13:01:38.389304  4925 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:38.377229  4321 raft_consensus.cc:2764] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 13:01:38.412547  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 47847.5us
I20260709 13:01:38.413419  1514 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:38.392333  4875 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:38.384771  4793 raft_consensus.cc:3055] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:38.415767  4793 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:38.416651  4793 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.416997  4855 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:38.418131  4793 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:38.420681  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:38.421597  1542 raft_consensus.cc:2393] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:38.422531  1548 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:01:38.422945  1548 pending_rounds.cc:85] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 6
I20260709 13:01:38.423169  1548 pending_rounds.cc:107] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:01:38.368427  4932 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.423434  1548 raft_consensus.cc:2889] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.425179  4841 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.425967  4932 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:38.289630  4949 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:38.426693  4949 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:38.368865  4944 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.409379  1587 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:38.410493  1543 rpcz_store.cc:276] 0709 13:01:36.733113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.849159 (+116046us) service_pool.cc:224] Handling call
0709 13:01:36.905420 (+ 56261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.617328 (+711908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.617363 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:37.617546 (+   183us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:37.617615 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.376786 (+759171us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54002b3c54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:38.376833 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.376938 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636604800}
I20260709 13:01:38.418198  4938 raft_consensus.cc:3055] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:38.421330  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:38.406329  1661 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:38.351636  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 127504us
I20260709 13:01:38.368889  4981 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:38.430122  1514 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:38.432049  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:38.452803  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 46523.3us
I20260709 13:01:38.455192  1514 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:38.430932  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 65406.3us
I20260709 13:01:38.455180  1661 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:38.427591  4941 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:38.427975  4923 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:38.463053  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 65186.4us
W20260709 13:01:38.467046  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 51478.5us
I20260709 13:01:38.465761  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:38.427800  4588 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:38.469887  1546 raft_consensus.cc:2393] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:38.470659  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:38.461315  4938 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:38.471767  2266 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:38.474279  4841 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:38.463455  4843 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:38.477388  4523 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.478448  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:38.468286  4984 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.478811  4917 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 1.557s	user 0.005s	sys 0.015s
I20260709 13:01:38.466464  4935 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:38.434269  4875 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:38.501856  4843 raft_consensus.cc:697] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:38.506861  4843 consensus_queue.cc:237] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.507557  4944 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:38.484654  4949 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:38.480875  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 48934.2us
I20260709 13:01:38.512219  1587 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:38.512638  4429 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:38.513073  4855 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:38.513489  4855 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:38.513558  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:38.513962  4855 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:38.482981  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:38.466109  4928 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:38.491394  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:38.517992  1695 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:38.491760  4883 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.492012  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:38.522552  1696 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:38.492609  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:38.524636  4928 raft_consensus.cc:697] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:38.525311  4523 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:38.526044  4928 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.497905  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:38.429567  4900 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:01:38.478225  4967 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.468497  4925 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:38.538591  4925 raft_consensus.cc:697] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:38.538906  1688 raft_consensus.cc:2368] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:01:38.540123  4967 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:38.539702  4925 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.500377  1690 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:38.517202  4875 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:38.543277  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:38.544605  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:38.545701  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:38.546280  1690 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:38.547065  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:38.504746  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:38.515612  1697 raft_consensus.cc:1240] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:38.517288  1693 raft_consensus.cc:2393] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:38.485179  4321 raft_consensus.cc:2764] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:01:38.530289  1694 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:38.550567  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:38.551239  2266 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:38.551357  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:38.552134  4690 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:38.531343  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:38.533710  4883 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.468120  4465 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:38.583464  1696 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:38.583513  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 78848.1us
I20260709 13:01:38.585465  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:38.586793  1586 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:38.555450  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:38.588408  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 57032.2us
I20260709 13:01:38.588738  1697 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
W20260709 13:01:38.591329  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 188427us
I20260709 13:01:38.594645  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:38.595678  1694 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:38.597069  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 104317us
I20260709 13:01:38.600685  1616 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:38.603241  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:38.603304  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:38.604368  1539 raft_consensus.cc:2410] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:38.605506  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:38.606200  1542 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:38.608078  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:38.611698  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.612758  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:38.614756  1539 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:38.613852  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:38.617614  1691 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:38.579043  4845 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:38.619942  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:38.627087  1696 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:38.630738  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:38.628628  1514 connection.cc:256] RPC call timeout handler was delayed by -1.4380060139999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:01:38.631685  1514 connection.cc:256] RPC call timeout handler was delayed by -1.3964252100000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 13:01:38.634543  1694 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:38.636871  1586 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:38.594941  4321 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:38.602206  4935 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:38.600853  4932 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.645335  1586 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:38.518743  4984 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.550448  4389 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.622104  4929 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.639092  4983 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:38.663457  2231 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:38.609392  4875 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:01:38.666011  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:38.647465  4861 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:38.552911  4981 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.673139  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:38.651360  4321 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.653277  4935 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.679472  2267 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:38.679435  1586 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:38.684417  1694 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:38.672089  4861 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.675323  4793 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:38.685577  4935 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:38.680840  4321 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:38.588100  4938 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.699308  4793 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:38.706688  2266 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:38.661412  4932 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.687779  4875 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:38.687631  4944 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:38.698127  4954 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:38.711714  1662 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:38.717013  4985 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:38.717618  4986 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.718039  4987 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:01:38.662518  4929 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.653304  4959 consensus_queue.cc:1059] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:01:38.600822  4872 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:01:38.719681  4903 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:38.719991  5001 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:38.705149  4690 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:38.728050  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:38.737735  1542 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:38.698542  4923 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:38.726437  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:38.742238  4985 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:38.743129  1514 leader_election.cc:336] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.566s (SENT)
I20260709 13:01:38.808424  1514 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:38.777298  4903 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.809302  4903 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:38.809629  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 66531.5us
I20260709 13:01:38.809873  4981 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.810379  4981 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:38.810814  1514 leader_election.cc:336] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.905s (SENT)
W20260709 13:01:38.745085  4953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.008s	sys 0.001s
I20260709 13:01:38.773698  4986 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.706270  4983 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:38.710392  4793 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:38.710457  4517 consensus_queue.cc:1175] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" responder_term: 10 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:38.738819  4944 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:38.755285  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 126895us
W20260709 13:01:38.720055  4991 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:01:38.776057  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:38.746554  4954 raft_consensus.cc:697] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:38.786669  2266 raft_consensus.cc:2368] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8.
I20260709 13:01:38.746794  4843 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:38.811734  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:38.804639  1694 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:38.698623  4861 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.717013  4883 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:38.715214  4875 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.811375  1514 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:38.829583  2231 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:38.827994  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:38.830544  1696 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:38.816583  2268 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:38.820430  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:38.826601  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 180488us
W20260709 13:01:38.839696  1514 leader_election.cc:336] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 2.238s (SENT)
I20260709 13:01:38.806974  5001 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:38.813534  4998 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:01:38.811761  4953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.008s	sys 0.001s
I20260709 13:01:38.840453  1514 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:38.842430  1696 raft_consensus.cc:1275] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:38.843816  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:38.819028  4932 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:38.820529  4985 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:38.831795  4875 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:38.824745  4690 raft_consensus.cc:697] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:38.821713  4938 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.818029  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:38.866348  5001 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.867367  4588 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:38.867772  4929 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:38.840744  4925 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:38.869088  4981 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:38.957126  4981 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:38.957261  4855 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.959129  2265 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:38.813650  4986 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:38.846882  4465 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:38.955050  4690 consensus_queue.cc:237] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.849448  4389 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:38.864629  4954 consensus_queue.cc:237] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.836371  4843 raft_consensus.cc:697] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:38.954720  5002 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.955008  4944 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:38.945822  4959 consensus_queue.cc:1059] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:01:38.992437  4959 consensus_queue.cc:1243] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:38.993767  4959 raft_consensus.cc:3055] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:38.994143  4959 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:38.814761  4911 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.995927  4911 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:38.997738  5003 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:01:38.812712  4983 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:38.966655  4935 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:38.971961  5010 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.092s	user 0.003s	sys 0.000s
I20260709 13:01:38.822054  4923 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:38.989495  4465 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:38.991459  4984 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:39.079146  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.989854  4929 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:39.096694  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:39.098795  1692 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:39.097477  1696 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:01:39.088838  4925 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:39.091837  4943 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:39.132825  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:39.014631  5002 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:39.120739  4900 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.106176  4929 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.106822  4465 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:39.147260  5005 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:01:39.164450  4983 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:39.160910  4900 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:39.175684  4900 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:39.180210  1548 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:39.147887  5014 consensus_queue.cc:1048] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:01:39.185932  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:39.200482  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 352227us
I20260709 13:01:39.187819  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:39.202111  2234 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:39.173216  1692 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:01:39.143666  4925 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:39.206421  4465 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:39.208086  4389 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:39.208426  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:39.201509  4959 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:39.215471  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:39.208436  4855 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:39.178968  4903 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.220660  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:39.183933  5002 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:39.146759  4943 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.220419  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:39.225628  1623 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:39.127262  4843 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.206977  4985 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.210559  5015 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:39.235183  1588 leader_election.cc:400] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8.
I20260709 13:01:39.235587  1588 leader_election.cc:403] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:39.182621  4793 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.182646  4861 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:39.249310  1620 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:39.221948  4999 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:39.217949  5014 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:01:39.263381  1689 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:39.264091  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 594) took 1686 ms (client timeout 1679 ms). Trace:
W20260709 13:01:39.264938  1618 rpcz_store.cc:269] 0709 13:01:37.577674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.577975 (+   301us) service_pool.cc:224] Handling call
0709 13:01:39.263859 (+1685884us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b5400067a54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:39.264000 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1529289600}
I20260709 13:01:39.239010  5002 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:39.236438  5015 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.271021  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:39.277978  1695 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:39.278673  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:39.274358  4925 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:39.270293  4923 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:39.277206  4985 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:39.278832  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 442825us
I20260709 13:01:39.296396  1623 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:39.296815  1587 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:39.297928  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:39.278995  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:39.298689  1696 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:39.241362  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:39.300572  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:39.279706  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:39.281279  1697 raft_consensus.cc:1240] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:39.282071  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:39.301769  1693 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:39.291864  1691 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:39.284912  5015 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:39.252562  4935 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:39.305917  1622 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:39.303769  1692 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:39.308980  1695 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:39.317308  1692 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:01:39.319257  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:39.321502  1587 leader_election.cc:400] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7.
I20260709 13:01:39.324970  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:39.325821  2271 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:39.326993  1587 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:39.331183  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:39.339864  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:39.340744  1623 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:39.343472  1696 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:39.347384  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:39.305939  4953 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:39.318975  5014 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:39.352995  2234 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:39.354789  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:39.355068  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:39.359496  1622 raft_consensus.cc:2368] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
I20260709 13:01:39.325178  4983 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:39.346670  4935 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:39.374400  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:39.349713  4985 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:39.350752  4900 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.375365  1615 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:39.381508  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:39.360913  4321 consensus_meta.cc:287] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.008s
I20260709 13:01:39.359984  4929 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:39.323379  4875 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.397907  1622 raft_consensus.cc:2368] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7.
I20260709 13:01:39.369043  4517 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:39.414999  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:39.416600  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:39.416833  4875 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:39.417487  1615 raft_consensus.cc:2368] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
W20260709 13:01:39.422151  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.396247  4943 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:39.385291  4985 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:39.423887  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:39.402240  4900 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.426646  4900 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:39.406585  4321 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.427515  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:39.428274  1622 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:39.429256  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:39.429903  1622 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:39.429685  4690 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:39.431568  4925 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:39.431838  1614 raft_consensus.cc:2393] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 9: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:39.432245  4925 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.434600  4925 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:39.436767  1616 raft_consensus.cc:2393] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 9: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:39.429716  4929 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:39.438115  4929 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.439851  4903 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:39.440971  4929 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:39.424849  2269 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:39.415005  4517 raft_consensus.cc:697] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:39.444406  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.444545  4517 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.446131  4935 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:39.446694  4935 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.447690  5020 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:39.447571  4953 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:39.448304  5020 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:39.448484  4953 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.450970  4953 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:39.453039  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:39.424187  4985 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:39.429260  4321 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:39.430910  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:39.418469  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:39.462627  1693 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:39.458559  1541 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:39.454216  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:39.473583  2271 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
W20260709 13:01:39.477700  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.508342  1588 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:39.511871  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:39.513289  1545 raft_consensus.cc:2393] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:39.514665  1542 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:01:39.518051  5020 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:39.435111  4925 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:39.530915  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:39.538880  1697 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:39.542280  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:39.543464  1691 raft_consensus.cc:2393] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 9: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:39.518301  4321 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:39.529939  4938 consensus_meta.cc:287] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.588s	user 0.005s	sys 0.008s
I20260709 13:01:39.558274  2265 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:01:39.561496  1697 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:39.516342  4841 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:01:39.563710  1615 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:39.557564  4321 raft_consensus.cc:697] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:39.721748  2269 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:39.551671  4925 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.737633  5007 raft_consensus.cc:3055] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:39.738211  5007 raft_consensus.cc:740] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:39.736128  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:39.719621  5015 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.752861  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:39.792841  1615 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:39.793820  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:39.741000  4935 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:39.740860  5007 consensus_queue.cc:260] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:39.772714  4925 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:39.777102  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1678) took 1174 ms. Trace:
I20260709 13:01:39.827662  1548 rpcz_store.cc:276] 0709 13:01:38.602627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.602746 (+   119us) service_pool.cc:224] Handling call
0709 13:01:38.638126 (+ 35380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.180595 (+542469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.776628 (+596033us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b540027bfd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:39.776856 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1245872384}
I20260709 13:01:39.781059  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 615) took 1179 ms. Trace:
I20260709 13:01:39.829445  1616 rpcz_store.cc:276] 0709 13:01:38.602140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.602988 (+   848us) service_pool.cc:224] Handling call
0709 13:01:39.780799 (+1177811us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b54003cb4d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:39.780977 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1913947904}
I20260709 13:01:39.831045  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:39.832039  1616 raft_consensus.cc:2393] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:39.833046  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:39.813349  1511 leader_election.cc:336] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.575s (SENT)
I20260709 13:01:39.836547  1511 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:39.858129  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:39.889663  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:39.890501  1539 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
W20260709 13:01:39.890957  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.891710  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:39.824231  4929 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.889189  4570 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:39.900310  1539 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:39.896049  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:39.856057  4465 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:39.817368  4903 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:39.859740  5007 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:39.902735  1540 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:39.906153  1615 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:39.906805  1540 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:39.908766  1540 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:39.913916  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:39.862537  4925 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:39.938970  1548 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:39.940071  1539 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:39.936321  4935 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:39.816529  4321 consensus_queue.cc:237] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.945427  4465 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:39.956837  4465 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:39.901070  4929 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:39.904382  4570 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:39.938532  4903 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:39.977793  1539 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:01:39.969710  5002 consensus_meta.cc:287] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.002s
I20260709 13:01:39.951620  4925 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:39.975240  5026 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.253s	user 0.000s	sys 0.002s
I20260709 13:01:39.987069  1548 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:40.009137  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 602) took 2161 ms. Trace:
W20260709 13:01:40.010574  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 45101.2us
W20260709 13:01:39.976707  5028 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:01:39.959025  4935 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:40.009752  1617 rpcz_store.cc:276] 0709 13:01:37.823594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.824374 (+   780us) service_pool.cc:224] Handling call
0709 13:01:39.764883 (+1940509us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5800085298. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb17fc0 00007f5c6fb02929 00007f5c6fb023d2 00007f5c69079bd4
0709 13:01:39.765104 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.765346 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:39.765680 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.937644 (+171964us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.984025 (+ 46381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.984149 (+   124us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:39.984211 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.984284 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.984445 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":582,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":3757,"raft.queue_time_us":233,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"spinlock_wait_cycles":4252800,"thread_start_us":170910,"threads_started":1,"wal-append.queue_time_us":196608}
I20260709 13:01:40.018504  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.019448  1617 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:40.025959  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:40.027807  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.028612  1617 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:40.032954  5034 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:01:40.035002  5033 log.cc:927] Time spent T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:40.036602  4465 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:40.038856  4465 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:40.016324  5031 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:01:40.049312  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.057336  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.057672  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:40.057976  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.058300  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.059324  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:40.023717  4983 consensus_meta.cc:287] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.000s
W20260709 13:01:40.055313  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:40.071545  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:40.063032  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.088439  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.022017  4570 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:40.093576  2231 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:40.099619  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.100646  1614 raft_consensus.cc:2368] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
W20260709 13:01:40.060796  4985 consensus_meta.cc:287] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.552s	user 0.012s	sys 0.000s
I20260709 13:01:40.014823  5002 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8.
W20260709 13:01:40.074206  5030 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:01:40.096158  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.382651  1617 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:40.383257  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1587) took 1037 ms. Trace:
I20260709 13:01:40.383659  1617 rpcz_store.cc:276] 0709 13:01:39.346086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.095812 (+749726us) service_pool.cc:224] Handling call
0709 13:01:40.383180 (+287368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.041330  4925 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:40.044618  4935 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:40.105240  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:40.058435  5015 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:40.106310  1539 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:40.042717  4929 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:40.137908  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:40.396239  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:40.138276  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:40.397084  1541 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:40.397186  1540 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:40.143544  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:40.107908  4985 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:40.104270  5000 raft_consensus.cc:2764] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:01:40.102830  5016 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.104601  4918 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:40.168776  4949 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:40.180569  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:40.181325  4953 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.181888  4793 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:40.182411  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 612) took 1720 ms. Trace:
I20260709 13:01:40.395813  4923 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.184330  4987 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:40.185392  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:40.197440  4570 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:40.204799  5029 log.cc:927] Time spent T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.345s	user 0.003s	sys 0.000s
I20260709 13:01:40.210592  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:40.427933  1542 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:40.217671  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:40.221128  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:40.224625  2272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 725) took 1436 ms (client timeout 1572 ms). Trace:
I20260709 13:01:40.229686  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:37.690290   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:40.039404  4465 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:40.234265  4999 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:40.244218  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 621) took 1011 ms. Trace:
I20260709 13:01:40.246943  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1681) took 2236 ms. Trace:
I20260709 13:01:40.250705  1616 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:40.259828  5014 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:40.260885  4981 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:40.460757  5014 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:40.447999  4321 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:40.461143  4981 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:40.462615  4321 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:40.413203  5016 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:40.262367  4861 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:40.264647  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:40.464238  1548 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:40.464848  5016 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:40.465152  4981 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:40.465289  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:40.465515  1547 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:40.461004  1620 rpcz_store.cc:276] 0709 13:01:39.232320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.232459 (+   139us) service_pool.cc:224] Handling call
0709 13:01:39.232743 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.249773 (+ 17030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.243976 (+994203us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b54000d3ed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:40.244155 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37602688}
I20260709 13:01:40.466038  1548 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:40.466431  4465 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:40.466673  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.269484  4903 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:40.295306  4959 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:40.303294  4865 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:40.468295  4865 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:40.468369  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.469616  1620 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
W20260709 13:01:40.305649  1511 leader_election.cc:336] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.619s (SENT)
I20260709 13:01:40.471479  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.471803  1511 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:40.313364  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.472934  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1590) took 1126 ms. Trace:
W20260709 13:01:40.473001  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 167379us
I20260709 13:01:40.473058  1620 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:40.392527  1623 raft_consensus.cc:2368] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:01:40.396497  1614 raft_consensus.cc:2368] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9.
I20260709 13:01:40.460211  1689 rpcz_store.cc:276] 0709 13:01:38.010130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.010823 (+   693us) service_pool.cc:224] Handling call
0709 13:01:38.011124 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.263206 (+1252082us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b5400077c20. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6aab5dc0 00007f5c6ab401c0 00007f5c6ab41231 00007f5c6ab3dd8f 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c
0709 13:01:39.263911 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.246643 (+982732us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540035d254. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:40.246847 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532423296}
I20260709 13:01:40.092125  4983 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:40.398486  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:40.398528  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:40.399545  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1679) took 2400 ms (client timeout 1575 ms). Trace:
I20260709 13:01:40.395153  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:40.404011  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 101225us
I20260709 13:01:40.420558  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:40.404809  2232 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:40.423976  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 238655us
I20260709 13:01:40.422295  2267 rpcz_store.cc:276] 0709 13:01:38.462303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.463134 (+   831us) service_pool.cc:224] Handling call
0709 13:01:38.470432 (+  7298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.682408 (+211976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.182121 (+1499713us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54007c2c54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:40.182308 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476489600}
I20260709 13:01:40.412662  4926 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:40.451973  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.499892  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1589) took 1153 ms. Trace:
I20260709 13:01:40.453969  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:40.501262  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:40.435849  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.449735  4985 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:40.461136  5049 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:40.471966  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.511945  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.313743  1446 catalog_manager.cc:5697] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:40.335633  1514 leader_election.cc:336] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 3.082s (SENT)
I20260709 13:01:40.512427  1697 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:40.500299  1614 rpcz_store.cc:276] 0709 13:01:39.346646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.101535 (+754889us) service_pool.cc:224] Handling call
0709 13:01:40.499820 (+398285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.421864  5000 consensus_queue.cc:1059] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 13:01:40.320215  1663 leader_election.cc:336] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.734s (SENT)
I20260709 13:01:40.523470  1663 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:40.325755  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.517189  1586 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:40.390764  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.525589  1617 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:40.475633  4903 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:40.447293  4570 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:40.467051  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:40.526413  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:40.526917  1548 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
W20260709 13:01:40.479043  1511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.643s (SENT) [suppressed 35 similar messages]
I20260709 13:01:40.527726  1690 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:40.474066  4999 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:40.497258  1539 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:40.497601  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:40.536464  1695 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:40.537075  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.473405  1621 rpcz_store.cc:276] 0709 13:01:39.346939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.312955 (+966016us) service_pool.cc:224] Handling call
0709 13:01:40.472861 (+159906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.497835  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.496791  1540 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:40.496683  1688 rpcz_store.cc:269] 0709 13:01:37.986062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.986299 (+   237us) service_pool.cc:224] Handling call
0709 13:01:40.383629 (+2397330us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b5400127ad4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:40.383934 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1227382016}
W20260709 13:01:40.502944  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.511173  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:40.542614  2266 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:40.512844  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:40.514297  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1579) took 1171 ms. Trace:
I20260709 13:01:40.544400  1623 rpcz_store.cc:276] 0709 13:01:39.342799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.347109 (+  4310us) service_pool.cc:224] Handling call
0709 13:01:40.514034 (+1166925us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400067a54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:40.514227 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2401309056}
I20260709 13:01:40.545547  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.514130  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:40.516103  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1603) took 1164 ms. Trace:
I20260709 13:01:40.546921  1616 rpcz_store.cc:276] 0709 13:01:39.351324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.832791 (+481467us) service_pool.cc:224] Handling call
0709 13:01:40.515534 (+682743us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54000d2fd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:40.515683 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939631488}
I20260709 13:01:40.548077  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.463760  4321 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:40.546171  1623 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:40.519129  1619 raft_consensus.cc:2410] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:01:40.521970  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 117263us
I20260709 13:01:40.476671  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:40.550268  1545 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:40.526449  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.551319  1617 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:40.484099  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:40.517292  2272 rpcz_store.cc:269] 0709 13:01:38.788310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.806442 (+ 18132us) service_pool.cc:224] Handling call
0709 13:01:40.224284 (+1417842us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b54006108d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:40.224491 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1632227200}
I20260709 13:01:40.552587  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:40.522393  1587 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:40.553540  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 52355.6us
I20260709 13:01:40.554301  1586 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:40.452124  5043 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.537998  1614 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:40.552636  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.554924  1622 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:40.568110  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.569064  1616 raft_consensus.cc:2410] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:40.569479  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1602) took 1218 ms. Trace:
I20260709 13:01:40.569814  1616 rpcz_store.cc:276] 0709 13:01:39.351075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.567838 (+1216763us) service_pool.cc:224] Handling call
0709 13:01:40.569421 (+  1583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.556106  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.559459  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1588) took 1213 ms. Trace:
I20260709 13:01:40.571900  1619 rpcz_store.cc:276] 0709 13:01:39.346370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.229300 (+882930us) service_pool.cc:224] Handling call
0709 13:01:40.559364 (+330064us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.572655  1542 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:40.463397  5014 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:40.579030  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:40.582815  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1605) took 1231 ms. Trace:
I20260709 13:01:40.583405  1620 rpcz_store.cc:276] 0709 13:01:39.351857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.577059 (+1225202us) service_pool.cc:224] Handling call
0709 13:01:40.582079 (+  5020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.582281 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.582308 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.582351 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:40.582392 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.582601 (+   209us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.582743 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.584132  1542 raft_consensus.cc:1240] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:40.584966  1689 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:40.457708  4923 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:40.589028  1614 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:01:40.554105  4865 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:40.589550  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 254053us
W20260709 13:01:40.591838  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 69586.9us
I20260709 13:01:40.420390  4918 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:40.533327  4869 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:40.611887  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.532337  4949 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:40.615936  1614 pending_rounds.cc:85] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 3
I20260709 13:01:40.589319  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.626812  1618 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:40.646235  4941 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:40.647964  1542 raft_consensus.cc:1275] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:40.531589  4926 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:40.581571  5043 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:40.429421  4953 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:40.553182  5049 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:40.556871  5050 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:40.657086  1547 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:40.811081  1614 pending_rounds.cc:107] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:01:40.811630  1614 raft_consensus.cc:2889] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:40.811872  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:40.813235  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:40.813978  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1606) took 1461 ms. Trace:
I20260709 13:01:40.739395  5051 consensus_queue.cc:1059] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:01:40.713897  1543 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:40.576882  4389 raft_consensus.cc:3055] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:40.816061  2265 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:40.816098  5009 raft_consensus.cc:3055] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:40.817106  1543 pending_rounds.cc:85] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 4
W20260709 13:01:40.565402  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 245245us
I20260709 13:01:40.817662  1543 pending_rounds.cc:107] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:01:40.817983  1543 raft_consensus.cc:2889] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:40.818499  4926 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:40.565516  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.822080  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.581888  5016 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:40.665500  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.827982  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:40.828653  1694 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:40.829715  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:40.830217  1514 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:40.831064  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:40.832931  2266 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
W20260709 13:01:40.808961  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 230051us
I20260709 13:01:40.834275  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:40.834789  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:40.835389  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:40.565088  1695 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:01:40.838714  1540 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:40.580031  4903 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:40.843436  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1594) took 1494 ms. Trace:
I20260709 13:01:40.844707  4793 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:40.844949  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:40.845023  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:40.862452  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:40.883316  1693 raft_consensus.cc:2410] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:40.883188  1697 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:40.611647  4987 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:40.848423  1547 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:40.886377  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 625) took 1531 ms. Trace:
I20260709 13:01:40.886924  4865 consensus_queue.cc:1059] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:40.751132  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.816424  4389 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:40.888749  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:40.613095  4985 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:40.580765  4257 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.299s
W20260709 13:01:41.025929  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.866528  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:40.881649  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 220692us
I20260709 13:01:41.129554  1692 raft_consensus.cc:2393] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:40.862758  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:40.846601  1690 raft_consensus.cc:3055] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:41.130856  1695 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
W20260709 13:01:41.018083  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 183383us
I20260709 13:01:41.140861  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:41.141641  1588 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:40.935933  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:41.143726  1693 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:40.883682  1614 rpcz_store.cc:276] 0709 13:01:39.348561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.567535 (+1218974us) service_pool.cc:224] Handling call
0709 13:01:40.588547 (+ 21012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.843118 (+254571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.843349 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.614687  5052 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.131474  1621 rpcz_store.cc:276] 0709 13:01:39.354612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.845797 (+1491185us) service_pool.cc:224] Handling call
0709 13:01:40.885564 (+ 39767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.885938 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.885974 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.886028 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:40.886077 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.886142 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.886301 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:40.936158  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 124486us
I20260709 13:01:41.177083  1587 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:40.926227  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 447160us
I20260709 13:01:40.814697  1620 rpcz_store.cc:276] 0709 13:01:39.352089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.584520 (+1232431us) service_pool.cc:224] Handling call
0709 13:01:40.813296 (+228776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.813543 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.813566 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.813606 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:40.813634 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.813687 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.813804 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53504}
I20260709 13:01:40.849881  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:40.576131  4981 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:40.658071  4570 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:40.891850  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:40.843479  4925 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.890365  1541 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
W20260709 13:01:40.928864  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.115180  4959 consensus_meta.cc:287] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.647s	user 0.002s	sys 0.007s
I20260709 13:01:40.889374  4918 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:41.179956  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 330174us
I20260709 13:01:41.184635  1694 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:40.817301  5009 raft_consensus.cc:740] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:41.130995  1690 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:41.063175  5002 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:41.187938  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:41.212253  1547 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:41.190106  1623 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:41.213817  1615 raft_consensus.cc:2410] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:01:41.215831  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1593) took 1867 ms (client timeout 2103 ms). Trace:
W20260709 13:01:41.216356  1615 rpcz_store.cc:269] 0709 13:01:39.348287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.907300 (+559013us) service_pool.cc:224] Handling call
0709 13:01:41.215546 (+1308246us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400068454. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:41.215750 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2986135296}
I20260709 13:01:41.217810  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:41.046648  5048 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:01:40.916066  1544 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:41.188633  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1708) took 1741 ms. Trace:
I20260709 13:01:41.221180  1621 rpcz_store.cc:276] 0709 13:01:39.446870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.187642 (+1740772us) service_pool.cc:224] Handling call
0709 13:01:41.187991 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.188224 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.188260 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.188315 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:41.188368 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.188437 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.188565 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.222008  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2490) took 1082 ms. Trace:
I20260709 13:01:41.222469  1544 rpcz_store.cc:276] 0709 13:01:40.139327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.554499 (+415172us) service_pool.cc:224] Handling call
0709 13:01:40.588054 (+ 33555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.220006 (+631952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.221673 (+  1667us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b540023f0d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:41.221860 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753674624}
I20260709 13:01:41.195205  1616 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:41.091244  5051 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.198743  1620 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:41.232355  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1709) took 1785 ms. Trace:
I20260709 13:01:41.232947  1620 rpcz_store.cc:276] 0709 13:01:39.447118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.189133 (+1742015us) service_pool.cc:224] Handling call
0709 13:01:41.198488 (+  9355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.231823 (+ 33335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.232259 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:41.174464  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1578) took 1835 ms (client timeout 1711 ms). Trace:
W20260709 13:01:41.234680  1618 rpcz_store.cc:269] 0709 13:01:39.339261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.339442 (+   181us) service_pool.cc:224] Handling call
0709 13:01:41.170629 (+1831187us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400068954. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:41.174391 (+  3762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2746261760}
I20260709 13:01:41.238198  1618 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:41.240104  1614 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:40.913937  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:41.044945  5016 raft_consensus.cc:697] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:41.203673  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:41.087231  5014 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:41.206235  1514 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:01:41.253837  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 47698.9us
I20260709 13:01:41.255064  1514 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:41.256611  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:41.208079  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:40.935891  5041 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:41.173969  4983 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:41.226889  1661 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:41.283902  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 57189.7us
I20260709 13:01:41.210882  1690 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:41.285791  1690 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:41.244978  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:41.286974  1547 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:41.195984  4929 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:40.844319  4949 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:41.242480  4865 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:41.327487  4981 raft_consensus.cc:697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:41.297668  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:41.252965  5014 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.328409  5014 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:40.843134  5050 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:41.198428  5052 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:41.332947  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1595) took 1984 ms. Trace:
I20260709 13:01:41.333349  1616 rpcz_store.cc:276] 0709 13:01:39.348828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.570613 (+1221785us) service_pool.cc:224] Handling call
0709 13:01:41.174389 (+603776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.223954 (+ 49565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.332747 (+108793us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b5400068950. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:41.332885 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1387804544}
I20260709 13:01:41.327185  4865 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:41.337805  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.338407  4865 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:41.339557  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:41.334620  5052 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:41.344573  4981 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:41.353053  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:41.353710  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:41.355345  1692 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:01:41.355887  1692 pending_rounds.cc:85] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 3
I20260709 13:01:41.356156  1692 pending_rounds.cc:107] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:01:41.356490  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:41.357064  1692 raft_consensus.cc:2889] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:41.364701  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1591) took 2017 ms. Trace:
I20260709 13:01:41.365170  1623 rpcz_store.cc:276] 0709 13:01:39.347665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.573657 (+1225992us) service_pool.cc:224] Handling call
0709 13:01:40.574262 (+   605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.213026 (+638764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.364434 (+151408us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54000d34d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:41.364636 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415515520}
I20260709 13:01:41.172122  4985 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:41.377672  4985 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:41.382185  1618 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:41.335585  1696 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:41.388005  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:41.251824  4987 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:41.395339  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1598) took 2045 ms. Trace:
I20260709 13:01:41.395823  1619 rpcz_store.cc:276] 0709 13:01:39.349691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.572603 (+1222912us) service_pool.cc:224] Handling call
0709 13:01:41.394457 (+821854us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b5800085298. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb17fc0 00007f5c6fb02929 00007f5c6fb023d2 00007f5c69079bd4
0709 13:01:41.394663 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.394975 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.395016 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.395061 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:41.395101 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.395161 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.395281 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47461120}
I20260709 13:01:41.331629  5050 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:41.399828  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:41.401338  1547 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:41.255388  5002 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:41.210196  4925 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:41.382583  5014 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:41.394752  5054 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.303s	user 0.002s	sys 0.001s
I20260709 13:01:41.429028  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:41.300333  5058 raft_consensus.cc:2764] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:01:41.385924  4918 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:41.396968  4903 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:41.251474  5051 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:41.412963  5041 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:41.409274  5052 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.421821  4929 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:41.458837  5016 consensus_queue.cc:237] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:41.475255  1588 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:41.432760  5015 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.405690  4465 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:41.242734  4389 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:41.471500  1618 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:41.474534  1623 raft_consensus.cc:1240] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:41.461670  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 119763us
W20260709 13:01:41.487546  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 310570us
W20260709 13:01:41.477559  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 192749us
I20260709 13:01:41.440826  4918 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:41.490327  1661 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:41.498507  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:41.489001  1587 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:41.505489  1587 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:41.513139  1661 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:41.514778  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:41.515867  4570 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:41.516425  1661 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:41.447449  5049 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:41.437000  1663 connection.cc:256] RPC call timeout handler was delayed by -2.8601675800000521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 13:01:41.471500  5043 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:41.512010  4918 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:41.579577  5059 log.cc:927] Time spent T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:01:41.542300  1587 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:41.587850  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 45672.4us
I20260709 13:01:41.420128  5009 consensus_queue.cc:260] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:41.596413  5043 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:41.597815  4981 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:41.598261  4981 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.598598  4981 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:41.603008  5072 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:41.604736  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:41.477144  5041 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:41.573972  4941 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:41.606527  4941 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.606899  4941 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:41.607060  4953 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:41.608179  4949 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:41.609252  5054 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:01:41.591897  5070 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:41.613309  4389 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:41.615350  4987 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.478211  4929 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:41.615906  4987 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:41.618057  4929 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:41.578718  5060 log.cc:927] Time spent T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:01:41.620042  4925 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:41.621011  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2504) took 1379 ms. Trace:
W20260709 13:01:41.577800  5056 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:01:41.621410  1543 rpcz_store.cc:276] 0709 13:01:40.241908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.816497 (+574589us) service_pool.cc:224] Handling call
0709 13:01:40.816904 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.818534 (+  1630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.818568 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.819063 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.184344 (+365281us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:41.384835 (+200491us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.408816 (+ 23981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.408877 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.620782 (+211905us) raft_consensus.cc:1685] finished
0709 13:01:41.620804 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.620949 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23550,"prepare.queue_time_us":255811,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":50,"raft.queue_time_us":201233,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":522064,"threads_started":2,"wal-append.queue_time_us":480347}
I20260709 13:01:41.576223  5014 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:41.628583  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1717) took 1306 ms. Trace:
I20260709 13:01:41.629958  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1592) took 2282 ms. Trace:
I20260709 13:01:41.576054  5051 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:41.630635  1617 rpcz_store.cc:276] 0709 13:01:39.347958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.565664 (+1217706us) service_pool.cc:224] Handling call
0709 13:01:40.566021 (+   357us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:40.577216 (+ 11195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.577263 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:40.582068 (+  4805us) log.cc:844] Serialized 78 byte log entry
0709 13:01:40.968342 (+386274us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:40.968410 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.968525 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.629700 (+661175us) raft_consensus.cc:1685] finished
0709 13:01:41.629721 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.629898 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10657,"raft.queue_time_us":21683,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":10361,"thread_start_us":353846,"threads_started":1,"wal-append.queue_time_us":629832}
I20260709 13:01:41.592729  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:41.633848  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.631376  1690 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
W20260709 13:01:41.594921  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.605758  5041 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:41.629428  1620 rpcz_store.cc:276] 0709 13:01:40.322181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.234385 (+912204us) service_pool.cc:224] Handling call
0709 13:01:41.247604 (+ 13219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.412178 (+164574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.412235 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.412278 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:41.412329 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.628342 (+216013us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54000d20d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:41.628389 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.628527 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377530752}
I20260709 13:01:41.485241  4861 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:41.634830  1690 pending_rounds.cc:85] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 8
I20260709 13:01:41.641132  1690 pending_rounds.cc:107] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:01:41.642632  1690 raft_consensus.cc:2889] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:41.643193  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2499) took 1496 ms. Trace:
I20260709 13:01:41.645715  1548 rpcz_store.cc:276] 0709 13:01:40.141590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.654184 (+512594us) service_pool.cc:224] Handling call
0709 13:01:40.654714 (+   530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.655397 (+   683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.668298 (+ 12901us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.669386 (+  1088us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.126914 (+457528us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:41.450351 (+323437us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.637721 (+187370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.637860 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.637931 (+    71us) raft_consensus.cc:1685] finished
0709 13:01:41.637956 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.638335 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":292011,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":172211,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":16085,"thread_start_us":765456,"threads_started":3,"wal-append.queue_time_us":502522}
W20260709 13:01:41.652631  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 151885us
I20260709 13:01:41.594859  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:41.485035  4465 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:41.671868  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 77099.9us
W20260709 13:01:41.672281  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2501) took 1530 ms (client timeout 1979 ms). Trace:
W20260709 13:01:41.673125  1541 rpcz_store.cc:269] 0709 13:01:40.142059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.398091 (+256032us) service_pool.cc:224] Handling call
0709 13:01:41.671410 (+1273319us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54002b3c54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:41.672179 (+   769us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903790848}
I20260709 13:01:41.674080  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:01:41.664420  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 366836us
I20260709 13:01:41.675499  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:41.678475  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1607) took 2316 ms. Trace:
I20260709 13:01:41.679039  1614 rpcz_store.cc:276] 0709 13:01:39.361796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.187817 (+1826021us) service_pool.cc:224] Handling call
0709 13:01:41.239590 (+ 51773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.240690 (+  1100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.678193 (+437503us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b5400314f50. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:41.678379 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90429824}
I20260709 13:01:41.518790  5058 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:41.711870  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:01:41.725767  1514 connection.cc:256] RPC call timeout handler was delayed by -1.3278034929999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:01:41.726222  1514 connection.cc:256] RPC call timeout handler was delayed by -1.2882034930000259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 13:01:41.726542  1514 connection.cc:256] RPC call timeout handler was delayed by -1.27830349300001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
W20260709 13:01:41.726832  1514 connection.cc:256] RPC call timeout handler was delayed by -1.2324034929999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 13:01:41.685935  1587 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:41.521718  4843 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:41.740445  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 54600.3us
W20260709 13:01:41.636325  5059 log.cc:927] Time spent T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.055s	user 0.002s	sys 0.000s
W20260709 13:01:41.746675  1622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1584) took 2328 ms (client timeout 2059 ms). Trace:
W20260709 13:01:41.754038  1622 rpcz_store.cc:269] 0709 13:01:39.344627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.430672 (+ 86045us) service_pool.cc:224] Handling call
0709 13:01:41.672782 (+2242110us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b5400115154. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:41.672926 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2232911744}
I20260709 13:01:41.754060  1587 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:01:41.760607  1514 connection.cc:256] RPC call timeout handler was delayed by -1.100103493000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
W20260709 13:01:41.761116  1514 connection.cc:256] RPC call timeout handler was delayed by -1.0731034930000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:01:41.761422  1514 connection.cc:256] RPC call timeout handler was delayed by -1.056903492999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
I20260709 13:01:41.475073  5052 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:41.794524  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 45502.3us
I20260709 13:01:41.604741  5072 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:41.640249  4861 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:41.802083  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 48141.9us
W20260709 13:01:41.770880  5053 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:01:41.694278  4465 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:41.770107  4925 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:41.781884  4959 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:41.746917  5070 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:41.636440  5049 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.162s
I20260709 13:01:41.745935  5014 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:41.832614  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 135955us
I20260709 13:01:41.511503  5015 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:41.519385  5002 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:41.769685  4929 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:41.813102  4953 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:41.878430  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 443256us
I20260709 13:01:41.882472  5084 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.883106  5084 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:41.886644  1514 leader_election.cc:336] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.698s (SENT)
I20260709 13:01:41.887197  1514 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:41.887794  5087 consensus_queue.cc:1048] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:41.888780  5084 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:41.889791  5087 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:41.810699  5072 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:41.842168  4925 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:41.864037  5070 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:41.896983  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:41.865952  5014 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:41.842483  4959 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:41.920238  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 567) took 1525 ms. Trace:
I20260709 13:01:41.813622  4861 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:41.893704  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 377326us
W20260709 13:01:41.940447  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 108096us
I20260709 13:01:41.870623  4903 raft_consensus.cc:697] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:41.948304  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:41.879041  4929 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.944262  1542 rpcz_store.cc:276] 0709 13:01:40.394670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.853772 (+459102us) service_pool.cc:224] Handling call
0709 13:01:40.854197 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.984072 (+129875us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:41.194314 (+210242us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.490453 (+296139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.490510 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:41.490682 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.920013 (+429331us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54003b6354. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:41.920055 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.920177 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":404508,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":128638,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"spinlock_wait_cycles":297823104,"thread_start_us":409208,"threads_started":2,"wal-append.queue_time_us":284525}
I20260709 13:01:41.891042  4953 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:41.829344  4983 raft_consensus.cc:697] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:41.843321  5069 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
W20260709 13:01:41.950630  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 64015.2us
I20260709 13:01:41.928097  4925 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:41.949771  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 63552.8us
I20260709 13:01:41.863055  5065 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 13:01:41.943495  5014 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.937016  5070 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:41.810550  5073 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
W20260709 13:01:41.971529  1621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.008s	sys 0.014s
W20260709 13:01:42.007176  1621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.009s	sys 0.015s
I20260709 13:01:41.946710  4959 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:41.952795  4929 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:41.952548  4953 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:41.963969  4570 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
W20260709 13:01:42.020900  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.965942  5086 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:42.016776  5049 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 13:01:42.034484  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.033982  4983 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:42.022173  4999 consensus_meta.cc:287] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 1.445s	user 0.014s	sys 0.000s
I20260709 13:01:42.004982  5050 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:01:42.047461  4999 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:42.052438  4999 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:42.053743  5100 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:42.069144  5015 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:42.045994  4941 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.090467  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:42.091143  1541 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:42.104568  1541 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:42.108055  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:42.023866  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 75641.1us
I20260709 13:01:42.114017  1587 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:42.121075  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:42.122301  1542 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:42.125641  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:42.130470  2231 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:42.132419  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:42.138701  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 343390us
I20260709 13:01:42.140501  5109 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:42.139451  1695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.007s	sys 0.003s
W20260709 13:01:42.142001  1695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.007s	sys 0.003s
W20260709 13:01:42.146112  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.146675  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1713) took 2677 ms. Trace:
I20260709 13:01:42.148552  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:42.042606  4843 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:42.133260  1541 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
W20260709 13:01:42.098981  4918 consensus_meta.cc:287] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.519s	user 0.003s	sys 0.008s
I20260709 13:01:42.147949  1615 rpcz_store.cc:276] 0709 13:01:39.469338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.227807 (+1758469us) service_pool.cc:224] Handling call
0709 13:01:41.257428 (+ 29621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.257640 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:41.584987 (+327347us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.066922 (+481935us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:42.146089 (+ 79167us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.146250 (+   161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.146292 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:42.146333 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.146500 (+   167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.146604 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":317270,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":27353,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":13894912,"thread_start_us":848567,"threads_started":3,"wal-append.queue_time_us":299851}
W20260709 13:01:42.135201  5091 log.cc:927] Time spent T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.249s	user 0.005s	sys 0.000s
I20260709 13:01:42.130726  5015 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:42.176345  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 145588us
I20260709 13:01:42.183974  1692 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:42.188009  1695 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:42.190527  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:42.193843  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 43666.1us
I20260709 13:01:42.194173  1696 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:42.189695  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:42.172271  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:42.196020  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1710) took 2748 ms. Trace:
I20260709 13:01:42.197121  1621 rpcz_store.cc:276] 0709 13:01:39.447374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.222414 (+1775040us) service_pool.cc:224] Handling call
0709 13:01:41.222875 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.223103 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:41.439929 (+216826us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.194739 (+754810us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.194977 (+   238us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:42.195245 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.195460 (+   215us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.195863 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7418,"prepare.queue_time_us":358403,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":46742,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":925962,"threads_started":3,"wal-append.queue_time_us":601970}
W20260709 13:01:42.202638  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 362528us
I20260709 13:01:42.212651  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:42.127406  4523 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:01:42.163210  4935 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:42.063215  4981 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.147323  4429 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:01:42.218849  1695 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:42.220752  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:42.234596  1694 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:42.197124  5111 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:42.221740  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:42.236740  1693 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:42.220359  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:42.222798  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:42.223037  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:42.191311  5041 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:42.134721  5083 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:01:42.216737  2264 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:42.049031  4903 consensus_queue.cc:237] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.162801  4843 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.165612  4918 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.204954  4985 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:42.217219  4941 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:42.224402  4935 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.250977  5052 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:42.214618  5051 consensus_queue.cc:1059] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:42.222028  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:42.239300  5111 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:42.204033  5058 raft_consensus.cc:697] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:42.284914  1586 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:42.302062  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:42.275916  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:42.316854  2264 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:42.321054  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:42.320989  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:42.321532  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:42.324339  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 178871us
I20260709 13:01:42.248519  4465 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.280341  5015 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.347618  1662 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:42.347980  5015 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.348698  4865 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:42.349170  4865 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.349599  4865 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:42.350872  5015 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:42.328722  4843 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:42.280166  5075 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:01:42.333282  5052 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:42.334290  4923 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:42.337721  5058 consensus_queue.cc:237] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.302359  4935 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:42.338255  4861 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:42.341821  5099 log.cc:927] Time spent T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:01:42.341428  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 65597.4us
I20260709 13:01:42.254128  5102 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:01:42.346597  5119 raft_consensus.cc:3055] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:42.323028  5111 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.258270  4879 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:01:42.331975  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:42.356240  1618 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:42.358191  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:42.358441  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:42.360357  1617 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:42.302871  5065 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
W20260709 13:01:42.433139  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.373481  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 47125.8us
I20260709 13:01:42.375955  1688 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
W20260709 13:01:42.328984  5095 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:01:42.457106  5015 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:42.605712  5052 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:42.434444  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:42.635195  1622 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:01:42.637079  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:42.329799  5103 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.641368  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:42.663604  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:42.634503  1619 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
W20260709 13:01:42.718905  4389 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 1.105s	user 0.013s	sys 0.000s
I20260709 13:01:42.706596  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:42.751364  4987 consensus_meta.cc:287] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 1.135s	user 0.006s	sys 0.007s
I20260709 13:01:42.705274  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:42.721416  5072 consensus_meta.cc:287] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.786s	user 0.008s	sys 0.005s
I20260709 13:01:42.798384  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:42.714099  4918 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:42.666937  5052 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:42.750680  4925 consensus_meta.cc:287] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.746s	user 0.005s	sys 0.005s
I20260709 13:01:42.583683  5119 raft_consensus.cc:740] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:42.325644  5104 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.393s
I20260709 13:01:42.746038  4865 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:42.356194  4959 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.457540  5098 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:42.688175  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:42.841048  1548 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:42.842058  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:42.712608  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:42.728704  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:42.399533  4941 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.625103  4981 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:42.731207  5050 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:42.720283  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.765928  4861 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:42.691882  1663 connection.cc:256] RPC call timeout handler was delayed by -2.7196842700000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 13:01:42.713020  5103 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:42.696339  5117 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.760051  4793 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.697304  5078 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.797372  1661 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:42.805678  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:42.864650  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 197278us
I20260709 13:01:42.865353  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:42.747308  4929 consensus_meta.cc:287] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.722s	user 0.006s	sys 0.004s
W20260709 13:01:42.757172  5070 consensus_meta.cc:287] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.741s	user 0.007s	sys 0.007s
I20260709 13:01:42.818660  1614 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:42.817607  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:42.875612  4865 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:42.875957  5070 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:42.819669  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:42.880264  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.714737  4465 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:42.880656  4929 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.882809  1542 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:01:42.826467  2268 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:42.884598  2263 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:01:42.805624  4953 consensus_meta.cc:287] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.780s	user 0.009s	sys 0.003s
I20260709 13:01:42.885943  4953 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:42.887791  5014 consensus_meta.cc:287] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.875s	user 0.008s	sys 0.004s
I20260709 13:01:42.887501  5078 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.823678  2271 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:42.826778  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:42.889442  1619 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:42.890673  5078 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:42.823273  4987 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:42.851800  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.005s	sys 0.003s
W20260709 13:01:42.892009  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.005s	sys 0.003s
I20260709 13:01:42.837958  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:42.893343  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 608318us
I20260709 13:01:42.868579  5117 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:42.894374  1543 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:42.846977  5098 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.837224  4925 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:42.896749  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:42.896987  4925 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:42.850651  4941 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:42.898130  1587 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:42.899163  5103 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:42.899942  4941 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:42.858438  1662 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:42.900202  5103 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:42.864133  4861 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:42.908985  4861 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.874778  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:42.879246  4981 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:42.875658  5050 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:01:42.883958  5119 consensus_queue.cc:260] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:42.888214  5014 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:42.843293  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:42.852525  1663 connection.cc:256] RPC call timeout handler was delayed by -2.7025842699999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
I20260709 13:01:42.873375  5053 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:42.901676  5104 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:42.902521  1540 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:42.904474  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:42.949540  2268 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:42.904619  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:42.905658  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:42.905277  4935 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.865715  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:42.907140  4941 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:42.951004  2265 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:01:42.930096  1617 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:42.936067  1663 connection.cc:256] RPC call timeout handler was delayed by -2.6845842700000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
W20260709 13:01:42.957657  1663 connection.cc:256] RPC call timeout handler was delayed by -2.6719842699999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2263s for a response
I20260709 13:01:42.822956  5072 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:42.947255  1543 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:42.859913  4843 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:42.897089  5117 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:42.869531  4793 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:42.928738  5103 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:42.936094  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:42.938678  4981 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:42.953070  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 68087.8us
I20260709 13:01:42.959882  1662 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:42.966328  1663 connection.cc:256] RPC call timeout handler was delayed by -2.0563609430000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 13:01:42.962975  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:43.541599  1617 raft_consensus.cc:2393] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 5: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:43.542997  1663 connection.cc:256] RPC call timeout handler was delayed by -1.9618609430000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260709 13:01:43.543596  1663 connection.cc:256] RPC call timeout handler was delayed by -1.859260943000038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
W20260709 13:01:43.544049  1663 connection.cc:256] RPC call timeout handler was delayed by -1.4614023420000422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260709 13:01:43.544508  1663 connection.cc:256] RPC call timeout handler was delayed by -1.3399023420000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 13:01:43.544975  1663 connection.cc:256] RPC call timeout handler was delayed by -1.0955753110000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260709 13:01:43.545468  1663 connection.cc:256] RPC call timeout handler was delayed by -1.0780023420000475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
W20260709 13:01:43.546257  1663 connection.cc:256] RPC call timeout handler was delayed by -1.0467093359999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
I20260709 13:01:43.003613  2268 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:01:43.016494  1622 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:43.253149  1589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.000s	sys 0.028s
W20260709 13:01:43.551928  1589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.000s	sys 0.042s
I20260709 13:01:43.302371  1588 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:43.368031  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.563970  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.585176  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 719462us
I20260709 13:01:42.947865  5053 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:43.586236  1661 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:43.590957  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:43.629024  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:43.410609  5128 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:01:42.995360  5111 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:42.996199  5118 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:43.005429  5085 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.226428  4925 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.563432  5103 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.024689  4865 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:43.249004  5065 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.961390  5058 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:43.006127  5132 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.783358  5058 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:43.784057  5132 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:43.786840  5058 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:43.410269  5135 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.255620  5142 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:43.005251  5072 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:42.999812  4929 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:43.193185  5069 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:43.373143  4903 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:43.511618  5137 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:42.999879  5084 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:42.987486  5049 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:43.010999  4843 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:43.410509  5086 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:43.674172  5053 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:43.001992  5052 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:43.045394  5016 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.673s
I20260709 13:01:43.735394  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:43.872898  1623 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:43.874130  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1611) took 1513 ms. Trace:
I20260709 13:01:43.270267  5043 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:43.006026  5080 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.850s
I20260709 13:01:42.956385  5104 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:43.733855  5103 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:43.875021  1623 rpcz_store.cc:276] 0709 13:01:42.360252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.360862 (+   610us) service_pool.cc:224] Handling call
0709 13:01:43.735195 (+1374333us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5800085298. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19e9c 00007f5c67a19a5b 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:01:43.874016 (+138821us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2455296}
I20260709 13:01:43.859675  4424 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:43.942778  4424 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:43.945719  4424 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:43.916735  5043 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:43.886071  5129 log.cc:927] Time spent T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.630s	user 0.000s	sys 0.015s
I20260709 13:01:43.890254  4793 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:43.724617  5085 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:43.734664  4925 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:43.897115  4843 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:43.787806  5135 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:43.789674  5069 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:43.789952  4903 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:43.799772  5065 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:43.803277  4935 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:43.790524  5084 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:43.985682  5069 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:43.900892  5111 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:43.790225  5137 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:43.963063  5080 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:43.991876  5080 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:43.994298  5137 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:43.788573  5072 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:43.995440  5072 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.903359  4981 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:43.788122  5142 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:43.997980  5142 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:43.793238  5014 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:43.867254  5128 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:01:43.879907  5086 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:43.998965  2271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54488 (request call id 618) took 3348 ms (client timeout 1633 ms). Trace:
W20260709 13:01:43.999923  2271 rpcz_store.cc:269] 0709 13:01:40.650618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.828241 (+177623us) service_pool.cc:224] Handling call
0709 13:01:43.998428 (+3170187us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540040ddd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:43.998719 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3749179264}
I20260709 13:01:43.791581  5049 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.002579  5049 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:43.880471  5118 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 13:01:43.963186  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.787355  5132 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:43.868108  4865 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:01:43.897185  5052 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:43.884336  5058 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:43.984041  5065 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:43.984609  4935 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:43.989630  5084 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:43.995813  5133 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 1.139s	user 0.013s	sys 0.000s
I20260709 13:01:43.973640  4793 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.995898  5072 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:43.972529  5141 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:44.028386  5138 log.cc:927] Time spent T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.729s	user 0.004s	sys 0.000s
I20260709 13:01:44.065078  5104 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:44.060768  5141 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:44.067677  5135 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:44.080605  5141 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:44.124882  1512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.010s	sys 0.000s
W20260709 13:01:44.126082  1548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.001s	sys 0.010s
I20260709 13:01:44.134832  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1704) took 1969 ms. Trace:
W20260709 13:01:44.140935  1548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.004s	sys 0.012s
I20260709 13:01:44.142310  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2517) took 1840 ms. Trace:
I20260709 13:01:44.141117  1539 rpcz_store.cc:276] 0709 13:01:42.165260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.165404 (+   144us) service_pool.cc:224] Handling call
0709 13:01:42.165763 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:42.166480 (+   717us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:42.196155 (+ 29675us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.206296 (+ 10141us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:42.207046 (+   750us) log.cc:844] Serialized 52 byte log entry
0709 13:01:42.215850 (+  8804us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:42.216283 (+   433us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.216599 (+   316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.216666 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.134301 (+1917635us) raft_consensus.cc:1685] finished
0709 13:01:44.134347 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.134664 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26315,"prepare.queue_time_us":26969,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":3405,"raft.queue_time_us":683,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":8764,"thread_start_us":12436,"threads_started":2,"wal-append.queue_time_us":640661}
W20260709 13:01:44.129901  1546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.005s
W20260709 13:01:44.159646  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.159789  1546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.007s	sys 0.005s
I20260709 13:01:44.161727  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2514) took 1861 ms. Trace:
I20260709 13:01:44.163218  4918 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:44.163086  4925 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:44.162930  4793 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.165053  4918 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.133257  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1705) took 1909 ms. Trace:
I20260709 13:01:44.166728  1545 rpcz_store.cc:276] 0709 13:01:42.223484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.223667 (+   183us) service_pool.cc:224] Handling call
0709 13:01:42.224094 (+   427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:42.224775 (+   681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.224828 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:42.233448 (+  8620us) log.cc:844] Serialized 52 byte log entry
0709 13:01:42.434838 (+201390us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:42.434899 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.434995 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.132604 (+1697609us) raft_consensus.cc:1685] finished
0709 13:01:44.132641 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.132998 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2403,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":8847,"thread_start_us":168926,"threads_started":1,"wal-append.queue_time_us":761883}
I20260709 13:01:44.144965  1617 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:44.146382  1663 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.012s	sys 0.037s
W20260709 13:01:44.171923  1663 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.012s	sys 0.037s
W20260709 13:01:44.172551  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 621631us
W20260709 13:01:43.970229  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 384059us
I20260709 13:01:44.146797  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:44.009620  5043 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:44.010672  5058 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:44.181075  5058 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.181878  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:44.134030  1542 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
W20260709 13:01:44.124889  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.003s	sys 0.013s
W20260709 13:01:44.183537  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.003s	sys 0.015s
W20260709 13:01:44.132030  1513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.005s	sys 0.005s
W20260709 13:01:44.140362  1512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.011s	sys 0.000s
W20260709 13:01:44.184988  1513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.006s	sys 0.006s
I20260709 13:01:44.138587  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1707) took 1858 ms. Trace:
W20260709 13:01:44.125185  1514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.011s	sys 0.006s
I20260709 13:01:44.171387  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 582) took 1289 ms. Trace:
I20260709 13:01:44.196022  1545 rpcz_store.cc:276] 0709 13:01:42.881672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.168784 (+1287112us) service_pool.cc:224] Handling call
0709 13:01:44.169710 (+   926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.170874 (+  1164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.170911 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.170987 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:44.171037 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.171116 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.171276 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.184664  5053 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:44.202934  1514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.014s	sys 0.010s
W20260709 13:01:44.209681  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 661019us
W20260709 13:01:44.213534  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 501384us
I20260709 13:01:44.214104  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 581) took 1332 ms. Trace:
I20260709 13:01:44.214653  1539 rpcz_store.cc:276] 0709 13:01:42.881461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.158546 (+1277085us) service_pool.cc:224] Handling call
0709 13:01:44.159365 (+   819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.213676 (+ 54311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.213702 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.213760 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:44.213787 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.213858 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.214017 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.216002  1514 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:44.219210  5150 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:44.224421  5098 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:44.224992  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 583) took 1343 ms. Trace:
I20260709 13:01:44.225381  1545 rpcz_store.cc:276] 0709 13:01:42.881883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.223595 (+1341712us) service_pool.cc:224] Handling call
0709 13:01:44.224182 (+   587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.224609 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.224637 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.224708 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:44.224742 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.224799 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.224916 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.227914  5157 consensus_queue.cc:1059] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:44.229367  5084 raft_consensus.cc:3055] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:44.229957  5084 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:44.230543  5085 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:44.219002  1514 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:44.142774  1548 rpcz_store.cc:276] 0709 13:01:42.301564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.934658 (+633094us) service_pool.cc:224] Handling call
0709 13:01:42.935059 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.935511 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.935552 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:42.948101 (+ 12549us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.366955 (+418854us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:43.433103 (+ 66148us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.141739 (+708636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.141900 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.141971 (+    71us) raft_consensus.cc:1685] finished
0709 13:01:44.141984 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.142225 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147094,"prepare.queue_time_us":65811,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":67,"raft.queue_time_us":570056,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":7205,"thread_start_us":913000,"threads_started":2,"wal-append.queue_time_us":943101}
I20260709 13:01:44.231948  5084 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.237476  5084 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:44.246670  1617 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:44.245719  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 584) took 1351 ms. Trace:
I20260709 13:01:44.247982  1545 rpcz_store.cc:276] 0709 13:01:42.882115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.226266 (+1344151us) service_pool.cc:224] Handling call
0709 13:01:44.226672 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.227067 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.227104 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.227173 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:44.227245 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.227342 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.233228 (+  5886us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.251643  4793 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:44.256815  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:44.262854  1621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1614) took 1842 ms (client timeout 1555 ms). Trace:
W20260709 13:01:44.263458  1621 rpcz_store.cc:269] 0709 13:01:42.420470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.636464 (+215994us) service_pool.cc:224] Handling call
0709 13:01:44.256264 (+1619800us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800085298. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:01:44.262725 (+  6461us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2997120}
I20260709 13:01:44.264567  5043 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.265576  5043 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.268066  5016 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:01:44.268821  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.259752  1663 leader_election.cc:400] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
I20260709 13:01:44.273068  1663 leader_election.cc:403] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:44.245476  5053 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:44.185850  1547 rpcz_store.cc:276] 0709 13:01:42.272593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.877203 (+604610us) service_pool.cc:224] Handling call
0709 13:01:42.877641 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:42.878105 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.878152 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:42.879014 (+   862us) log.cc:844] Serialized 52 byte log entry
0709 13:01:43.226649 (+347635us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:43.226698 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.226772 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.130306 (+903534us) raft_consensus.cc:1685] finished
0709 13:01:44.130388 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.130899 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":375,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"thread_start_us":347213,"threads_started":1,"wal-append.queue_time_us":978492}
I20260709 13:01:44.253998  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:44.429152  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 88769.1us
I20260709 13:01:44.276643  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2521) took 1381 ms. Trace:
I20260709 13:01:44.162181  1546 rpcz_store.cc:276] 0709 13:01:42.300732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.880317 (+579585us) service_pool.cc:224] Handling call
0709 13:01:42.880673 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.882501 (+  1828us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:42.909671 (+ 27170us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.977087 (+ 67416us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.997879 (+ 20792us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.002292 (+  4413us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.599083 (+596791us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:43.605255 (+  6172us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.160962 (+555707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.161190 (+   228us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.161282 (+    92us) raft_consensus.cc:1685] finished
0709 13:01:44.161303 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.161652 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41790,"prepare.queue_time_us":56188,"prepare.run_cpu_time_us":145,"prepare.run_wall_time_us":150,"raft.queue_time_us":436036,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":300,"spinlock_wait_cycles":61158272,"thread_start_us":621328,"threads_started":2,"wal-append.queue_time_us":822838}
I20260709 13:01:44.432126  1545 rpcz_store.cc:276] 0709 13:01:42.895135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.272590 (+1377455us) service_pool.cc:224] Handling call
0709 13:01:44.275527 (+  2937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.276039 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.276095 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.276173 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:44.276235 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.276341 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.276532 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:44.432865  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 213995us
W20260709 13:01:44.391251  1589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.002s	sys 0.025s
W20260709 13:01:44.435721  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 131975us
I20260709 13:01:44.281414  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 586) took 1398 ms. Trace:
I20260709 13:01:44.285962  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:44.374619  1588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.006s	sys 0.005s
W20260709 13:01:44.428894  1662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.013s	sys 0.014s
W20260709 13:01:44.302338  1543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.005s	sys 0.015s
I20260709 13:01:44.439244  1548 rpcz_store.cc:276] 0709 13:01:42.882624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.249874 (+1367250us) service_pool.cc:224] Handling call
0709 13:01:44.280348 (+ 30474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.280925 (+   577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.280955 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.281035 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:44.281086 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.281164 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.281330 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.306754  5086 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:44.443908  1662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.013s	sys 0.014s
W20260709 13:01:44.442770  1588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.013s	sys 0.007s
W20260709 13:01:44.443662  1589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.005s	sys 0.030s
I20260709 13:01:44.285166  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:44.288208  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:44.446902  1543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.011s	sys 0.018s
I20260709 13:01:44.286463  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:44.288051  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:44.450965  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:01:44.357788  5094 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 2.419s	user 0.019s	sys 0.019s
I20260709 13:01:44.420300  5070 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:44.454026  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.291209  5101 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
I20260709 13:01:44.377863  5080 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:44.459583  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 255413us
W20260709 13:01:44.464964  5130 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 1.577s	user 0.007s	sys 0.021s
I20260709 13:01:44.465408  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 580) took 1584 ms. Trace:
I20260709 13:01:44.463701  1586 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:44.465925  1541 rpcz_store.cc:276] 0709 13:01:42.881207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.717164 (+835957us) service_pool.cc:224] Handling call
0709 13:01:43.717534 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.717744 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:44.240176 (+522432us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.448121 (+207945us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.456487 (+  8366us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:44.458233 (+  1746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.461921 (+  3688us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.465102 (+  3181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30924,"raft.queue_time_us":35493,"spinlock_wait_cycles":3089152,"thread_start_us":648614,"threads_started":2,"wal-append.queue_time_us":204072}
I20260709 13:01:44.467163  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 573) took 2670 ms. Trace:
I20260709 13:01:44.467703  4929 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:44.467779  1540 rpcz_store.cc:276] 0709 13:01:41.797094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.797568 (+   474us) service_pool.cc:224] Handling call
0709 13:01:41.798187 (+   619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.948719 (+1150532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.466647 (+1517928us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000c5654. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:44.466960 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2539099008}
I20260709 13:01:44.468421  4923 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:44.468865  4923 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:44.469326  4923 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:44.470446  4941 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.504s	user 0.016s	sys 0.017s
I20260709 13:01:44.471136  4941 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:44.477955  1622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1733) took 1745 ms (client timeout 1742 ms). Trace:
I20260709 13:01:44.468262  4929 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:44.487740  4929 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:44.486672  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 641) took 1279 ms. Trace:
W20260709 13:01:44.479722  1622 rpcz_store.cc:269] 0709 13:01:42.726257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.728422 (+  2165us) service_pool.cc:224] Handling call
0709 13:01:44.471169 (+1742747us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400066154. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:44.471442 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395720960}
I20260709 13:01:44.470471  2263 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:44.514484  4959 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:44.516484  1513 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:44.517540  4465 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:44.517926  4465 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.518328  4465 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:44.510042  1622 raft_consensus.cc:1240] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:44.481750  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 1.52188e+06us
I20260709 13:01:44.510752  1663 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:44.478705  5016 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:44.511940  1514 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:44.498231  1619 rpcz_store.cc:276] 0709 13:01:43.206801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.485122 (+1278321us) service_pool.cc:224] Handling call
0709 13:01:44.485725 (+   603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.486182 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.486210 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.486257 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:44.486298 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.486360 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.486499 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.502971  1614 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:44.498601  5043 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:44.532994  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 642) took 1321 ms. Trace:
I20260709 13:01:44.534508  1622 rpcz_store.cc:276] 0709 13:01:43.207071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.509024 (+1301953us) service_pool.cc:224] Handling call
0709 13:01:44.509714 (+   690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.526884 (+ 17170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.528910 (+  2026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.477113  5058 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.529126  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 638) took 1321 ms. Trace:
I20260709 13:01:44.537760  1614 rpcz_store.cc:276] 0709 13:01:43.205996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.253431 (+1047435us) service_pool.cc:224] Handling call
0709 13:01:44.527404 (+273973us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.541126  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 589) took 1543 ms. Trace:
I20260709 13:01:44.542840  1546 rpcz_store.cc:276] 0709 13:01:42.994162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.443560 (+1449398us) service_pool.cc:224] Handling call
0709 13:01:44.472855 (+ 29295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.532349 (+ 59494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.532385 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.536882 (+  4497us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:44.536940 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.537010 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.537152 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.545359  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2522) took 1616 ms. Trace:
I20260709 13:01:44.547621  1547 rpcz_store.cc:276] 0709 13:01:42.928819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.445712 (+1516893us) service_pool.cc:224] Handling call
0709 13:01:44.461536 (+ 15824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.541884 (+ 80348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.541928 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.544886 (+  2958us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:44.544957 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.545039 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.545213 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.553275  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 644) took 1345 ms. Trace:
W20260709 13:01:44.553853  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.553819  1619 rpcz_store.cc:276] 0709 13:01:43.207805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.541414 (+1333609us) service_pool.cc:224] Handling call
0709 13:01:44.552166 (+ 10752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.552719 (+   553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.552744 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.552815 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:44.552851 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.552910 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.553055 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.554405  4923 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:44.556115  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 1.25376e+06us
I20260709 13:01:44.557363  1588 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:44.557775  5164 log.cc:927] Time spent T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:01:44.560065  5002 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:44.526553  4953 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:44.564102  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61573.1us
I20260709 13:01:44.549854  2231 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:44.559950  4941 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:44.572778  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 646) took 1304 ms. Trace:
I20260709 13:01:44.573261  1619 rpcz_store.cc:276] 0709 13:01:43.268701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.555151 (+1286450us) service_pool.cc:224] Handling call
0709 13:01:44.571740 (+ 16589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.572266 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.572292 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.572481 (+   189us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:44.572530 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.572586 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.572715 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.579998  1514 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:44.575268  4941 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:01:44.590279  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 60109.6us
I20260709 13:01:44.586042  5043 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:44.599614  5080 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:44.600235  5080 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:44.600458  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 89967.1us
I20260709 13:01:44.600737  5080 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:44.599318  5072 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:44.592840  4941 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:44.592640  5043 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:44.617508  5043 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:44.614154  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 80470.3us
I20260709 13:01:44.621270  1622 raft_consensus.cc:1240] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:44.622326  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 643) took 1415 ms. Trace:
I20260709 13:01:44.622694  1622 rpcz_store.cc:276] 0709 13:01:43.207321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.548896 (+1341575us) service_pool.cc:224] Handling call
0709 13:01:44.591579 (+ 42683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.622019 (+ 30440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.622231 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:44.629654  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.612680  4953 consensus_queue.cc:1059] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:01:44.616858  5167 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:44.614549  1614 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:44.645685  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 89448us
I20260709 13:01:44.651962  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 645) took 1401 ms. Trace:
I20260709 13:01:44.652426  1614 rpcz_store.cc:276] 0709 13:01:43.250867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.540761 (+1289894us) service_pool.cc:224] Handling call
0709 13:01:44.576628 (+ 35867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.651606 (+ 74978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.651886 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.654526  4861 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:44.661228  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 45820.6us
I20260709 13:01:44.649741  5167 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.670835  5072 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:44.672031  2231 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:44.662806  1511 leader_election.cc:336] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.643s (SENT)
I20260709 13:01:44.675899  4861 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.667212  5167 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:44.686152  4985 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.686411  4949 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:44.686869  4985 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.687276  4949 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.689774  4985 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:44.690192  4949 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:44.690884  5016 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:44.669344  5058 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:44.685678  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:44.673136  4918 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:44.684832  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 69245.1us
I20260709 13:01:44.686478  4321 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.680534  4861 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.684347  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:44.689471  4926 consensus_queue.cc:1059] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:44.682811  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:44.704897  1622 raft_consensus.cc:1240] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:44.719735  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 647) took 1446 ms. Trace:
I20260709 13:01:44.720250  1619 rpcz_store.cc:276] 0709 13:01:43.271334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.575230 (+1303896us) service_pool.cc:224] Handling call
0709 13:01:44.644263 (+ 69033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.694669 (+ 50406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.694697 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.704671 (+  9974us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:44.717223 (+ 12552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.717292 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.717427 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.721728  4321 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:44.724570  4321 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:44.727770  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 83640.1us
I20260709 13:01:44.727952  4465 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:44.728818  1663 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:44.683794  4923 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:44.735684  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 648) took 1433 ms. Trace:
I20260709 13:01:44.736424  1622 rpcz_store.cc:276] 0709 13:01:43.301926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.638192 (+1336266us) service_pool.cc:224] Handling call
0709 13:01:44.673605 (+ 35413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.721098 (+ 47493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.735523 (+ 14425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.741359  4863 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:44.744261  4918 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:44.747891  4923 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.748903  1663 leader_election.cc:400] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:01:44.750424  1663 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:44.719785  5072 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.752130  5072 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:44.754616  5072 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:44.757818  4321 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:44.758889  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 585) took 1876 ms. Trace:
I20260709 13:01:44.762217  4861 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:44.762930  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52808 (request call id 200) took 11502 ms (client timeout 15000 ms). Trace:
I20260709 13:01:44.758917  4321 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.774686  4903 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:44.781170  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.767478  5058 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:44.766520  1539 rpcz_store.cc:276] 0709 13:01:42.882367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.757501 (+1875134us) service_pool.cc:224] Handling call
0709 13:01:44.758056 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.758432 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.758469 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.758525 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:44.758568 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.758637 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.758809 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:44.782648  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 122200us
I20260709 13:01:44.787138  5009 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:44.787516  5053 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:44.788496  1446 catalog_manager.cc:5697] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:44.790149  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1741) took 2038 ms (client timeout 2042 ms). Trace:
I20260709 13:01:44.791700  5080 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.792476  1616 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:01:44.795392  1617 rpcz_store.cc:269] 0709 13:01:42.752237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.628675 (+876438us) service_pool.cc:224] Handling call
0709 13:01:44.768250 (+1139575us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54001f8bd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:44.790075 (+ 21825us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180350720}
W20260709 13:01:44.799777  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.800179  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 141111us
W20260709 13:01:44.800946  1511 leader_election.cc:336] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.643s (SENT)
W20260709 13:01:44.802079  1511 leader_election.cc:336] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.645s (SENT)
I20260709 13:01:44.807590  5162 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.808516  5058 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.808352  5162 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.809183  5058 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:44.802515  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:44.818431  4321 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:44.821404  5123 log.cc:927] Time spent T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 2.117s	user 0.001s	sys 0.013s
I20260709 13:01:44.823838  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2518) took 2320 ms. Trace:
I20260709 13:01:44.824306  1543 rpcz_store.cc:276] 0709 13:01:42.503638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.960059 (+456421us) service_pool.cc:224] Handling call
0709 13:01:43.541097 (+581038us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:43.591289 (+ 50192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.591324 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:43.673545 (+ 82221us) log.cc:844] Serialized 52 byte log entry
0709 13:01:44.473322 (+799777us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:44.810900 (+337578us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.817986 (+  7086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.823560 (+  5574us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.823599 (+    39us) raft_consensus.cc:1685] finished
0709 13:01:44.823612 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.823780 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":314581,"prepare.queue_time_us":324014,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":118,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":45144,"thread_start_us":684135,"threads_started":1,"wal-append.queue_time_us":552142}
I20260709 13:01:44.807026  5101 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:44.828579  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53718 (request call id 588) took 1909 ms. Trace:
W20260709 13:01:44.830758  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 157329us
W20260709 13:01:44.831956  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1729) took 2497 ms (client timeout 2481 ms). Trace:
I20260709 13:01:44.832206  4959 raft_consensus.cc:3055] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:44.832919  4959 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:01:44.833359  5134 log.cc:927] Time spent T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 1.931s	user 0.003s	sys 0.025s
I20260709 13:01:44.835737  4987 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:44.837387  5162 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:44.838907  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.839651  5049 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:44.840198  5049 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:44.841609  5049 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.842715  5053 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:44.832405  1618 rpcz_store.cc:269] 0709 13:01:42.321168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.321300 (+   132us) service_pool.cc:224] Handling call
0709 13:01:44.767072 (+2445772us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b540016e254. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:44.818368 (+ 51296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77894016}
I20260709 13:01:44.843142  5072 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:44.843461  5053 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:44.844027  5072 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:44.844436  5101 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:44.846086  5053 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:44.846442  5072 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:44.846871  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1706) took 2590 ms. Trace:
I20260709 13:01:44.847064  5101 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:44.847652  5092 log.cc:927] Time spent T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 2.964s	user 0.008s	sys 0.027s
I20260709 13:01:44.847362  1544 rpcz_store.cc:276] 0709 13:01:42.256381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.256881 (+   500us) service_pool.cc:224] Handling call
0709 13:01:42.257426 (+   545us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.257864 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:42.258258 (+   394us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.330406 (+ 72148us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:42.353690 (+ 23284us) log.cc:844] Serialized 26 byte log entry
0709 13:01:42.356213 (+  2523us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:42.356599 (+   386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.368126 (+ 11527us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.039356 (+1671230us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b1800401bc0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:01:44.845575 (+806219us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b2400416918. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c678d79c4 00007f5c678d5acb 00007f5c67a90dc9 00007f5c67a90a55 00007f5c67a8ffb0 00007f5c6a706488 00007f5c6a706be8 00007f5c6a6de398 00007f5c6a6d976a 00007f5c6a6d8bb6
0709 13:01:44.846504 (+   929us) raft_consensus.cc:1685] finished
0709 13:01:44.846524 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.846671 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":639,"prepare.queue_time_us":6506,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":3818,"raft.run_cpu_time_us":485,"raft.run_wall_time_us":21236,"spinlock_wait_cycles":53851520,"thread_start_us":70745,"threads_started":1,"wal-append.queue_time_us":768902}
W20260709 13:01:44.851969  5166 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.363s	user 0.004s	sys 0.001s
I20260709 13:01:44.854287  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 640) took 1647 ms. Trace:
I20260709 13:01:44.855715  5119 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:44.854743  1621 rpcz_store.cc:276] 0709 13:01:43.206537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.264417 (+1057880us) service_pool.cc:224] Handling call
0709 13:01:44.265171 (+   754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.266002 (+   831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.266038 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.267096 (+  1058us) log.cc:844] Serialized 26 byte log entry
0709 13:01:44.443674 (+176578us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:44.443717 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.443782 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.806916 (+363134us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:44.853870 (+ 46954us) raft_consensus.cc:1685] finished
0709 13:01:44.853895 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.854167 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2457,"raft.run_cpu_time_us":499,"raft.run_wall_time_us":477,"spinlock_wait_cycles":32929152,"thread_start_us":117478,"threads_started":1,"wal-append.queue_time_us":205667}
I20260709 13:01:44.855835  1446 catalog_manager.cc:5697] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 5 to 7, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 7 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:44.857585  1620 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:44.829177  1542 rpcz_store.cc:276] 0709 13:01:42.902216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.935820 (+ 33604us) service_pool.cc:224] Handling call
0709 13:01:44.779502 (+1843682us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54000a73d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:44.811646 (+ 32144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337523584}
W20260709 13:01:44.861377  5120 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 2.001s	user 0.002s	sys 0.027s
I20260709 13:01:44.839747  4925 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:44.863785  5124 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.864435  5124 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:44.865058  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1612) took 2503 ms. Trace:
I20260709 13:01:44.864529  4523 consensus_queue.cc:1059] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:44.857600  5125 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 2.192s	user 0.005s	sys 0.015s
I20260709 13:01:44.866806  5124 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:44.867820  5113 raft_consensus.cc:3055] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:44.868383  5113 raft_consensus.cc:740] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:44.868655  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2682) took 2694 ms. Trace:
I20260709 13:01:44.869820  5113 consensus_queue.cc:260] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:44.869110  1690 rpcz_store.cc:276] 0709 13:01:42.174178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.174467 (+   289us) service_pool.cc:224] Handling call
0709 13:01:42.175087 (+   620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.204123 (+ 29036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.204158 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:42.228863 (+ 24705us) log.cc:844] Serialized 26 byte log entry
0709 13:01:42.325075 (+ 96212us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:42.325124 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.325195 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.856278 (+2531083us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:44.868063 (+ 11785us) raft_consensus.cc:1685] finished
0709 13:01:44.868089 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.868401 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7013,"raft.queue_time_us":42204,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":8648,"spinlock_wait_cycles":79077760,"thread_start_us":77194,"threads_started":1,"wal-append.queue_time_us":172139}
I20260709 13:01:44.842046  1662 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:44.872762  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.865381  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1609) took 2506 ms. Trace:
I20260709 13:01:44.811323  5058 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:44.865450  1616 rpcz_store.cc:276] 0709 13:01:42.361208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.361349 (+   141us) service_pool.cc:224] Handling call
0709 13:01:44.791572 (+2430223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.795744 (+  4172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.864827 (+ 69083us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b540016e250. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:44.864984 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4925907968}
I20260709 13:01:44.874084  1620 rpcz_store.cc:276] 0709 13:01:42.358655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.358812 (+   157us) service_pool.cc:224] Handling call
0709 13:01:44.754070 (+2395258us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b5800085298. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb17fc0 00007f5c6fb02929 00007f5c6fb023d2 00007f5c69079bd4
0709 13:01:44.857220 (+103150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.858075 (+   855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.859315 (+  1240us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000fcdd0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:44.865326 (+  6011us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277384320}
I20260709 13:01:44.842898  5049 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:44.880780  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 152744us
I20260709 13:01:44.855945  5110 raft_consensus.cc:3055] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:44.858786  1446 catalog_manager.cc:5697] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:44.834131  4959 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:44.874503  5080 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:44.885603  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 43750.1us
I20260709 13:01:44.896318  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:44.923678  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:44.883847  5110 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:44.875712  4929 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.934017  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:44.934849  2265 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:44.940326  2232 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:44.941892  5103 consensus_meta.cc:287] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.993s	user 0.008s	sys 0.012s
I20260709 13:01:44.942420  5103 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.943491  4959 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:44.943812  1623 raft_consensus.cc:2393] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:44.944154  1446 catalog_manager.cc:5697] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:44.947660  5113 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:44.948009  1514 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:01:44.952625  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 202339us
I20260709 13:01:44.947001  1446 catalog_manager.cc:5697] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 5 to 6, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 6 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:01:44.960516  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 158479us
I20260709 13:01:44.912087  4465 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:44.767486  1442 rpcz_store.cc:269] 0709 13:01:33.260289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.260865 (+   576us) service_pool.cc:224] Handling call
0709 13:01:44.762627 (+11501762us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:36.024385 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:36.025432 (+  1047us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:36.025473 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:01:36.025498 (+    25us) tablet.cc:662] Decoding operations
0709 13:01:36.026827 (+  1329us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:36.026888 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:36.026918 (+    30us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:01:36.364512 (+337594us) tablet.cc:701] Row locks acquired
0709 13:01:36.375365 (+ 10853us) write_op.cc:260] PREPARE: finished
0709 13:01:36.390983 (+ 15618us) write_op.cc:270] Start()
0709 13:01:36.401284 (+ 10301us) write_op.cc:276] Timestamp: P: 1783602096387867 usec, L: 0
0709 13:01:36.401312 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:01:36.440221 (+ 38909us) log.cc:844] Serialized 5567 byte log entry
0709 13:01:36.715371 (+275150us) op_driver.cc:464] REPLICATION: finished
0709 13:01:37.179839 (+464468us) write_op.cc:301] APPLY: starting
0709 13:01:37.197675 (+ 17836us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:37.250477 (+ 52802us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:37.279581 (+ 29104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:37.426993 (+147412us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:37.427515 (+   522us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:01:37.427564 (+    49us) write_op.cc:312] APPLY: finished
0709 13:01:37.427874 (+   310us) log.cc:844] Serialized 101 byte log entry
0709 13:01:37.428048 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:37.428300 (+   252us) write_op.cc:454] Released schema lock
0709 13:01:37.428379 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:37.476413 (+ 48034us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:37.481594 (+  5181us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41489,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":431443,"apply.run_cpu_time_us":6396,"apply.run_wall_time_us":276638,"num_ops":14,"prepare.queue_time_us":737618,"prepare.run_cpu_time_us":23652,"prepare.run_wall_time_us":507858,"raft.queue_time_us":167682,"raft.run_cpu_time_us":15086,"raft.run_wall_time_us":376160,"replication_time_us":305398,"spinlock_wait_cycles":39296,"thread_start_us":1051909,"threads_started":4,"wal-append.queue_time_us":104486,"wal-append.run_cpu_time_us":86785,"wal-append.run_wall_time_us":1955324}]]}
I20260709 13:01:44.965204  1446 catalog_manager.cc:5697] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:44.967792  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:44.933270  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:44.959348  4923 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:44.970279  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 587) took 2068 ms. Trace:
I20260709 13:01:44.963577  5058 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:44.980037  1511 leader_election.cc:336] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.645s (SENT)
I20260709 13:01:44.951577  4983 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.982160  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:44.982276  1548 raft_consensus.cc:1240] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:44.933548  5015 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:44.984802  4999 consensus_queue.cc:1059] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:01:44.985247  5015 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:44.986258  4999 raft_consensus.cc:3055] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:44.986763  4999 raft_consensus.cc:740] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:44.979120  1586 leader_election.cc:336] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.958s (SENT)
I20260709 13:01:44.979070  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:44.988499  1623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1740) took 2252 ms (client timeout 2968 ms). Trace:
I20260709 13:01:44.992456  1663 leader_election.cc:400] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9.
I20260709 13:01:44.992883  1663 leader_election.cc:403] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:01:44.976236  1545 rpcz_store.cc:276] 0709 13:01:42.901818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.442818 (+1541000us) service_pool.cc:224] Handling call
0709 13:01:44.472520 (+ 29702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.514322 (+ 41802us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:44.811304 (+296982us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.823307 (+ 12003us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b180043b340. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:01:44.968779 (+145472us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.968828 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:44.968875 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.970111 (+  1236us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.970225 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":296367,"prepare.queue_time_us":306295,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":5995,"spinlock_wait_cycles":3796224,"thread_start_us":141361,"threads_started":1}
I20260709 13:01:44.974613  5080 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:44.992774  1623 rpcz_store.cc:269] 0709 13:01:42.728236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.181231 (+1452995us) service_pool.cc:224] Handling call
0709 13:01:44.980620 (+799389us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b5400068454. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:44.980773 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1749702528}
I20260709 13:01:44.958153  5167 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:44.975279  4925 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:44.980381  5162 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.997360  1618 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:45.013236  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.003986  1446 catalog_manager.cc:5697] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:44.943871  5110 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.010643  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:45.020908  2263 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:45.001807  4925 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:44.998234  5058 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:45.030495  1616 raft_consensus.cc:2393] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:45.005112  5080 raft_consensus.cc:697] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:44.995755  4999 consensus_queue.cc:260] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.033000  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:45.035112  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.028103  1446 catalog_manager.cc:5697] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.007067  5043 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:45.043753  4999 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:45.041280  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 66527.7us
W20260709 13:01:45.043000  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.030512  4925 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.065132  5103 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:45.046511  2264 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.040077  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:45.011509  4941 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:45.068504  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:45.069012  1586 leader_election.cc:336] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.979s (SENT)
I20260709 13:01:45.070081  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:45.070536  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:45.071316  2267 raft_consensus.cc:2393] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 9: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:45.009233  5162 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.073742  5173 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9.
I20260709 13:01:45.047554  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.048528  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:45.048779  5043 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:45.048976  4523 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:45.050100  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.050992  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:45.051508  5015 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:45.052904  5167 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:45.044229  4923 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:45.055678  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:45.056049  5058 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.057694  4929 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:45.057334  5136 consensus_queue.cc:1175] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "44c8c572048a40b1a5e71865068ed1bb" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:45.057098  1446 catalog_manager.cc:5697] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e reported cstate change: leader changed from <none> to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 5 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.060326  5080 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:45.063995  5110 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:45.038466  4903 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.064857  4869 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.000985  4983 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:45.091241  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 111562us
W20260709 13:01:45.090655  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 159716us
W20260709 13:01:45.099242  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 119237us
I20260709 13:01:45.107359  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.108136  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:45.108830  4903 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:45.109478  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:45.111042  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:45.110673  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:45.116063  1690 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:45.122002  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:45.123571  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:45.108415  1616 raft_consensus.cc:2393] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:45.112802  1446 catalog_manager.cc:5697] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.112025  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.137420  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.139657  1663 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:45.140558  5173 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:45.137454  1615 raft_consensus.cc:2393] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:45.141177  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:45.141952  5173 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:45.142674  2270 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:45.143100  1511 leader_election.cc:336] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.742s (SENT)
I20260709 13:01:45.143146  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.136536  4941 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:45.143715  1511 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:45.138541  1691 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:45.144321  5167 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:45.111975  4869 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.113040  4923 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:45.147922  1621 raft_consensus.cc:2393] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:45.148926  2268 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:45.147574  5167 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:45.154606  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.156067  4929 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.155957  1446 catalog_manager.cc:5697] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 3 to 6, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 6 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.157511  5126 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.155740  5167 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.158123  5126 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.158876  5167 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.163751  2267 raft_consensus.cc:2393] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:45.164731  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:45.166559  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:45.169902  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:45.170372  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.171698  4929 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:45.171778  1513 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:45.172158  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:45.172724  1692 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.172936  5043 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:45.173390  5043 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:45.173770  5043 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.172950  4923 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:45.178490  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.179908  1688 raft_consensus.cc:2393] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:45.181001  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.113585  4983 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:45.171157  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:45.183997  2265 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
W20260709 13:01:45.184599  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 115621us
W20260709 13:01:45.191210  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.208246  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:45.208345  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 65269.3us
I20260709 13:01:45.208889  1513 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:45.209439  1511 leader_election.cc:336] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.804s (SENT)
I20260709 13:01:45.221660  4389 raft_consensus.cc:2764] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:01:45.224474  2271 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:45.209571  4903 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:45.218003  1446 catalog_manager.cc:5697] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 6 to 7, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 7 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:01:45.232338  1623 raft_consensus.cc:2410] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:45.215133  4929 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:45.236696  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:45.251956  2272 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:45.252439  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.254505  1697 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:45.259042  5073 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.259650  5073 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.260962  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:45.266592  1545 raft_consensus.cc:1240] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:45.271351  5136 consensus_queue.cc:1059] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:45.273486  5136 raft_consensus.cc:3055] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:45.274065  5136 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:45.275791  5162 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:45.276247  5136 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.277679  5136 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.277478  5162 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:45.280758  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.281456  1697 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:45.282749  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.283071  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.283715  1688 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:45.285097  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.286093  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.286860  1688 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:45.245065  4923 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:45.291769  4923 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:45.292167  4983 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:45.293092  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:45.293880  4983 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:45.294319  4983 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:45.294461  4923 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:45.295408  4983 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.300532  2267 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:45.306785  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:45.307744  1616 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:45.308209  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.309926  2263 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
W20260709 13:01:45.310962  2272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54488 (request call id 623) took 3417 ms (client timeout 1937 ms). Trace:
I20260709 13:01:45.311188  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:45.312058  2263 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:45.313112  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:45.313839  5073 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:45.311383  2272 rpcz_store.cc:269] 0709 13:01:41.893140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.894183 (+  1043us) service_pool.cc:224] Handling call
0709 13:01:45.310749 (+3416566us) spinlock_profiling.cc:243] Waited 3.3 s on lock 0x7b5400697dd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:45.310881 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7589372800}
I20260709 13:01:45.311479  1662 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:45.254864  5126 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:45.309759  1692 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:45.249251  4929 raft_consensus.cc:697] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:45.315336  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.325067  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.297820  4983 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:45.327337  1662 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:45.244796  4941 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:01:45.328204  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:45.332789  4869 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:45.329324  5173 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:45.333849  5173 raft_consensus.cc:697] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:45.334857  5173 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.339620  4929 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.348572  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:45.352757  2268 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:45.353535  1621 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:45.358855  2266 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:45.369493  1616 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:45.372270  1688 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
W20260709 13:01:45.373806  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 53394.6us
W20260709 13:01:45.376163  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.376921  2264 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:45.309409  5058 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:01:45.393261  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.396291  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:45.395478  1548 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:45.375902  5162 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:45.424960  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:45.426004  1616 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:45.429591  2269 raft_consensus.cc:1240] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:45.430892  2232 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:45.443089  2234 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:45.445868  1588 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:45.450656  1511 leader_election.cc:336] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.753s (SENT)
I20260709 13:01:45.451290  1511 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:45.455320  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.404884  5162 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:45.460098  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:45.463485  1620 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.461257  2268 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:01:45.464355  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.467715  1588 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:45.475998  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.476745  1615 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
W20260709 13:01:45.483372  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.457894  5009 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:45.487365  5009 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.487849  5009 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:45.488974  5178 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:01:45.489593  5049 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.490191  5049 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:45.492347  5049 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:45.493177  5015 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:45.493788  5015 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:45.496297  5009 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.499953  4570 consensus_queue.cc:1059] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:45.501827  4570 raft_consensus.cc:3055] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:45.502305  4570 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:45.502429  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:45.503070  1548 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:45.503918  5180 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:01:45.503405  4570 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:45.504788  5179 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.234s	user 0.002s	sys 0.000s
I20260709 13:01:45.505091  4570 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:45.511528  1548 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:45.513021  5009 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:45.519567  1588 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:45.521201  4987 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:45.521284  4941 consensus_queue.cc:1059] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:45.522581  4941 raft_consensus.cc:3055] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:45.522971  4941 raft_consensus.cc:740] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:45.522823  4959 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:45.524645  4923 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:45.525557  5177 log.cc:927] Time spent T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.254s	user 0.006s	sys 0.000s
I20260709 13:01:45.458283  5126 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:45.529910  5126 raft_consensus.cc:697] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:45.530977  5126 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.466394  5162 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:45.544356  2232 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:45.494848  5015 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.478313  5103 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:45.571887  4999 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.572573  4999 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.575040  4999 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:45.575702  5103 raft_consensus.cc:697] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:45.471978  4925 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:45.485066  5043 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.580107  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.580840  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.581732  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.581805  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.582558  2270 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:45.583016  4923 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:45.583810  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:01:45.571889  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 85081.2us
I20260709 13:01:45.564253  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:45.608537  1618 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:45.603951  1621 raft_consensus.cc:2410] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:45.605456  1623 raft_consensus.cc:2393] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:45.605655  1620 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:45.609967  2234 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:45.611289  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 160678us
I20260709 13:01:45.611784  1617 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:45.614764  2234 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:45.614548  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 54761.8us
I20260709 13:01:45.627707  1692 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:45.587958  5119 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:45.635741  1511 leader_election.cc:336] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.951s (SENT)
I20260709 13:01:45.636466  1511 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:45.637719  1615 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:45.630172  2231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.723s (SENT) [suppressed 38 similar messages]
I20260709 13:01:45.639302  1616 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:45.647584  5073 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:45.648167  1511 leader_election.cc:336] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.969s (SENT)
I20260709 13:01:45.647508  4941 consensus_queue.cc:260] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.647698  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.648609  1511 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:45.649170  4941 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.649276  1696 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:45.650360  5080 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:45.651067  5080 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:45.647507  4929 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:45.660107  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.661083  1688 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:45.661274  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.662874  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.663820  1693 raft_consensus.cc:2393] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:45.665155  1689 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:45.666493  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.667400  5080 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:45.667805  5103 consensus_queue.cc:237] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:45.674535  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 90843.1us
I20260709 13:01:45.675922  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:45.676985  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:45.678320  5119 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:45.679790  5073 raft_consensus.cc:697] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:45.680181  4929 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.680779  5073 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.683657  4923 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:45.684803  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.685410  1695 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:45.686256  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:45.687741  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:45.688532  1691 raft_consensus.cc:2410] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:45.689090  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:45.689349  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.690521  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.691653  1689 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:45.695752  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.629487  4999 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:45.687283  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:45.709070  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.709970  1692 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:45.697413  1588 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:45.728154  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:45.736048  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 89070.1us
I20260709 13:01:45.736820  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.738799  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:45.739768  1688 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:45.743479  1586 leader_election.cc:336] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.527s (SENT)
W20260709 13:01:45.751931  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 73960.3us
I20260709 13:01:45.755172  1514 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:45.756137  5080 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:45.629077  5173 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:01:45.707916  4999 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:45.774513  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 128163us
W20260709 13:01:45.774765  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.775789  1695 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:45.779999  1618 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:45.814909  1588 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:45.799852  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.812218  2265 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:45.781347  4999 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.779448  4929 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:45.807791  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 50283.2us
I20260709 13:01:45.780941  4959 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:45.796762  1663 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:45.822463  1688 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:45.785260  5049 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:45.702353  5119 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:45.852481  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.859452  1688 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:45.859476  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 229274us
I20260709 13:01:45.827796  5185 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:45.840476  4983 consensus_meta.cc:287] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.006s
I20260709 13:01:45.793673  4987 raft_consensus.cc:697] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:01:45.874747  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.881333  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.885846  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 107387us
I20260709 13:01:45.890569  1694 raft_consensus.cc:2410] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:45.894387  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:45.868372  5185 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:45.895480  1616 raft_consensus.cc:2410] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:01:45.852260  5162 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.886854  4983 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:45.864223  5049 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.886739  5173 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:45.908747  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:45.912599  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 131828us
I20260709 13:01:45.864838  4903 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:45.918694  1690 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:45.926196  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.907823  4983 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:45.938802  4925 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:45.935736  2265 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:45.937295  4987 consensus_queue.cc:237] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:45.939139  4983 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:45.949159  2269 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:45.921017  5043 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:45.954826  5049 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:45.960583  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:45.963799  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:45.956861  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 113775us
I20260709 13:01:45.957752  5015 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.964483  1694 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.965672  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:45.973825  1693 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
W20260709 13:01:45.980975  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 332822us
I20260709 13:01:45.985162  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:45.991369  1511 leader_election.cc:336] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.999s (SENT)
I20260709 13:01:45.992131  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:45.993467  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 62194.6us
I20260709 13:01:45.967732  4959 raft_consensus.cc:697] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:45.967057  4941 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:01:45.975088  5015 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:45.987951  5201 consensus_queue.cc:1059] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:01:46.007463  4903 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:46.020823  1511 leader_election.cc:336] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.094s (SENT)
I20260709 13:01:45.980490  5185 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:46.032689  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:01:46.030169  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.030537  2231 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:46.053460  1690 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
W20260709 13:01:46.069077  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 53653.5us
W20260709 13:01:46.069998  1511 leader_election.cc:336] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.175s (SENT)
I20260709 13:01:46.070447  1511 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:46.073172  5207 raft_consensus.cc:3055] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:46.073618  5207 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:46.074898  5015 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:46.084774  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 97018.3us
I20260709 13:01:46.087605  1694 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:46.049489  4903 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:46.109114  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 127326us
W20260709 13:01:46.110987  1511 leader_election.cc:336] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.231s (SENT)
I20260709 13:01:46.126202  1511 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:46.080021  5080 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:46.146255  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.147145  1694 raft_consensus.cc:2410] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:01:46.149586  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 63252.3us
I20260709 13:01:46.157603  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:46.160203  1514 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:46.161515  4925 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:46.162181  4925 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:46.163658  4929 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:46.163360  4925 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:46.170406  1514 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:46.175261  5043 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:46.175990  5043 raft_consensus.cc:697] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:46.177255  5043 consensus_queue.cc:237] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:46.199625  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 93654us
W20260709 13:01:46.202000  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 54136.7us
I20260709 13:01:46.204977  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.205497  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:46.191629  5177 log.cc:927] Time spent T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:01:46.208572  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:46.209681  1620 raft_consensus.cc:2376] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7. Re-sending same reply.
I20260709 13:01:46.208572  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:46.107046  5204 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 13:01:46.128587  4959 consensus_queue.cc:237] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:46.357120  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.216367  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:46.357963  1614 raft_consensus.cc:2393] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:46.259537  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:46.254688  1544 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:46.251168  5043 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:46.361088  5043 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:46.346076  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.244863  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.375320  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 56582.9us
I20260709 13:01:46.381875  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:46.382948  1617 raft_consensus.cc:2410] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:01:46.265278  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:46.378891  4999 consensus_meta.cc:287] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.004s
I20260709 13:01:46.383798  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:46.214403  4929 raft_consensus.cc:697] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:46.468969  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:46.469712  5043 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:46.433502  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:46.471103  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:46.471581  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:46.472572  1542 raft_consensus.cc:2393] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:46.472657  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:46.473688  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:46.474938  1616 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:46.475621  4999 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:46.478443  4999 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:46.383596  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:46.441670  4983 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:46.480553  5198 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.485s	user 0.003s	sys 0.000s
I20260709 13:01:46.481909  4983 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:46.483044  5205 log.cc:927] Time spent T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.525s	user 0.000s	sys 0.003s
I20260709 13:01:46.415935  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:46.484222  1548 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:46.484047  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:46.485132  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:46.485772  1548 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:46.251572  4903 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.466208  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:46.467371  4929 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:46.469869  1541 raft_consensus.cc:2393] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:46.356284  5215 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:46.307394  4925 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:46.485782  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:46.467971  1615 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:46.317893  5194 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:46.475099  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:46.498070  5227 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:01:46.518507  1542 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:46.468674  5228 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:01:46.574682  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:46.575512  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:46.574810  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:46.578804  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 366913us
I20260709 13:01:46.584295  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.584728  1548 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:46.586522  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:46.586136  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:46.586220  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:46.589776  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.589929  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.590204  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:46.580569  5184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.003s	sys 0.007s
I20260709 13:01:46.591545  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:46.552035  4903 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:46.602501  1548 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:46.603613  5234 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.005s
I20260709 13:01:46.521487  4925 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:46.608081  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:46.598030  5184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.003s	sys 0.007s
I20260709 13:01:46.612360  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:46.614946  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:46.618125  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.623358  1542 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:46.626829  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.628021  1694 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:46.599819  4923 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.021s	sys 0.021s
I20260709 13:01:46.648690  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:46.649493  1547 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:46.644980  1586 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:46.653925  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:46.654239  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.661628  1539 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.662859  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.663587  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:46.664399  1618 raft_consensus.cc:2393] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
W20260709 13:01:46.645524  4923 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.021s	sys 0.021s
I20260709 13:01:46.667057  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:46.667971  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:46.668551  1616 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:46.670173  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 649339us
I20260709 13:01:46.669932  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:46.682178  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.655133  4389 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:46.679492  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:46.683069  1694 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:46.691284  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:46.689839  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:46.690326  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:46.698135  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 53220us
W20260709 13:01:46.756402  5196 log.cc:927] Time spent T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.781s	user 0.002s	sys 0.000s
I20260709 13:01:46.727895  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.840349  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 758) took 1195 ms. Trace:
I20260709 13:01:46.840710  4925 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:46.841024  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.753541  4903 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:46.752255  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:46.747861  1618 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:46.843521  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:46.830039  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.844425  2268 raft_consensus.cc:2393] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:46.749148  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.724848  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:46.840921  2270 rpcz_store.cc:276] 0709 13:01:45.645372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.645550 (+   178us) service_pool.cc:224] Handling call
0709 13:01:45.649943 (+  4393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.683702 (+ 33759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.683748 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:45.684264 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.840966 (+156702us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:45.841044 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.841155 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.755635 (+914480us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:46.839981 (+ 84346us) raft_consensus.cc:1685] finished
0709 13:01:46.840004 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.840249 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33283,"raft.queue_time_us":35264,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":56,"spinlock_wait_cycles":37403520,"thread_start_us":155237,"threads_started":1,"wal-append.queue_time_us":239013}
I20260709 13:01:46.839177  1539 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
W20260709 13:01:46.801100  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.847563  1690 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:46.749536  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.762553  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:46.796696  2269 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:46.757678  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:46.847280  1547 raft_consensus.cc:2410] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:46.851035  1542 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:46.862198  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:46.863559  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.865996  1614 raft_consensus.cc:2410] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:01:46.847797  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.868350  1692 raft_consensus.cc:2393] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:46.873474  1688 raft_consensus.cc:2410] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:46.874229  2266 raft_consensus.cc:2368] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:01:46.728458  2265 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:46.842650  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.900467  1546 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:46.909121  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.794057  1540 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:46.910707  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.731619  1586 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:46.911934  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 180416us
I20260709 13:01:46.751816  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:46.915798  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:46.917016  1542 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.920733  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2734) took 1206 ms. Trace:
I20260709 13:01:46.921334  1693 rpcz_store.cc:276] 0709 13:01:45.663392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.688857 (+ 25465us) service_pool.cc:224] Handling call
0709 13:01:46.869900 (+1181043us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400146c54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:46.870010 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355276672}
I20260709 13:01:46.863461  5162 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:46.934633  1614 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:01:46.938547  1622 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:46.940342  1548 raft_consensus.cc:2410] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:01:46.754062  5241 log.cc:927] Time spent T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:46.957010  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:46.954942  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:46.966871  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:47.013305  5167 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:47.013808  5197 log.cc:927] Time spent T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 1.058s	user 0.003s	sys 0.022s
W20260709 13:01:47.015364  5200 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 1.060s	user 0.005s	sys 0.000s
I20260709 13:01:47.016993  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:46.936121  1586 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:46.688802  5238 raft_consensus.cc:2764] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:01:47.022555  1619 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:47.023707  1513 leader_election.cc:400] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:01:47.024395  1622 raft_consensus.cc:1240] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:47.024295  1513 leader_election.cc:403] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:47.026572  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:47.031136  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:47.034351  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.037052  2231 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:47.040380  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 127852us
W20260709 13:01:47.042165  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.044013  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 102148us
I20260709 13:01:47.018193  5162 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.045084  2270 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:47.035728  1543 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:47.048689  1690 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:47.032369  5188 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 1.161s	user 0.004s	sys 0.001s
I20260709 13:01:47.053364  1616 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:47.053838  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:47.057793  5195 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 1.135s	user 0.000s	sys 0.007s
I20260709 13:01:47.064554  1542 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:47.073643  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:47.084549  1690 raft_consensus.cc:2410] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:47.073575  1540 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:47.025938  5167 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:47.052994  5110 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:47.058269  5222 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:47.086246  1540 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:47.049307  4999 consensus_queue.cc:1059] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:01:47.094359  2231 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:47.095460  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:47.097293  5136 raft_consensus.cc:3055] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:47.098945  5136 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:47.099601  5119 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:47.096462  1690 raft_consensus.cc:2410] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:47.100306  1539 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:47.102488  1542 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:47.059463  5162 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:47.105333  2231 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:47.108304  1586 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:47.109465  1540 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:47.087754  4929 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:01:47.125140  1539 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:47.126004  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:47.126633  1690 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:47.103524  4959 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:47.130126  5250 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:01:47.130571  2232 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:47.130514  5249 consensus_queue.cc:1059] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:01:47.133276  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:47.133312  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:47.156474  1688 raft_consensus.cc:2410] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:01:47.156490  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 51999.6us
I20260709 13:01:47.134657  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:47.135711  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:47.113608  5244 consensus_queue.cc:1059] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:01:47.139917  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:47.100276  5136 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:47.161206  5189 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:47.161700  5185 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:47.161805  5189 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:47.162279  5189 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:47.163026  5246 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:47.142298  1542 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:47.128186  5222 raft_consensus.cc:697] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:47.144785  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:47.145543  5162 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:47.147353  5167 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:47.157887  1693 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:47.157598  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:47.169416  1690 raft_consensus.cc:2393] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:47.124796  5119 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:47.172070  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 48900.6us
I20260709 13:01:47.174067  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.185572  1540 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:47.188504  1586 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:47.199105  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:47.201799  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:47.202694  1693 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:47.163699  5246 raft_consensus.cc:697] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:47.203958  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:47.209573  5247 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:01:47.210978  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.214152  1586 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:47.215961  1623 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:47.217482  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:47.222021  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:47.185986  5203 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:47.236281  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 490) took 1543 ms. Trace:
I20260709 13:01:47.237315  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 494) took 1551 ms. Trace:
W20260709 13:01:47.238875  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.240535  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:47.243909  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.237816  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:47.245743  1623 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:47.252525  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:47.257091  1586 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:47.260610  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:47.237259  1689 rpcz_store.cc:276] 0709 13:01:45.684943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.693879 (+  8936us) service_pool.cc:224] Handling call
0709 13:01:45.694218 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:45.694659 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.694684 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:45.695280 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 13:01:45.882195 (+186915us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:45.900286 (+ 18091us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.901166 (+   880us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.905473 (+  4307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.905558 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.528539 (+622981us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b18003447a0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:01:47.013151 (+484612us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:47.227989 (+214838us) raft_consensus.cc:1685] finished
0709 13:01:47.228022 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.228230 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54783,"prepare.queue_time_us":20975,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":91,"raft.queue_time_us":16355,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":30748,"spinlock_wait_cycles":120483072,"thread_start_us":186511,"threads_started":1,"wal-append.queue_time_us":259860}
I20260709 13:01:47.231338  4987 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:47.270375  1586 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:47.231637  5203 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:47.237978  1696 rpcz_store.cc:276] 0709 13:01:45.685957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.743989 (+ 58032us) service_pool.cc:224] Handling call
0709 13:01:45.744395 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.902761 (+158366us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:46.201342 (+298581us) log.cc:844] Serialized 14 byte log entry
0709 13:01:46.653434 (+452092us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.206893 (+553459us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b2c000d1b28. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:01:47.207301 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.220600 (+ 13299us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:47.220629 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.220739 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.220790 (+    51us) raft_consensus.cc:1685] finished
0709 13:01:47.232120 (+ 11330us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.237164 (+  5044us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66882,"prepare.queue_time_us":72319,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":88149,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":21496,"spinlock_wait_cycles":4384640,"thread_start_us":725424,"threads_started":4,"wal-append.queue_time_us":443166}
I20260709 13:01:47.272409  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.278657  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:47.274262  1623 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:47.274899  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:47.276283  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:47.280577  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.280588  1693 raft_consensus.cc:2410] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:47.281250  1540 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:47.279868  1688 raft_consensus.cc:2410] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:47.268709  5244 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:47.306988  1689 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:47.269613  4987 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:47.281874  5203 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:47.312078  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:47.311365  1623 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:01:47.266920  5235 consensus_queue.cc:1059] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:01:47.267877  5162 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:01:47.335148  1690 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:01:47.338132  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.339087  1545 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:47.315958  4987 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:47.311465  5244 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:47.333483  5251 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:01:47.346431  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:47.350711  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 153810us
I20260709 13:01:47.353245  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:47.354104  1619 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:47.354655  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1768) took 1146 ms. Trace:
I20260709 13:01:47.355010  1619 rpcz_store.cc:276] 0709 13:01:46.208681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.208835 (+   154us) service_pool.cc:224] Handling call
0709 13:01:47.016838 (+808003us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b5800085298. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:01:47.354601 (+337763us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40715136}
I20260709 13:01:47.365797  1542 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:47.367751  1616 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:47.372437  1542 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:47.370908  2232 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:47.283964  5222 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:47.334141  5235 consensus_queue.cc:1243] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:47.340508  5214 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:47.379243  5058 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.387382  1545 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 5.
W20260709 13:01:47.388540  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.353895  5244 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:47.360114  5238 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:47.306483  5246 consensus_queue.cc:237] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:47.331519  5189 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:47.398970  1616 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:47.404744  1514 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:01:47.406522  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 141638us
I20260709 13:01:47.407703  1693 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:47.407810  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.412595  1542 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:47.416642  1688 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:47.424772  1619 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:47.403980  5249 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:47.430393  1689 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 13:01:47.475215  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 70541.3us
I20260709 13:01:47.476372  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.487913  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.500046  1542 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:47.443379  5249 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.404609  5058 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:47.405462  5260 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:01:47.484709  5263 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:47.572026  1663 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:47.572069  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2552) took 1093 ms. Trace:
I20260709 13:01:47.573652  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:47.573824  1546 rpcz_store.cc:276] 0709 13:01:46.468991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.080327 (+611336us) service_pool.cc:224] Handling call
0709 13:01:47.101369 (+ 21042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.113148 (+ 11779us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:47.280736 (+167588us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.561798 (+281062us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.561889 (+    91us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:47.561966 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.562058 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.562243 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27412,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"thread_start_us":447455,"threads_started":3}
I20260709 13:01:47.508358  5249 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:47.586215  5256 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 13:01:47.586444  5190 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 1.685s	user 0.006s	sys 0.004s
I20260709 13:01:47.583473  5109 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.588063  5271 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.587965  5109 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:47.588774  5271 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:47.592171  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.568426  4925 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:47.594782  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.592839  1540 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:47.592818  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2714) took 2263 ms. Trace:
I20260709 13:01:47.592213  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2541) took 1153 ms. Trace:
I20260709 13:01:47.602733  1546 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:47.603348  1543 rpcz_store.cc:276] 0709 13:01:46.439065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.060623 (+621558us) service_pool.cc:224] Handling call
0709 13:01:47.071764 (+ 11141us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:47.072390 (+   626us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:47.081345 (+  8955us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.231235 (+149890us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:47.259073 (+ 27838us) log.cc:844] Serialized 52 byte log entry
0709 13:01:47.259329 (+   256us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:47.259388 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.259517 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.591493 (+331976us) raft_consensus.cc:1685] finished
0709 13:01:47.591794 (+   301us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.592138 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9762,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":55,"raft.queue_time_us":4668,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":8541,"spinlock_wait_cycles":15517568,"thread_start_us":107083,"threads_started":1,"wal-append.queue_time_us":225169}
I20260709 13:01:47.628705  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.636202  5058 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:47.581719  5263 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:47.603231  1697 rpcz_store.cc:276] 0709 13:01:45.329726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.329904 (+   178us) service_pool.cc:224] Handling call
0709 13:01:45.344300 (+ 14396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:45.344836 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:45.480225 (+135389us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.705221 (+224996us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:45.714333 (+  9112us) log.cc:844] Serialized 52 byte log entry
0709 13:01:45.714510 (+   177us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:45.714562 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.714635 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.486436 (+1771801us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:47.592275 (+105839us) raft_consensus.cc:1685] finished
0709 13:01:47.592377 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.592528 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":138988,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":5064,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":14496,"spinlock_wait_cycles":239740160,"thread_start_us":307603,"threads_started":2,"wal-append.queue_time_us":314387}
I20260709 13:01:47.640065  5263 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:47.640268  5271 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:47.600214  5258 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:47.657168  1542 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:47.672145  5259 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:47.675879  5109 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:47.680635  5259 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:47.681239  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.682350  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:47.676087  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 178544us
I20260709 13:01:47.676694  4999 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.683852  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.687954  1540 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:47.689325  4999 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:47.679237  5203 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:47.696873  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.719981  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:47.788899  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 670) took 1102 ms. Trace:
I20260709 13:01:47.733402  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.734071  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:47.761438  2232 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:47.832743  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.714118  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.839138  1543 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:47.839185  1618 rpcz_store.cc:276] 0709 13:01:46.686644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.788006 (+1101362us) service_pool.cc:224] Handling call
0709 13:01:47.788353 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.788546 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.788575 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.788621 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:47.788661 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.788716 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.788839 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.762714  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:47.841603  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 236315us
W20260709 13:01:47.764829  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.843912  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.846587  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.847899  1621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1619) took 1640 ms (client timeout 1542 ms). Trace:
I20260709 13:01:47.847813  1547 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 4.
I20260709 13:01:47.664930  5258 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:47.848696  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1711) took 1378 ms. Trace:
W20260709 13:01:47.849363  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2538) took 1491 ms (client timeout 1856 ms). Trace:
W20260709 13:01:47.848433  1621 rpcz_store.cc:269] 0709 13:01:46.207554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.207672 (+   118us) service_pool.cc:224] Handling call
0709 13:01:47.733878 (+1526206us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5800085298. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:01:47.847824 (+113946us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43678080}
W20260709 13:01:47.779251  5192 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 1.825s	user 0.000s	sys 0.023s
I20260709 13:01:47.708917  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.876348  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:47.878759  1547 rpcz_store.cc:276] 0709 13:01:46.469941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.863820 (+393879us) service_pool.cc:224] Handling call
0709 13:01:47.733147 (+869327us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b5800093398. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:01:47.848642 (+115495us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118799104}
I20260709 13:01:47.884019  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:47.714716  5262 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 13:01:47.879916  1544 rpcz_store.cc:269] 0709 13:01:46.357955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.359698 (+  1743us) service_pool.cc:224] Handling call
0709 13:01:46.870287 (+510589us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b5800093398. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:01:47.762559 (+892272us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b5800093398. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19e9c 00007f5c67a19a5b 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:01:47.849277 (+ 86718us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149229056}
I20260709 13:01:47.778792  5272 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.887324  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.715310  4999 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:47.788537  5189 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:47.888868  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:47.891813  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:47.812366  4925 raft_consensus.cc:697] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:47.899158  1619 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:47.851080  5259 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:47.850814  5110 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:47.905014  1545 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:47.916997  5110 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.930287  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:47.934409  1663 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:47.928005  5110 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:47.948412  5058 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:47.950306  4925 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:47.951617  5222 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:47.958480  1587 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:47.969542  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:47.970432  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:47.904176  5272 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:47.985656  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:47.939986  5203 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:47.984277  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:47.990410  1587 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:47.967077  5058 consensus_queue.cc:1059] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:01:47.998762  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:48.003275  1663 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:47.981704  5103 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.010088  2265 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:48.010192  5264 consensus_queue.cc:1059] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:01:48.010237  5101 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:48.011371  5261 raft_consensus.cc:3055] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:48.014618  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.014452  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.001623  5222 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:48.024427  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1717) took 1531 ms (client timeout 1818 ms). Trace:
W20260709 13:01:48.024868  1541 rpcz_store.cc:269] 0709 13:01:46.492748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.013979 (+1521231us) service_pool.cc:224] Handling call
0709 13:01:48.024365 (+ 10386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:48.004824  5162 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:48.029127  5101 consensus_queue.cc:1059] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:48.031004  5203 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:48.031805  5203 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.032501  5237 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:48.038046  1588 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:48.022547  5261 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:48.010102  5276 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:48.044498  5162 raft_consensus.cc:3055] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:48.058429  5162 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:48.059778  5202 log.cc:927] Time spent T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 2.052s	user 0.003s	sys 0.011s
I20260709 13:01:48.061750  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 488) took 2377 ms. Trace:
I20260709 13:01:48.062254  1691 rpcz_store.cc:276] 0709 13:01:45.684391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.691329 (+  6938us) service_pool.cc:224] Handling call
0709 13:01:45.703709 (+ 12380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.712479 (+  8770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.712529 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:45.725637 (+ 13108us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.893447 (+167810us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:45.893566 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.893648 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.058914 (+2165266us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:48.061348 (+  2434us) raft_consensus.cc:1685] finished
0709 13:01:48.061381 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.061671 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5264,"raft.queue_time_us":137,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":47704,"spinlock_wait_cycles":3717504,"thread_start_us":96483,"threads_started":1,"wal-append.queue_time_us":176994}
I20260709 13:01:48.064324  5207 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.067787  2268 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:48.008767  5204 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:48.046200  5282 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:01:48.047657  4987 consensus_meta.cc:287] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.679s	user 0.009s	sys 0.005s
I20260709 13:01:48.048337  5231 raft_consensus.cc:3055] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:48.049453  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 761) took 1397 ms. Trace:
W20260709 13:01:48.023161  1511 connection.cc:256] RPC call timeout handler was delayed by -2.3193282860000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
I20260709 13:01:48.080291  5272 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:48.081409  5113 raft_consensus.cc:3055] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:47.977058  5258 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:48.092505  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.120596  1539 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:48.093648  5162 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:48.096721  5261 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:48.102377  1543 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
W20260709 13:01:48.056396  5244 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.647s	user 0.014s	sys 0.001s
I20260709 13:01:48.106901  1616 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:01:48.042805  5110 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.106866  2269 rpcz_store.cc:276] 0709 13:01:46.651756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.651924 (+   168us) service_pool.cc:224] Handling call
0709 13:01:46.652674 (+   750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.872784 (+220110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.049085 (+1176301us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54004d6cd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:48.049370 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320096000}
W20260709 13:01:48.095134  5280 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.156s	user 0.002s	sys 0.000s
I20260709 13:01:48.067384  5237 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:48.124712  1623 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:48.126258  1619 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:48.095695  5207 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:48.106709  5231 raft_consensus.cc:740] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:48.136221  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:48.142064  1616 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:48.122393  5113 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:48.127081  5249 consensus_meta.cc:287] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.006s
I20260709 13:01:48.143563  2267 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:48.148991  1540 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:48.106719  4987 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.133880  5203 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:48.164193  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:48.144692  5237 raft_consensus.cc:697] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:48.149516  5261 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.186714  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:48.188573  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:48.189119  5275 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:48.167644  1618 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:48.151763  5249 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.167794  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:48.169281  5286 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:01:48.170682  5237 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.171897  5113 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.176847  5103 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:48.173686  5110 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:48.180451  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:48.172508  5231 consensus_queue.cc:260] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:48.183216  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:48.183938  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:48.184096  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:48.184540  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 669) took 1498 ms. Trace:
I20260709 13:01:48.186077  2269 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:48.201221  1543 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:48.190264  4959 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:48.132833  5244 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:48.194183  1539 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:48.186126  2232 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:48.201340  1617 rpcz_store.cc:276] 0709 13:01:46.686376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.183665 (+1497289us) service_pool.cc:224] Handling call
0709 13:01:48.183991 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.184181 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.184208 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:48.184250 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:48.184283 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.184340 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.184469 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:48.204615  4959 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:48.204847  4869 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:48.205327  4869 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.205725  4869 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.206836  1544 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:48.207907  1621 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:48.208655  2270 raft_consensus.cc:2368] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8.
I20260709 13:01:48.208734  5231 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:48.197656  5109 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:01:48.210069  5109 raft_consensus.cc:3055] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:48.210443  5109 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:48.211522  5109 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.212366  5113 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.213160  5109 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:48.200007  5222 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:01:48.216399  5230 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:48.173543  4987 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:48.198453  5203 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:01:48.196889  5126 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:01:48.208905  5249 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:48.225498  5244 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:48.229228  1543 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:48.230227  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:48.210464  2232 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:48.239781  5110 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:48.240370  5110 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.240783  5110 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:48.240598  5249 consensus_queue.cc:1059] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:48.238216  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:48.242838  1615 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:48.243371  2232 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:48.257650  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 139406us
W20260709 13:01:48.258250  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.270582  1511 connection.cc:256] RPC call timeout handler was delayed by -2.0455203059999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 13:01:48.259730  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 74401.5us
W20260709 13:01:48.271575  1511 connection.cc:256] RPC call timeout handler was delayed by -1.8585867409999537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3254s for a response
W20260709 13:01:48.272869  1511 connection.cc:256] RPC call timeout handler was delayed by -1.6855203060000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
I20260709 13:01:48.249291  4925 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:48.273371  1511 connection.cc:256] RPC call timeout handler was delayed by -1.5145203059999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
I20260709 13:01:48.273931  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:48.276093  1543 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:48.273913  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 249021us
I20260709 13:01:48.258534  5126 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:48.268549  5253 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.006s	sys 0.015s
I20260709 13:01:48.250370  5272 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:01:48.296067  1663 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:48.287129  5204 consensus_queue.cc:1059] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:01:48.280182  5261 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.318928  4929 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:48.296052  5187 consensus_queue.cc:1059] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 13:01:48.320672  5252 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 1.106s	user 0.005s	sys 0.000s
W20260709 13:01:48.281399  5253 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.007s	sys 0.016s
I20260709 13:01:48.274844  5203 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:01:48.330376  1543 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
W20260709 13:01:48.334209  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 53480.1us
I20260709 13:01:48.300145  5058 raft_consensus.cc:3055] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:48.324010  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.287201  5264 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:01:48.287225  5258 consensus_queue.cc:1059] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:01:48.279527  4925 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:48.306082  5126 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:48.346176  1615 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
W20260709 13:01:48.342761  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.291561  4869 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.355949  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 646) took 1341 ms. Trace:
I20260709 13:01:48.354024  1511 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:48.359731  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:48.378561  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.367529  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.369539  2272 raft_consensus.cc:1240] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:48.367489  2264 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:01:48.375767  2266 rpcz_store.cc:276] 0709 13:01:47.014096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.014241 (+   145us) service_pool.cc:224] Handling call
0709 13:01:47.014692 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.015580 (+   888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.015615 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.016255 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.079907 (+ 63652us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:47.079969 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.080073 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.320014 (+1239941us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:48.355509 (+ 35495us) raft_consensus.cc:1685] finished
0709 13:01:48.355544 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.355848 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":380,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":118,"spinlock_wait_cycles":3125504,"thread_start_us":61484,"threads_started":1,"wal-append.queue_time_us":146707}
I20260709 13:01:48.348511  2232 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:48.392421  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 44035us
W20260709 13:01:48.352267  5257 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.972s	user 0.000s	sys 0.003s
W20260709 13:01:48.409376  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 55416.4us
I20260709 13:01:48.401026  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:48.364305  5292 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:01:48.404942  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:48.414399  1547 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:48.405313  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 83594us
I20260709 13:01:48.363260  5203 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:48.348286  5058 raft_consensus.cc:740] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:48.362674  4925 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:48.370503  4869 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:48.338672  5261 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.409473  5073 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:48.356191  5249 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:01:48.356366  4999 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:01:48.373997  5126 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.353616  5268 consensus_queue.cc:1059] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:01:48.395872  5238 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.470999  1511 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:48.347533  5293 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:48.446033  5185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.005s	sys 0.021s
I20260709 13:01:48.398274  4959 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:48.421123  5203 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:48.434347  5258 consensus_queue.cc:1243] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:48.511225  5264 consensus_queue.cc:1059] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:48.354928  5283 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:01:48.516691  5289 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:48.502348  5307 consensus_queue.cc:1059] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:01:48.522428  5203 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.524250  5203 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:48.499795  5293 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:48.510336  5185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.005s	sys 0.022s
I20260709 13:01:48.541271  5293 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:48.534687  5110 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.543293  5110 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:48.543635  5307 consensus_queue.cc:1243] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:48.536836  5289 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:48.540705  5308 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:48.544517  4959 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:48.503692  5073 raft_consensus.cc:697] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:48.546247  5073 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.550002  1514 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:01:48.555022  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.556951  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 178069us
W20260709 13:01:48.565456  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 94538.3us
I20260709 13:01:48.570029  1661 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:48.572158  1511 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:48.551848  5261 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:48.510648  5238 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:48.550448  5258 consensus_queue.cc:1059] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:01:48.562633  5278 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:48.501603  5058 consensus_queue.cc:260] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:48.580621  1661 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:48.567240  5185 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.571199  2263 raft_consensus.cc:1240] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:01:48.575774  5255 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 1.118s	user 0.004s	sys 0.001s
I20260709 13:01:48.564162  5268 consensus_queue.cc:1059] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 13:01:48.629853  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 63287.5us
W20260709 13:01:48.628646  5301 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.209s	user 0.000s	sys 0.002s
I20260709 13:01:48.646845  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.648234  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:48.632236  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.632992  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 52486.7us
I20260709 13:01:48.643738  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:48.644392  5261 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:48.645370  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.645629  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.651154  1543 raft_consensus.cc:2393] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:48.651455  1545 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:48.598480  5307 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:48.654785  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:48.652356  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:48.653266  1541 raft_consensus.cc:2368] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8.
W20260709 13:01:48.648793  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.659793  1539 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:48.659835  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.632889  5278 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:48.665032  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.665865  1543 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:48.673561  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:48.682008  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:48.683336  1546 raft_consensus.cc:2368] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9.
I20260709 13:01:48.684211  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.685173  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.685088  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:48.686529  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.687139  1539 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:48.599915  5185 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:48.688464  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.690014  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:48.664366  5278 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:48.643579  5309 consensus_queue.cc:1059] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:01:48.695271  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.697336  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.702674  1545 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:48.703709  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:48.687582  5162 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:48.705487  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:48.692451  5268 raft_consensus.cc:3055] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:48.704507  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:48.709264  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 402023us
I20260709 13:01:48.704254  1546 raft_consensus.cc:2376] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8. Re-sending same reply.
I20260709 13:01:48.683238  5261 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:48.683079  5307 raft_consensus.cc:697] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:48.696519  5278 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:48.714087  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:48.719262  1545 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:48.713126  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:48.811825  1543 raft_consensus.cc:2376] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6. Re-sending same reply.
W20260709 13:01:48.818369  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.691350  5101 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:48.743943  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.803995  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:48.689669  5312 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:48.711956  5058 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.716106  1539 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:48.721309  5314 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:48.827102  5185 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:48.828015  1546 raft_consensus.cc:2393] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:48.719000  5268 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:48.721629  5309 consensus_queue.cc:1243] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:48.832414  1543 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:48.834065  1541 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:48.835341  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2536) took 2478 ms. Trace:
I20260709 13:01:48.838380  1548 rpcz_store.cc:276] 0709 13:01:46.357053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.031665 (+674612us) service_pool.cc:224] Handling call
0709 13:01:47.032007 (+   342us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:47.043985 (+ 11978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.044019 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:47.074831 (+ 30812us) log.cc:844] Serialized 78 byte log entry
0709 13:01:47.215659 (+140828us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:47.215697 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.215761 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.398245 (+1182484us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:01:48.827585 (+429340us) raft_consensus.cc:1685] finished
0709 13:01:48.827609 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.835269 (+  7660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11280,"raft.queue_time_us":17030,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":10056,"spinlock_wait_cycles":16348032,"thread_start_us":101816,"threads_started":1,"wal-append.queue_time_us":232438}
I20260709 13:01:48.712249  5310 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.131s
I20260709 13:01:48.846184  1547 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:48.859943  1546 raft_consensus.cc:1240] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:48.807171  5308 consensus_queue.cc:1059] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:01:48.806671  5261 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:48.891258  1545 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
W20260709 13:01:48.848239  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 160709us
I20260709 13:01:48.840708  5309 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:48.913404  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:48.914808  1694 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:48.921595  1694 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:48.873394  5312 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.937999  1692 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:48.939253  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:48.946772  1690 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
W20260709 13:01:48.951664  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.841044  5185 consensus_queue.cc:1059] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:01:48.979404  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:48.981056  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.017930  1693 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:49.021641  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 648688us
I20260709 13:01:48.911844  5308 raft_consensus.cc:3055] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:49.017043  1689 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:49.046842  1545 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:49.049541  1692 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:01:49.061861  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 503586us
I20260709 13:01:48.927040  5309 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.084805  2232 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:49.089990  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.090837  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:49.094038  1616 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:49.098488  1588 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:49.049558  5308 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:49.111354  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 390503us
I20260709 13:01:49.114130  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:49.118656  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:48.971514  5312 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:49.109671  4389 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:49.110046  5231 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:48.966991  5268 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.126196  5167 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.052145  5307 consensus_queue.cc:237] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.152130  4389 raft_consensus.cc:697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:49.126498  5276 consensus_queue.cc:1059] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:01:49.181654  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:49.183336  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.169639  5167 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:49.185277  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:49.191386  5318 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.366s	user 0.002s	sys 0.000s
I20260709 13:01:49.222383  4389 consensus_queue.cc:237] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:49.222800  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:49.223387  5258 consensus_queue.cc:1059] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:49.201432  5310 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:49.217247  5261 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:49.193169  5308 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.229151  5312 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:49.229868  5319 log.cc:927] Time spent T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:01:49.236305  5268 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:49.242120  5204 raft_consensus.cc:3055] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:49.243693  5187 raft_consensus.cc:3055] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:49.244127  5187 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:49.245558  5187 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.246583  5187 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:49.247820  5309 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:49.248780  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:49.249475  1661 connection.cc:256] RPC call timeout handler was delayed by -1.0333675620000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 13:01:49.250021  1661 leader_election.cc:336] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.596s (SENT)
I20260709 13:01:49.250373  1661 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:49.235771  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:49.254840  1696 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:49.267053  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.242980  5204 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:49.278142  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:49.279009  1540 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:49.318346  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 68343.4us
W20260709 13:01:49.319495  1661 leader_election.cc:336] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.717s (SENT)
I20260709 13:01:49.320044  1661 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:49.316224  5325 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:49.346346  1661 leader_election.cc:336] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.818s (SENT)
I20260709 13:01:49.336959  1540 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:49.346899  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:49.364634  1661 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:49.366642  5167 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:49.369669  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:49.370445  5162 consensus_meta.cc:287] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.000s
I20260709 13:01:49.370815  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:49.372408  5306 raft_consensus.cc:3055] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:49.372812  5306 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:49.373600  5306 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.371353  1694 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:49.346202  5323 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:49.374548  5293 consensus_meta.cc:287] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.833s	user 0.013s	sys 0.000s
I20260709 13:01:49.390637  5136 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:49.393237  5058 consensus_meta.cc:287] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 13:01:49.379932  5325 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:49.404263  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:49.407373  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.416501  1661 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:49.417893  1586 leader_election.cc:336] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.734s (SENT)
W20260709 13:01:49.419035  1586 leader_election.cc:336] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.769s (SENT)
I20260709 13:01:49.419688  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:49.423442  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:49.424342  1540 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:49.436574  1694 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:49.443356  1661 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:49.414192  5162 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:49.385380  5204 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.448818  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:49.441488  5314 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:49.455750  1694 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:49.461093  1661 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:49.396585  5293 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:49.441413  4941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.008s	sys 0.002s
I20260709 13:01:49.452250  5323 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:49.452334  5162 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:49.482477  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 772) took 1293 ms. Trace:
I20260709 13:01:49.482923  2270 rpcz_store.cc:276] 0709 13:01:48.185981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.186489 (+   508us) service_pool.cc:224] Handling call
0709 13:01:49.478817 (+1292328us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b54005a0354. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:49.478987 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48570112}
W20260709 13:01:49.487911  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 364584us
W20260709 13:01:49.493986  1511 connection.cc:256] RPC call timeout handler was delayed by -1.2965090750000172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2735s for a response
W20260709 13:01:49.494650  1511 leader_election.cc:336] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.541s (SENT)
W20260709 13:01:49.468529  4941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.008s	sys 0.002s
I20260709 13:01:49.497484  1663 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:49.499068  1688 raft_consensus.cc:1217] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Deduplicated request from leader. Original: 9.9->[11.10-11.10]   Dedup: 11.10->[]
I20260709 13:01:49.499686  1688 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:49.485908  5162 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:49.503866  5276 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.505590  1694 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
W20260709 13:01:49.505816  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 86923.5us
I20260709 13:01:49.506451  1692 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:49.517005  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.523984  1586 leader_election.cc:336] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.856s (SENT)
I20260709 13:01:49.525522  1694 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:49.494542  5204 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:49.536422  5351 raft_consensus.cc:3055] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:01:49.557175  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 57897.3us
I20260709 13:01:49.537425  5203 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.559974  5334 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 13:01:49.561625  1511 leader_election.cc:336] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.712s (SENT)
I20260709 13:01:49.562731  1511 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:49.567368  1696 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
W20260709 13:01:49.582294  1511 leader_election.cc:336] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.093s (SENT)
I20260709 13:01:49.583149  1511 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:49.555099  5348 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:49.527207  5276 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.587285  5276 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:49.558784  5351 raft_consensus.cc:740] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:49.600457  5356 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:49.571208  5355 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:49.612686  5351 consensus_queue.cc:260] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:49.613622  5336 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:49.616252  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:49.617250  1548 raft_consensus.cc:2393] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:49.625173  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:49.625934  1545 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:49.626662  1547 raft_consensus.cc:1217] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Deduplicated request from leader. Original: 4.3->[7.4-7.4]   Dedup: 7.4->[]
I20260709 13:01:49.627161  1547 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:49.628739  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:49.614066  5356 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:49.590305  5358 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:01:49.567940  5203 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.641126  4925 raft_consensus.cc:3055] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:49.618049  5348 consensus_queue.cc:1059] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:01:49.642057  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2563) took 1002 ms. Trace:
I20260709 13:01:49.642881  5348 raft_consensus.cc:3055] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:49.643527  5348 raft_consensus.cc:740] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:49.641633  4925 raft_consensus.cc:740] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:49.619758  5336 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.642529  1546 rpcz_store.cc:276] 0709 13:01:48.639257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.833177 (+193920us) service_pool.cc:224] Handling call
0709 13:01:48.859370 (+ 26193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.877827 (+ 18457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.641651 (+763824us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b54003b4a50. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:49.641963 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59263360}
W20260709 13:01:49.649909  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.649603  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:49.652077  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:49.639457  5350 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.002s
I20260709 13:01:49.637900  5351 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:49.604610  5343 consensus_queue.cc:1059] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:01:49.663282  5338 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:01:49.664127  5349 log.cc:927] Time spent T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:01:49.668035  4925 consensus_queue.cc:260] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.640318  5356 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:49.644523  5348 consensus_queue.cc:260] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:49.680370  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 87479us
W20260709 13:01:49.691506  5340 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.150s	user 0.000s	sys 0.002s
I20260709 13:01:49.648509  5293 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:49.694585  1586 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:49.699311  5355 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.676905  5231 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:01:49.695564  5278 consensus_meta.cc:287] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.868s	user 0.009s	sys 0.007s
I20260709 13:01:49.704210  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:49.706295  5348 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:49.708945  5343 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:49.709210  4925 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:49.699882  5355 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.738834  5356 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:49.745240  5316 raft_consensus.cc:3055] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:49.745769  5316 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:49.746680  5316 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.709115  5278 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.752801  1542 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:49.752857  5316 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:49.753940  5278 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:49.755860  5355 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:49.761123  5361 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:49.764292  5238 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:49.725494  5363 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:49.770458  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 59542.3us
I20260709 13:01:49.774026  5203 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:49.774761  5363 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.775205  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 314169us
I20260709 13:01:49.775049  5314 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:49.775712  5363 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:49.777140  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 279750us
I20260709 13:01:49.777493  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:49.776026  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:49.778091  1511 leader_election.cc:336] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.551s (SENT)
I20260709 13:01:49.778252  1544 raft_consensus.cc:2368] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6.
I20260709 13:01:49.779210  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2566) took 1139 ms. Trace:
I20260709 13:01:49.779525  1544 rpcz_store.cc:276] 0709 13:01:48.640172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.645183 (+  5011us) service_pool.cc:224] Handling call
0709 13:01:49.775142 (+1129959us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b5800093398. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:01:49.779150 (+  4008us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4908288}
I20260709 13:01:49.780644  5325 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:49.774812  5058 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:49.782662  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.783499  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.785912  5354 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.786439  5354 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.790946  5354 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:49.779028  5203 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:49.766494  5231 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:49.769675  5162 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:49.796366  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.785828  5363 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:49.792147  5351 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:49.801882  5321 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.697s	user 0.004s	sys 0.000s
I20260709 13:01:49.801944  5314 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:49.802749  5314 consensus_queue.cc:1059] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:49.803464  5314 consensus_queue.cc:1243] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:49.804513  5314 raft_consensus.cc:3055] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:49.805055  5314 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:49.801578  1661 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:49.811496  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.815924  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.801687  5351 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:49.820178  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.821056  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.821309  1697 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:49.820214  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:49.823562  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 45500.1us
I20260709 13:01:49.825147  5351 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:49.806226  5203 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:49.826611  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.827615  1692 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:01:49.828778  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.834408  1688 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:49.841188  1661 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:49.845517  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.848466  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:49.849206  1541 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:49.850278  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:49.850358  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.854223  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:49.852077  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.852845  1688 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:49.827283  5203 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:49.855608  1544 raft_consensus.cc:2410] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:49.858634  1697 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:01:49.860006  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:49.860487  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.854240  5325 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:49.867573  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.868008  5325 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.868434  5325 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:49.869261  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.870401  1696 raft_consensus.cc:2410] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:49.873953  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.874876  1692 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:01:49.875339  1692 pending_rounds.cc:85] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 7
I20260709 13:01:49.875730  1692 pending_rounds.cc:107] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:49.876086  1692 raft_consensus.cc:2889] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:49.876432  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.877341  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.878249  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.881047  5336 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:49.884828  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 461411us
I20260709 13:01:49.886351  2232 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:49.884694  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 646397us
I20260709 13:01:49.887383  2232 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:49.888571  5344 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:49.902305  5344 raft_consensus.cc:697] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:49.903177  5344 consensus_queue.cc:237] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:49.854308  5354 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:49.905591  5361 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:49.890316  4389 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.906383  4389 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:49.850937  5355 consensus_queue.cc:1059] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:01:49.907686  5355 raft_consensus.cc:3055] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:49.908039  5355 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:49.893844  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:49.908989  2272 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:49.909065  5355 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.898202  4925 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:49.894053  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 776) took 1643 ms. Trace:
I20260709 13:01:49.910679  5204 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.910588  4925 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:49.911226  5204 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.911725  5278 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:49.912271  5278 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:49.913009  4925 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:49.913184  5204 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:49.913739  5204 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:49.805886  5314 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.914916  5314 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:49.915400  5358 raft_consensus.cc:3055] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:49.915824  5358 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:49.897594  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2558) took 1259 ms. Trace:
I20260709 13:01:49.916709  5358 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.917590  1542 rpcz_store.cc:276] 0709 13:01:48.637750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.637926 (+   176us) service_pool.cc:224] Handling call
0709 13:01:48.646451 (+  8525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.753310 (+1106859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.897346 (+144036us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000c6a54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:49.897531 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543910784}
I20260709 13:01:49.918031  5358 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.920074  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:49.921375  1548 raft_consensus.cc:2393] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:49.893249  5260 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:49.923344  5260 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:49.925204  5306 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:49.900830  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:49.931074  1513 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:49.933110  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:49.933555  5289 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:49.934182  5289 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:49.934758  5289 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:49.952279  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 522) took 1016 ms. Trace:
W20260709 13:01:49.957803  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.960956  1586 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.107.190:37205, user_credentials={real_user=slave}} blocked reactor thread for 103153us
I20260709 13:01:49.963598  5276 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.964315  5276 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.967738  4959 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.968385  4959 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:49.910624  2263 rpcz_store.cc:276] 0709 13:01:48.250469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.257457 (+  6988us) service_pool.cc:224] Handling call
0709 13:01:48.304536 (+ 47079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.628779 (+324243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.893764 (+1264985us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b5400544554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:49.893983 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565976320}
I20260709 13:01:49.972642  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:49.973424  1544 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:49.973888  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:49.974690  1548 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:49.987835  5355 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:49.963037  1586 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:49.995793  5203 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:49.996783  1661 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:49.997370  5283 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:49.998021  5283 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:49.999166  2297 heartbeater.cc:646] Failed to heartbeat to 127.0.107.190:37205 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.190:37205 timed out after 15.000s (SENT)
I20260709 13:01:50.000299  5283 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:50.001116  5320 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:50.001194  2231 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:50.001591  5320 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.001974  5320 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.002213  5308 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:50.002743  5275 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:50.003137  5275 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:50.003561  5275 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.010511  4959 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:50.012825  5276 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:50.013670  5204 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.014582  5275 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.016544  5260 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:50.016916  5204 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:50.023559  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.024222  1587 connection.cc:256] RPC call timeout handler was delayed by -1.0970540819999428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
I20260709 13:01:49.877940  1692 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
W20260709 13:01:50.025162  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 62267.3us
W20260709 13:01:50.028137  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 140809us
W20260709 13:01:50.025663  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.030272  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:50.031356  1542 raft_consensus.cc:2410] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:49.995821  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.034632  5336 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:50.034777  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:50.035720  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:50.059525  5336 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.035889  1543 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:50.036477  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.028455  1586 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:50.061318  5276 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:50.061787  5336 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:50.061842  5276 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.062918  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.059087  1621 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:01:50.066035  1621 pending_rounds.cc:85] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 8
I20260709 13:01:50.066284  1621 pending_rounds.cc:107] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:01:50.066772  1621 raft_consensus.cc:2889] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:50.074582  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 46192.2us
I20260709 13:01:50.042562  5162 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:50.044463  5283 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:49.952914  1695 rpcz_store.cc:276] 0709 13:01:48.936365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.936486 (+   121us) service_pool.cc:224] Handling call
0709 13:01:48.936848 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.468741 (+531893us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:49.487434 (+ 18693us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.784031 (+296597us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.784545 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.784698 (+   153us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:49.784731 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.882457 (+ 97726us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54001293d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:49.882502 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.919063 (+ 36561us) raft_consensus.cc:1685] finished
0709 13:01:49.919348 (+   285us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.952182 (+ 32834us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197003,"prepare.queue_time_us":55541,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":244869,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":167,"spinlock_wait_cycles":558000512,"thread_start_us":347372,"threads_started":2,"wal-append.queue_time_us":150381}
W20260709 13:01:50.048496  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.089323  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.029263  1689 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:50.037448  1688 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:50.092104  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.056555  1511 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:50.057518  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.055759  4925 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:50.106350  1621 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:01:50.090109  1695 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:50.079392  1586 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:50.081817  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.105005  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:50.113612  1586 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:50.110930  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 54461.2us
I20260709 13:01:50.115769  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.117427  1620 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:01:50.117807  1620 pending_rounds.cc:85] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 9
I20260709 13:01:50.118032  1620 pending_rounds.cc:107] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:01:50.118268  1620 raft_consensus.cc:2889] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:50.119961  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:50.121403  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:50.120980  5363 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:01:50.126042  5367 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:50.127032  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:50.129662  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:50.129379  1618 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:01:50.132640  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:50.089211  5203 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:50.139855  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:50.138867  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:50.142560  1619 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:50.142761  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.087670  5283 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.127799  5367 raft_consensus.cc:697] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:50.143671  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:50.112214  5336 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:50.153697  1696 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:50.158198  5238 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.168789  5238 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.169658  1619 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:50.119097  5351 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:50.160048  1688 raft_consensus.cc:2393] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:50.148356  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:50.173960  1618 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:01:50.176353  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.176771  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:50.177742  1618 raft_consensus.cc:2410] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:50.139497  5276 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:50.179566  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:50.182272  1619 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:50.183935  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.184749  1688 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:50.185621  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.162487  5283 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:50.189376  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:50.189515  1619 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:50.119222  4925 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.191229  1616 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.191037  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.186398  1689 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:50.196991  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:50.139447  4929 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:01:50.222005  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:50.197180  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.178118  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.166674  4389 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:50.141727  5356 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:01:50.199769  1618 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:50.223651  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:50.223946  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:50.224205  1696 raft_consensus.cc:2393] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:01:50.199605  1446 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33072 (request call id 134) took 15695 ms (client timeout 15000 ms). Trace:
I20260709 13:01:50.174444  5238 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:50.229640  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:50.243721  1617 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
W20260709 13:01:50.244033  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 138055us
I20260709 13:01:50.174011  5203 raft_consensus.cc:697] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:01:50.237249  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.242689  1616 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:50.172026  5333 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:01:50.251690  4929 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.252261  5333 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:50.253014  5371 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.252804  5333 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.253491  5371 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.199198  5351 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:50.268877  1587 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:50.278333  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 165595us
I20260709 13:01:50.279423  1689 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
W20260709 13:01:50.281198  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.284690  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.285480  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.286449  1689 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:50.288334  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.290138  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.291150  1689 raft_consensus.cc:2393] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:01:50.227470  1446 rpcz_store.cc:269] 0709 13:01:34.505835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.538655 (+ 32820us) service_pool.cc:224] Handling call
0709 13:01:50.199532 (+15660877us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:45.743867 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:45.744528 (+   661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:45.744589 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:01:45.744615 (+    26us) tablet.cc:662] Decoding operations
0709 13:01:45.745960 (+  1345us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:45.746069 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:45.746102 (+    33us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:01:45.763818 (+ 17716us) tablet.cc:701] Row locks acquired
0709 13:01:45.785729 (+ 21911us) write_op.cc:260] PREPARE: finished
0709 13:01:45.842603 (+ 56874us) write_op.cc:270] Start()
0709 13:01:45.871253 (+ 28650us) write_op.cc:276] Timestamp: P: 1783602105820053 usec, L: 0
0709 13:01:45.875105 (+  3852us) op_driver.cc:348] REPLICATION: starting
0709 13:01:45.976038 (+100933us) log.cc:844] Serialized 5196 byte log entry
0709 13:01:46.499887 (+523849us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c67a340ac 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b
0709 13:01:47.312499 (+812612us) op_driver.cc:464] REPLICATION: finished
0709 13:01:48.239823 (+927324us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c67a340ac 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6e574ef0
0709 13:01:48.336872 (+ 97049us) write_op.cc:301] APPLY: starting
0709 13:01:48.339456 (+  2584us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:48.339803 (+   347us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:48.339843 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:48.511123 (+171280us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:48.511560 (+   437us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:01:48.511611 (+    51us) write_op.cc:312] APPLY: finished
0709 13:01:48.512001 (+   390us) log.cc:844] Serialized 95 byte log entry
0709 13:01:48.579753 (+ 67752us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:48.622339 (+ 42586us) write_op.cc:454] Released schema lock
0709 13:01:48.653518 (+ 31179us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:48.713694 (+ 60176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:48.735930 (+ 22236us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4262906,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":948802,"apply.run_cpu_time_us":29792,"apply.run_wall_time_us":390036,"num_ops":13,"prepare.queue_time_us":434648,"prepare.run_cpu_time_us":18183,"prepare.run_wall_time_us":921926,"raft.queue_time_us":189444,"raft.run_cpu_time_us":24651,"raft.run_wall_time_us":1083533,"replication_time_us":1399140,"spinlock_wait_cycles":22890624,"thread_start_us":1962405,"threads_started":5,"wal-append.queue_time_us":778987,"wal-append.run_cpu_time_us":82831,"wal-append.run_wall_time_us":2642473}]]}
I20260709 13:01:50.293537  1587 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:50.346195  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 52736.8us
I20260709 13:01:50.347627  1587 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:50.280151  5371 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:50.358671  1587 leader_election.cc:400] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8.
I20260709 13:01:50.386425  1587 leader_election.cc:403] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:50.381773  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.292964  5348 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:50.389102  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:50.388389  1689 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:01:50.252272  4929 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:50.394191  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.401324  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:50.402098  1540 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:01:50.383044  5278 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:50.292626  5325 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:50.394939  5348 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.245435  5367 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:50.391191  5275 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:50.398783  5238 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:50.299185  5320 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:50.424666  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.414196  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.393875  5333 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:50.399487  5366 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:50.436234  1587 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:50.437016  1697 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:50.419435  5354 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:50.426946  5348 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.459739  1692 raft_consensus.cc:2368] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:01:50.427034  5162 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:50.438967  5368 log.cc:927] Time spent T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:01:50.426640  5238 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:50.437502  5276 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8.
W20260709 13:01:50.468865  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 43771us
I20260709 13:01:50.472684  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:50.480743  1541 consensus_meta.cc:287] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.631s	user 0.007s	sys 0.005s
W20260709 13:01:50.468667  5314 consensus_meta.cc:287] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.004s
I20260709 13:01:50.472066  5258 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:50.479751  1695 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:50.421720  5203 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:50.493665  1690 raft_consensus.cc:2410] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:50.424046  5351 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:50.481218  1541 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:50.465965  5162 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.470345  2263 raft_consensus.cc:2393] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:50.468148  5238 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:50.500447  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 80299us
I20260709 13:01:50.503394  2232 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:50.482698  5276 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:50.489743  1587 leader_election.cc:400] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9.
I20260709 13:01:50.468447  5381 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:50.456080  5354 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.515944  1587 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:50.518392  5369 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:01:50.519037  5370 log.cc:927] Time spent T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:01:50.518498  5375 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:50.520666  5354 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:50.521448  5382 log.cc:927] Time spent T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:01:50.521572  5320 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:50.522019  1541 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:50.522850  5314 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:50.524336  5358 consensus_meta.cc:287] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.606s	user 0.017s	sys 0.000s
I20260709 13:01:50.525528  5325 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:50.494566  4925 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:50.498095  5366 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:50.539840  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.547487  1587 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:50.494921  5258 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:50.553401  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 239048us
I20260709 13:01:50.545349  5375 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.574177  5388 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:50.574887  5388 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:50.575306  5388 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:50.565975  5366 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:50.579260  5366 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:50.590246  5308 consensus_meta.cc:287] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.587s	user 0.005s	sys 0.004s
I20260709 13:01:50.587237  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:50.559947  5354 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:50.591403  1694 raft_consensus.cc:2410] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:01:50.591740  5354 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.593998  5354 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:50.562227  5314 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.594574  5366 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:50.590924  5388 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:50.597709  5348 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:50.598249  5358 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:50.601049  5358 raft_consensus.cc:697] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:50.601930  5358 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:50.603502  5373 log.cc:927] Time spent T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.200s	user 0.000s	sys 0.002s
I20260709 13:01:50.604674  5375 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.607089  5348 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:50.608736  5258 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:50.609371  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.565577  5320 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:50.599252  1587 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:50.599546  5366 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:50.610378  5320 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:50.612957  5320 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:50.558269  5381 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.613515  5366 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:50.615069  5388 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:50.616776  1587 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:50.623988  5355 consensus_meta.cc:287] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.000s
I20260709 13:01:50.563719  4929 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:50.649152  4929 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:50.649641  4929 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:50.656253  4929 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:50.630415  5369 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:50.631677  5162 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:50.632108  1696 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:50.596196  5314 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:50.640818  5306 consensus_meta.cc:287] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.010s
I20260709 13:01:50.642496  2231 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:50.643349  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 76076.1us
I20260709 13:01:50.597785  5385 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:01:50.645166  5344 consensus_queue.cc:1059] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:01:50.629868  5289 consensus_meta.cc:287] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.000s
I20260709 13:01:50.676860  1688 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:50.679149  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:50.680346  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.703272  1697 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:50.688741  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:50.696277  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 79662.1us
I20260709 13:01:50.705539  1587 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:50.708127  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:50.708179  1693 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:50.715502  5289 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.718477  5289 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:50.719151  5378 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:50.720569  5203 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:50.721406  5203 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:50.722651  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.045s	sys 0.047s
W20260709 13:01:50.723021  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.045s	sys 0.047s
W20260709 13:01:50.723306  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 559420us
I20260709 13:01:50.726069  1543 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:01:50.726770  5388 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:50.728178  5381 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:50.702539  5345 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:50.729074  5345 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.729434  5345 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:50.732153  5283 consensus_meta.cc:287] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.004s
I20260709 13:01:50.732963  5283 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.737468  1661 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:50.743508  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.751986  5306 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:50.752642  5306 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:50.753504  5306 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:50.755013  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.800002  1693 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
W20260709 13:01:50.747993  1511 leader_election.cc:336] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 2.481s (SENT)
I20260709 13:01:50.757035  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:50.759701  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:50.766332  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.767086  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:50.804872  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 56908.6us
W20260709 13:01:50.805963  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.805757  5381 consensus_queue.cc:1059] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:50.806535  5336 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.806813  5381 raft_consensus.cc:3055] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:50.767345  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:50.767822  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.769315  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.769574  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.808054  1541 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:50.808555  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:50.809090  1542 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:50.809834  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:50.770776  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.811100  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:50.811702  1547 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:50.771483  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.772365  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:50.772528  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 63380us
I20260709 13:01:50.775660  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:50.694798  5363 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:50.739645  5351 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.781508  5231 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.783396  5238 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:50.784786  5391 raft_consensus.cc:3055] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:50.785506  5289 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.788723  5375 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.815837  1690 raft_consensus.cc:2393] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:50.817929  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:50.880805  1616 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:50.818248  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:50.819901  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:50.825109  1621 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:50.825192  2271 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:50.826164  1511 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:50.819298  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:50.882212  1542 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:50.882809  1548 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.829702  2269 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:50.884675  2270 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:50.732205  1587 leader_election.cc:400] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 5 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 5. Current term is 6.
W20260709 13:01:50.846329  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.885641  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.846796  1688 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:50.862457  1545 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:50.886466  2234 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:50.863540  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:50.865063  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:50.865218  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.862480  5391 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:50.866230  5231 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.868814  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.869107  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.869927  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.847642  4389 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.767015  1441 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 4 to 6, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 6 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.827746  5381 raft_consensus.cc:740] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:50.874953  1618 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:01:50.826032  5307 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:50.916640  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 90536.4us
I20260709 13:01:50.899654  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.917503  1511 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:50.918335  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:50.899184  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:50.918952  1539 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:50.904248  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.922883  1588 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:01:50.864621  5259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.010s	sys 0.005s
I20260709 13:01:50.912238  1618 pending_rounds.cc:85] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 9
I20260709 13:01:50.941227  1618 pending_rounds.cc:107] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:01:50.941556  1618 raft_consensus.cc:2889] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:50.871351  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:50.873910  5283 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:50.847493  5355 consensus_queue.cc:1059] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:01:50.806995  5336 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:50.944705  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 212614us
I20260709 13:01:50.946587  1617 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:01:50.952782  1617 pending_rounds.cc:85] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 6
I20260709 13:01:50.953023  1617 pending_rounds.cc:107] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:01:50.953267  1617 raft_consensus.cc:2889] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:50.940521  1511 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:50.847596  5388 consensus_queue.cc:1059] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:01:50.900599  5374 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:50.857488  4929 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 13:01:50.941131  5259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.013s	sys 0.005s
I20260709 13:01:50.862053  5351 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:50.944367  5314 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.943387  5379 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:50.967238  1548 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:01:50.952095  5307 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.900453  5275 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:01:50.884071  5289 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:50.947906  5377 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:50.938737  5363 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:01:50.985683  1539 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:01:50.936852  4959 consensus_queue.cc:1059] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:01:51.005270  5375 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:50.936879  4389 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:51.018155  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.020795  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:51.021467  1688 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.961022  5374 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:50.971493  5355 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:51.023634  2232 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:51.009895  1441 catalog_manager.cc:5697] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 4 to 5, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 5 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.030217  1688 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:01:51.031601  5310 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.032148  5310 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:51.033922  1441 catalog_manager.cc:5697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 4 to 5, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 5 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.034912  5377 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:51.039745  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 117002us
I20260709 13:01:51.042610  2234 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:51.039347  2231 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:51.051334  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.052959  2234 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:51.053876  1541 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:51.001564  5162 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.057878  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:51.061056  1539 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.034444  5310 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:50.979429  5314 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:51.022396  5374 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:51.090235  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.047084  5344 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:51.051369  5276 raft_consensus.cc:3055] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:51.074359  5404 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:01:51.059062  5260 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:51.058066  5386 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:51.069029  5355 raft_consensus.cc:697] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:51.068246  5375 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:51.051017  5363 consensus_queue.cc:1059] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:01:50.971872  5391 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:51.014468  5381 consensus_queue.cc:260] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:51.159205  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 200719us
W20260709 13:01:51.160199  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 219719us
I20260709 13:01:51.068048  5383 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:01:51.162643  1539 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:01:51.141810  5276 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:51.150547  5310 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.036065  5377 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:51.071847  5162 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:51.177767  1511 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:51.077786  5345 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:51.193135  5397 log.cc:927] Time spent T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:51.195305  5345 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:51.166236  1588 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:51.195919  2266 raft_consensus.cc:2368] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:01:51.182894  1587 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:51.150346  5344 raft_consensus.cc:697] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:51.176038  5385 consensus_queue.cc:1175] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" responder_term: 8 status { last_received { term: 8 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 8 index: 9 } }
I20260709 13:01:51.178646  1441 catalog_manager.cc:5697] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:01:51.190228  5403 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:01:51.192526  1511 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:51.182507   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:51.165095  5238 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:51.234665  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:51.237957  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:51.238135  1511 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:51.238804  1696 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.197382  5379 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.239604  4929 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:51.239882  5379 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:51.240039  4929 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:51.240302  5379 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.240473  4929 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.240701  5379 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:51.191604  5407 log.cc:927] Time spent T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:01:51.231367  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:51.243382  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.243789  1548 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:51.246315  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 80159.9us
I20260709 13:01:51.178313  5390 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:51.247511  1588 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:51.264510  1696 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:51.267105  1548 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
W20260709 13:01:51.273665  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 90845.6us
I20260709 13:01:51.274863  1587 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:51.211714  5231 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:51.246814  4925 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:51.265601  5238 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.189616  5310 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:51.279783  5402 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
W20260709 13:01:51.290139  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.265563  5414 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:51.296842  5289 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:51.298322  1441 catalog_manager.cc:5697] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 4 to 5, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 5 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.290616  5336 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:51.290894  5351 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:51.310904  5375 raft_consensus.cc:697] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:51.327529  5375 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:51.340559  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.344022  2232 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:51.345067  5383 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:51.345615  5383 raft_consensus.cc:697] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:51.346805  5383 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:51.352523  4389 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:51.274976  5276 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:51.330814  5429 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.280687  5355 consensus_queue.cc:237] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:51.357538  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 119488us
I20260709 13:01:51.363250  1543 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:51.316911  5307 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:51.381804  1511 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:51.384030  1511 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:51.388921  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:51.382896  5162 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:51.357473  5314 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:51.398916  5426 log.cc:927] Time spent T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:01:51.401152  1511 leader_election.cc:400] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:01:51.403443  5276 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:51.310063  5344 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:51.405194  5377 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:51.414286  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 139526us
W20260709 13:01:51.445318  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 200847us
I20260709 13:01:51.449046  1587 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:51.414819  5412 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:51.415343  5231 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:51.440497  1511 leader_election.cc:403] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:51.470541  5379 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:51.441466  1548 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:51.414717  4929 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:51.392196  5431 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.415843  5307 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:51.476289  1693 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:51.481365  1691 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:51.442857  1441 catalog_manager.cc:5697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:51.457581  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.464226  5310 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:51.471588  5363 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:51.413638  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 166199us
W20260709 13:01:51.439306  5411 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
W20260709 13:01:51.473323  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 72305.2us
W20260709 13:01:51.476296  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.453917  5238 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:51.384873  5429 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:51.526963  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.482389  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:51.484143  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:51.488458  1691 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:51.641741  1688 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:51.491561  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:51.492044  5400 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:51.494814  4959 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:51.643232  1623 raft_consensus.cc:3055] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:51.496616  4929 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:51.643643  1623 raft_consensus.cc:740] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:51.644403  1623 consensus_queue.cc:260] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:51.645494  1623 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:51.497606  5307 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:51.480980  4925 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:01:51.443370  5289 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:51.392972  5336 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:51.524519  1511 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:51.444751  5430 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:51.571856  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:51.572297  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 46011.6us
I20260709 13:01:51.574473  1620 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:01:51.574997  1615 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:51.577872  2265 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:51.578477  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:51.690773  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.501288  5431 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:51.694813  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 170393us
I20260709 13:01:51.600769  5379 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:51.575253  5413 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:51.475968  5377 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.528035  5343 consensus_queue.cc:1059] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:01:51.612524  1616 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:51.614455  5429 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:51.616977  5435 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:01:51.618407  1618 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:51.705575  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.709442  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:51.710592  1663 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:51.619100  1621 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:51.509343  5422 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
W20260709 13:01:51.624639  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 99437.7us
I20260709 13:01:51.523891  5363 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:51.717415  5363 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:51.718007  5363 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.718458  5363 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:51.719128  4959 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:51.720606  5363 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:51.720701  4959 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:01:51.636976  5409 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.599s	user 0.001s	sys 0.001s
I20260709 13:01:51.722429  1622 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:51.496340  1441 catalog_manager.cc:5697] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 5 to 8, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 8 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.657728  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:51.658713  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:51.725235  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:51.727229  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:51.690790  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.579151  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:51.707044  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:51.694131  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:51.579458  5408 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.429s	user 0.001s	sys 0.004s
I20260709 13:01:51.698350  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.672849  5306 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:51.686993  5374 consensus_meta.cc:287] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
I20260709 13:01:51.713102  5430 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:51.738827  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.739832  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.703542  1511 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:51.740844  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.727463  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.657889  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:51.737815  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.698662  4929 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:51.741886  1511 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:51.743695  1617 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:51.744494  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:51.702144  5379 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:51.757409  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.770176  1663 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:51.776073  1663 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:51.774565  5289 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:51.744032  5306 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:51.788357  5306 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:51.788672  5307 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:51.789256  5343 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:51.702694  5377 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:51.766000  5429 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:51.790923  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:51.777837  5379 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:51.793771  5379 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:51.793382  5377 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:51.727902  5336 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:01:51.744550  5374 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:51.798931  5374 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:51.799604  5310 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:51.799872  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.801924  5434 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:51.802495  5434 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:51.802951  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:51.766407  5355 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:51.743985  5431 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:51.738126  5162 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:01:51.810819  5433 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:01:51.822598  5391 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:51.701472  5413 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:51.778234  5314 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:51.813599  5355 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.826372  5413 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:51.826910  5355 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:51.738430  5425 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:01:51.802963  5434 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.840965  1586 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:51.845932  1616 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:51.848511  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:51.849264  1616 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.854607  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.855166  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.868348  1618 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:51.868074  1617 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:51.869782  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.870958  1618 raft_consensus.cc:2410] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:01:51.867960  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:51.877745  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 72744.5us
I20260709 13:01:51.880429  2234 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:51.875310  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 99316.9us
I20260709 13:01:51.884438  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:51.896095  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.896870  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.876570  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:51.900200  1663 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:51.902936  1616 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:51.904778  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.903919  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:51.897532  1618 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:51.921713  5367 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:01:51.907282  5433 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:51.908733  5425 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:51.923535  5314 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:01:51.904058  5388 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:51.915746  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 139213us
I20260709 13:01:51.913802  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.927156  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.935221  1617 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:51.928640  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54504 (request call id 601) took 1162 ms. Trace:
I20260709 13:01:51.935973  2266 rpcz_store.cc:276] 0709 13:01:50.765832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.767095 (+  1263us) service_pool.cc:224] Handling call
0709 13:01:51.922934 (+1155839us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54000f32d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:51.928579 (+  5645us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893025152}
I20260709 13:01:51.921430  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:51.930034  1545 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:51.909551  1623 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:01:51.932513  1663 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:51.938750  1623 pending_rounds.cc:85] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 7
I20260709 13:01:51.939318  1623 pending_rounds.cc:107] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:51.939749  1623 raft_consensus.cc:2889] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:51.937620  1620 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:51.945889  1513 leader_election.cc:400] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:01:51.946341  1513 leader_election.cc:403] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:51.952543  1663 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:51.958010  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 700) took 1076 ms. Trace:
I20260709 13:01:51.930222  5363 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.958552  1623 rpcz_store.cc:276] 0709 13:01:50.868024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.869729 (+  1705us) service_pool.cc:224] Handling call
0709 13:01:50.869960 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.643146 (+773186us) spinlock_profiling.cc:243] Waited 95.2 ms on lock 0x7b54002c2520. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6aab5dc0 00007f5c6ab401c0 00007f5c6ab41231 00007f5c6ab3dd8f 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c
0709 13:01:51.943615 (+300469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.943875 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218985728}
I20260709 13:01:51.933193  5374 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:51.941916  5388 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:51.957404  5358 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:01:51.973691  5374 raft_consensus.cc:697] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:51.971587  5388 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.974884  5374 consensus_queue.cc:237] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:51.972342  5425 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:01:51.952220  5306 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:51.942631  5447 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:51.988502  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:51.933362  5433 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:51.989727  4929 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.987224  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:51.991391  1543 raft_consensus.cc:2410] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:51.992033  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:51.994268  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:51.995025  1542 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:51.972313  5363 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:52.000630  5428 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:52.002338  5444 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:52.003243  5363 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:51.993376  5441 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.004316  5441 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:52.006633  5441 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:52.007315  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:52.007932  1545 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:52.007705  5433 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:51.990242  4929 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:51.980106  5431 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:52.043143  4929 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:52.045804  5355 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:51.979691  5413 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:01:52.041137  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:52.052942  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.057291  1543 raft_consensus.cc:1240] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:52.057554  1622 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:01:52.059383  1542 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:52.062076  1539 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:01:52.066506  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 186183us
I20260709 13:01:52.072924  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:52.081941  1545 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:52.083752  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:52.101647  1546 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:52.101990  1544 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:52.102582  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:52.102829  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:52.102656  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:52.102933  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:52.103511  1542 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:52.103845  1546 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:52.110167  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:52.111186  1545 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
W20260709 13:01:52.115124  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 162504us
I20260709 13:01:52.116415  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:52.118069  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:52.118571  1540 raft_consensus.cc:3055] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:52.120647  1540 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:52.126395  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:52.129778  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:52.130927  1691 raft_consensus.cc:2393] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:52.133776  1540 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:52.162002  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:52.323125  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 370716us
I20260709 13:01:52.273139  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:52.330771  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:52.331880  5431 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:52.334926  1540 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:52.282913  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 375352us
I20260709 13:01:52.180390  1544 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:01:52.302057  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 183018us
I20260709 13:01:52.343282  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:52.330964  1539 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:01:52.274293  1661 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:52.360538  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 86367.6us
I20260709 13:01:52.362213  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:52.165033  1688 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:01:52.420513  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 77327.1us
W20260709 13:01:52.571357  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 240661us
I20260709 13:01:52.516765  1540 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:52.572760  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:01:52.443661  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 81711.3us
I20260709 13:01:52.128721  5345 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.277s
I20260709 13:01:52.574875  1661 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:52.581485  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:52.592603  5457 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 13:01:52.593423  5428 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:52.593816  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.407441  5459 consensus_queue.cc:1059] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.171s
W20260709 13:01:52.391520  5452 log.cc:927] Time spent T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 13:01:52.408406  5450 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:01:52.491748  5433 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.386560  5306 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:52.593953  5447 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:52.608381  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:52.360831  5355 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:52.634615  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:52.635814  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:52.648094  1540 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:52.652910  1539 raft_consensus.cc:2393] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:52.581959  5432 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.661718  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:52.676164  1547 raft_consensus.cc:2410] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:52.594036  5428 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:52.639787  5306 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:52.751942  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 114174us
I20260709 13:01:52.761515  1587 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:52.768054  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2799) took 1041 ms. Trace:
I20260709 13:01:52.768569  1693 rpcz_store.cc:276] 0709 13:01:51.726251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.728548 (+  2297us) service_pool.cc:224] Handling call
0709 13:01:51.728924 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.766154 (+ 37230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.766188 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.773060 (+  6872us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.053079 (+280019us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:52.055367 (+  2288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.055469 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.767777 (+712308us) raft_consensus.cc:1685] finished
0709 13:01:52.767806 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.767975 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37917,"raft.queue_time_us":36983,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":7660,"thread_start_us":213070,"threads_started":1,"wal-append.queue_time_us":319230}
I20260709 13:01:52.761708  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 708) took 1244 ms. Trace:
I20260709 13:01:52.665514  5433 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:52.776671  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 201859us
I20260709 13:01:52.792958  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:01:52.777338  5391 consensus_meta.cc:287] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.954s	user 0.014s	sys 0.010s
W20260709 13:01:52.794541  5467 log.cc:927] Time spent T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:01:52.794938  2269 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:52.709838  5465 raft_consensus.cc:3055] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:52.771833  1614 rpcz_store.cc:276] 0709 13:01:51.517556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.518795 (+  1239us) service_pool.cc:224] Handling call
0709 13:01:51.519202 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.753472 (+234270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.753515 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.775903 (+ 22388us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.959009 (+183106us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:51.959047 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.959195 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.761501 (+802306us) raft_consensus.cc:1685] finished
0709 13:01:52.761521 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.761653 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92374,"raft.queue_time_us":105667,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":98,"thread_start_us":135183,"threads_started":1,"wal-append.queue_time_us":279523}
I20260709 13:01:52.766774  5306 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.807600  1661 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:52.767002  5355 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:52.816897  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 544) took 1244 ms. Trace:
I20260709 13:01:52.817613  1692 rpcz_store.cc:276] 0709 13:01:51.572793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.572921 (+   128us) service_pool.cc:224] Handling call
0709 13:01:51.578181 (+  5260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.694320 (+116139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.694389 (+    69us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:51.694578 (+   189us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:51.694636 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.816514 (+1121878us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400147654. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:52.816574 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.816811 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266355456}
I20260709 13:01:52.796099  5475 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:52.807822  5434 consensus_meta.cc:287] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.974s	user 0.014s	sys 0.000s
I20260709 13:01:52.798069  5465 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:52.797776  5433 raft_consensus.cc:697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:52.821103  1514 connection.cc:256] RPC call timeout handler was delayed by -1.4443439219999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31400000000000006s for a response
W20260709 13:01:52.829638  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 257705us
W20260709 13:01:52.837563  1514 connection.cc:256] RPC call timeout handler was delayed by -1.4020042349999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 13:01:52.838471  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.839525  1514 connection.cc:256] RPC call timeout handler was delayed by -1.2547738079999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 13:01:52.801040  5447 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:01:52.840066  1514 connection.cc:256] RPC call timeout handler was delayed by -1.0706290980000404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 13:01:52.842998  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 81604.9us
I20260709 13:01:52.838294  5434 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:52.846184  1587 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:52.851754  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:52.853220  1587 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:52.823673  5355 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:52.844874  1514 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:52.867830  5465 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:52.869024  5474 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:01:52.869119  5465 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:52.869941  5462 log.cc:927] Time spent T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:01:52.872351  5466 log.cc:927] Time spent T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Append to log took a long time: real 0.267s	user 0.000s	sys 0.002s
I20260709 13:01:52.872898  5366 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:52.873231  5469 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
I20260709 13:01:52.873600  5366 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:52.854992  5356 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:01:52.864128  5431 consensus_meta.cc:287] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.002s
W20260709 13:01:52.886698  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 313992us
I20260709 13:01:52.888022  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:52.854526  5483 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.838613  5475 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:52.917788  5460 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:52.918726  5428 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:52.919929  5477 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:52.889644  5433 consensus_queue.cc:237] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:52.920936  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 791) took 1117 ms. Trace:
W20260709 13:01:52.913432  5461 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:01:52.864713  5231 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:52.900148  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 55907.3us
I20260709 13:01:52.912863  5434 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:52.892671  5431 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:52.905923  5476 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:52.909372  5413 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.921459  2264 rpcz_store.cc:276] 0709 13:01:51.803433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.803620 (+   187us) service_pool.cc:224] Handling call
0709 13:01:51.804105 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.875585 (+ 71480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.875617 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.904291 (+ 28674us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.129935 (+225644us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:52.579947 (+450012us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.580801 (+   854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.581009 (+   208us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.920378 (+339369us) raft_consensus.cc:1685] finished
0709 13:01:52.920401 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.920850 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9985,"prepare.queue_time_us":174907,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":287482,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":9351,"thread_start_us":666021,"threads_started":2,"wal-append.queue_time_us":994952}
W20260709 13:01:52.896816  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 89985.4us
I20260709 13:01:52.928632  1514 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:52.920943  5477 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:52.926973  1663 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:52.933207  1661 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:52.936299  1695 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
W20260709 13:01:52.933670  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 80603.1us
I20260709 13:01:52.939221  1663 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:52.939311  1661 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:52.939349  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:52.925338  5231 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.944459  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 703) took 1014 ms. Trace:
I20260709 13:01:52.944965  1587 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:52.948470  1694 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:01:52.933938  5374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.003s	sys 0.026s
I20260709 13:01:52.933087  5356 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:01:52.929864  5447 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:52.951838  1514 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:52.945647  1541 rpcz_store.cc:276] 0709 13:01:51.929644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.930383 (+   739us) service_pool.cc:224] Handling call
0709 13:01:51.930671 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.931011 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.931042 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.931554 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:01:52.193848 (+262294us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:52.193906 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.193998 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:52.944196 (+750198us) raft_consensus.cc:1685] finished
0709 13:01:52.944216 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.944399 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15184,"raft.queue_time_us":2285,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":2045,"thread_start_us":228612,"threads_started":1,"wal-append.queue_time_us":878621}
I20260709 13:01:52.937237  5377 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:52.955112  1688 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:52.970744  5478 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:01:52.951670  5487 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:52.973753  5487 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:52.974174  5487 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:52.976745  5480 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:01:52.978077  5483 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:52.978781  5483 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:52.980113  5483 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:52.941897  5431 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:52.992475  5431 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.992882  5431 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:52.994179  5167 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:52.932399  4929 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:01:52.996394  4929 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:52.997255  5477 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:53.000672  5438 log.cc:927] Time spent T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 1.398s	user 0.004s	sys 0.000s
I20260709 13:01:53.001644  5355 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:52.950124  5231 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:52.948668  5428 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:53.005259  1692 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:53.005821  5167 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:52.951337  5366 consensus_queue.cc:1059] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 13:01:52.951992  5374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.003s	sys 0.027s
I20260709 13:01:53.011543  1435 maintenance_manager.cc:419] P ee9debc877d548cb9a1a1187cf0a2dcd: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033343
I20260709 13:01:52.944144  5434 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.944599  5413 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.074s
W20260709 13:01:52.950702  5388 consensus_meta.cc:287] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.976s	user 0.006s	sys 0.007s
I20260709 13:01:52.964998  1514 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:01:53.034026  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 88351.3us
I20260709 13:01:53.035811  2266 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:53.036115  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:53.042198  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 77256.6us
I20260709 13:01:53.044461  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:53.044494  1514 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:53.048110  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:53.051191  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:53.038333  5447 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:52.944020  5476 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 13:01:53.043262  5377 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:53.062001  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:53.064245  5415 raft_consensus.cc:3055] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:53.064922  5415 raft_consensus.cc:740] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:53.050570  5355 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:53.050132  5356 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:53.038196  5073 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 13:01:53.085238  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 140349us
I20260709 13:01:53.059113  5447 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.090289  1587 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:53.046576  5388 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.062867  4929 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:53.102536  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 110028us
I20260709 13:01:53.102157  5447 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:53.122514  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 183578us
I20260709 13:01:53.106211  5356 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:53.124876  1663 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:01:53.144373  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 102379us
I20260709 13:01:53.110695  5377 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 13:01:53.152103  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 44305.4us
I20260709 13:01:53.154937  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:53.110812  5491 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:01:53.165239  5496 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:53.169595  5459 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:53.170084  5459 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.170828  5459 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:53.184090  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 59257.7us
I20260709 13:01:53.185714  1663 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:53.187021  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:53.123242  5415 consensus_queue.cc:260] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:53.270071  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 83118.5us
I20260709 13:01:53.164672  5487 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.280846  5383 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:53.283255  5383 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.286116  5383 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:53.287119  5476 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:53.291755  1587 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:53.278072  5366 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.174816  5496 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.266939  5501 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:53.259486  5073 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.184610  5497 consensus_queue.cc:1059] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:01:53.287986  5476 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.282133  5275 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:01:53.323199  5500 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.157s	user 0.002s	sys 0.000s
I20260709 13:01:53.326810  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 793) took 1254 ms. Trace:
W20260709 13:01:53.330195  5306 consensus_meta.cc:287] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 13:01:53.340477  5505 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:53.362933  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 196844us
I20260709 13:01:53.319236  5388 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:53.288517  5503 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:01:53.366912  2269 rpcz_store.cc:276] 0709 13:01:52.072419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.072557 (+   138us) service_pool.cc:224] Handling call
0709 13:01:53.326624 (+1254067us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54007c2c54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:53.326733 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658401024}
I20260709 13:01:53.316048  5366 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.364882  5501 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.416545  1694 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:53.330231  5431 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.394098  5306 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.429471  5431 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:53.394574  5497 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:53.430238  5507 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.430536  5497 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.430899  5507 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.431635  1690 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:53.432720  5497 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:53.431313  5306 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:53.433372  5507 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:53.417596  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:53.424372  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:53.434933  1694 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:53.397050  5505 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.424896  5508 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:01:53.425680  5366 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:53.366688  5476 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.427521  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2802) took 1235 ms. Trace:
I20260709 13:01:53.434998  1697 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:53.404255  5428 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:53.447203  1695 rpcz_store.cc:276] 0709 13:01:52.191891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.581190 (+389299us) service_pool.cc:224] Handling call
0709 13:01:53.427307 (+846117us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b5400148a54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:53.427445 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":813572864}
I20260709 13:01:53.375792  5275 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.455909  5515 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:53.456529  5377 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:53.456678  5515 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.457456  5377 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.459810  5377 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:53.364377  5073 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.472715  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:53.435324  5465 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:53.476614  1697 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:01:53.480294  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.481091  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:53.484411  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:53.439308  5505 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.457042  5275 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:53.498718  1694 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:53.486192  5465 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.455053  5504 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:53.481493  5503 raft_consensus.cc:3055] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:53.520305  5503 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:53.417689  5501 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.521412  5503 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.524014  5501 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:53.527612  5484 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:53.528505  5484 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.533253  5475 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:53.485817  5497 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:01:53.541256  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:53.542035  1697 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:53.477916  5515 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:53.543309  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:53.548530  1697 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:01:53.550125  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:53.550967  1697 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:01:53.552624  5484 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:53.500631  5434 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:53.569090  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:53.567648  5231 consensus_meta.cc:287] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.529s	user 0.013s	sys 0.000s
I20260709 13:01:53.565649  5424 raft_consensus.cc:3055] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:53.562503  5491 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:53.601714  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:53.565873  5508 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.594515  1588 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:53.593865  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.611507  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.586443  5484 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.585606  5073 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:53.621488  5476 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:53.626997  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 335390us
I20260709 13:01:53.595577  5412 consensus_queue.cc:1059] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:01:53.610296  5424 raft_consensus.cc:740] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:53.598719  5231 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.641266  1614 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:01:53.642954  1614 pending_rounds.cc:85] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 8
I20260709 13:01:53.644294  1614 pending_rounds.cc:107] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:01:53.644681  1614 raft_consensus.cc:2889] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:53.642340  5447 consensus_meta.cc:287] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.500s	user 0.013s	sys 0.000s
I20260709 13:01:53.613967  5505 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.669157  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:53.626642  5484 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.670079  1622 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:01:53.673621  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:53.641978  5523 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:53.676337  1623 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:01:53.677067  5421 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:53.680212  5421 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.680991  5231 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:53.682833  5421 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:01:53.689189  4389 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:53.613336  5491 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.617954  5508 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.669729  5447 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.732439  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:53.732499  5508 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:53.733117  1622 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:01:53.652689  5465 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:53.696679  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:53.729450  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:53.730240  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:53.730450  5505 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:53.711794  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:53.738667  2264 raft_consensus.cc:2410] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:53.706560  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:53.737572  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:53.659054  5515 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:01:53.737601  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:53.743451  1691 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:53.734803  4925 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.744499  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:53.734809  5447 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:53.757133  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:53.758852  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:53.760201  1691 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:53.765499  2234 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:53.768025  2234 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:53.769408  1697 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:01:53.694366  5523 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.773423  2234 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:53.774574  5465 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:53.775213  5073 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:53.776610  5073 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:53.775182  5465 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.777015  5073 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.753815  5283 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:01:53.780573  5465 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:53.784425  5496 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:53.788537  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:53.789270  1616 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:01:53.792778  1692 raft_consensus.cc:1240] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:53.792407  5073 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.794428  5484 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:53.794945  5073 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:01:53.795147  5484 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.795869  5484 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.797781  5203 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.799616  5377 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.800473  5377 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:53.802736  5459 consensus_meta.cc:287] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.004s
I20260709 13:01:53.799736  5515 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.809716  1616 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:53.810362  1618 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:01:53.811031  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:53.811873  1616 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:53.814991  2231 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:53.819288  1661 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.964s (SENT) [suppressed 51 similar messages]
W20260709 13:01:53.822355  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 433528us
I20260709 13:01:53.823882  2231 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:53.828774  1663 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:53.821913  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:53.753623  4925 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.833032  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:53.837567  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:53.771129  5385 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:53.846554  1616 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:53.798863  5203 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.772425  5400 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:53.851046  5400 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:53.851660  5400 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:53.865229  1614 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:53.790745  5424 consensus_queue.cc:260] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.772753  5523 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:53.820927  5289 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.833053  5246 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:53.833343  5435 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:53.832019  5484 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:53.882597  5246 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.885645  5246 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:53.886001  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:53.886799  4925 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:53.887347  4925 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.887799  4925 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:53.803345  5459 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.891342  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:53.893750  1614 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:53.892428  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:53.894603  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:53.848331  5385 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:53.895605  1622 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.848151  5167 consensus_queue.cc:1059] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:01:53.889441  5435 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.908987  5487 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:53.912531  5468 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 1.151s	user 0.003s	sys 0.000s
I20260709 13:01:53.838701  5515 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:53.920636  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 91840.8us
I20260709 13:01:53.922458  5502 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:53.883379  5289 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:53.922981  5496 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:53.920667  5377 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:54.107700  5377 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:54.105031  4925 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:54.085681  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.105006  5491 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:53.923322  5415 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.105661  5400 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:54.106031  5496 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:54.045781  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.133100  5496 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:54.109951  5246 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:54.116568  5465 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:54.134552  5465 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:54.136268  5246 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:54.119606  4925 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.120793  5502 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.152825  5517 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:01:54.154378  5502 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.154942  5400 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:53.932601  1691 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:54.121400  5435 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:54.126915  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:54.125130  5377 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:54.136547  5524 log.cc:927] Time spent T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.444s	user 0.003s	sys 0.000s
I20260709 13:01:54.138028  5465 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:54.117262  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 67755.4us
I20260709 13:01:54.142658  5478 raft_consensus.cc:3055] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:54.148146  5493 raft_consensus.cc:3055] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:54.148449  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:54.149933  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:54.150768  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:54.150710  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:54.152904  4925 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:54.124203  5385 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:54.121646  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.927233  5459 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:54.050590  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:54.171166  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 351864us
I20260709 13:01:54.174077  1539 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:54.319208  1543 raft_consensus.cc:1240] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:54.387768  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:54.433444  1548 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:54.193970  1622 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:01:54.450084  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:54.446240  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 295687us
I20260709 13:01:54.465293  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:54.431324  1614 consensus_meta.cc:287] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.537s	user 0.013s	sys 0.000s
I20260709 13:01:54.473196  1614 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:01:54.440860  1615 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:54.477330  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:54.483211  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:54.486119  4925 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:54.439568  5493 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:54.161442  5496 consensus_queue.cc:1059] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.311s
I20260709 13:01:54.165982  5517 consensus_queue.cc:1243] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 27308aae2ef347ccba1b27e7f6f04334 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:54.439752  5478 raft_consensus.cc:740] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:54.523152  5478 consensus_queue.cc:260] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:54.524636  5478 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:54.452167  1622 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:54.455734  5487 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:54.296401  5491 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:54.202857  5515 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:54.499722  1614 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:01:54.303241  5484 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:54.478660  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:54.454216  5459 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:54.515821  5289 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:54.521720  5381 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:54.528750  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:54.518810  5503 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:54.545730  1615 raft_consensus.cc:2393] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:54.549998  1621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.057s	sys 0.107s
I20260709 13:01:54.488543  5465 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:01:54.541356  5377 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:54.338531  5523 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:54.533437  5484 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:54.553237  1697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.016s	sys 0.017s
W20260709 13:01:55.846563  1697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.977s	user 0.017s	sys 0.018s
I20260709 13:01:55.846310  5559 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:55.824481  1547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.338s	user 0.005s	sys 0.007s
W20260709 13:01:55.848064  1547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.362s	user 0.006s	sys 0.008s
I20260709 13:01:55.847708  5559 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:55.834313  1694 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.670s	user 0.001s	sys 0.001s
W20260709 13:01:55.850539  1694 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.686s	user 0.005s	sys 0.005s
W20260709 13:01:55.741242  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.620s	user 0.009s	sys 0.012s
W20260709 13:01:55.851889  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.731s	user 0.009s	sys 0.026s
I20260709 13:01:55.852788  5560 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:55.853282  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1803) took 2403 ms. Trace:
W20260709 13:01:55.752699  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.550522  1621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.057s	sys 0.107s
I20260709 13:01:55.854130  5560 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:55.769062  1617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.837s	user 0.012s	sys 0.007s
W20260709 13:01:55.734417  1514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.790s	user 0.005s	sys 0.014s
W20260709 13:01:55.824625  1692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.712s	user 0.011s	sys 0.023s
W20260709 13:01:56.259912  1514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.315s	user 0.013s	sys 0.018s
W20260709 13:01:56.265280  1617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.333s	user 0.017s	sys 0.013s
W20260709 13:01:54.706943  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.338688  1692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.227s	user 0.012s	sys 0.032s
W20260709 13:01:56.358951  1539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.868s	user 0.017s	sys 0.050s
W20260709 13:01:56.359524  1539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.868s	user 0.017s	sys 0.050s
W20260709 13:01:55.415767  5433 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.000s	sys 0.008s
W20260709 13:01:55.345144  5537 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.184s	user 0.001s	sys 0.001s
W20260709 13:01:54.642622  5470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.020s	sys 0.022s
I20260709 13:01:55.855472  1694 rpcz_store.cc:276] 0709 13:01:53.449635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.778429 (+328794us) service_pool.cc:224] Handling call
0709 13:01:53.779217 (+   788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.815694 (+ 36477us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:53.839873 (+ 24179us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.852238 (+2012365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:55.852419 (+   181us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:55.852593 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.852769 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.853109 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7967,"prepare.queue_time_us":31712,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":151363,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":1767,"thread_start_us":2002948,"threads_started":2,"wal-append.queue_time_us":783403}
W20260709 13:01:56.470046  1697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.015s	sys 0.035s
W20260709 13:01:55.427734  5520 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.024s	sys 0.049s
W20260709 13:01:55.150063  5453 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.018s	sys 0.032s
W20260709 13:01:54.885713  5489 log.cc:927] Time spent T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 1.551s	user 0.000s	sys 0.006s
W20260709 13:01:55.102540  5538 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.257s	user 0.001s	sys 0.001s
W20260709 13:01:56.471522  1697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.015s	sys 0.035s
I20260709 13:01:54.543892  5310 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:55.481599  5503 consensus_meta.cc:287] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.931s	user 0.008s	sys 0.004s
W20260709 13:01:55.367358  5435 consensus_meta.cc:287] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 1.134s	user 0.005s	sys 0.006s
W20260709 13:01:55.633344  5478 consensus_meta.cc:287] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 1.108s	user 0.010s	sys 0.007s
W20260709 13:01:55.362630  5502 consensus_meta.cc:287] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.208s	user 0.013s	sys 0.000s
W20260709 13:01:55.416229  5381 consensus_meta.cc:287] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.868s	user 0.006s	sys 0.009s
W20260709 13:01:55.164573  5415 consensus_meta.cc:287] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 1.036s	user 0.016s	sys 0.000s
W20260709 13:01:56.475144  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.478714  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.011s	sys 0.047s
W20260709 13:01:56.484298  5470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.576s	user 0.057s	sys 0.068s
I20260709 13:01:54.833778  5493 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:56.485796  5520 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.550s	user 0.030s	sys 0.049s
I20260709 13:01:54.888583  5465 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:54.543641  5487 raft_consensus.cc:697] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:56.478955  5553 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.511060  5435 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.511238  5553 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.502385  5310 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:56.503623  5453 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.162s	user 0.026s	sys 0.052s
I20260709 13:01:56.504555  5465 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:56.506924  1541 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.192s	user 0.013s	sys 0.032s
I20260709 13:01:56.507103  5523 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:56.508267  1623 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:56.508662  5487 consensus_queue.cc:237] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.509756  5502 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.510154  5343 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.514178  5435 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:55.749106  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:56.495704  5559 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:56.530550  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.532953  1541 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.252s	user 0.014s	sys 0.032s
I20260709 13:01:56.524211  5553 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:56.540800  1588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.047s	user 0.017s	sys 0.048s
W20260709 13:01:56.542323  1588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.098s	user 0.018s	sys 0.049s
I20260709 13:01:54.886024  5485 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 1.994s
W20260709 13:01:56.543658  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 2.09898e+06us
I20260709 13:01:56.546053  1618 raft_consensus.cc:2410] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:01:56.543725  5542 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.542107  5491 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.548866  1614 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
W20260709 13:01:56.548702  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.006s	sys 0.047s
W20260709 13:01:56.552444  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.007s	sys 0.047s
I20260709 13:01:54.547576  5459 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:56.543761  5433 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.633s	user 0.000s	sys 0.013s
I20260709 13:01:56.542398  5381 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.540848  5377 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.556982  2233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.724s	user 0.022s	sys 0.027s
W20260709 13:01:56.557286  1661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.998s	user 0.012s	sys 0.022s
W20260709 13:01:56.566499  2233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.803s	user 0.023s	sys 0.027s
W20260709 13:01:56.550791  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1702) took 2103 ms (client timeout 1635 ms). Trace:
W20260709 13:01:56.567204  1661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.078s	user 0.014s	sys 0.022s
W20260709 13:01:56.567621  1614 rpcz_store.cc:269] 0709 13:01:54.447223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.550075 (+102852us) service_pool.cc:224] Handling call
0709 13:01:56.550629 (+2000554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:56.547703  5503 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.567925  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.562256  1663 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.033s	user 0.009s	sys 0.029s
W20260709 13:01:56.568073  5557 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.709s	user 0.003s	sys 0.000s
I20260709 13:01:56.568478  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1800) took 3142 ms. Trace:
I20260709 13:01:56.574505  5493 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:56.575402  5385 consensus_meta.cc:287] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 2.066s	user 0.013s	sys 0.002s
I20260709 13:01:56.578576  5415 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.563303  5343 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:56.581162  1663 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.119s	user 0.009s	sys 0.029s
I20260709 13:01:56.575443  5310 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:56.584017  5567 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.558203  5562 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:56.588191  5551 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:56.592905  5562 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.596781  5551 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:56.591238  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.601755  5465 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:56.595734  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.039s	user 0.059s	sys 0.127s
I20260709 13:01:56.581283  1697 rpcz_store.cc:276] 0709 13:01:53.448855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.772773 (+323918us) service_pool.cc:224] Handling call
0709 13:01:53.787829 (+ 15056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.788055 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:53.869203 (+ 81148us) log.cc:844] Serialized 14 byte log entry
0709 13:01:56.506536 (+2637333us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:56.529165 (+ 22629us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:56.540627 (+ 11462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.547392 (+  6765us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.565906 (+ 18514us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":171,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"thread_start_us":2687940,"threads_started":3}
I20260709 13:01:56.588236  5550 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.606302  2234 connection.cc:256] RPC call timeout handler was delayed by -1.3455451049999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 13:01:56.608076  2234 connection.cc:256] RPC call timeout handler was delayed by -1.0424490099999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 13:01:56.609167  2234 connection.cc:256] RPC call timeout handler was delayed by -1.029645104999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
I20260709 13:01:56.599732  5523 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.608563  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.119s	user 0.060s	sys 0.128s
W20260709 13:01:56.613974  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.583941  5381 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.616966  5503 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.600610  5562 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:56.584137  5542 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.607111  5560 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:56.602797  5310 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.606329  5484 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:56.624967  5551 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:56.631373  5560 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.631292  5550 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.632228  5310 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:56.633231  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.626546  5552 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.623708  5502 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:56.699877  5576 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:56.700872  1514 connection.cc:256] RPC call timeout handler was delayed by -2.1878621379999572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:01:56.704406  1514 connection.cc:256] RPC call timeout handler was delayed by -1.7522621379999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 13:01:56.706527  1514 connection.cc:256] RPC call timeout handler was delayed by -1.6676621379999688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 13:01:56.602773  5377 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:56.707523  1514 connection.cc:256] RPC call timeout handler was delayed by -1.6559621379999498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 13:01:56.715580  1514 connection.cc:256] RPC call timeout handler was delayed by -1.6415621379999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2262s for a response
W20260709 13:01:56.715917  1514 connection.cc:256] RPC call timeout handler was delayed by -1.3130621379999639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2627s for a response
W20260709 13:01:56.716091  1514 connection.cc:256] RPC call timeout handler was delayed by -1.3031621380000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2638s for a response
W20260709 13:01:56.716243  1514 connection.cc:256] RPC call timeout handler was delayed by -1.2088458520000245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:01:56.716393  1514 connection.cc:256] RPC call timeout handler was delayed by -1.0700621379999689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2897s for a response
W20260709 13:01:56.717428  2232 connection.cc:256] RPC call timeout handler was delayed by -1.70546082300001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260709 13:01:56.717520  5572 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:56.718508  5572 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.608036  5385 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.701658  5562 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.737174  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1700) took 2285 ms (client timeout 1729 ms). Trace:
I20260709 13:01:56.721964  5565 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.737766  1614 rpcz_store.cc:269] 0709 13:01:54.446635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.707543 (+2260908us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:56.732397 (+ 24854us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:56.630153  5415 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.703872  5523 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.721964  5563 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:56.736537  1514 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:56.744961  5484 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.738556  5503 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:56.749362  5545 log.cc:927] Time spent T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 13:01:56.738850  5551 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:01:56.763568  1511 connection.cc:256] RPC call timeout handler was delayed by -2.4557345789999658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 13:01:56.777580  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1797) took 3329 ms. Trace:
I20260709 13:01:56.777820  5385 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:56.778054  1691 rpcz_store.cc:276] 0709 13:01:53.418539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.763542 (+345003us) service_pool.cc:224] Handling call
0709 13:01:53.763914 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.161540 (+397626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.628865 (+2467325us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400097ed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:56.747473 (+118608us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387316992}
I20260709 13:01:56.780181  2263 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:56.780972  5564 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.747177  5560 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.768070  5559 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.785367  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 709) took 2560 ms. Trace:
I20260709 13:01:56.785887  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:56.767109  5552 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.794054  5492 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.794939  5492 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.796350  5552 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:56.728966  5567 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.797467  5492 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:56.798521  5491 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:56.799808  5541 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:01:56.786827  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 202861us
I20260709 13:01:56.787001  5560 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:56.769223  5562 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.787609  5563 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.801704  5484 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.787881  5495 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:56.788784  5554 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:56.788887  5579 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:56.813158  5572 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:56.813867  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1698) took 2337 ms (client timeout 1731 ms). Trace:
I20260709 13:01:56.787199  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 723) took 2248 ms. Trace:
I20260709 13:01:56.769651  5502 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.769819  5544 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.808497  5580 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.810070  5562 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:56.811128  5551 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.812693  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:56.813485  5579 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.833915  1695 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:56.809180  5585 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:56.814327  1620 rpcz_store.cc:269] 0709 13:01:54.446139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.771391 (+2325252us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:56.783857 (+ 12466us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:56.799181  5567 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:56.837009  5579 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:56.835923  5585 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:56.837450  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1804) took 3020 ms (client timeout 2627 ms). Trace:
I20260709 13:01:56.789477  5503 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.790037  5377 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:56.786916  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:56.790030  1547 rpcz_store.cc:276] 0709 13:01:54.225416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.225616 (+   200us) service_pool.cc:224] Handling call
0709 13:01:54.485286 (+259670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.485652 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.485683 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.486228 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:01:55.849187 (+1362959us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:55.849313 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.849473 (+   160us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.785112 (+935639us) raft_consensus.cc:1685] finished
0709 13:01:56.785135 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.785306 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31669,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":1362042,"threads_started":1,"wal-append.queue_time_us":1370139}
W20260709 13:01:56.838043  1620 rpcz_store.cc:269] 0709 13:01:53.816931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.837193 (+3020262us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:56.837347 (+   154us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:56.804214  5381 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:56.814688  1540 rpcz_store.cc:276] 0709 13:01:54.517265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.532900 (+ 15635us) service_pool.cc:224] Handling call
0709 13:01:54.534199 (+  1299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.534441 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:55.841576 (+1307135us) log.cc:844] Serialized 14 byte log entry
0709 13:01:56.719634 (+878058us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:56.728798 (+  9164us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:56.742526 (+ 13728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.748057 (+  5531us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.765268 (+ 17211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1977366,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":67,"raft.queue_time_us":131166,"raft.run_cpu_time_us":509,"raft.run_wall_time_us":52459,"thread_start_us":884786,"threads_started":3,"wal-append.queue_time_us":653757}
I20260709 13:01:56.845079  5491 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.814543  5515 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.894474  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 54746.2us
W20260709 13:01:56.894754  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 54170.7us
I20260709 13:01:56.905560  1696 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:56.905753  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1802) took 3094 ms (client timeout 2638 ms). Trace:
W20260709 13:01:56.906224  1620 rpcz_store.cc:269] 0709 13:01:53.811170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.903701 (+3092531us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:56.905672 (+  1971us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:56.906967  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1697) took 2461 ms (client timeout 2110 ms). Trace:
I20260709 13:01:56.783329  5576 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:56.907271  1620 rpcz_store.cc:269] 0709 13:01:54.445831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.906806 (+2460975us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:56.906919 (+   113us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:56.781553  5565 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:56.908308  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 56049.5us
I20260709 13:01:56.850268  5492 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.847131  5560 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:56.918488  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1701) took 2471 ms (client timeout 2204 ms). Trace:
I20260709 13:01:56.918004  5503 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.920799  5565 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:56.890403  5459 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:56.921782  1620 rpcz_store.cc:269] 0709 13:01:54.446896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.918277 (+2471381us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:56.918428 (+   151us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:56.926986  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 710) took 2693 ms. Trace:
I20260709 13:01:56.886880  5502 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.901065  5377 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.907613  5544 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.901377  5562 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:56.917917  5492 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.911005  5559 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.937959  5523 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:56.938865  5559 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:56.916745  5567 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.877296  5575 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.935138  5581 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:01:56.935837  5562 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.936525  5503 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:56.936914  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1690) took 3116 ms. Trace:
I20260709 13:01:56.938936  5492 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:56.939174  5585 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:56.885414  5572 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:56.939860  5567 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.944378  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:56.940321  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 720) took 2452 ms. Trace:
W20260709 13:01:56.949985  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1803) took 3138 ms (client timeout 2897 ms). Trace:
W20260709 13:01:56.952629  1620 rpcz_store.cc:269] 0709 13:01:53.816489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.943473 (+3126984us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:56.949919 (+  6446us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:56.885627  5564 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.928562  1541 rpcz_store.cc:276] 0709 13:01:54.234107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.239179 (+  5072us) service_pool.cc:224] Handling call
0709 13:01:54.239902 (+   723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.240249 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:56.554097 (+2313848us) log.cc:844] Serialized 14 byte log entry
0709 13:01:56.846953 (+292856us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:56.894747 (+ 47794us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:56.902403 (+  7656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.915741 (+ 13338us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.926930 (+ 11189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2271189,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":131809,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":171,"thread_start_us":2542112,"threads_started":3,"wal-append.queue_time_us":142162}
W20260709 13:01:56.957677  1511 connection.cc:256] RPC call timeout handler was delayed by -1.879734578999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 13:01:56.958396  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 233295us
I20260709 13:01:56.941609  5415 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:56.958132  1511 connection.cc:256] RPC call timeout handler was delayed by -1.8653345789999776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2262s for a response
I20260709 13:01:56.931372  5565 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:56.959972  1511 connection.cc:256] RPC call timeout handler was delayed by -1.7510345789999633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2389s for a response
I20260709 13:01:56.952565  1539 rpcz_store.cc:276] 0709 13:01:54.488352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.490155 (+  1803us) service_pool.cc:224] Handling call
0709 13:01:54.490637 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.536299 (+2045662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.539499 (+  3200us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.626883 (+ 87384us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.754337 (+127454us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:56.754404 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.757400 (+  2996us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.940074 (+182674us) raft_consensus.cc:1685] finished
0709 13:01:56.940100 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.940266 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26482,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":1894264,"threads_started":2,"wal-append.queue_time_us":208686}
W20260709 13:01:56.960426  1511 connection.cc:256] RPC call timeout handler was delayed by -1.7263234129999319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 13:01:56.932399  5560 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.885556  5580 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.948765  5515 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.890547  5554 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.940066  5575 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:56.945775  1621 rpcz_store.cc:276] 0709 13:01:53.809062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.809248 (+   186us) service_pool.cc:224] Handling call
0709 13:01:53.820970 (+ 11722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.838857 (+ 17887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.838888 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.839370 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.515096 (+2675726us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:56.847838 (+332742us) log.cc:844] Serialized 14 byte log entry
0709 13:01:56.916013 (+ 68175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.916101 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.916140 (+    39us) raft_consensus.cc:1685] finished
0709 13:01:56.916152 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.925081 (+  8929us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100664,"prepare.queue_time_us":199789,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":8876,"raft.queue_time_us":17599,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":26291,"spinlock_wait_cycles":1016192,"thread_start_us":2709066,"threads_started":2,"wal-append.queue_time_us":1293424}
I20260709 13:01:56.994482  2266 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:56.961303  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1689) took 3152 ms. Trace:
I20260709 13:01:57.031262  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:56.979236  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1818) took 3134 ms (client timeout 3014 ms). Trace:
W20260709 13:01:57.078816  1620 rpcz_store.cc:269] 0709 13:01:53.827709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.957761 (+3130052us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:56.962346 (+  4585us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:56.967926  1511 connection.cc:256] RPC call timeout handler was delayed by -1.536834578999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2627s for a response
W20260709 13:01:57.081524  1511 connection.cc:256] RPC call timeout handler was delayed by -1.293834578999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2897s for a response
W20260709 13:01:57.081858  1511 connection.cc:256] RPC call timeout handler was delayed by -1.2907234129999665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 13:01:57.082163  1511 connection.cc:256] RPC call timeout handler was delayed by -1.2061234129999434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 13:01:56.948835  5559 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:56.993372  5574 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:01:56.995573  5537 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:01:56.979810  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:56.993010  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:57.099661  1695 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:56.979252  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:57.034911  5502 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:57.043169  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:57.044063  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:56.994899  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:56.978570  1514 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:56.954267  5503 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.042548  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:56.966876  5585 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.073083  1617 rpcz_store.cc:276] 0709 13:01:53.808722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.826191 (+ 17469us) service_pool.cc:224] Handling call
0709 13:01:53.863963 (+ 37772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.873700 (+  9737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.873749 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.874690 (+   941us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.432522 (+2557832us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:56.522198 (+ 89676us) log.cc:844] Serialized 14 byte log entry
0709 13:01:56.550475 (+ 28277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.550590 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.956044 (+405454us) raft_consensus.cc:1685] finished
0709 13:01:56.956073 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.961222 (+  5149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23809,"prepare.queue_time_us":145308,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":8985,"raft.queue_time_us":55802,"raft.run_cpu_time_us":689,"raft.run_wall_time_us":44635,"thread_start_us":2412760,"threads_started":2,"wal-append.queue_time_us":2738295}
I20260709 13:01:57.107299  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:57.110796  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:57.111855  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.112461  5564 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:57.112396  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:56.966727  5590 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:57.039527  5488 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:57.113406  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:57.111897  5562 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:57.029047  5377 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.994997  5593 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.966873  5586 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:57.040532  5576 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:57.134635  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:57.136778  1696 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:01:57.123467  2268 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:56.967062  5589 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.141571  2267 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:57.128736  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.143342  1695 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:57.040923  5587 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:56.990439  5491 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:56.994810  5565 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:57.134514  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:57.134593  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:57.116109  1586 connection.cc:256] RPC call timeout handler was delayed by -1.0934617830000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2262s for a response
I20260709 13:01:57.132028  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:57.135219  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1696) took 3320 ms (client timeout 3064 ms). Trace:
I20260709 13:01:57.152930  1546 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.980261  5581 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:57.146845  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:57.147516  2264 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:57.147294  5589 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:57.148272  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:57.148507  5560 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:57.149221  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:57.145546  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:57.156400  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:57.150785  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 171119us
W20260709 13:01:57.141991  1663 connection.cc:256] RPC call timeout handler was delayed by -1.4227475999999797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
I20260709 13:01:56.991705  5572 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:57.153223  1620 rpcz_store.cc:269] 0709 13:01:53.810833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.103800 (+3292967us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:57.130994 (+ 27194us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:57.149010  5587 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:57.272655  5550 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:57.273715  5580 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:57.276077  5348 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:57.238428  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 82946.5us
I20260709 13:01:57.272953  5491 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:57.265759  1547 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:57.272972  5559 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:57.275609  5564 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.274096  5377 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:57.264303  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 105987us
I20260709 13:01:57.263567  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.264096  5590 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:57.157107  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:57.276738  5597 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:57.277868  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:57.275575  5593 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:57.248324  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.143489  5544 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:57.223232  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 64520.9us
I20260709 13:01:57.155380  1541 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.156472  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:57.303869  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1705) took 2824 ms (client timeout 2796 ms). Trace:
I20260709 13:01:57.307459  1695 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:57.277151  1511 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:57.309067  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.315825  2267 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 10: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:57.305780  1543 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
W20260709 13:01:57.291852  5493 consensus_meta.cc:287] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.691s	user 0.006s	sys 0.008s
W20260709 13:01:57.309499  1661 connection.cc:256] RPC call timeout handler was delayed by -2.3905872010000166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3204s for a response
I20260709 13:01:57.305958  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:57.328747  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.328676  1661 connection.cc:256] RPC call timeout handler was delayed by -2.3356872010000416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3265s for a response
I20260709 13:01:57.308144  1545 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
W20260709 13:01:57.317162  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 338770us
W20260709 13:01:57.317320  1663 connection.cc:256] RPC call timeout handler was delayed by -1.1475726809999856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 13:01:57.320904  1617 rpcz_store.cc:269] 0709 13:01:54.479048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.140662 (+2661614us) service_pool.cc:224] Handling call
0709 13:01:57.303763 (+163101us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:57.329299  1661 connection.cc:256] RPC call timeout handler was delayed by -2.0967215559999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
I20260709 13:01:57.314119  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:57.331219  1663 connection.cc:256] RPC call timeout handler was delayed by -1.0458726809999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 13:01:57.331501  1661 connection.cc:256] RPC call timeout handler was delayed by -1.9332795400000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 13:01:57.331830  1661 connection.cc:256] RPC call timeout handler was delayed by -1.9332643960000269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 13:01:57.332103  1661 connection.cc:256] RPC call timeout handler was delayed by -1.831579540000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 13:01:57.332334  1661 connection.cc:256] RPC call timeout handler was delayed by -1.7739680699999667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
I20260709 13:01:57.312309  1694 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:57.150766  5586 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:57.332556  1661 connection.cc:256] RPC call timeout handler was delayed by -1.7469795399999839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 13:01:57.334898  1661 connection.cc:256] RPC call timeout handler was delayed by -1.745179539999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 13:01:57.335136  1661 connection.cc:256] RPC call timeout handler was delayed by -1.3194795399999748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
I20260709 13:01:57.303372  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:57.342959  1621 raft_consensus.cc:1240] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:57.310667  5587 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:57.344728  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:57.152336  5562 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:57.342023  1547 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 5.
I20260709 13:01:57.149896  5503 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:57.349912  5581 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:57.350868  5598 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:57.351791  1623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 730) took 3647 ms (client timeout 1988 ms). Trace:
I20260709 13:01:57.329897  5488 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:57.353349  5590 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:57.329917  5167 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:57.356209  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:57.346297  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.364060  5593 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:57.365907  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1810) took 3547 ms (client timeout 1655 ms). Trace:
I20260709 13:01:57.292126  5576 consensus_queue.cc:1059] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:01:57.368103  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1692) took 3537 ms. Trace:
I20260709 13:01:57.404670  1621 rpcz_store.cc:276] 0709 13:01:53.809740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.159501 (+3349761us) service_pool.cc:224] Handling call
0709 13:01:57.336383 (+176882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.347324 (+ 10941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.347553 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.370739  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:57.145680  5585 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:57.352798  5515 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:57.373265  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:57.374565  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.345817  5606 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:57.337348  5586 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:57.379695  1539 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:57.342165  5561 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:57.385900  5562 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:57.386592  5565 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:57.371542  1623 rpcz_store.cc:269] 0709 13:01:53.703989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.704145 (+   156us) service_pool.cc:224] Handling call
0709 13:01:57.351565 (+3647420us) spinlock_profiling.cc:243] Waited 2.77 s on lock 0x7b54000fcdd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:57.351707 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6362424064}
I20260709 13:01:57.396572  5554 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:57.398396  1546 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:57.306493  5564 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:57.400072  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:57.400161  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:57.413630  1620 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:57.414528  5564 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:57.414947  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:57.304478  5348 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:57.397627  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:57.398790  1618 rpcz_store.cc:269] 0709 13:01:53.818861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.821657 (+  2796us) service_pool.cc:224] Handling call
0709 13:01:57.365562 (+3543905us) spinlock_profiling.cc:243] Waited 2.65 s on lock 0x7b54003cb9d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:57.365803 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6103382400}
I20260709 13:01:57.407861  1547 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:57.407053  1545 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:57.410187  1696 raft_consensus.cc:2410] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:57.415088  1546 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:01:57.406445  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 93225.8us
I20260709 13:01:57.417016  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:57.416849  5598 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:57.541185  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.531373  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:57.564158  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:57.587250  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.560204  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:57.527884  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:57.560256  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:57.561352  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.599048  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 322078us
I20260709 13:01:57.562052  1541 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:57.406394  5572 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:57.465677  1514 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:01:57.469666  5604 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:01:57.603309  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:57.603544  5563 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:57.603695  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:57.604913  1663 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:01:57.607275  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 260002us
I20260709 13:01:57.608006  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:57.609517  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2805) took 4655 ms. Trace:
I20260709 13:01:57.409044  5167 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:57.612687  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:57.614912  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.473958  1617 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.544763  5567 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:57.545430  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:57.475723  5557 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:57.409318  5606 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:01:57.617818  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.635293  1618 raft_consensus.cc:2376] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 6. Re-sending same reply.
I20260709 13:01:57.638767  1622 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
W20260709 13:01:57.643540  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.636031  1690 rpcz_store.cc:276] 0709 13:01:52.954354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.954491 (+   137us) service_pool.cc:224] Handling call
0709 13:01:52.954823 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.432129 (+477306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.609013 (+4176884us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b5400148054. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:57.609312 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096035712}
W20260709 13:01:57.653205  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.647979  1661 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:57.648133  5585 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:57.648586  5587 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:57.650041  1547 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:01:57.646803  1663 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:57.564739  5503 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:57.655185  1621 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:57.668918  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.469862  5561 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:57.680536  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:57.657028  5606 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:57.681561  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:57.687500  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.688246  1696 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 4.
I20260709 13:01:57.689417  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.690593  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.684018  1618 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:01:57.692803  1622 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:57.662864  5587 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:57.708706  1696 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:57.713279  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:57.716535  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:57.720201  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 347461us
I20260709 13:01:57.717890  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:57.721837  1695 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 5.
I20260709 13:01:57.687613  5433 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:57.722010  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.694437  5559 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:57.668918  5567 consensus_queue.cc:1059] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:01:57.711151  5587 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:57.727247  5517 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:57.729693  5484 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:57.730545  1663 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:57.730602  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:57.731001  5310 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:57.731436  1618 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:01:57.731631  5565 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:57.732069  5565 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:01:57.732223  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1703) took 3284 ms (client timeout 1895 ms). Trace:
I20260709 13:01:57.732481  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:01:57.732662  1614 rpcz_store.cc:269] 0709 13:01:54.475081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.731995 (+3256914us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:57.732124 (+   129us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:57.733201  1618 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:57.728025  5589 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:57.727715  5517 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:57.737399  5517 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:57.731444  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 83646.5us
I20260709 13:01:57.739564  5476 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:57.733659  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:57.741869  1614 raft_consensus.cc:2393] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:57.743263  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 72779.4us
I20260709 13:01:57.727602  5567 raft_consensus.cc:3055] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:57.748010  5567 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:57.748276  1614 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:57.750501  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:57.759828  5567 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:57.761036  5348 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:57.774235  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1809) took 3930 ms. Trace:
I20260709 13:01:57.913426  1614 rpcz_store.cc:276] 0709 13:01:53.818572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.742532 (+3923960us) service_pool.cc:224] Handling call
0709 13:01:57.742881 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.748717 (+  5836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.748989 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.789115  1621 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:01:57.815467  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:57.813174  1514 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:01:57.851262  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.814024  1618 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:01:57.914463  5587 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:57.913508  5424 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.923516  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2798) took 6003 ms. Trace:
I20260709 13:01:57.923965  5587 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:57.923943  1689 rpcz_store.cc:276] 0709 13:01:51.726025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.726201 (+   176us) service_pool.cc:224] Handling call
0709 13:01:51.726682 (+   481us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:51.787696 (+ 61014us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:51.923954 (+136258us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.171848 (+247894us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:52.350816 (+178968us) log.cc:844] Serialized 52 byte log entry
0709 13:01:52.351603 (+   787us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:52.352640 (+  1037us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.353633 (+   993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.109063 (+1755430us) spinlock_profiling.cc:243] Waited 9.91 ms on lock 0x7b1800241540. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:01:57.155682 (+3046619us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b1800241540. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a1f2a6 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419
0709 13:01:57.722642 (+566960us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b540022f454. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:57.722689 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.725466 (+  2777us) raft_consensus.cc:1685] finished
0709 13:01:57.725476 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.728925 (+  3449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152344,"prepare.queue_time_us":139203,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":9315,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":38952,"spinlock_wait_cycles":260113792,"thread_start_us":214312,"threads_started":1,"wal-append.queue_time_us":901722,"wal-append.run_cpu_time_us":4790,"wal-append.run_wall_time_us":1094834}
I20260709 13:01:57.926712  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.815665  1511 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:57.863056  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.931105  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 118021us
I20260709 13:01:57.927400  1693 raft_consensus.cc:1217] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[8.4-8.4]   Dedup: 8.4->[]
I20260709 13:01:57.918637  1622 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
W20260709 13:01:57.763489  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 123528us
I20260709 13:01:57.932742  1693 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:01:57.732489  5565 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:57.936084  2234 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:01:57.779279  5585 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:57.815344  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:57.938789  1621 raft_consensus.cc:1240] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:57.943095  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.763854  5562 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:57.761924  5598 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:57.948840  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1814) took 4123 ms. Trace:
I20260709 13:01:57.948654  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.764948  5433 raft_consensus.cc:697] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:57.933525  5167 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:57.953146  1621 rpcz_store.cc:276] 0709 13:01:53.820077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.930872 (+4110795us) service_pool.cc:224] Handling call
0709 13:01:57.938356 (+  7484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.943042 (+  4686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.943289 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.954730  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:57.956003  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.761713  5586 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:57.960434  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.961026  1689 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:57.951198  5576 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:57.953444  5476 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:57.959800  5589 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:01:57.974467  5606 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:57.963291  1619 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:57.963703  5433 consensus_queue.cc:237] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:57.977530  5343 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:57.954923  5587 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:57.978991  5381 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.979380  5375 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:57.963691  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:57.979537  5381 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:57.980082  5375 raft_consensus.cc:697] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:57.959095  1662 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:57.955549  5567 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.979157  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.963205  1690 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 4.
I20260709 13:01:57.963080  1514 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:58.005920  1540 raft_consensus.cc:2393] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:58.004451  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:58.004773  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 285876us
W20260709 13:01:58.008788  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 228057us
I20260709 13:01:58.009759  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:57.955879  5585 raft_consensus.cc:697] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:58.010903  1617 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
W20260709 13:01:57.984063  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 48040.1us
W20260709 13:01:58.013957  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 262317us
I20260709 13:01:58.014627  1621 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:58.017493  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.018201  1690 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:58.017594  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:57.965590  5561 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:58.019965  1621 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:58.015710  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.019165  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.025375  1690 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:01:58.022598  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 68389.5us
I20260709 13:01:58.023620  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.027760  1694 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:58.011380  5476 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:58.030620  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.056120  5476 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:58.056603  5476 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:58.031281  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:58.057039  5575 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:58.057323  1617 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:58.058102  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 575) took 1303 ms. Trace:
I20260709 13:01:58.058251  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:58.058853  1617 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:01:58.057037  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.058467  1697 rpcz_store.cc:276] 0709 13:01:56.776239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.776915 (+   676us) service_pool.cc:224] Handling call
0709 13:01:56.777353 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.840877 (+ 63524us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:56.901971 (+ 61094us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.185573 (+283602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.185645 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:57.185714 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.561391 (+375677us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b18002f3860. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:01:58.057898 (+496507us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b54001b85d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:58.057942 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.058055 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45264,"prepare.queue_time_us":56556,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":3210,"raft.queue_time_us":89030,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":29031,"spinlock_wait_cycles":136498176,"thread_start_us":199217,"threads_started":1,"wal-append.queue_time_us":362914}
I20260709 13:01:58.060351  1690 raft_consensus.cc:2393] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:58.060739  5544 raft_consensus.cc:3055] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:58.061129  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.061319  5544 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:58.036897  5586 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:58.063741  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:58.064711  1617 raft_consensus.cc:2393] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:58.066300  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.067560  1690 raft_consensus.cc:2410] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:58.068922  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.044535  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.070091  1695 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:58.045406  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 581) took 1266 ms. Trace:
W20260709 13:01:58.048385  1619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 729) took 4352 ms (client timeout 1637 ms). Trace:
I20260709 13:01:58.048461  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:58.081138  1615 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:58.049854  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:58.079988  1619 rpcz_store.cc:269] 0709 13:01:53.696267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.696410 (+   143us) service_pool.cc:224] Handling call
0709 13:01:58.048137 (+4351727us) spinlock_profiling.cc:243] Waited 4.23 s on lock 0x7b540016ec54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:58.048276 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9722628992}
I20260709 13:01:58.038830  5561 consensus_queue.cc:1059] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:58.060681  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.004791  5375 consensus_queue.cc:237] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:58.065879  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:58.101452  1617 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:01:58.055509  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.073477  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2819) took 1041 ms. Trace:
I20260709 13:01:58.038125  1663 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:58.073786  1688 rpcz_store.cc:276] 0709 13:01:56.778639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.937151 (+158512us) service_pool.cc:224] Handling call
0709 13:01:56.937507 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.322397 (+384890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.322431 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.330531 (+  8100us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:57.336166 (+  5635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.045170 (+709004us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54000979d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:58.045218 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.045350 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781995776}
I20260709 13:01:58.030360  5589 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:57.982837  5587 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.102579  1695 rpcz_store.cc:276] 0709 13:01:57.032293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.072423 (+1040130us) service_pool.cc:224] Handling call
0709 13:01:58.072777 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.073066 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.073102 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.073176 (+    74us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:58.073228 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.073294 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.073411 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.102612  1696 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:01:58.082593  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:58.108325  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 70270.2us
I20260709 13:01:58.109246  1663 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:58.110098  1623 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:58.107398  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:58.113013  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:58.116086  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 95234.6us
I20260709 13:01:58.116748  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:58.117511  1621 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:58.119379  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:58.120112  1694 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:58.124639  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 99359.3us
I20260709 13:01:58.105050  5589 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.115924  5587 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:58.144309  5425 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:58.144547  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.144865  5425 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:58.145259  5425 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:58.145852  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:58.153398  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:58.062564  5544 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:58.155444  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.156435  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.160981  1511 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:58.132930  5310 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:58.167183  1697 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:58.169454  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.181583  1696 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:58.169896  5606 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:58.175956  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.181740  1514 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:58.141522  5589 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.189981  1689 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:58.195734  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2822) took 1162 ms. Trace:
I20260709 13:01:58.196134  1689 rpcz_store.cc:276] 0709 13:01:57.033409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.108954 (+1075545us) service_pool.cc:224] Handling call
0709 13:01:58.153521 (+ 44567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.195514 (+ 41993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.195683 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.191558  1688 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:58.177800  5310 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:58.201268  5310 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.201460  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:58.202674  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:58.203555  4925 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:58.203962  4925 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:58.204329  4925 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:58.207901  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 56121.9us
I20260709 13:01:58.208864  1663 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:58.198613  1688 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:58.211145  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.217083  5588 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:58.217434  5606 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:58.217594  5588 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:58.217975  5606 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:58.218088  5588 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.218446  5606 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.220165  1514 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:58.212950  5553 consensus_queue.cc:1059] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:01:58.221190  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:58.221833  5553 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:58.222085  5576 raft_consensus.cc:3055] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:58.222221  5553 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:58.222497  5576 raft_consensus.cc:740] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:58.222651  5553 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.223593  5576 consensus_queue.cc:260] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:58.227883  1514 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:01:58.228734  5576 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.229598  5597 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:58.230103  5597 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:58.230453  5597 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:58.231777  5585 consensus_queue.cc:237] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:58.258172  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:58.205643  5586 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:58.269847  1619 raft_consensus.cc:2368] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:01:58.275879  1615 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:58.276649  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1817) took 4449 ms. Trace:
I20260709 13:01:58.253149  5561 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:58.277107  1615 rpcz_store.cc:276] 0709 13:01:53.827478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.154977 (+4327499us) service_pool.cc:224] Handling call
0709 13:01:58.213697 (+ 58720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.276400 (+ 62703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.276586 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.245203  5517 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:58.270531  5544 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.269114  5586 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:01:58.306265  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 145397us
I20260709 13:01:58.303228  1688 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:58.310595  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 155486us
I20260709 13:01:58.320837  1690 raft_consensus.cc:2393] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:58.323050  5390 consensus_queue.cc:1059] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:58.301667  5561 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:58.324431  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:58.325489  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:58.323877  5562 raft_consensus.cc:3055] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:58.341859  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:58.308039  5586 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.342571  1688 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.347450  1511 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:58.348698  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:58.358162  1615 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:58.363029  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1704) took 3880 ms. Trace:
I20260709 13:01:58.363643  1615 rpcz_store.cc:276] 0709 13:01:54.478629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.296705 (+3818076us) service_pool.cc:224] Handling call
0709 13:01:58.321531 (+ 24826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.358844 (+ 37313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.359114 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.315665  5310 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:58.344691  5562 raft_consensus.cc:740] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:58.394857  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:01:58.427536  5496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.856s	user 0.022s	sys 0.070s
I20260709 13:01:58.428053  1615 raft_consensus.cc:1240] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:58.434954  1694 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:01:58.436057  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1706) took 3956 ms. Trace:
I20260709 13:01:58.439042  1615 rpcz_store.cc:276] 0709 13:01:54.503581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.399790 (+3896209us) service_pool.cc:224] Handling call
0709 13:01:58.424055 (+ 24265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.435806 (+ 11751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.436006 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:58.435693  5496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.894s	user 0.022s	sys 0.070s
I20260709 13:01:58.449674  1615 raft_consensus.cc:1240] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:58.455168  5542 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:58.469051  5562 consensus_queue.cc:260] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:58.470935  5562 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.422756  4925 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:58.475131  5565 consensus_meta.cc:287] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.003s
I20260709 13:01:58.480080  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 735) took 1188 ms. Trace:
I20260709 13:01:58.487373  1615 rpcz_store.cc:276] 0709 13:01:57.272214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.449027 (+1176813us) service_pool.cc:224] Handling call
0709 13:01:58.449419 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.459440 (+ 10021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.460132 (+   692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.485548  5542 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:58.486657  5517 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:58.483914  5586 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:58.507361  5581 raft_consensus.cc:2764] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:01:58.437597  5561 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:58.447628  5476 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:58.489420  5565 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:58.500015  5542 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:58.528918  5586 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:58.530766  5203 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:01:58.518445  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 290619us
I20260709 13:01:58.525967  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:58.540908  5542 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.519528  5606 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:58.559648  1688 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 13:01:58.570653  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.531054  5425 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:58.573586  5203 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:58.580964  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.581085  5203 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:58.581518  5203 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.583338  5551 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:58.557667  5310 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:01:58.585580  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 238252us
I20260709 13:01:58.573096  1688 pending_rounds.cc:85] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 4
I20260709 13:01:58.591902  5476 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:58.595821  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:58.596212  5630 consensus_queue.cc:1059] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:58.596582  2270 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:58.589967  1688 pending_rounds.cc:107] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:01:58.597241  5586 raft_consensus.cc:3055] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:01:58.614287  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.614109  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 92381.4us
I20260709 13:01:58.609815  1688 raft_consensus.cc:2889] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.615404  1586 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:01:58.616644  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.620913  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1811) took 4796 ms. Trace:
I20260709 13:01:58.618675  1586 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:58.624884  1586 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:01:58.630216  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 87087.3us
I20260709 13:01:58.611195  5586 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:58.607861  5589 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:58.618937  4925 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:58.637339  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2824) took 1603 ms. Trace:
I20260709 13:01:58.621865  1614 rpcz_store.cc:276] 0709 13:01:53.819166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.914295 (+4095129us) service_pool.cc:224] Handling call
0709 13:01:57.914718 (+   423us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:57.933806 (+ 19088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.933852 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:57.953413 (+ 19561us) log.cc:844] Serialized 52 byte log entry
0709 13:01:58.397546 (+444133us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:58.397580 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.397639 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.615626 (+217987us) raft_consensus.cc:1685] finished
0709 13:01:58.615655 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.615825 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6154,"raft.queue_time_us":6323,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":6569,"thread_start_us":386291,"threads_started":1,"wal-append.queue_time_us":587903}
I20260709 13:01:58.640970  1688 rpcz_store.cc:276] 0709 13:01:57.034110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.108076 (+1073966us) service_pool.cc:224] Handling call
0709 13:01:58.135928 (+ 27852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.637010 (+501082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.637278 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.649178  1586 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:58.650779  1511 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:58.653366  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 670) took 4527 ms. Trace:
I20260709 13:01:58.653761  2263 rpcz_store.cc:276] 0709 13:01:54.122346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.125730 (+  3384us) service_pool.cc:224] Handling call
0709 13:01:54.127831 (+  2101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.780744 (+2652913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.643858 (+1863114us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b54005055d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:58.649779 (+  5921us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6019600128}
W20260709 13:01:58.659343  5621 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 13:01:58.663740  5626 log.cc:927] Time spent T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:01:58.663899  5589 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:58.664625  5597 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:58.666579  5623 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:01:58.668164  5629 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:58.667764  5586 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:58.668939  5586 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:58.669309  5601 log.cc:927] Time spent T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 1.108s	user 0.004s	sys 0.000s
I20260709 13:01:58.671519  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 737) took 1398 ms. Trace:
I20260709 13:01:58.671667  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1812) took 4852 ms. Trace:
I20260709 13:01:58.667052  5597 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:58.671895  1614 rpcz_store.cc:276] 0709 13:01:57.272895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.645659 (+1372764us) service_pool.cc:224] Handling call
0709 13:01:58.670947 (+ 25288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.671162 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.671185 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.671227 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:58.671266 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.671318 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.671465 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.673271  5640 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:58.673697  5640 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.673971  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 738) took 1400 ms. Trace:
I20260709 13:01:58.674434  1614 rpcz_store.cc:276] 0709 13:01:57.273208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.673129 (+1399921us) service_pool.cc:224] Handling call
0709 13:01:58.673456 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.673627 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.673649 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.673688 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:58.673732 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.673783 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.673894 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.674032  5640 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.676839  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2826) took 1642 ms. Trace:
I20260709 13:01:58.677165  1695 rpcz_store.cc:276] 0709 13:01:57.034867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.108144 (+1073277us) service_pool.cc:224] Handling call
0709 13:01:58.132419 (+ 24275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.141333 (+  8914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.141376 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.160155 (+ 18779us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.491788 (+331633us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:58.491855 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.491940 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.676711 (+184771us) raft_consensus.cc:1685] finished
0709 13:01:58.676722 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.676799 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":8553,"thread_start_us":315084,"threads_started":1,"wal-append.queue_time_us":383759}
I20260709 13:01:58.677618  2270 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:01:58.672093  1618 rpcz_store.cc:276] 0709 13:01:53.819500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.931608 (+4112108us) service_pool.cc:224] Handling call
0709 13:01:57.955793 (+ 24185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.962508 (+  6715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.962527 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.023630 (+ 61103us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.447317 (+423687us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:58.447374 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.447491 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.671476 (+223985us) raft_consensus.cc:1685] finished
0709 13:01:58.671496 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.671616 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7246,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":12062,"thread_start_us":415072,"threads_started":1,"wal-append.queue_time_us":528132}
I20260709 13:01:58.680527  1662 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:01:58.681470  5310 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:58.682044  5310 raft_consensus.cc:697] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:58.683138  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:58.675720  5367 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:58.684528  5367 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:58.684613  1511 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:58.683223  5310 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:58.686427  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:58.686848  5367 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:58.687341  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1813) took 4859 ms. Trace:
I20260709 13:01:58.687662  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 732) took 4860 ms. Trace:
I20260709 13:01:58.688078  5595 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:58.688208  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:58.684486  5632 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.688997  1618 raft_consensus.cc:2376] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 11. Re-sending same reply.
I20260709 13:01:58.689685  5561 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:58.690400  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 733) took 4862 ms. Trace:
I20260709 13:01:58.679230  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1815) took 4854 ms. Trace:
I20260709 13:01:58.653182  4925 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:58.691272  5561 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:58.692143  5561 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:01:58.693499  5567 consensus_meta.cc:287] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.003s
I20260709 13:01:58.691587  1622 rpcz_store.cc:276] 0709 13:01:53.825230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.932400 (+4107170us) service_pool.cc:224] Handling call
0709 13:01:57.958218 (+ 25818us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:58.012721 (+ 54503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.012750 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:58.041916 (+ 29166us) log.cc:844] Serialized 78 byte log entry
0709 13:01:58.382812 (+340896us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:58.602529 (+219717us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.602938 (+   409us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.603569 (+   631us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.642419 (+ 38850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.642514 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.679039 (+ 36525us) raft_consensus.cc:1685] finished
0709 13:01:58.679055 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.679181 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29050,"prepare.queue_time_us":179893,"prepare.run_cpu_time_us":175,"prepare.run_wall_time_us":12611,"raft.queue_time_us":35670,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":13093,"spinlock_wait_cycles":10380928,"thread_start_us":584358,"threads_started":3,"wal-append.queue_time_us":442325}
I20260709 13:01:58.693924  5561 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:58.687743  1616 rpcz_store.cc:276] 0709 13:01:53.819804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.927178 (+4107374us) service_pool.cc:224] Handling call
0709 13:01:57.927591 (+   413us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:57.928062 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.928089 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:57.928730 (+   641us) log.cc:844] Serialized 52 byte log entry
0709 13:01:58.139621 (+210891us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:58.418450 (+278829us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.424170 (+  5720us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.424421 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.424540 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.676427 (+251887us) raft_consensus.cc:1685] finished
0709 13:01:58.676438 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.678921 (+  2483us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1775,"prepare.queue_time_us":533528,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":2297,"raft.queue_time_us":7278,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":16447,"spinlock_wait_cycles":14660992,"thread_start_us":481753,"threads_started":2,"wal-append.queue_time_us":388894}
I20260709 13:01:58.696480  5553 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:58.689018  5595 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:58.697721  5203 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:58.688119  1617 rpcz_store.cc:276] 0709 13:01:53.827283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.137188 (+4309905us) service_pool.cc:224] Handling call
0709 13:01:58.197861 (+ 60673us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.260861 (+ 63000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.260897 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.265925 (+  5028us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.533655 (+267730us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:58.533695 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.533766 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.687470 (+153704us) raft_consensus.cc:1685] finished
0709 13:01:58.687488 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.687611 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15936,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7692,"thread_start_us":216021,"threads_started":1,"wal-append.queue_time_us":316732}
I20260709 13:01:58.701407  1511 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:58.706087  5588 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:58.690841  1619 rpcz_store.cc:276] 0709 13:01:53.827586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.296255 (+4468669us) service_pool.cc:224] Handling call
0709 13:01:58.364083 (+ 67828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.381432 (+ 17349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.381461 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.404025 (+ 22564us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.586009 (+181984us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:58.586061 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.586149 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.690117 (+103968us) raft_consensus.cc:1685] finished
0709 13:01:58.690146 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.690295 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":152661,"threads_started":1,"wal-append.queue_time_us":267959}
I20260709 13:01:58.707433  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 744) took 1432 ms. Trace:
I20260709 13:01:58.718123  1548 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: [6.4-7.5]
I20260709 13:01:58.724444  1616 rpcz_store.cc:276] 0709 13:01:57.275041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.696409 (+1421368us) service_pool.cc:224] Handling call
0709 13:01:58.700235 (+  3826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.707050 (+  6815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.707086 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.707129 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:58.707172 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.707237 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.707341 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640384}
I20260709 13:01:58.707238  5544 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:58.712531  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 740) took 1438 ms. Trace:
I20260709 13:01:58.726358  1618 rpcz_store.cc:276] 0709 13:01:57.273790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.689799 (+1416009us) service_pool.cc:224] Handling call
0709 13:01:58.700482 (+ 10683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.712031 (+ 11549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.712077 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.712165 (+    88us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:58.712228 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.712306 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.712460 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.707402  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 741) took 1433 ms. Trace:
I20260709 13:01:58.731196  1622 rpcz_store.cc:276] 0709 13:01:57.274076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.694471 (+1420395us) service_pool.cc:224] Handling call
0709 13:01:58.700138 (+  5667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.707059 (+  6921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.707089 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.707132 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:58.707171 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.707233 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.707347 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3328}
I20260709 13:01:58.695839  5561 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.687283  5367 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:58.736963  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 745) took 1461 ms. Trace:
I20260709 13:01:58.737453  1617 rpcz_store.cc:276] 0709 13:01:57.275323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.700933 (+1425610us) service_pool.cc:224] Handling call
0709 13:01:58.734612 (+ 33679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.734751 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.734767 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.736602 (+  1835us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:58.736654 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.736727 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.736913 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.698650  5553 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:58.712486  5425 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:58.675836  5585 consensus_queue.cc:1059] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:01:58.739537  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:01:58.756577  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.739691  5203 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:01:58.744956  2268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54488 (request call id 673) took 1811 ms (client timeout 1701 ms). Trace:
I20260709 13:01:58.725541  5606 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:58.736105  5367 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:58.746376  5587 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.558s	user 0.004s	sys 0.004s
I20260709 13:01:58.750617  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 565) took 5056 ms. Trace:
I20260709 13:01:58.697867  5595 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:58.754583  1616 raft_consensus.cc:1240] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:58.759691  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 746) took 1441 ms. Trace:
I20260709 13:01:58.760320  1616 rpcz_store.cc:276] 0709 13:01:57.318726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.725895 (+1407169us) service_pool.cc:224] Handling call
0709 13:01:58.737216 (+ 11321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.759327 (+ 22111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.759621 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.753679  5465 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:58.761816  5465 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:01:58.757267  2268 rpcz_store.cc:269] 0709 13:01:56.966934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.978427 (+ 11493us) service_pool.cc:224] Handling call
0709 13:01:58.744502 (+1766075us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b54004d6cd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:58.744803 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11588352}
I20260709 13:01:58.763967  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 736) took 1491 ms. Trace:
I20260709 13:01:58.711104  5597 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:01:58.768747  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1816) took 4941 ms. Trace:
I20260709 13:01:58.765821  1615 rpcz_store.cc:276] 0709 13:01:57.272588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.493057 (+1220469us) service_pool.cc:224] Handling call
0709 13:01:58.501927 (+  8870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.511668 (+  9741us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:58.612212 (+100544us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.763647 (+151435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.763698 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:58.763737 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.763798 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.763905 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":76583,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4063,"thread_start_us":215191,"threads_started":2}
I20260709 13:01:58.783881  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2844) took 1041 ms. Trace:
I20260709 13:01:58.784370  1690 rpcz_store.cc:276] 0709 13:01:57.742834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.068608 (+325774us) service_pool.cc:224] Handling call
0709 13:01:58.783665 (+715057us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54003908d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:58.783816 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529454848}
I20260709 13:01:58.763252  5595 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:58.798990  5576 consensus_meta.cc:287] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.001s
I20260709 13:01:58.758478  1692 rpcz_store.cc:276] 0709 13:01:53.694221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.793656 (+ 99435us) service_pool.cc:224] Handling call
0709 13:01:53.793962 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:53.919996 (+126034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.920031 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:54.111124 (+191093us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b2c000d1b28. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:01:54.111680 (+   556us) log.cc:844] Serialized 52 byte log entry
0709 13:01:56.509402 (+2397722us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:56.548817 (+ 39415us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.750109 (+2201292us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b18003f5860. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c6a6e64bc 00007f5c67a3448b 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a4e455 00007f5c6ab36060 00007f5c6ab48716 00007f5c6ab59287
0709 13:01:58.750239 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.750358 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.750396 (+    38us) raft_consensus.cc:1685] finished
0709 13:01:58.750408 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.750562 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125306,"prepare.queue_time_us":112646,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":24073,"raft.queue_time_us":195132,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":304,"spinlock_wait_cycles":26161280,"thread_start_us":2454694,"threads_started":3,"wal-append.queue_time_us":2442446,"wal-append.run_cpu_time_us":5508,"wal-append.run_wall_time_us":1486903}
I20260709 13:01:58.815235  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 729) took 1784 ms. Trace:
I20260709 13:01:58.816636  5488 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:58.815754  1544 rpcz_store.cc:276] 0709 13:01:57.030556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.031605 (+  1049us) service_pool.cc:224] Handling call
0709 13:01:57.032013 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.470784 (+438771us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.470822 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.649460 (+178638us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.942317 (+292857us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:57.942342 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.814676 (+872334us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54000c5654. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:58.814725 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.814777 (+    52us) raft_consensus.cc:1685] finished
0709 13:01:58.814793 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.815046 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1111,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":914469632,"thread_start_us":247277,"threads_started":1,"wal-append.queue_time_us":497929}
I20260709 13:01:58.823711  5486 raft_consensus.cc:3055] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:58.824388  5486 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:58.825344  5486 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:58.826952  5486 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.764951  5587 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:58.828564  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2631) took 1712 ms (client timeout 2191 ms). Trace:
I20260709 13:01:58.830065  5588 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:58.834033  1546 raft_consensus.cc:1240] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:58.836436  1543 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:58.852595  5640 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:58.854404  5447 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:01:58.914723  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.856971  5542 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:58.916417  5640 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:58.916704  5542 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:58.857539  1548 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:58.858233  5549 raft_consensus.cc:3055] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:58.918059  5549 raft_consensus.cc:740] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:58.918573  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.919188  1548 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:58.919060  5549 consensus_queue.cc:260] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:58.920238  5549 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:58.858880  5595 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:58.924014  1539 raft_consensus.cc:1240] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:58.864050  5544 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:58.864480  2272 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:58.864295  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:58.860026  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:58.862025  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:58.868108  2267 raft_consensus.cc:1240] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:58.868791  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:58.769044  1621 rpcz_store.cc:276] 0709 13:01:53.827174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.133726 (+4306552us) service_pool.cc:224] Handling call
0709 13:01:58.172884 (+ 39158us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:58.173388 (+   504us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:58.381852 (+208464us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.652436 (+270584us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:58.671735 (+ 19299us) log.cc:844] Serialized 52 byte log entry
0709 13:01:58.674492 (+  2757us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:58.674961 (+   469us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.758559 (+ 83598us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.768413 (+  9854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.768566 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.768606 (+    40us) raft_consensus.cc:1685] finished
0709 13:01:58.768613 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.768706 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9458,"prepare.queue_time_us":351288,"prepare.run_cpu_time_us":145,"prepare.run_wall_time_us":5819,"raft.queue_time_us":102656,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":301,"thread_start_us":502235,"threads_started":4,"wal-append.queue_time_us":257124}
W20260709 13:01:58.876164  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 227045us
I20260709 13:01:58.928725  1586 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:58.877316  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:58.879452  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.863083  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:58.929915  1690 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:01:58.930110  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.884182  1689 raft_consensus.cc:1240] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:58.886915  5565 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:58.888468  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.890326  1615 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:58.895671  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1790) took 5479 ms. Trace:
I20260709 13:01:58.895905  5381 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:58.897993  5391 consensus_queue.cc:1059] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:58.899969  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.901767  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:58.904524  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:58.932478  1693 rpcz_store.cc:276] 0709 13:01:53.416191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.416317 (+   126us) service_pool.cc:224] Handling call
0709 13:01:57.730323 (+4314006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.947768 (+217445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.894448 (+946680us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b540022f454. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:58.895469 (+  1021us) spinlock_profiling.cc:243] Waited 4.31 s on lock 0x7b540022f450. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:58.895610 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9933342336}
I20260709 13:01:58.899228  2234 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:01:58.907713  1540 rpcz_store.cc:269] 0709 13:01:57.115960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.150938 (+ 34978us) service_pool.cc:224] Handling call
0709 13:01:58.828321 (+1677383us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54000a69d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:01:58.828476 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495811328}
I20260709 13:01:58.936134  1547 raft_consensus.cc:2393] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:58.935261  1542 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:58.936370  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:58.937255  1541 raft_consensus.cc:2410] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:01:58.910497  5465 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:58.910727  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:58.910534  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:58.939071  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:58.912990  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:58.913988  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.855929  5367 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:58.942283  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:58.942584  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.920260  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.938661  1692 raft_consensus.cc:2376] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 9. Re-sending same reply.
I20260709 13:01:58.924300  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:58.939206  1696 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:01:58.925516  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:58.883023  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.926129  5595 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:58.904709  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:58.909864  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.910756  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:01:58.943437  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 44261.4us
I20260709 13:01:58.944315  1546 raft_consensus.cc:2393] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:58.938243  1587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 4.259s (SENT) [suppressed 51 similar messages]
W20260709 13:01:58.946662  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.942955  1540 raft_consensus.cc:2376] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8. Re-sending same reply.
I20260709 13:01:58.947830  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:58.948081  5587 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:58.948248  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:58.949060  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:58.949364  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.949663  5167 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:58.949816  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.949159  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:58.950479  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.951035  1623 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.951555  1586 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:58.955387  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.957823  1545 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:58.957922  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.964510  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.965798  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.966543  1545 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:58.967101  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:58.974642  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:58.975221  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.971825  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.975644  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:58.975970  1546 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:58.976402  1617 raft_consensus.cc:2393] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:58.976311  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.976629  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:58.977068  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.977319  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:58.977466  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.977754  1546 raft_consensus.cc:2393] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:58.968096  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:58.968642  5647 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:58.958693  5390 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:58.978477  1618 raft_consensus.cc:2410] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:58.971792  1614 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:58.979394  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:58.980288  1544 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.967995  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.981557  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:01:58.981690  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.982314  1547 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:58.983018  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.983933  2263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:01:58.984326  1546 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:01:58.984670  2263 raft_consensus.cc:606] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:58.984928  5259 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.985446  5259 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:58.986279  5465 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.986769  5465 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:58.987579  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.978190  1622 raft_consensus.cc:2393] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:58.988713  5465 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:58.989015  5259 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:58.977779  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:58.973349  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:58.978247  5647 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:01:58.989267  5553 raft_consensus.cc:3055] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:58.956126  5167 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:01:58.999157  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 47721.5us
I20260709 13:01:58.999718  5646 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:59.000540  5646 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.000295  5167 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.001184  5646 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.998644  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:58.990110  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:58.990319  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.993713  1694 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:01:58.998605  1545 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.000607  1586 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:58.989861  1540 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:01:59.008447  1691 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:01:59.013378  1542 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:01:59.015286  1541 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:59.017813  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:59.018236  1546 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:59.020679  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.020797  1548 raft_consensus.cc:1240] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:59.025103  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.025977  1542 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:59.004139  5553 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:01:59.031076  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.033531  1540 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:59.004027  5647 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:59.036038  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.039600  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:59.040202  1615 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.041361  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.023540  5381 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:59.043728  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:59.027367  5606 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.049532  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:59.048246  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.050192  1544 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:01:59.053498  1586 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:01:59.063813  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:59.050037  5481 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.008s	sys 0.007s
I20260709 13:01:59.070560  1544 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:59.073902  1547 raft_consensus.cc:1240] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:59.072440  2231 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.077773  1546 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:59.049472  5381 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.034744  5391 consensus_queue.cc:1059] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:01:59.084296  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.085233  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:59.085407  1540 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:59.087430  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.075816  5390 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:59.091403  1541 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
W20260709 13:01:59.076732  5481 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.009s	sys 0.007s
I20260709 13:01:59.096336  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:59.090709  1661 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:59.095054  5390 raft_consensus.cc:697] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:59.095014  5435 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.100123  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.090651  5381 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:59.119238  4389 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:59.072793  5563 consensus_queue.cc:1059] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:01:59.068248  5606 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:59.121904  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61328.4us
W20260709 13:01:59.127091  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.132791  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:59.126343  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.134183  1622 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.134446  5563 raft_consensus.cc:3055] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:59.134879  5563 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:59.115624  5447 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:59.135676  5391 consensus_queue.cc:1059] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:59.135741  5563 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.136608  5447 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.137012  5447 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:59.137187  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.139977  5310 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.140059  5651 consensus_queue.cc:1059] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:01:59.140787  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.141078  5606 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:59.134177  1544 raft_consensus.cc:2410] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:59.148828  2231 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:59.150944  1661 leader_election.cc:336] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.831s (SENT)
I20260709 13:01:59.155184  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.137089  5563 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.128213  5435 raft_consensus.cc:3055] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:59.165864  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.167042  1544 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:59.168787  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:59.119266  5366 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:01:59.173666  2231 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:59.172406  1514 leader_election.cc:400] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:01:59.177156  1514 leader_election.cc:403] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:01:59.178853  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 739) took 1905 ms. Trace:
I20260709 13:01:59.179469  1614 rpcz_store.cc:276] 0709 13:01:57.273505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.675258 (+1401753us) service_pool.cc:224] Handling call
0709 13:01:58.700355 (+ 25097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.979192 (+278837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.178524 (+199332us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400115654. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:01:59.178770 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":624418816}
I20260709 13:01:59.183369  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:01:59.190660  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 57062.5us
I20260709 13:01:59.158649  5435 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:59.171088  5656 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.195688  2231 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:01:59.198005  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 47083.2us
W20260709 13:01:59.206512  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.176370  5310 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.208170  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.210843  1544 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
W20260709 13:01:59.195145  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 117939us
I20260709 13:01:59.213161  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.192987  5390 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.218782  5375 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:59.220216  5375 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:59.220561  5375 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:59.220954  5375 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.223703  5561 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:59.225198  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.226264  5650 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:59.227723  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.228274  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.228865  1697 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:01:59.229318  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:59.229813  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.230753  1697 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 9: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:59.231678  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.232501  1695 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 13: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:59.235392  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1707) took 1922 ms. Trace:
I20260709 13:01:59.235980  1619 rpcz_store.cc:276] 0709 13:01:57.313119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.724204 (+1411085us) service_pool.cc:224] Handling call
0709 13:01:58.724613 (+   409us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:58.725030 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.725057 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:58.918717 (+193660us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b2c0005b5c8. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:01:58.919601 (+   884us) log.cc:844] Serialized 52 byte log entry
0709 13:01:59.021904 (+102303us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:59.021968 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.022056 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.235082 (+213026us) raft_consensus.cc:1685] finished
0709 13:01:59.235110 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.235335 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":343,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"spinlock_wait_cycles":9676672,"thread_start_us":101738,"threads_started":1,"wal-append.queue_time_us":166645}
I20260709 13:01:59.237388  5495 consensus_queue.cc:1059] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:59.238852  5495 raft_consensus.cc:3055] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:59.229998  1689 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.250229  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:59.255786  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:59.261181  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:59.196606  5606 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:01:59.267962  1623 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:59.270284  1545 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:01:59.245398  5375 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.276162  1622 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:01:59.187328  5454 consensus_queue.cc:1059] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:01:59.277513  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:59.276136  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:59.285722  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:59.285868  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:59.279754  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.281955  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.282792  1691 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:01:59.286114  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:59.288972  1693 raft_consensus.cc:2376] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8. Re-sending same reply.
I20260709 13:01:59.239352  5495 raft_consensus.cc:740] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:59.263718  5651 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:59.279385  1514 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.313181  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.313647  2267 raft_consensus.cc:1240] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:59.332222  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:59.336771  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.337611  1545 raft_consensus.cc:2410] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:59.340677  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.347451  1689 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:59.348670  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.349335  1689 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:59.352125  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:59.357096  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.357700  1545 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:01:59.357779  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.361008  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:01:59.344740  5660 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:01:59.363924  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 84646us
I20260709 13:01:59.368906  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.369151  1514 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.369704  1697 raft_consensus.cc:2410] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:59.370249  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.331781  5606 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:59.365249  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.373935  1545 raft_consensus.cc:2393] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 10: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:59.374696  1544 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:59.375541  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.376211  1547 raft_consensus.cc:2393] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:59.337517  5651 raft_consensus.cc:697] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:59.370808  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.371351  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.371829  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:59.371971  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.372376  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.368113  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.377914  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:59.376588  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:59.335842  5565 consensus_queue.cc:1059] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:01:59.384295  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:59.384939  1542 raft_consensus.cc:2376] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6. Re-sending same reply.
I20260709 13:01:59.383649  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.386466  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:59.392275  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:59.392633  1539 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.393357  1587 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.396096  1541 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:59.396512  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.377434  5588 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.398695  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.399611  1540 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:59.400719  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.401530  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.381430  5595 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.402225  1689 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:59.316080  5435 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.405016  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:59.405544  1694 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.361976  5630 consensus_queue.cc:1059] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:59.405751  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.405565  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:01:59.406973  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 211347us
I20260709 13:01:59.407020  1544 raft_consensus.cc:2393] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:59.408448  1615 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:59.409010  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.409814  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.408555  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:59.410689  1543 raft_consensus.cc:2376] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8. Re-sending same reply.
I20260709 13:01:59.399940  5486 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:59.414860  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.424486  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.415954  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:59.434403  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.378005  5495 consensus_queue.cc:260] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.435608  5435 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.440430  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:59.423725  5588 raft_consensus.cc:3055] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:59.443955  1587 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:59.445562  5549 consensus_meta.cc:287] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.521s	user 0.002s	sys 0.007s
I20260709 13:01:59.430778  5587 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.445914  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:59.446558  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:59.447203  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.447799  5390 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:59.449923  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:59.451624  5447 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.453676  5167 raft_consensus.cc:3055] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:59.463749  4389 raft_consensus.cc:993] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:01:59.416337  5630 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.416357  5486 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.464955  1539 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:01:59.465471  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:59.505806  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:59.475157  1693 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:59.450495  5553 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.478478  1544 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:59.478998  5481 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:59.513326  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 97250.7us
W20260709 13:01:59.497977  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.500275  1690 raft_consensus.cc:2410] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:59.503306  4389 raft_consensus.cc:1081] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:01:59.503357  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.469106  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.473924  5588 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:59.508699  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:01:59.473879  5375 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:59.509469  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:59.519289  2231 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:01:59.475173  5606 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:59.499250  5167 raft_consensus.cc:740] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:59.513866  1692 raft_consensus.cc:2368] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:01:59.514021  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.513536  1695 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:01:59.488651  1694 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:59.514981  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.516534  1548 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
W20260709 13:01:59.517498  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 48496.4us
I20260709 13:01:59.518477  1542 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:59.518126  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.521976  1543 raft_consensus.cc:2410] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:01:59.524873  1661 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.525668  5565 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:59.525702  1661 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:59.526950  5565 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:59.527554  5565 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:01:59.528062  5565 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.531862  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.532735  5630 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.528048  1661 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:59.537231  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.534206  5381 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.540277  5381 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:59.541203  5367 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:59.542090  1620 raft_consensus.cc:2368] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
I20260709 13:01:59.542475  1693 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:59.543612  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:01:59.544351  1693 raft_consensus.cc:2393] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 6: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:01:59.545439  1691 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:59.545733  5565 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.548310  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:59.548873  1541 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.549566  4389 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:59.550125  4389 raft_consensus.cc:697] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:59.550565  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.460964  5651 consensus_queue.cc:237] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.551818  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.552429  5561 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:59.552642  1546 raft_consensus.cc:2393] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 5: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:01:59.552887  5561 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.553310  5561 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:59.554652  1586 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:59.511579  5486 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.555608  5583 raft_consensus.cc:3055] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:59.556001  5583 raft_consensus.cc:740] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:59.556972  5447 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:59.556795  5583 consensus_queue.cc:260] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.558053  5583 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.559911  5553 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.562187  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.512029  5495 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.563378  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.564039  5488 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:59.564424  5488 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:01:59.564570  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:59.565249  1540 raft_consensus.cc:2376] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10. Re-sending same reply.
I20260709 13:01:59.567117  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.568555  1539 raft_consensus.cc:2368] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6.
I20260709 13:01:59.569357  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:01:59.570086  1539 raft_consensus.cc:2393] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:01:59.570497  5646 consensus_meta.cc:287] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.004s
I20260709 13:01:59.572009  5598 raft_consensus.cc:3055] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:59.572515  5598 raft_consensus.cc:740] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:59.573452  5598 consensus_queue.cc:260] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.574615  1545 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:59.576449  5167 consensus_queue.cc:260] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.577786  5167 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.579689  1539 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:59.579906  5425 raft_consensus.cc:3055] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:59.580335  5425 raft_consensus.cc:740] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:59.550987  4389 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.518457  5587 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.581153  5425 consensus_queue.cc:260] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.582451  5425 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.583462  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.584254  5390 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.564765  5488 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:59.586239  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 63165us
I20260709 13:01:59.553539  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:59.585628  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:59.586539  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 67348.7us
I20260709 13:01:59.593667  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.588101  1694 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:59.588773  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:01:59.590906  1542 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:59.595261  1511 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.598027  1541 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:01:59.566100  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:01:59.605358  1540 raft_consensus.cc:2376] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7. Re-sending same reply.
I20260709 13:01:59.610994  1511 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.613045  1689 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:59.615849  1618 raft_consensus.cc:1240] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:59.570930  5646 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:01:59.593413  5647 consensus_meta.cc:287] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 13:01:59.614255  5630 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.609613  5587 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.624020  5647 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.624948  5587 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:59.621080  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.575098  5598 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:59.621785  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 84681.3us
I20260709 13:01:59.622980  1617 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:59.623339  5310 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.609772  5664 consensus_queue.cc:1059] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:01:59.647394  1541 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:59.663493  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.665849  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.562908  5588 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.669518  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.670114  5481 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.627512  5544 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.679284  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:59.680301  2267 raft_consensus.cc:2393] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:01:59.683084  1587 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.659698  5595 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:59.688212  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:01:59.684922  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 101541us
I20260709 13:01:59.675161  5390 consensus_queue.cc:1059] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:01:59.664228  5447 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.671190  5465 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.672694  5656 raft_consensus.cc:3055] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:59.646502  5458 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:01:59.707499  1539 raft_consensus.cc:1240] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:59.716847  2267 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:59.684940  5643 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.696215  5549 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:01:59.703863  5588 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:59.752442  5646 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:59.752575  5664 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:59.731549  1662 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.707484  5481 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.753357  5565 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:59.753983  5565 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.746178  5310 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:59.754506  5310 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:59.755484  5310 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.701546  5656 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:59.757431  5656 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.758487  5656 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:59.744527  5544 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:59.730938  1442 catalog_manager.cc:5697] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:59.760597  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 77598.8us
I20260709 13:01:59.769097  1587 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.668840  5259 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:01:59.780675  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:01:59.784312  2264 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:59.705245  5447 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.713896  5669 consensus_queue.cc:1059] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
W20260709 13:01:59.800360  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 149778us
W20260709 13:01:59.803910  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 193009us
I20260709 13:01:59.807662  1511 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.808772  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:01:59.815141  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 125199us
I20260709 13:01:59.706115  5465 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.824077  1511 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.816067  5595 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.838996  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:01:59.848052  5671 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:01:59.849515  5673 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:59.858227  5561 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.863758  5678 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.864346  5678 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.866503  5678 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:59.867507  5561 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:59.870687  1546 raft_consensus.cc:2410] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:59.826011  5542 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:59.868206  5561 consensus_queue.cc:1059] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:01:59.876753  5447 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:59.877727  5447 raft_consensus.cc:3055] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:59.877916  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:01:59.878077  5447 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:01:59.878918  5447 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.886140  5366 raft_consensus.cc:3055] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:59.886593  5366 raft_consensus.cc:740] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:01:59.892123  5486 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.894306  5486 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:01:59.899685  5310 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:59.901943  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.899573  5544 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.843633  1511 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.917723  2269 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:01:59.867007  5678 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:01:59.930320  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 128802us
W20260709 13:01:59.926281  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 109112us
W20260709 13:01:59.928911  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 85365.2us
I20260709 13:01:59.931533  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.931694  1511 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.843103  5606 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.892148  5454 raft_consensus.cc:3055] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:59.934300  1511 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:01:59.934631  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 165625us
W20260709 13:01:59.935199  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 52819us
I20260709 13:01:59.935957  1587 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.937593  5381 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.933497  5454 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:01:59.939595  5454 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.940941  5454 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:59.936076  5553 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.943637  1511 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.933691  5542 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.945613  1586 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.946256  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.950062  1511 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:59.950675  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.951366  1586 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:01:59.951823  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:01:59.942694  5465 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:01:59.917459  5366 consensus_queue.cc:260] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:01:59.953152  1511 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:01:59.954195  5651 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:59.954828  5683 consensus_queue.cc:1059] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:59.996357  5683 raft_consensus.cc:3055] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:59.996722  5683 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:59.991349  1620 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:59.997591  5683 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.999042  5683 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:59.999676  5630 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:59.955847  5672 log.cc:927] Time spent T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:01:59.999938  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 47384.9us
I20260709 13:01:59.956071  5588 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:00.001015  1511 leader_election.cc:400] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:02:00.001400  1511 leader_election.cc:403] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:59.952193  5381 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.949913  5595 consensus_queue.cc:1059] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:01:59.959803  5447 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.002445  5595 raft_consensus.cc:3055] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:00.002825  5595 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:01:59.962118  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.949926  5565 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.949424  5425 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:01:59.944794  5682 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:59.947114  5544 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:00.007918  1513 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:00.008042  5606 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:00.008908  5606 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:59.984112  5259 raft_consensus.cc:3055] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:59.985241  5366 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.015579  5486 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.986050  5651 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:02:00.017086  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 69465.9us
I20260709 13:02:00.016992  5651 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:00.017923  1587 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:00.018215  5651 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:59.990063  2267 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:59.971232  1663 leader_election.cc:336] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.729s (SENT)
I20260709 13:02:00.011370  5259 raft_consensus.cc:740] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:02:00.020269  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 49069.8us
I20260709 13:02:00.020751  5259 consensus_queue.cc:260] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:00.021816  5259 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.991442  1588 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:02:00.021742  1663 leader_election.cc:336] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.731s (SENT)
I20260709 13:01:59.993114  5647 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:01:59.994714  1545 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:00.024396  5681 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.024955  5681 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:01:59.994371  1442 catalog_manager.cc:5697] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 5 to 9, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 9 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:00.001308  5588 raft_consensus.cc:697] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:01:59.948619  5481 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:59.950564  5553 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.028383  1539 raft_consensus.cc:1240] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:00.028563  5595 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.030145  5595 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.026747  5588 consensus_queue.cc:237] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.010962  5390 raft_consensus.cc:2764] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:02:00.010011  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 62401.3us
I20260709 13:01:59.991619  1623 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.034693  1586 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:00.035117  5606 raft_consensus.cc:697] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:00.035562  1586 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:00.019131  1587 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:00.039927  5481 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:00.040520  5481 raft_consensus.cc:697] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:00.036043  5606 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:00.041755  5681 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:00.041492  5481 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.042338  5681 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:00.019584  5486 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:00.044543  5310 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:00.046480  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 94709.2us
I20260709 13:02:00.048146  1442 catalog_manager.cc:5697] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 3 to 6, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 6 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.052084  1442 catalog_manager.cc:5697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 5 to 6, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 6 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.053354  5454 consensus_queue.cc:1059] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:00.056107  1587 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:00.056860  1623 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:59.952772  5680 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:00.053874  1442 catalog_manager.cc:5697] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:00.070384  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:00.076731  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 75899us
I20260709 13:02:00.077684  1442 catalog_manager.cc:5697] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 5 to 8, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 8 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:00.081919  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.047883  5681 raft_consensus.cc:697] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:00.067901  5381 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:00.086376  5675 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:02:00.094884  5563 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:00.076836  5390 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.096156  5681 consensus_queue.cc:237] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.087972  5647 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.099710  5647 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.102017  5647 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:00.082799  5488 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.072856  5680 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.084285  5544 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:00.090471  1587 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:00.105166  1442 catalog_manager.cc:5697] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:00.109884  1548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "738a15ae04514d49969f3624caa73f45"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:02:00.114934  1548 raft_consensus.cc:606] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:00.111768  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.115280  1548 raft_consensus.cc:614] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:00.120797  1587 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:02:00.131451  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.084993  5561 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:00.137123  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:00.138458  1663 leader_election.cc:336] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.895s (SENT)
W20260709 13:02:00.146123  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 75845us
I20260709 13:02:00.114219  5680 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:00.080210  5684 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:02:00.150424  1442 catalog_manager.cc:5697] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.153666  1587 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:00.089630  5630 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:02:00.137198  5643 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.162228  1587 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:00.163388  1587 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:00.143687  5381 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:00.164124  1442 catalog_manager.cc:5697] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 7 to 8, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 8 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:00.184176  1661 leader_election.cc:400] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6.
I20260709 13:02:00.184556  1661 leader_election.cc:403] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:00.159373  5366 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:00.158850  5681 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:00.200167  1661 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:00.208474  1661 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:00.176257  5481 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:00.167762  5563 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:00.172330  5381 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:00.219336  1661 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:00.220753  2269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:53842
W20260709 13:02:00.221020  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 57705.2us
I20260709 13:02:00.186703  5664 raft_consensus.cc:3055] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:00.225636  2269 raft_consensus.cc:606] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:00.228366  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.233374  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:00.235987  1620 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:00.233881  1661 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:00.216745  5447 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6.
I20260709 13:02:00.226040  5381 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:00.221863  5565 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.247391  1620 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:00.222878  5561 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.231609  5549 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:00.248807  5549 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.249204  5549 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.253769  2267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "953db44baef24f55a28e65ff051866d1"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:00.254405  2267 raft_consensus.cc:606] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:00.254925  5495 consensus_queue.cc:1059] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:00.255160  5682 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.255692  5682 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.231667  5681 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:02:00.257898  5682 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:00.259533  5685 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:02:00.263227  5549 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.265473  5549 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:00.273152  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:00.273715  1696 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:00.227537  5664 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:00.275597  1511 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:00.311810  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.225775  5678 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:02:00.283958  5672 log.cc:927] Time spent T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:00.270040  5488 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:00.324463  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 96388.7us
I20260709 13:02:00.325320  1587 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:00.328224  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:00.287019  5682 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:00.329655  5563 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:00.326493  5549 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:00.340997  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 114211us
I20260709 13:02:00.343043  5670 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:02:00.344544  5549 raft_consensus.cc:697] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:00.345495  5549 consensus_queue.cc:237] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.353801  5366 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:00.357366  5310 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.358338  5647 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:00.358741  5647 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:00.332803  5684 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:00.333616  5481 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:00.387027  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 58881.3us
I20260709 13:02:00.336491  5682 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.393251  1661 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:00.399950  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:00.417456  1663 leader_election.cc:336] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 2.110s (SENT)
I20260709 13:02:00.416718  2264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:53842
W20260709 13:02:00.388335  5690 log.cc:927] Time spent T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:02:00.418918  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 77231.3us
I20260709 13:02:00.421551  1661 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:00.419764  5465 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:00.418607  2264 raft_consensus.cc:606] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:00.430845  2264 raft_consensus.cc:614] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:00.392462  5544 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:02:00.383466  5563 raft_consensus.cc:697] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:00.408037  5682 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:00.454502  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 65460.1us
I20260709 13:02:00.453661  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:00.439851  5481 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:00.467401  1689 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:00.468161  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:00.469991  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.472864  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:00.473028  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:00.473747  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:00.474946  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:00.482190  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:00.443739  5465 raft_consensus.cc:697] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:00.486797  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:00.455741  1587 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:00.483441  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:00.484896  1690 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:00.485268  1693 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.472493   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:00.483434  1546 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:00.463315  1691 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:00.486711  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:00.488217  1545 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:00.485950  1694 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:00.460796  5310 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.492910  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:00.492661  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:00.496604  1541 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:00.496739  1548 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:02:00.497035  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:00.457942  5588 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.493306  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:00.500622  1540 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:00.496050  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:00.501832  1544 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.497817  1539 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:00.399912  5647 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.505383  2264 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:00.507740  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:00.508401  1689 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:00.483174  5390 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.510993  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:00.498759  1587 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:00.499148  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:00.496769  1542 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:02:00.512990  1546 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.464809  5606 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.420629  5664 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:00.525200  5486 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:00.504408  5366 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.545171  5563 consensus_queue.cc:237] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.573765  1543 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:00.522459  5595 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:02:00.549502  5683 consensus_meta.cc:287] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.539s	user 0.004s	sys 0.004s
W20260709 13:02:00.587778  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 66621.6us
I20260709 13:02:00.589425  1587 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:00.560734  1690 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:00.578600  1546 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:00.593472  1693 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:02:00.546625  5381 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:00.595613  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 239987us
W20260709 13:02:00.598361  1663 leader_election.cc:336] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 2.204s (SENT)
I20260709 13:02:00.608203  1544 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:02:00.622102  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.622869  1621 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:00.623438  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.624233  1618 raft_consensus.cc:2393] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:00.624361  5680 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.624979  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.626116  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.626299  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.626850  1618 raft_consensus.cc:2410] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:00.626951  1621 raft_consensus.cc:2393] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:00.506541  5588 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.627663  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.627991  1621 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:00.628983  5588 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:00.629323  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.629314  1621 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:00.630584  5684 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:00.632277  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.522975  5606 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.619189  5664 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:00.637042  5606 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:00.639043  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.640278  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:00.641203  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.629694  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.642380  1614 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:00.643162  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.643961  1618 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:00.644835  1619 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:00.555250  5643 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.660049  1620 raft_consensus.cc:1240] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:00.659921  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.646020  1442 catalog_manager.cc:5697] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 3 to 4, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 4 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:00.661473  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.662042  1540 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:00.662382  1621 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:02:00.645977   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:00.663276  1623 raft_consensus.cc:2393] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:00.663358  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.672111  1616 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:00.672286  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.678273  1617 raft_consensus.cc:2393] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:00.618916  5681 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:00.684787  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.687593  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.687803  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.688436  1614 raft_consensus.cc:2410] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:02:00.688788  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.694675  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.697633  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.699304  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:00.645684  5549 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:00.710304  1617 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:00.715453  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.716485  5598 raft_consensus.cc:993] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: : Instructing follower 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:02:00.716984  5598 raft_consensus.cc:1081] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Signalling peer 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:02:00.717229  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:00.720258  1622 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:00.695628  5310 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:00.730988  1616 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:00.629738  5465 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.717907  1692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:58526
I20260709 13:02:00.737502  1692 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:00.738008  1692 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:00.653681  5680 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:00.747493  1618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "953db44baef24f55a28e65ff051866d1"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:33892
I20260709 13:02:00.748127  1618 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:00.748497  1618 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:00.751942  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.709728  5549 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:00.769029  1693 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:00.771171  1619 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:00.740861  5310 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:00.780412  1691 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:00.782760  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:00.783526  1691 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:00.789013  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:00.793104  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.793179  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.793880  1622 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.800112  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.800869  1619 raft_consensus.cc:2368] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:00.800719  1616 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:02:00.802053  1511 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:00.768734  5685 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:00.809542  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.824368  1688 raft_consensus.cc:1240] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:00.825213  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 123618us
I20260709 13:02:00.826917  1622 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:00.808595  5481 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:00.813943  5606 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:00.831307  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.836609  1688 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:00.828266  1618 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:00.845616  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.846369  1617 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:02:00.846606  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.847355  1623 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:00.847919  1614 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:00.848168  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.848529  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.848873  1621 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:00.849331  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.849515  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.849705  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.850147  1617 raft_consensus.cc:2393] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:00.850242  1622 raft_consensus.cc:2393] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:00.850482  1621 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:00.850935  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.851280  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.851039  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.848897  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.852449  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.852861  1614 raft_consensus.cc:2393] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:00.852784  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.853502  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.856614  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.853572  1622 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:00.853794  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.858263  1614 raft_consensus.cc:2393] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:00.854034  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.861212  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.861884  1621 raft_consensus.cc:2368] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
W20260709 13:02:00.859608  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 91679.6us
I20260709 13:02:00.866814  5495 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.867321  5495 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:00.869431  5495 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:00.871876  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:00.872745  1548 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
W20260709 13:02:00.873389  1441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52824 (request call id 228) took 26277 ms (client timeout 15000 ms). Trace:
I20260709 13:02:00.873739  5657 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:00.874337  5657 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:00.876248  1442 catalog_manager.cc:5697] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.811830  5630 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:02:00.828610  5685 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:00.878281  1442 catalog_manager.cc:5697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 8 to 9, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 9 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.882531  1695 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:00.882899  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:00.830313  5381 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:00.889325  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.889633  1618 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:00.843797  5606 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.892889  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:00.896502  2267 raft_consensus.cc:3055] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:00.898699  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.899295  1621 raft_consensus.cc:2376] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9. Re-sending same reply.
I20260709 13:02:00.900399  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.900614  5549 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:00.910952  5713 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:02:00.911556  5606 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.918885  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:00.896938  2267 raft_consensus.cc:740] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:00.921279  5647 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:00.921757  2267 consensus_queue.cc:260] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:00.923126  2267 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:00.924047  5709 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:02:00.925695  1695 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:02:00.873956  1441 rpcz_store.cc:269] 0709 13:01:34.596176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.596515 (+   339us) service_pool.cc:224] Handling call
0709 13:02:00.873095 (+26276580us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:51.974260 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:51.975064 (+   804us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:51.975110 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:01:51.975137 (+    27us) tablet.cc:662] Decoding operations
0709 13:01:51.976415 (+  1278us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:51.976523 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:51.976570 (+    47us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:01:51.977848 (+  1278us) tablet.cc:701] Row locks acquired
0709 13:01:51.977878 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:01:51.978077 (+   199us) write_op.cc:270] Start()
0709 13:01:51.978228 (+   151us) write_op.cc:276] Timestamp: P: 1783602111978016 usec, L: 0
0709 13:01:51.978256 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:01:52.042204 (+ 63948us) log.cc:844] Serialized 2865 byte log entry
0709 13:01:53.065584 (+1023380us) op_driver.cc:464] REPLICATION: finished
0709 13:01:53.290754 (+225170us) write_op.cc:301] APPLY: starting
0709 13:01:53.351948 (+ 61194us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:53.503815 (+151867us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:53.504316 (+   501us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:53.511554 (+  7238us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:53.511934 (+   380us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:01:53.511990 (+    56us) write_op.cc:312] APPLY: finished
0709 13:01:53.512350 (+   360us) log.cc:844] Serialized 59 byte log entry
0709 13:01:53.512583 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:53.512713 (+   130us) write_op.cc:454] Released schema lock
0709 13:01:53.512759 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:53.513428 (+   669us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:53.513456 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12585,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":200745,"apply.run_cpu_time_us":10678,"apply.run_wall_time_us":231567,"num_ops":7,"prepare.queue_time_us":155321,"prepare.run_cpu_time_us":23990,"prepare.run_wall_time_us":288445,"raft.queue_time_us":167706,"raft.run_cpu_time_us":26381,"raft.run_wall_time_us":118182,"replication_time_us":1079196,"thread_start_us":425775,"threads_started":4,"wal-append.queue_time_us":460780,"wal-append.run_cpu_time_us":17154,"wal-append.run_wall_time_us":1952202}]]}
I20260709 13:02:00.929272  1615 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
W20260709 13:02:00.931556  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 47514us
I20260709 13:02:00.932297  2232 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:00.934015  5598 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:00.934376  5598 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.934691  5598 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:00.937209  5606 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:00.932435  5704 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.428s	user 0.000s	sys 0.002s
I20260709 13:02:00.958417  5598 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:00.947837  2267 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:02:00.951188  1692 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:00.894456  1442 catalog_manager.cc:5697] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.958808  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.949604  5549 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.964939  1542 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:00.966094  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:00.966746  1540 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.967618  1514 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:00.971658  1697 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:00.877419  5657 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:00.973573  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:00.974393  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:00.976176  1542 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:00.984141  1546 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:02:00.978637  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:00.985404  1620 raft_consensus.cc:2376] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10. Re-sending same reply.
I20260709 13:02:00.986359  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.987771  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.980376  1442 catalog_manager.cc:5697] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 5 to 6, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 6 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.981400  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:00.982430  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.982234  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.989935  1540 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:02:00.990309  1622 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:00.983234  1617 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.989307  1623 raft_consensus.cc:2376] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9. Re-sending same reply.
I20260709 13:02:00.988269  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:00.992354  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:00.992683  1514 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:00.996789  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:00.983497  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:00.997715  1693 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.992264  1547 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:01.000015  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:01.001049  1543 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:02:00.966286  5717 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:02:01.004501  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:01.005506  1622 raft_consensus.cc:2368] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
I20260709 13:02:00.992951  1623 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:01.007143  1514 leader_election.cc:400] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
I20260709 13:02:00.988493  1620 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:01.007501  1514 leader_election.cc:403] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:02:01.009341  1621 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:01.001729  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:01.010528  1442 catalog_manager.cc:5697] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 3 to 6, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 6 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.015071  1514 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:01.016601  1539 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:01.018500  1663 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:01.021934  1586 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:01.023039  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:01.019732  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:01.025940  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:01.026804  1623 raft_consensus.cc:2376] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12. Re-sending same reply.
I20260709 13:02:01.026964  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:01.028191  1620 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:01.015867  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:01.031770  1541 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:00.978143  5595 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:01.041126  2231 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:01.038084  1692 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:01.038297  5563 consensus_queue.cc:1059] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:01.038897  5651 consensus_queue.cc:1059] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:01.039165  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 44794.8us
I20260709 13:02:01.039778  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:01.038625  5680 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:01.017267  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:01.018405  5447 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:00.981449  5606 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:01.047503  1693 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:01.047855  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:01.048497  1586 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:01.072947  1586 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:00.978160  5549 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:01.075578  5681 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:01.076745  5486 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:01.033842  5544 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
I20260709 13:02:01.058377  5595 raft_consensus.cc:697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:01.059515  5680 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.060387  5563 raft_consensus.cc:3055] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:00.999114  5721 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.003330  5588 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:01.047086  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:01.068043  1617 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:01.069021  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:01.089759  1539 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:01.089875  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 71439.9us
I20260709 13:02:01.043186  5553 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:01.085978  1541 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:01.009928  5481 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:02:01.043049  5723 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:01.078351  5656 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:01.079001  5375 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.090247  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:01.096563  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:01.091518  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:01.112120  1620 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:01.099858  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:01.075361  5549 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:01.084434  5680 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:01.083607  5259 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.116932  1621 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:01.083781  5563 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:01.122247  1617 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:01.091372  5310 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:01.089197  5630 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:01.102612  5553 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:01.101588  5721 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:01.112854  5447 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:01.126515  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:01.136161  1543 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:01.140213  1541 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:01.141690  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.143935  1539 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:02:01.141059  1442 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 6 to 7, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 7 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.148836  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:01.149382  1693 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:01.149313  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:01.131887  5553 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:01.167948  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:01.168712  1692 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:01.171463  1693 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
W20260709 13:02:01.180053  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 93064.4us
W20260709 13:02:01.185477  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.188007  1543 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:01.144465  5681 raft_consensus.cc:697] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:01.122066  5375 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:01.125811  5454 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:02:01.126296  5259 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:01.130908  5630 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:01.147257  5310 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:02:01.146801  5651 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:02:01.210534  1692 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:01.194185  5486 raft_consensus.cc:697] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:01.153559  5656 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:02:01.248908  1442 catalog_manager.cc:5697] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 1 to 4, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 4 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
W20260709 13:02:01.250566  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 110097us
I20260709 13:02:01.250923  1539 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:02:01.252311  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 160831us
I20260709 13:02:01.195366  5729 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:01.264818  1442 catalog_manager.cc:5697] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 3 to 6, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 6 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.224071  5685 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:01.269840  5725 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:02:01.270488  5726 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:02:01.272267  5682 consensus_meta.cc:287] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.810s	user 0.011s	sys 0.001s
I20260709 13:02:01.183151  5595 consensus_queue.cc:237] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:01.280053  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 130850us
I20260709 13:02:01.255054  5246 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.192137  5563 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:01.290597  1442 catalog_manager.cc:5697] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.304141  5731 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.304746  5731 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:01.305285  5375 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:01.305917  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:01.311990  1621 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
W20260709 13:02:01.308058  5733 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:02:01.313446  2234 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:01.308485  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:01.300593  5682 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:01.315449  2264 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:01.315553  5681 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:01.316956  5682 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:01.317726  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:01.318313  1621 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:01.302518  1661 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:01.262717  5683 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.295629  5724 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 13:02:01.307289  5731 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:01.366753  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 53394.6us
I20260709 13:02:01.451316  1588 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:01.440659  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 138756us
I20260709 13:02:01.453845  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:01.272851  5680 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:01.455149  1661 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:01.397316  5725 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:01.320498  5685 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
I20260709 13:02:01.506343  1621 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:01.392832  5375 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:01.393091  5606 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.319581  5737 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.168s
I20260709 13:02:01.513531  1619 raft_consensus.cc:2368] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
I20260709 13:02:01.458261  5563 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:01.523823  5721 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:01.345520  5246 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:01.379077  5683 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:01.494843  1661 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:01.543377  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 80028.3us
I20260709 13:02:01.544687  1661 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:01.599361  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 54786.3us
I20260709 13:02:01.344461  1442 catalog_manager.cc:5697] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 6 to 7, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 7 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.504050  5549 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:01.464834  5729 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:01.461426  5447 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:01.510668  5375 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:01.556978  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.524874  5737 consensus_queue.cc:1243] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 27308aae2ef347ccba1b27e7f6f04334 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:01.562295  5684 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:01.562819  5486 consensus_queue.cc:237] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:01.464037  5728 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:02:01.612195  5684 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.614388  5684 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:01.571805  5381 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:01.576514  5680 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:01.577775  5544 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.605041  5736 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:01.579558  5630 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:01.581964  5481 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:01.584587  5734 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.585579  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2865) took 1138 ms. Trace:
I20260709 13:02:01.627861  1542 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:01.585704  5685 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.557909  5465 raft_consensus.cc:2764] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:01.600296  1661 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:01.519634  5606 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:01.587678  5682 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.617974  1514 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:01.601892  5549 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:01.602164  5259 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:01.578187  5683 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:01.611495  5375 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:01.623644  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:01.647089  1616 raft_consensus.cc:1240] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:01.647506  1622 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:02:01.293511  1663 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:01.615902  5381 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:01.609404  5447 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:01.629693  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.001s	sys 0.012s
I20260709 13:02:01.632066  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:01.651639  1546 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:01.627737  1696 rpcz_store.cc:276] 0709 13:02:00.446983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.447119 (+   136us) service_pool.cc:224] Handling call
0709 13:02:00.447439 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.461112 (+ 13673us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:00.482488 (+ 21376us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.899003 (+416515us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b18000193c0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de23a 00007f5c6ab48a2a
0709 13:02:01.118154 (+219151us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:01.118637 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:02:01.118826 (+   189us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:01.118872 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.118960 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.585255 (+466295us) raft_consensus.cc:1685] finished
0709 13:02:01.585353 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.585525 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26698,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":98758,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":26939,"spinlock_wait_cycles":4183296,"thread_start_us":218892,"threads_started":2,"wal-append.queue_time_us":630080}
W20260709 13:02:01.635999  1513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.020s	sys 0.063s
I20260709 13:02:01.637051  1661 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:01.639518  1544 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:01.640378  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.641294  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:01.642657  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:01.645951  1514 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:02:01.648947  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 355500us
I20260709 13:02:01.625046  5481 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:02:01.651113  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.001s	sys 0.012s
I20260709 13:02:01.631094  5736 raft_consensus.cc:697] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:01.723850  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 77972.8us
I20260709 13:02:01.728572  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:01.622733  5544 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:01.725665  1547 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:02:01.726744  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:01.741813  1619 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
W20260709 13:02:01.727402  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 65234.7us
I20260709 13:02:01.727614  1614 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
W20260709 13:02:01.733281  1513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.028s	sys 0.085s
W20260709 13:02:01.734171  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 97608.9us
W20260709 13:02:01.744256  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 642607us
I20260709 13:02:01.744540  1661 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:01.747498  1546 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:01.644381  5729 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:01.646726  5549 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:01.638511  5685 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:01.731993  5542 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:01.756518  5747 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:02:01.757578  5685 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:01.646929  5651 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.758353  5651 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:01.760541  5651 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:01.650228  5712 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:01.748733  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:01.652068  5728 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:01.749663  2232 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:01.748143   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:01.726948  5447 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:01.727402  1587 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:01.761758  1615 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:01.725098  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:01.779438  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 54370.8us
I20260709 13:02:01.784036  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:01.652278  5630 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.136s
I20260709 13:02:01.743984  5737 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:01.754954  5425 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:01.648059  5682 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:01.748587  5721 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.800390  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 50842.6us
I20260709 13:02:01.800887  1663 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:01.793704  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 66377.2us
I20260709 13:02:01.801206  5481 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:01.820209  5712 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:01.764890  5740 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:02:01.874531  5756 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:01.875942  5739 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:02:01.880213  5738 log.cc:927] Time spent T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:02:01.803354  5685 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:01.799892  5749 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:01.770087  5729 raft_consensus.cc:697] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:01.806277  5454 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:01.804440  5750 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:01.892534  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 164012us
I20260709 13:02:01.635304  5734 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:01.900928  1587 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:01.904258  2232 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:01.893076  5542 raft_consensus.cc:697] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:02:01.921648  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 168251us
I20260709 13:02:01.914372  5481 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:01.940320  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 139546us
I20260709 13:02:01.955358  1663 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:01.943754  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:01.958567  1587 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:01.960081  1587 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:01.963529  5425 raft_consensus.cc:697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:01.965510  1587 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:01.968735  5729 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:01.904860  5643 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:02:01.905042  5721 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:01.973783  1587 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:01.971484  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 67288.2us
I20260709 13:02:01.932803  5756 raft_consensus.cc:697] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:01.980298  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:01.984402  1546 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:01.964596  5486 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:01.999073  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:02.002034  1544 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:01.972625  5749 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:02.005867  2232 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:01.967214  5685 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:01.981608  5647 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:01.971324  5454 raft_consensus.cc:697] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:01.893522  5736 consensus_queue.cc:237] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:01.992131  5681 consensus_queue.cc:1059] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:02:02.001000  5381 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:02.054052  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 48316.1us
I20260709 13:02:01.915727  5739 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:01.976158  5748 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:01.990010  5741 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:02.096324  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 151784us
I20260709 13:02:02.061082  5495 raft_consensus.cc:3055] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:02.063939  5595 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.063793  5542 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.066326  5746 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:02.067485  5425 consensus_queue.cc:237] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.069098  5682 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:02.070657  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:02.134825  2267 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:01.989833  5757 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.970678  5742 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:02.077653  5598 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:02.078455  5647 raft_consensus.cc:697] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:02.079406  5375 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:02.104492  5495 raft_consensus.cc:740] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:02.080519  5544 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:02.081099  5756 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:01.961012  5750 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:02.082568  5734 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:02.051397  5712 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.083819  5740 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:02.157878  5746 raft_consensus.cc:697] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:02.084630  5454 consensus_queue.cc:237] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:02.160218  5761 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:02.087054  5752 log.cc:927] Time spent T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:02:02.090507  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:02.090719  2232 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:02.198906  2264 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:02.004649  5656 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:02.095726  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.098618  1661 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:02.102603  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 147326us
W20260709 13:02:02.092084  5553 consensus_meta.cc:287] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.902s	user 0.009s	sys 0.002s
I20260709 13:02:02.087810  5681 raft_consensus.cc:3055] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:02.122253  5739 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:02.072790  5753 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:02.102285  5741 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.097074  5755 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:02:02.080406  5744 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.485s	user 0.003s	sys 0.000s
W20260709 13:02:02.161271  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 183228us
I20260709 13:02:02.127615  5762 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.084038  5246 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:02.129801  5595 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:02.199009  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 108354us
I20260709 13:02:02.001730  5486 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.203553  1663 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:02.203714  1513 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:02.286383  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 82802.6us
I20260709 13:02:02.286989  1513 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:02.288473  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:02.265435  5630 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:02.289095  1546 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:02.308364  5630 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.308809  5375 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:02.310518  5630 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:02.265498  5656 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:02.312152  5721 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:02.312719  5656 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:02.194070  5495 consensus_queue.cc:260] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:02.315816  5750 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:02.315992  5542 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:02.316097  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:02.316442  5542 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.316846  1540 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:02:02.317020  5682 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:02.317451  5682 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.317771  5682 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.272192  5765 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:02.194350  5544 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:02.272205  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 80250.7us
I20260709 13:02:02.199676  5737 raft_consensus.cc:697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:02.197412  5761 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:02.158914  5757 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.265177  5754 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:02.312189  5447 consensus_meta.cc:287] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.000s
I20260709 13:02:02.285429  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:02.270018  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 171448us
I20260709 13:02:02.297374  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:02.289603  5486 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:02.350392  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 146900us
I20260709 13:02:02.194156  5740 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:02.307761  5684 consensus_meta.cc:287] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.001s
W20260709 13:02:02.277690  5549 consensus_meta.cc:287] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.002s
I20260709 13:02:02.333034  5750 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.300119  5746 consensus_queue.cc:237] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:02.272590  5753 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:02.307224  5563 consensus_meta.cc:287] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.770s	user 0.007s	sys 0.001s
I20260709 13:02:02.332067  2232 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:02.369736  5734 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:02.370186  5734 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:02.370345  2232 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:02.370605  5734 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:02.278657  5741 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:02.371378  5598 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:02.371809  5598 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.372143  5598 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.284359  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:02.267917  5553 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.332419  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:02.349267  1662 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:02.351636  1663 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:02.316854  5542 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:02.356112  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:02.331681  5765 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.358369  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:02.384331  1545 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:02:02.269109  5681 raft_consensus.cc:740] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:02.360126  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:02.360397  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:02.335698  5761 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:02.337170  5754 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.295449  5749 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 13:02:02.382192  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 49864.4us
I20260709 13:02:02.335243  5544 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.362886  5736 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:02.307778  5647 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.432485  1543 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:02.352483  5447 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.459647  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:02.460234  1619 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:02.286036  5755 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:02.394548  5669 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:02.368320  5753 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:02.370186  5727 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.439702  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:02.440697  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:02.440903  2269 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:02.438022  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:02.384287  5680 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:02.457185  5763 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.364852  5549 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.366312  5310 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:02:02.455543  5643 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:02.367329  5750 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:02.463936  1621 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:02.432416  5754 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:02.457863  5730 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.363584  5684 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:02.470222  1514 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:02.462188  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:02.622362  1617 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:02.480290  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:02.623818  1615 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:02:02.487859  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:02.624828  1616 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:02.459268  5381 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:02.473281  5685 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.550693  5664 raft_consensus.cc:993] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:02:02.464990  5488 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:02.394591  5765 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:02.559278  5553 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:02.481495  5727 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.559626  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:02.489456  5736 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:02.561354  2269 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:02.490897  5681 consensus_queue.cc:260] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.564055  5769 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.591689  5721 consensus_queue.cc:1059] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.157s
I20260709 13:02:02.564708  5772 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:02.566401  5755 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:02.566809  5783 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:02.482224  5766 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:02.833395  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:02.568864  5731 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:02.570037  2234 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:02.572526  5643 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:02.571902  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 222704us
I20260709 13:02:02.479210  5760 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:02.480969  5683 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:02.592610  5481 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.622s	user 0.005s	sys 0.007s
W20260709 13:02:02.733434  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 381867us
I20260709 13:02:02.738708  5381 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:02.488899  5763 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.811240  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:03.055893  1688 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:02.747175  5656 raft_consensus.cc:1081] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:02:02.454519  5737 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.748548  5787 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.752558  5595 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:02.847549  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 277552us
I20260709 13:02:02.570214  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:02.854768  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:02.855052  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:02.798454  5680 raft_consensus.cc:697] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:02.739425  5685 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.826614  5712 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:02.828179  5714 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.564368  5758 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:02.871345  1663 leader_election.cc:400] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:03.167300  1663 leader_election.cc:403] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:03.167434  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:02.873724  1662 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:03.128400  5784 log.cc:927] Time spent T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.554s	user 0.001s	sys 0.000s
W20260709 13:02:03.168445  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 294793us
I20260709 13:02:02.875803  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:02.847012  5766 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:02.936838  5447 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:03.110383  5740 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:02.867379  5246 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:03.143982  5664 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.752282  5488 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:02.592357  5730 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:03.186381  5782 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.633s	user 0.001s	sys 0.000s
I20260709 13:02:03.045145  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:02.865814  5683 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.860652  5731 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:03.056125  5801 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 13:02:03.067176  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 596962us
I20260709 13:02:03.095134  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:02.835865  5772 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.177006  5714 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:02.825057  5769 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:03.057729  5775 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.594s	user 0.000s	sys 0.001s
W20260709 13:02:03.127920  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 98869.8us
I20260709 13:02:03.131716  1694 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:02.871266  5760 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.281113  1688 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:03.204165  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:03.281773  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:03.223891  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:03.168038  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 296801us
I20260709 13:02:03.168038  1689 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
W20260709 13:02:03.187320  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.881276  5729 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:03.129673  5549 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:03.156493  5657 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:03.160890  5712 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:03.180881  5728 consensus_meta.cc:287] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.387s	user 0.005s	sys 0.011s
I20260709 13:02:03.161933  5750 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:03.225059  5798 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:02:02.922051  5799 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:03.166215  5544 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:03.158753  5805 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:03.306828  5657 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.321125  5799 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.321245  5805 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.323372  5657 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:03.325297  5778 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.450s	user 0.001s	sys 0.000s
I20260709 13:02:03.325567  5804 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.325296  1688 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:03.326124  5804 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.326948  1688 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:03.328310  1688 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:03.328580  5804 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:03.329746  5763 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:03.189909  5246 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.330557  5246 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:03.302472  5680 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.285184  1661 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:03.333912  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 48826.9us
I20260709 13:02:03.230688  5684 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:03.186003  5766 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.297195  1514 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:03.307435  1663 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:03.315294  5741 consensus_meta.cc:287] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.944s	user 0.010s	sys 0.001s
I20260709 13:02:03.343537  1663 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:03.249325  5553 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:03.313272  1588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.008s	sys 0.004s
W20260709 13:02:03.346633  1588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.008s	sys 0.005s
I20260709 13:02:03.194983  5764 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:03.350633  1663 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:03.224362  5796 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:02:03.194967  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:03.319085  1689 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:03.137416  5787 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.329797  1688 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:02:03.353878  1688 pending_rounds.cc:85] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 4
I20260709 13:02:03.319197  5728 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:03.336869  1694 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 5.
I20260709 13:02:03.358683  1663 leader_election.cc:400] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
I20260709 13:02:03.359139  1663 leader_election.cc:403] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:02:03.165570  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.050s	sys 0.060s
I20260709 13:02:03.231395  5740 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:03.185444  5758 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:03.344970  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 47787.8us
I20260709 13:02:03.189949  5793 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.307404  5712 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:03.222922  5773 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.348215  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.376428  1617 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:03.354169  1688 pending_rounds.cc:107] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:02:03.377220  1688 raft_consensus.cc:2889] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:03.335243  5734 consensus_meta.cc:287] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.964s	user 0.009s	sys 0.003s
I20260709 13:02:03.194687  5786 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
W20260709 13:02:03.362675  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.050s	sys 0.060s
I20260709 13:02:03.290360  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:03.369071  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:03.370687  1539 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.008s	sys 0.024s
I20260709 13:02:03.368623  1514 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:03.333262  5802 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.338774  5805 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:03.404960  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:03.342168  5727 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:03.381837  1688 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:03.413055  1688 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:03.382964  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.414305  1617 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:03.300451  5729 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.375738  5721 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.346575  5791 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:02:03.387936  1697 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
W20260709 13:02:03.390730  1539 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.008s	sys 0.024s
I20260709 13:02:03.358283  5684 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.393162  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.387463  5763 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
I20260709 13:02:03.357127  5549 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:03.391425  1545 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:03.368100  5682 consensus_meta.cc:287] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.050s	user 0.010s	sys 0.001s
I20260709 13:02:03.404117  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.404910  1540 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.357328  5736 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:03.341990  5310 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:03.441039  5310 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.441494  5310 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:03.444401  5769 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:03.444917  5787 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:03.445669  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1871) took 1083 ms. Trace:
I20260709 13:02:03.410962  1689 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:03.373070  5447 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:03.415766  1695 raft_consensus.cc:2376] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11. Re-sending same reply.
I20260709 13:02:03.370193  5764 raft_consensus.cc:697] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:03.416273  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.453241  1620 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:02:03.446105  1543 rpcz_store.cc:276] 0709 13:02:02.362030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.362330 (+   300us) service_pool.cc:224] Handling call
0709 13:02:02.362577 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.456281 (+ 93704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.445432 (+989151us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b54000c6054. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:03.445603 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160298752}
I20260709 13:02:03.418346  5803 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.396086  1623 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:03.473054  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 237347us
I20260709 13:02:03.473896  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.428517  1621 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:03.429414  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.475324  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.476563  1621 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
W20260709 13:02:03.438645  5753 consensus_meta.cc:287] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.950s	user 0.011s	sys 0.000s
I20260709 13:02:03.356254  5553 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:03.416690  5486 consensus_meta.cc:287] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 1.059s	user 0.009s	sys 0.001s
I20260709 13:02:03.404603  5595 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:03.349100  5741 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.377976  5740 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.417614  5806 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:03.376016  5793 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.401261  5773 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.416657  5805 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.477406  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.478648  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.434669  5721 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.390287  5734 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.409641  5802 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.519243  5734 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:03.488750  5685 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:03.472366  5736 raft_consensus.cc:697] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:03.502424  5553 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:03.480919  5814 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.208910  5664 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:03.495800  5542 consensus_meta.cc:287] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.101s	user 0.010s	sys 0.002s
I20260709 13:02:03.509748  1621 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:03.514394  1623 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:03.517010  5683 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:03.488595  5549 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:03.519938  2264 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:03.453120  5447 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:03.487339  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:03.564881  1620 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:03.565145  1623 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:03.438855  5684 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.524236  1540 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:03.529166  1617 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:03.508222  5488 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:03.490839  5595 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:03.453155  5682 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.540478  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1870) took 1178 ms. Trace:
I20260709 13:02:03.547955  1622 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:02:03.561269  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 84740.3us
I20260709 13:02:03.566565  1615 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:03.573763  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:03.574873  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 216286us
I20260709 13:02:03.509029  5822 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:03.580065  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 213543us
I20260709 13:02:03.494836  5486 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.569669  1546 rpcz_store.cc:276] 0709 13:02:02.361731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.361946 (+   215us) service_pool.cc:224] Handling call
0709 13:02:02.362141 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.366585 (+  4444us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:02.463361 (+ 96776us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.010428 (+547067us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.010499 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:03.010567 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.539965 (+529398us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b54000aa0d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:03.540018 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.540388 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9265,"prepare.queue_time_us":471447,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":173365,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":26748,"spinlock_wait_cycles":9803520,"thread_start_us":633897,"threads_started":3,"wal-append.queue_time_us":856476}
I20260709 13:02:03.532024  5731 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:03.519836  5730 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:03.489675  5753 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:03.572099  5598 consensus_meta.cc:287] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 1.195s	user 0.007s	sys 0.006s
I20260709 13:02:03.482875  5803 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.619540  1544 raft_consensus.cc:2393] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:03.626019  1619 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.545635  5756 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.628438  1545 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:03.629050  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1869) took 1269 ms. Trace:
I20260709 13:02:03.575649  5595 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:03.568614  5447 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:03.520506  5805 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.637991  2234 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:03.509172  5806 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.649456  1539 rpcz_store.cc:276] 0709 13:02:02.359680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.361360 (+  1680us) service_pool.cc:224] Handling call
0709 13:02:02.365993 (+  4633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.366184 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:03.425188 (+1059004us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.628659 (+203471us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.628715 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:03.628789 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.628860 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.628993 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":380367,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":27523,"raft.queue_time_us":15987,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":1247094,"threads_started":3}
I20260709 13:02:03.507782  5764 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.662830  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:03.663120  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:03.667265  2266 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:03.663225  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:03.630483  5788 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 13:02:03.671128  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 116759us
I20260709 13:02:03.671861  1588 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:03.639197  5804 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:03.568902  5542 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.636920  5772 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:03.651365  5683 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:03.704492  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 125910us
I20260709 13:02:03.651635  5791 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.651649  5714 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:03.716416  1620 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:02:03.717825  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.672369  5657 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:03.728154  5836 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:03.729143  5805 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:03.659696  5756 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:03.730738  5813 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:02:03.731968  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 60174.7us
I20260709 13:02:03.733060  1548 raft_consensus.cc:2368] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11.
I20260709 13:02:03.733031  1588 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:03.568703  5814 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.657961  5598 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.678375  5760 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:03.739898  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.747800  1620 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:03.760375  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:03.734293  5657 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.736088  5772 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.775537  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:03.600235  5822 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.778620  1623 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:03.736313  5685 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.741248  5465 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.785393  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:03.787817  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.786245  2234 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:03.734884  5246 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.745113  5758 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:03.712955  5683 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.802765  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.803580  1620 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:02:03.797925  2269 raft_consensus.cc:2393] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:03.776104  5714 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.755534  5729 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:03.780743  5657 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:03.821720  1622 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:03.676138  5736 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.712987  5549 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.850359  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:03.852252  5793 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:03.828510  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:03.865407  5803 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:03.866235  5803 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:03.869491  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:03.811040  5630 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:03.871454  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 623) took 1070 ms. Trace:
I20260709 13:02:03.819507  5734 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:03.792824  5772 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.873299  1693 rpcz_store.cc:276] 0709 13:02:02.801498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.806369 (+  4871us) service_pool.cc:224] Handling call
0709 13:02:02.806737 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.807116 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.807155 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.807852 (+   697us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.193012 (+385160us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:03.336240 (+143228us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.336840 (+   600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.336955 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.871250 (+534295us) raft_consensus.cc:1685] finished
0709 13:02:03.871268 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.871377 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82158,"prepare.queue_time_us":40131,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":7861,"raft.queue_time_us":21691,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":22017,"thread_start_us":422219,"threads_started":2,"wal-append.queue_time_us":743157}
W20260709 13:02:03.905999  5810 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:02:03.846810  5758 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:03.710240  5807 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.147s
I20260709 13:02:03.849334  5553 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:03.733920  5791 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.796123  5839 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:03.911732  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.866869  5803 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.912542  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:03.811524  5685 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.914938  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:03.877835  5682 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:03.811100  5465 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.827708  5714 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:03.910220  5734 raft_consensus.cc:697] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:03.934904  1619 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:03.936030  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:03.911300  5741 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:03.916713  5756 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:03.928661  5837 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:03.926693  5827 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:02:03.882516  5630 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.947880  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:03.955710  1693 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:03.944191  5766 consensus_meta.cc:287] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 13:02:03.932675  5486 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:03.951686  5768 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.968222  2266 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:03.960919  5832 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.923732  5758 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.964566  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.964298  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:03.972867  1622 raft_consensus.cc:2393] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:03.912355  5814 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:03.974094  1693 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:03.978340  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:03.976621  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:03.980118  5816 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:03.981999  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 620) took 1181 ms. Trace:
I20260709 13:02:03.982668  5664 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:03.983384  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.983891  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 622) took 1182 ms. Trace:
I20260709 13:02:03.982373  1696 rpcz_store.cc:276] 0709 13:02:02.800615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.800740 (+   125us) service_pool.cc:224] Handling call
0709 13:02:02.838208 (+ 37468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.882107 (+ 43899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.008882 (+126775us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.040417 (+ 31535us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.308362 (+267945us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:03.428636 (+120274us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.453465 (+ 24829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.453535 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.981762 (+528227us) raft_consensus.cc:1685] finished
0709 13:02:03.981788 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.981927 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62605,"prepare.queue_time_us":48736,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":40,"raft.queue_time_us":77446,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":44832,"thread_start_us":274638,"threads_started":2,"wal-append.queue_time_us":768489}
I20260709 13:02:03.987907  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:03.989024  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:03.984258  1692 rpcz_store.cc:276] 0709 13:02:02.801224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.801321 (+    97us) service_pool.cc:224] Handling call
0709 13:02:02.801640 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.805828 (+  4188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.805870 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.834181 (+ 28311us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.107689 (+273508us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:03.145355 (+ 37666us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.145764 (+   409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.145838 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.983714 (+837876us) raft_consensus.cc:1685] finished
0709 13:02:03.983730 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.983840 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50819,"prepare.queue_time_us":35432,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":10182,"raft.queue_time_us":14882,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":41959,"thread_start_us":225482,"threads_started":1,"wal-append.queue_time_us":791129}
I20260709 13:02:03.933061  5553 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:03.995018  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:03.995731  1693 raft_consensus.cc:2376] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9. Re-sending same reply.
I20260709 13:02:03.997148  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:03.996681  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:03.964241  5753 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:03.997900  5772 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:04.049711  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:04.050366  1539 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:04.047144  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:04.051800  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 54846.2us
I20260709 13:02:03.999359  1546 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:04.034723  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.054205  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:04.054680  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:03.969599  5766 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:04.056085  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.057137  1692 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:04.058429  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.063400  1539 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:02:04.065790  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:04.066489  1546 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:02:03.990185  5598 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:03.975734  5802 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:04.051350  5681 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.976328  5768 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:04.076638  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:04.079118  1588 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:04.054090  5814 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:04.094446  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:03.999329  5832 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:04.099530  1693 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:04.070947  5806 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:04.104913  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.110733  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.111552  1693 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:02:04.112818  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.114202  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:04.114965  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:04.115475  1693 raft_consensus.cc:2376] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9. Re-sending same reply.
I20260709 13:02:04.115849  1539 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:04.116634  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.119048  1622 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:04.118924  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.120081  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:04.083520  5683 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:04.120760  1546 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:04.120658  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 49309.1us
I20260709 13:02:03.971858  5837 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:04.125023  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:04.125502  1620 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:04.128168  5844 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:02:04.130287  5310 consensus_meta.cc:287] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.688s	user 0.008s	sys 0.000s
I20260709 13:02:04.130761  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.132103  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.136672  5832 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:04.138453  5768 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:04.139353  5465 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:04.100117  5802 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:04.145109  5758 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:04.146654  5761 consensus_meta.cc:287] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.711s	user 0.004s	sys 0.009s
I20260709 13:02:04.071305  5734 consensus_queue.cc:237] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:04.120355  5762 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.799s	user 0.008s	sys 0.007s
I20260709 13:02:04.149384  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:04.150004  2266 raft_consensus.cc:2393] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:04.085115  5753 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:02:04.147207  5761 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:04.102772  5814 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:04.150298  5842 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:02:04.157327  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:04.164899   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:04.178004  1619 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:04.179046  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:04.180227  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:04.180665  1619 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:04.174727  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53718 (request call id 808) took 1889 ms (client timeout 2032 ms). Trace:
W20260709 13:02:04.183146  1544 rpcz_store.cc:269] 0709 13:02:02.284910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.285135 (+   225us) service_pool.cc:224] Handling call
0709 13:02:04.174534 (+1889399us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54000c5654. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:04.174670 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2924097920}
W20260709 13:02:04.164520  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 103722us
W20260709 13:02:04.174271  2231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.841s (SENT) [suppressed 37 similar messages]
I20260709 13:02:04.195683  1619 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:04.130733  5310 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:04.199702  2270 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:04.202585  2232 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:04.184583  5712 consensus_meta.cc:287] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.001s
I20260709 13:02:04.210578  1688 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:04.209784  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:04.140796  5643 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:04.164767  5762 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:04.213650  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:04.214428  1539 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:04.161060  5606 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:04.159890  5803 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:04.216868  1619 raft_consensus.cc:2410] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:04.217366  2232 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:04.122182  5822 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:04.177608  5768 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.176082  5802 raft_consensus.cc:697] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:04.220579  1620 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:02:04.222939  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:04.223762  1546 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:02:04.228554  1692 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
W20260709 13:02:04.229389  1586 leader_election.cc:336] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.564s (SENT)
I20260709 13:02:04.215716  5741 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:04.239126  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:04.239679  5837 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:04.239967  2232 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:04.240579  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.240833  5854 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:04.155964  5657 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:04.240126  5766 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:04.245605  5761 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:04.236841  5768 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:04.256525  5814 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:04.257249  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1871) took 1799 ms. Trace:
I20260709 13:02:04.211201  5817 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:02:04.263623  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:04.264621  1621 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:04.245723  5495 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.261267  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:04.258699  1618 rpcz_store.cc:276] 0709 13:02:02.458347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.467086 (+  8739us) service_pool.cc:224] Handling call
0709 13:02:02.467398 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.595039 (+127641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.595069 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.740278 (+145209us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.313827 (+573549us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:03.461705 (+147878us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.473716 (+ 12011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.256884 (+783168us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400041d54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:04.256925 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:04.256967 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:04.257051 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.257174 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40463,"prepare.queue_time_us":471901,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":10457,"raft.queue_time_us":526866,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":56447,"spinlock_wait_cycles":292662528,"thread_start_us":626182,"threads_started":2,"wal-append.queue_time_us":646066}
I20260709 13:02:04.269516  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.272475  5804 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:04.272941  5804 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:04.283123  5768 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:04.285981  2271 raft_consensus.cc:2393] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:04.288110  5553 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:04.218168  5712 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:04.290985  1621 raft_consensus.cc:1217] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 5.5->[6.6-10.8]   Dedup: 6.6->[8.7-10.8]
I20260709 13:02:04.291577  1621 pending_rounds.cc:85] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 6
I20260709 13:02:04.291855  1621 pending_rounds.cc:107] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:02:04.292135  1621 raft_consensus.cc:2889] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.288926  5732 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:02:04.293874  5542 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:04.257632  5741 raft_consensus.cc:697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:04.297387  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.265348  5854 raft_consensus.cc:697] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:04.306519  1689 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:04.307741  5853 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:04.308329  5657 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:04.308401  5853 raft_consensus.cc:697] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:04.309010  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:04.309422  5853 consensus_queue.cc:237] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:04.542171  1695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2891) took 1373 ms (client timeout 1564 ms). Trace:
I20260709 13:02:04.942751  1620 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:04.430244  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.541080  1434 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 1.604s	user 0.000s	sys 0.016s
I20260709 13:02:04.310071  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:04.527058  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:04.946502  5804 consensus_meta.cc:287] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.004s
W20260709 13:02:04.956733  1548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2687) took 2494 ms (client timeout 1858 ms). Trace:
W20260709 13:02:04.957396  1548 rpcz_store.cc:269] 0709 13:02:02.438677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.440466 (+  1789us) service_pool.cc:224] Handling call
0709 13:02:04.897841 (+2457375us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003b5e54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:04.933055 (+ 35214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2906648832}
W20260709 13:02:04.901342  1618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.005s	sys 0.028s
I20260709 13:02:04.946637  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:04.958664  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:04.958789  1539 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:02:04.959266  1548 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
W20260709 13:02:04.947263  5811 log.cc:927] Time spent T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Append to log took a long time: real 0.406s	user 0.007s	sys 0.008s
I20260709 13:02:04.948112  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 697) took 1557 ms. Trace:
I20260709 13:02:04.949115  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1859) took 1300 ms. Trace:
I20260709 13:02:04.941496  2234 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:04.348654  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:04.965481  1546 raft_consensus.cc:2393] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:04.964977  1689 rpcz_store.cc:276] 0709 13:02:03.648223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.947301 (+1299078us) service_pool.cc:224] Handling call
0709 13:02:04.947724 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.948802 (+  1078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.948833 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.948872 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:04.948910 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.948963 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.949066 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.966694  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:04.967052  1689 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:02:04.373785  1623 raft_consensus.cc:2410] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:04.890995  2270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:04.510284  1544 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:04.967770  2264 rpcz_store.cc:276] 0709 13:02:03.334619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.334757 (+   138us) service_pool.cc:224] Handling call
0709 13:02:03.335001 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.564463 (+229462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.891455 (+1326992us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54000834d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:04.891631 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424907136}
I20260709 13:02:04.943325  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1771) took 1362 ms. Trace:
I20260709 13:02:04.969062  1620 rpcz_store.cc:276] 0709 13:02:03.581015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.280781 (+699766us) service_pool.cc:224] Handling call
0709 13:02:04.942608 (+661827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.943144 (+   536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.943281 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.970568  1620 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:02:04.971138  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1775) took 1381 ms. Trace:
I20260709 13:02:04.971490  1620 rpcz_store.cc:276] 0709 13:02:03.589982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.969887 (+1379905us) service_pool.cc:224] Handling call
0709 13:02:04.970292 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:04.970894 (+   602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.971090 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.972810  1620 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:04.973338  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1781) took 1196 ms. Trace:
W20260709 13:02:04.549311  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.297546  5740 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:04.508698  1514 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:02:04.942318  1695 rpcz_store.cc:269] 0709 13:02:03.168870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.177928 (+  9058us) service_pool.cc:224] Handling call
0709 13:02:04.541936 (+1364008us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b5400127fd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:04.542097 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146220288}
W20260709 13:02:04.959764  1618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.006s	sys 0.029s
I20260709 13:02:04.967494  1689 pending_rounds.cc:85] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 4
I20260709 13:02:04.977039  1689 pending_rounds.cc:107] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:04.977531  1689 raft_consensus.cc:2889] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.977583  1695 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:04.978390  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1865) took 1198 ms. Trace:
I20260709 13:02:04.978444  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1860) took 1330 ms. Trace:
W20260709 13:02:04.324016  5447 consensus_meta.cc:287] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.002s
W20260709 13:02:04.401153  5858 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:02:04.403398  5815 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.748s	user 0.000s	sys 0.003s
I20260709 13:02:04.978911  1695 rpcz_store.cc:276] 0709 13:02:03.779709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.976961 (+1197252us) service_pool.cc:224] Handling call
0709 13:02:04.977260 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.978134 (+   874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.978327 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.347101  5762 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:04.979218  1689 rpcz_store.cc:276] 0709 13:02:03.648480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.966400 (+1317920us) service_pool.cc:224] Handling call
0709 13:02:04.966699 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.978219 (+ 11520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.978384 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:04.347776  5595 consensus_meta.cc:287] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.002s
W20260709 13:02:04.985430  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 476781us
W20260709 13:02:04.404202  5754 consensus_meta.cc:287] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 1.811s	user 0.011s	sys 0.003s
I20260709 13:02:04.347350  5761 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:04.399857  5310 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:04.543130  5246 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:04.979642  5643 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.003796  1689 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:02:04.901448  5763 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:05.011967  1689 pending_rounds.cc:85] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 6
I20260709 13:02:04.948933  5837 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:04.973676  1620 rpcz_store.cc:276] 0709 13:02:03.776574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.972213 (+1195639us) service_pool.cc:224] Handling call
0709 13:02:04.972503 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.973134 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.973290 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.004840  5588 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:05.016948  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:05.023391  5712 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:04.403929  5656 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.029753  1689 pending_rounds.cc:107] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:02:04.989089  5366 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.005626  5791 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.031639  1695 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:05.036198  1539 raft_consensus.cc:2368] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11.
I20260709 13:02:05.041632  1689 raft_consensus.cc:2889] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.994083  5740 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:05.054327  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1867) took 1200 ms. Trace:
I20260709 13:02:05.008074  5381 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:04.993862  5447 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:04.310245  5802 consensus_queue.cc:237] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.008996  5762 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:04.962699  5804 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:04.402179  5741 consensus_queue.cc:237] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.038161  5310 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.057191  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1868) took 1180 ms. Trace:
I20260709 13:02:05.058773  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 820) took 1070 ms. Trace:
W20260709 13:02:05.059674  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 802) took 1685 ms (client timeout 1831 ms). Trace:
I20260709 13:02:04.369233  5854 consensus_queue.cc:237] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.107728  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 631) took 2289 ms. Trace:
I20260709 13:02:05.059978  1693 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
W20260709 13:02:05.105700  1615 rpcz_store.cc:269] 0709 13:02:03.374141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.374276 (+   135us) service_pool.cc:224] Handling call
0709 13:02:05.059510 (+1685234us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54003a0f54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:05.059614 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293041408}
I20260709 13:02:05.106510  1543 rpcz_store.cc:276] 0709 13:02:03.987967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.989162 (+  1195us) service_pool.cc:224] Handling call
0709 13:02:04.034833 (+ 45671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.160868 (+126035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.160926 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.160970 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:04.161009 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.058572 (+897563us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540027c9d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:05.058616 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.058719 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289264512}
I20260709 13:02:05.108283  1690 rpcz_store.cc:276] 0709 13:02:02.817873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.818011 (+   138us) service_pool.cc:224] Handling call
0709 13:02:02.849907 (+ 31896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.320664 (+470757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.320726 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.320772 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:03.320832 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.107377 (+1786545us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b54000e6fd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:05.107457 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.107649 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082155648}
I20260709 13:02:05.110684  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 823) took 1113 ms. Trace:
W20260709 13:02:05.112226  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1887) took 1714 ms (client timeout 1748 ms). Trace:
I20260709 13:02:05.078979  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:05.115247  1617 rpcz_store.cc:269] 0709 13:02:03.398338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.415087 (+ 16749us) service_pool.cc:224] Handling call
0709 13:02:05.112024 (+1696937us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b5400067054. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:05.112156 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122498816}
I20260709 13:02:05.115947  1539 raft_consensus.cc:2393] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:05.111171  1547 rpcz_store.cc:276] 0709 13:02:03.997523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.998206 (+   683us) service_pool.cc:224] Handling call
0709 13:02:03.998456 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.037452 (+ 38996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.037498 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.037557 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:04.037609 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.110388 (+1072779us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b54000c2454. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:05.110449 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.110612 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89047424}
I20260709 13:02:05.012671  5761 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.054795  5740 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.010658  5754 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.031698  5643 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.054363  5712 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.126545  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1873) took 2667 ms. Trace:
I20260709 13:02:05.009279  5595 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.123698  1689 rpcz_store.cc:276] 0709 13:02:03.876528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.002724 (+1126196us) service_pool.cc:224] Handling call
0709 13:02:05.003063 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.056926 (+ 53863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.057135 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.035243  5763 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.037352  5837 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.058202  5381 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.159529  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 818) took 1032 ms. Trace:
I20260709 13:02:05.161029  1620 rpcz_store.cc:276] 0709 13:02:04.126857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.105425 (+978568us) service_pool.cc:224] Handling call
0709 13:02:05.158802 (+ 53377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.159090 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.159125 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.159183 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:05.159230 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.159300 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.159459 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.154403  1614 rpcz_store.cc:276] 0709 13:02:02.458958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.459082 (+   124us) service_pool.cc:224] Handling call
0709 13:02:02.479807 (+ 20725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.868908 (+389101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.868949 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.006733 (+137784us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.185369 (+178636us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:03.185417 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.185488 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:04.402733 (+1217245us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:05.078452 (+675719us) raft_consensus.cc:1685] finished
0709 13:02:05.078481 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.126441 (+ 47960us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":537039,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":15902,"spinlock_wait_cycles":2511744,"thread_start_us":385780,"threads_started":2,"wal-append.queue_time_us":487145}
I20260709 13:02:05.059821  5447 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:05.048734  5366 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.043975  5588 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.058353  5799 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:05.194120  2267 raft_consensus.cc:2368] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11.
I20260709 13:02:05.264773  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:05.273550  1539 raft_consensus.cc:2393] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:05.166515  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:05.275314  1543 raft_consensus.cc:2368] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10.
I20260709 13:02:05.152911  5740 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.125451  5765 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:05.168923  5763 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:05.170491  5837 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.152745  5563 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.188333  5647 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.289448  5630 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:05.291165  5835 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 1.652s	user 0.000s	sys 0.012s
I20260709 13:02:05.202841  5375 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:05.349083  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:05.295245  5757 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.352362  5366 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.056175  5656 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.178524  5761 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:05.170758  5595 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.180042  5804 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.172130  5762 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:05.358019  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:05.055871  1695 rpcz_store.cc:276] 0709 13:02:03.854241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.000229 (+1145988us) service_pool.cc:224] Handling call
0709 13:02:05.011037 (+ 10808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.054049 (+ 43012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.054270 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.462863  1539 raft_consensus.cc:2393] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:05.166170  5381 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:05.395936  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 633) took 2577 ms (client timeout 2038 ms). Trace:
W20260709 13:02:05.451742  1663 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.022s	sys 0.045s
W20260709 13:02:05.469965  1663 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.022s	sys 0.045s
W20260709 13:02:05.469875  1694 rpcz_store.cc:269] 0709 13:02:02.818393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.281528 (+463135us) service_pool.cc:224] Handling call
0709 13:02:05.395707 (+2114179us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b54002a53d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:05.395848 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125144448}
I20260709 13:02:05.195222  5754 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:05.226919  5712 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:05.431615  5764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.057s	sys 0.066s
I20260709 13:02:05.461239  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:05.396886  5736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.043s	sys 0.030s
I20260709 13:02:05.285355  5799 consensus_queue.cc:1059] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.170s
I20260709 13:02:05.151641  5310 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.470891  1663 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:05.475104  1543 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
W20260709 13:02:05.478756  5736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.044s	sys 0.030s
I20260709 13:02:05.455492  5375 raft_consensus.cc:697] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:05.483358  1663 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:05.393102  5563 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.486706  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:05.475085  5764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.058s	sys 0.067s
I20260709 13:02:05.389791  5647 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.486650  5763 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:05.472400  5762 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:05.502240  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1873) took 2298 ms. Trace:
I20260709 13:02:05.502822  1541 rpcz_store.cc:276] 0709 13:02:03.204153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.205420 (+  1267us) service_pool.cc:224] Handling call
0709 13:02:03.225397 (+ 19977us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.225693 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.225718 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.226137 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.492649 (+266512us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:03.492801 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.493081 (+   280us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.290416 (+1797335us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:05.495198 (+204782us) raft_consensus.cc:1685] finished
0709 13:02:05.495226 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.502158 (+  6932us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24098,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":13845,"spinlock_wait_cycles":2545920,"thread_start_us":258626,"threads_started":1,"wal-append.queue_time_us":300241}
I20260709 13:02:05.518316  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 627) took 2703 ms. Trace:
I20260709 13:02:05.499200  5765 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:05.519568  1588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.008s	sys 0.016s
I20260709 13:02:05.518851  1691 rpcz_store.cc:276] 0709 13:02:02.815198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.816340 (+  1142us) service_pool.cc:224] Handling call
0709 13:02:02.816693 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.838144 (+ 21451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.838171 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.838208 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:02.838241 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.517981 (+2679740us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b5400147654. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:05.518044 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.518242 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48883584}
W20260709 13:02:05.522524  1588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.008s	sys 0.016s
I20260709 13:02:05.522671  1541 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:05.524705  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2694) took 1014 ms. Trace:
I20260709 13:02:05.525460  1541 rpcz_store.cc:276] 0709 13:02:04.509979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.513624 (+1003645us) service_pool.cc:224] Handling call
0709 13:02:05.522379 (+  8755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.524357 (+  1978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.524641 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:05.527684  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2695) took 1017 ms. Trace:
W20260709 13:02:05.528595  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.000s	sys 0.015s
W20260709 13:02:05.529201  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.000s	sys 0.015s
I20260709 13:02:05.521893  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:05.529628  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.528158  1541 rpcz_store.cc:276] 0709 13:02:04.510210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.526520 (+1016310us) service_pool.cc:224] Handling call
0709 13:02:05.526861 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.527282 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.527320 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.527374 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:05.527452 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.527525 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.527635 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105}
I20260709 13:02:05.520795  5765 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.530431  1539 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
W20260709 13:02:05.531934  1589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.007s	sys 0.008s
W20260709 13:02:05.532038  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.002s	sys 0.013s
W20260709 13:02:05.536695  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.002s	sys 0.013s
W20260709 13:02:05.537068  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 595592us
W20260709 13:02:05.532188  1618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.000s	sys 0.015s
I20260709 13:02:05.511185  5762 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:05.538409  1618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.000s	sys 0.015s
W20260709 13:02:05.533830  1514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.004s	sys 0.012s
W20260709 13:02:05.539897  1514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.004s	sys 0.012s
I20260709 13:02:05.531155  5749 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.535669  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.005s	sys 0.021s
I20260709 13:02:05.535513  5765 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:05.536214  1589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.007s	sys 0.008s
W20260709 13:02:05.557626  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.545482  1541 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:05.541008  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:02:05.552218  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.005s	sys 0.021s
I20260709 13:02:05.561959  1514 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:02:05.531792  1616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.007s	sys 0.009s
W20260709 13:02:05.562651  1616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.007s	sys 0.009s
W20260709 13:02:05.563930  1662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.011s	sys 0.025s
W20260709 13:02:05.564402  1662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.012s	sys 0.025s
W20260709 13:02:05.565397  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 590468us
I20260709 13:02:05.562865  1514 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:05.539744  5366 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:05.569903  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.551658  5588 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.572333  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.551885  5731 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:05.566108  5757 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:05.588730  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:05.589453  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:05.590242  1614 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:05.583493  2264 raft_consensus.cc:2393] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:02:05.584484  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.007s	sys 0.015s
I20260709 13:02:05.575060  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.530938  5375 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.566323  5595 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:05.568336  5754 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:05.551774  5804 consensus_queue.cc:1059] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:02:05.563767  5764 consensus_queue.cc:1059] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:02:05.577107  1541 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:02:05.591903  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.007s	sys 0.015s
I20260709 13:02:05.597059  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:05.588757  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.604638  1620 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:05.593668  1514 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:05.596710  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.596925  1662 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:05.561796  5763 consensus_queue.cc:1059] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:02:05.587613  5731 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.598670  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.595347  5588 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:02:05.599357  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.595523  5837 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:02:05.599794  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.558959  5749 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.584029  5630 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:05.607491  1541 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:05.568197  5736 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:02:05.594660  5757 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.615440  5783 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:05.598582  5595 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.597775  5310 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:05.585843  5366 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.611055  5712 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:05.620210  1621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.037s	sys 0.043s
I20260709 13:02:05.638372  2270 raft_consensus.cc:606] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:05.638553  1621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.037s	sys 0.044s
I20260709 13:02:05.639447  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1773) took 2051 ms. Trace:
W20260709 13:02:05.621723  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.005s	sys 0.023s
W20260709 13:02:05.619057  5802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.043s	sys 0.075s
I20260709 13:02:05.625612  5630 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:02:05.642037  5802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.043s	sys 0.075s
W20260709 13:02:05.641968  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.005s	sys 0.023s
I20260709 13:02:05.642167  5630 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:05.639878  1621 rpcz_store.cc:276] 0709 13:02:03.588116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.290396 (+702280us) service_pool.cc:224] Handling call
0709 13:02:04.290769 (+   373us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:04.298164 (+  7395us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:04.307358 (+  9194us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.900475 (+593117us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:04.950941 (+ 50466us) log.cc:844] Serialized 52 byte log entry
0709 13:02:04.951160 (+   219us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:04.951452 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.639004 (+687552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.639103 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.639157 (+    54us) raft_consensus.cc:1685] finished
0709 13:02:05.639186 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.639371 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":237599,"prepare.queue_time_us":5559,"raft.queue_time_us":317186,"raft.run_cpu_time_us":504,"raft.run_wall_time_us":39387,"spinlock_wait_cycles":30805632,"thread_start_us":1042873,"threads_started":2,"wal-append.queue_time_us":708013}
I20260709 13:02:05.606782  5754 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.621459  5865 raft_consensus.cc:3055] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:05.633692  5595 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:05.626524  5757 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:05.663205  1620 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:05.652546  5563 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:05.687245  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 81796.6us
I20260709 13:02:05.651611  5381 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.654556  5712 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:05.664427  5802 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.686693  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.665097  5310 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:05.692361  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:05.692554  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 98984.2us
I20260709 13:02:05.654115  5877 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:05.665932  5865 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:05.695767  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1769) took 2115 ms. Trace:
I20260709 13:02:05.680673  5873 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.698553  1618 rpcz_store.cc:276] 0709 13:02:03.580350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.279717 (+699367us) service_pool.cc:224] Handling call
0709 13:02:04.280096 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.280363 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:04.293382 (+ 13019us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.684883 (+1391501us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.695444 (+ 10561us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.695494 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:05.695546 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.695609 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.695714 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25444,"prepare.queue_time_us":13822,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":221559,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":115,"thread_start_us":1370543,"threads_started":3,"wal-append.queue_time_us":763791}
I20260709 13:02:05.704566  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.690820  5712 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.705734  1588 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:05.706076  5712 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:05.706990  5834 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 1.959s	user 0.007s	sys 0.005s
I20260709 13:02:05.708292  5773 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.710067  5731 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.697741  5762 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:05.712391  5685 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:05.713905  5366 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:05.701264  5877 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.708355  5749 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.690740  5588 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:05.616875  1434 maintenance_manager.cc:643] P ee9debc877d548cb9a1a1187cf0a2dcd: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 12.521s	user 0.207s	sys 0.080s Metrics: {"bytes_written":29942,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":181369,"dirs.run_cpu_time_us":487,"dirs.run_wall_time_us":21130,"drs_written":1,"lbm_read_time_us":393,"lbm_reads_lt_1ms":4,"lbm_write_time_us":125520,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":6,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":30247168,"thread_start_us":756291,"threads_started":3,"update_count":7,"wal-append.queue_time_us":859514}
I20260709 13:02:05.698094  5310 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.721622  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.722961  5310 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:05.723169  1618 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:05.723893  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1772) took 2136 ms. Trace:
I20260709 13:02:05.724252  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.695726  5802 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.724889  2266 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:02:05.726254  5802 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.726014  5865 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.721036  5789 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:05.727198  5865 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.724280  1616 rpcz_store.cc:276] 0709 13:02:03.587846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.276839 (+688993us) service_pool.cc:224] Handling call
0709 13:02:04.277266 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:04.277713 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.277754 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:04.290085 (+ 12331us) log.cc:844] Serialized 26 byte log entry
0709 13:02:05.563253 (+1273168us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:05.563729 (+   476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.563823 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.723730 (+159907us) raft_consensus.cc:1685] finished
0709 13:02:05.723749 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.723846 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":675149,"threads_started":1,"wal-append.queue_time_us":1389595}
I20260709 13:02:05.728364  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.712404  5754 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:05.730587  5877 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.715248  5873 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.734994  2234 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:05.704933  1514 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:05.720178  5366 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:05.752736  1614 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:05.755208  2234 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:05.755208  1588 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:05.761998  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 57144.7us
I20260709 13:02:05.734558  5588 raft_consensus.cc:697] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:05.763453  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.770267  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:05.772651  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:05.777024  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:05.777967  1618 raft_consensus.cc:2393] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
W20260709 13:02:05.775971  5797 log.cc:927] Time spent T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 2.735s	user 0.000s	sys 0.015s
I20260709 13:02:05.779451  5630 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.774639  5773 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:05.780422  5773 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.780774  5773 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.781594  5630 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.762192  5817 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:05.752749  5753 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:05.783669  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:05.783478  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:05.784224  1614 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:05.785161  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:05.786405  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:05.753750  5867 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.788726  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:05.790858  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:05.794843  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:05.752607  5246 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:02:05.812009  2234 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:05.819538  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:05.820595  1615 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:05.828263  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:05.829852  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:05.761226  5366 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.775086  5869 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:05.841291  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 100847us
I20260709 13:02:05.869166  1615 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:05.866559  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:05.870782  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:05.871250  1614 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.797061  5817 raft_consensus.cc:697] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:05.806519  5789 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:05.788543  5731 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:05.875682  1614 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:05.819677  5753 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:05.880810  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:05.881656  1435 maintenance_manager.cc:419] P ee9debc877d548cb9a1a1187cf0a2dcd: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9501 bytes on disk
I20260709 13:02:05.862151  5877 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:05.869001  5869 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.883527  5789 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.884563  5764 raft_consensus.cc:3055] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:05.884744  5817 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:05.886018  2267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 831) took 3327 ms (client timeout 1858 ms). Trace:
I20260709 13:02:05.887451  5783 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:05.892985  5740 consensus_meta.cc:287] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.000s
I20260709 13:02:05.892623  5563 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:05.898731  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:05.876384  5749 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:05.909020  5787 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:05.909529  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:58526
W20260709 13:02:05.963373  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.910049  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:05.911288  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:05.912922  1622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1784) took 1944 ms (client timeout 1853 ms). Trace:
I20260709 13:02:05.914413  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1871) took 1959 ms. Trace:
I20260709 13:02:05.916965  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:05.917857  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:05.918537  5792 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:05.922435  5647 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.922845  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:05.879350  5588 consensus_queue.cc:237] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.924058  5868 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:02:05.804149  5867 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.892598  5366 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:05.935789  5869 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.945235  5764 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:05.946758  5789 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:05.949854  2267 rpcz_store.cc:269] 0709 13:02:02.558623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.569962 (+ 11339us) service_pool.cc:224] Handling call
0709 13:02:05.885782 (+3315820us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b5400620f54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:05.885921 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4745100160}
I20260709 13:02:05.941210  5865 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:05.942728  5757 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:05.948347  1615 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:05.899202  5872 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:02:05.962908  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:05.967118  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 160469us
W20260709 13:02:05.963939  1661 connection.cc:256] RPC call timeout handler was delayed by -1.2205869729999677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:02:06.010072  1661 connection.cc:256] RPC call timeout handler was delayed by -1.2061869729999444s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 13:02:05.965966  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:05.966174  1691 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:06.010861  1694 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:02:05.966313  1696 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:06.011605  1696 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:06.011668  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:05.964154  1622 rpcz_store.cc:269] 0709 13:02:03.968981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.983121 (+ 14140us) service_pool.cc:224] Handling call
0709 13:02:05.912685 (+1929564us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400066b54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:05.912843 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310097280}
I20260709 13:02:05.968791  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:06.012312  1694 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:05.967864  1693 rpcz_store.cc:276] 0709 13:02:03.954764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.118716 (+163952us) service_pool.cc:224] Handling call
0709 13:02:05.914238 (+1795522us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54002503d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:05.914340 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2158900096}
I20260709 13:02:05.969694  1434 maintenance_manager.cc:643] P ee9debc877d548cb9a1a1187cf0a2dcd: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.021s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":318,"lbm_reads_lt_1ms":4}
I20260709 13:02:05.971617  5656 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:02:06.021399  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:05.906838  5877 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:05.900941  5731 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:05.990190  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 173264us
I20260709 13:02:05.966598  5873 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:05.997697  1618 raft_consensus.cc:2393] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:06.002903  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:05.933372  1514 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:06.047611  1539 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:06.048063  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 114771us
I20260709 13:02:06.048990  1514 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:06.006489  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:06.051823  1616 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
W20260709 13:02:06.010386  1661 connection.cc:256] RPC call timeout handler was delayed by -1.1503136620000305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260709 13:02:05.966679  1690 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.012681  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:06.052757  1661 connection.cc:256] RPC call timeout handler was delayed by -1.0288136620000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 13:02:06.011314  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:06.053287  1661 connection.cc:256] RPC call timeout handler was delayed by -1.0225869729999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:02:06.013134  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:05.963402  5740 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:06.060896  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 95898.2us
I20260709 13:02:06.053151  1622 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:06.064481  1615 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
W20260709 13:02:06.019320  5863 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.477s	user 0.002s	sys 0.000s
W20260709 13:02:06.031644  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.009424  5865 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:06.043493  1623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1890) took 2469 ms (client timeout 1783 ms). Trace:
W20260709 13:02:06.045529  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1875) took 2840 ms (client timeout 1921 ms). Trace:
W20260709 13:02:06.083045  1623 rpcz_store.cc:269] 0709 13:02:03.573883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.787520 (+213637us) service_pool.cc:224] Handling call
0709 13:02:06.043248 (+2255728us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54000fc8d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:06.043392 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329079552}
W20260709 13:02:06.083182  1540 rpcz_store.cc:269] 0709 13:02:03.204810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.223624 (+ 18814us) service_pool.cc:224] Handling call
0709 13:02:06.045348 (+2821724us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540027b5d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:06.045451 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279291776}
I20260709 13:02:06.054199  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:05.969985  5787 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:05.969806  5749 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:06.092733  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:06.092996  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:06.072932  1697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 621) took 3272 ms (client timeout 1872 ms). Trace:
I20260709 13:02:06.073953  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:06.075240  1690 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:02:06.095016  2267 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:02:06.082459  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:06.093878  1697 rpcz_store.cc:269] 0709 13:02:02.800949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.801068 (+   119us) service_pool.cc:224] Handling call
0709 13:02:06.072717 (+3271649us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b5400378cd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:06.072847 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264583040}
I20260709 13:02:06.097926  1620 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:06.100713  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:06.101176  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 47084.4us
I20260709 13:02:06.102878  1661 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:06.098654  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1867) took 3738 ms. Trace:
I20260709 13:02:06.044992  5877 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:06.112286  1543 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:06.113864  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:06.116786  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 223622us
I20260709 13:02:06.117056  2269 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:06.117969  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:06.081665  5886 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:06.122315  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 818) took 2135 ms. Trace:
I20260709 13:02:06.071070  5630 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:06.121203  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:06.123435  1614 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.125036  1620 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:06.123462  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:06.081481  5843 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:06.122740  1545 rpcz_store.cc:276] 0709 13:02:03.987343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.987483 (+   140us) service_pool.cc:224] Handling call
0709 13:02:03.987736 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.060160 (+ 72424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.060192 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.060233 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:04.060270 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.122118 (+2061848us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b54000c3354. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:06.122162 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.122264 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166155136}
I20260709 13:02:06.130896  1614 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:06.122087  5762 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:06.136674  5762 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:06.137035  5872 consensus_queue.cc:1059] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:06.137253  5762 raft_consensus.cc:697] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:06.104637  1542 rpcz_store.cc:276] 0709 13:02:02.359137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.359278 (+   141us) service_pool.cc:224] Handling call
0709 13:02:02.359606 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.359925 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.359950 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.360345 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.734386 (+374041us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:06.007363 (+3272977us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b1800397cc0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c6a6e64bc 00007f5c67a3448b 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a4e455 00007f5c6e5363c7 00007f5c6ab489a7 00007f5c6ab580bf
0709 13:02:06.007551 (+   188us) log.cc:844] Serialized 14 byte log entry
0709 13:02:06.073447 (+ 65896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.073533 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.073572 (+    39us) raft_consensus.cc:1685] finished
0709 13:02:06.096860 (+ 23288us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.097055 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13862,"prepare.queue_time_us":147395,"prepare.run_cpu_time_us":3321,"prepare.run_wall_time_us":41893,"raft.queue_time_us":12822,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":18952,"spinlock_wait_cycles":14535936,"thread_start_us":726185,"threads_started":3,"wal-append.queue_time_us":467753,"wal-append.run_cpu_time_us":3893,"wal-append.run_wall_time_us":1097255}
I20260709 13:02:06.145359  5865 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:06.146159  5865 consensus_queue.cc:1059] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:06.155791  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:06.134034  1696 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:06.155102  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:06.157853  1616 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.001660  5753 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:06.138521  5762 consensus_queue.cc:237] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:06.161703  1586 leader_election.cc:336] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.521s (SENT)
I20260709 13:02:06.166834  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1854) took 2567 ms. Trace:
I20260709 13:02:06.172505  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:06.172458  1688 rpcz_store.cc:276] 0709 13:02:03.599223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.618560 (+ 19337us) service_pool.cc:224] Handling call
0709 13:02:03.618975 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.211657 (+592682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.166547 (+1954890us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b5400140854. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:06.166761 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1360119552}
I20260709 13:02:06.175868  1696 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:06.176163  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:06.176915  2266 raft_consensus.cc:3055] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:06.177336  2266 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:02:06.155529  5765 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.589s	user 0.006s	sys 0.004s
I20260709 13:02:06.173548  1513 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:06.169445  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:06.184574  1513 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:06.184849  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:06.185644  1542 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:02:06.156194  5886 raft_consensus.cc:697] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:02:06.203030  1619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 812) took 2126 ms (client timeout 2142 ms). Trace:
W20260709 13:02:06.203552  1619 rpcz_store.cc:269] 0709 13:02:04.076766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.222756 (+145990us) service_pool.cc:224] Handling call
0709 13:02:06.202853 (+1980097us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54002648d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:06.202971 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3259638144}
I20260709 13:02:06.204804  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:06.205447  1619 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:06.123009  5647 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:02:06.128372  5712 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:06.211140  5712 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:06.211719  5712 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:06.184772  5789 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.216822  1619 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:06.114336  5764 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:06.228307  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:06.200120  5837 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:06.205917  1616 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:02:06.159622  5843 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:06.236136  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:06.246971  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 206350us
I20260709 13:02:06.247216  5381 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:06.269627  5381 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:06.241731  5837 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:06.273114  5731 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:06.273523  5837 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.276026  2266 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:06.277098  2266 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:06.279072  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 176292us
W20260709 13:02:06.260443  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 1866) took 2450 ms (client timeout 2044 ms). Trace:
W20260709 13:02:06.280741  1692 rpcz_store.cc:269] 0709 13:02:03.811484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.058168 (+246684us) service_pool.cc:224] Handling call
0709 13:02:06.260202 (+2202034us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400391554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:06.260346 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389946240}
I20260709 13:02:06.193099  5765 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:06.281836  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.282004  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:06.282548  1690 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:06.283437  1694 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:06.283238  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:06.284726  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 100229us
I20260709 13:02:06.286120  1513 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:06.288508  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:06.251497  2267 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:06.305987  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:06.348919  1693 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:06.227666  5647 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.353739  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 49547us
I20260709 13:02:06.242769  5714 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:06.388022  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.392520  1696 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:06.385879  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.235433  5789 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:06.387322  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:06.393990  1697 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:06.386677  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:06.405340  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:06.381692  5890 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.390s	user 0.001s	sys 0.000s
I20260709 13:02:06.401480  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:06.247539  5764 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:06.403163  1586 leader_election.cc:336] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.903s (SENT)
I20260709 13:02:06.400775  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:06.280269  5787 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:06.409132  1616 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:06.416458  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:06.420451  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.383980  5887 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:06.422349  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.421237  1695 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:06.425459  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.401206  5630 raft_consensus.cc:697] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:06.427702  5630 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:06.428283  5903 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 13:02:06.428573  5765 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:06.434747  5749 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:06.394280  5647 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:06.447336  1693 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:06.453599  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.510310  1691 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:06.509814  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.512625  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.513041  1694 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:06.513722  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.514155  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.512328  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.515547  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.515618  1693 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:06.515338  1694 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:06.443600  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.514474  1691 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:06.519591  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.520066  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.520227  1697 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:02:06.521689  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:06.522850  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.518610  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.524740  1690 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:06.514362  5740 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:06.521377  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.526412  1697 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:06.521112  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.527370  1693 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
W20260709 13:02:06.508876  5773 consensus_meta.cc:287] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
W20260709 13:02:06.498247  5595 consensus_meta.cc:287] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.812s	user 0.009s	sys 0.002s
W20260709 13:02:06.498078  5864 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.946s	user 0.000s	sys 0.003s
I20260709 13:02:06.516849  5874 raft_consensus.cc:3055] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:06.423977  5757 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:06.446458  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:06.531224  2266 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
W20260709 13:02:06.530439  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 239785us
I20260709 13:02:06.527709  1694 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:06.539050  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.539808  1694 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
W20260709 13:02:06.535723  5741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.005s	sys 0.015s
I20260709 13:02:06.528548  5904 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.497350  5837 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:06.545692  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.532480  5874 raft_consensus.cc:740] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:06.409529  5886 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:06.548087  5647 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:06.549233  2232 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:06.544420  5741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.006s	sys 0.015s
I20260709 13:02:06.532745  5773 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:06.536337  5595 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:06.552740  5643 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:06.546363  5904 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:06.565083  5874 consensus_queue.cc:260] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:06.562036  5776 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:06.572507  5789 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:06.573793  5773 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:06.574536  5869 consensus_meta.cc:287] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.579s	user 0.006s	sys 0.001s
I20260709 13:02:06.574700  5837 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:06.578100  5776 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.580103  5595 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:06.580396  5874 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.581970  5904 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:06.582487  5877 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:06.586169  5776 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.585781  5869 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:06.684245  5488 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 13:02:06.636149  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.690660  1621 raft_consensus.cc:2368] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:02:06.592734  5877 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:06.637430  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.652009  1692 raft_consensus.cc:2376] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10. Re-sending same reply.
I20260709 13:02:06.653584  1696 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:06.649942  1663 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:06.580428  2271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54504 (request call id 649) took 2702 ms (client timeout 2043 ms). Trace:
W20260709 13:02:06.693595  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 43999.3us
W20260709 13:02:06.664749  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 104221us
I20260709 13:02:06.667510  1586 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:06.695866  5787 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.666838  2269 raft_consensus.cc:1240] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:06.695709  5762 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:06.707998  5869 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:06.713145  5789 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:06.716029  5643 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:06.717583  5643 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:06.719923  5836 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:06.720535  5836 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:06.723065  5647 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:02:06.723577  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 56532.6us
I20260709 13:02:06.724259  5647 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:06.725065  5900 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:06.716038  5749 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:02:06.756100  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 59990.3us
I20260709 13:02:06.773607  5762 raft_consensus.cc:697] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:06.775530  5762 consensus_queue.cc:237] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:06.693634  2271 rpcz_store.cc:269] 0709 13:02:03.878173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.878361 (+   188us) service_pool.cc:224] Handling call
0709 13:02:06.580161 (+2701800us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54006202d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:06.580337 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803513728}
I20260709 13:02:06.704131  1663 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:06.825059  5904 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:06.825723  5904 raft_consensus.cc:697] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:06.826740  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 131525us
I20260709 13:02:06.830622  1663 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:06.828287  5904 consensus_queue.cc:237] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:06.834446  5776 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:06.828007  5647 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:06.836189  5787 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:06.841006  5776 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:02:06.842803  5787 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:06.843990  1689 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
W20260709 13:02:06.849316  1587 leader_election.cc:336] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.858s (SENT)
I20260709 13:02:06.849984  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:06.851064  5647 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:06.909164  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 78789.7us
I20260709 13:02:06.910495  5736 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:06.910486  1663 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:06.912237  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:06.912353  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:06.913477  5787 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.913585  1616 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:06.914456  5787 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:06.909052  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.929111  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:06.929523  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.930583  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.930737  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.931823  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.932962  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:06.931281  1690 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
W20260709 13:02:07.083566  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.112771  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.334538  5721 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:07.346993  5761 raft_consensus.cc:3055] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:07.347680  5761 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:07.351220  5787 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.350875  5761 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:07.351824  5787 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:07.354099  5761 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.350864  5736 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.361495  5736 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:07.354287  5787 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:07.372134  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 218482us
I20260709 13:02:07.454438  5907 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:07.458287  5907 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:07.461289  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2697) took 2559 ms. Trace:
I20260709 13:02:07.461820  1539 rpcz_store.cc:276] 0709 13:02:04.901431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.537762 (+636331us) service_pool.cc:224] Handling call
0709 13:02:06.047364 (+509602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.048162 (+   798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.460774 (+1412612us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540027b5d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:07.461022 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130886400}
I20260709 13:02:07.465901  5736 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:07.476768  5381 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:07.476884  5867 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:07.482375  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:07.485224  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:07.482935  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 819) took 3355 ms. Trace:
I20260709 13:02:07.488201  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:07.489720  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.488384  1617 rpcz_store.cc:276] 0709 13:02:04.127197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.130647 (+1003450us) service_pool.cc:224] Handling call
0709 13:02:05.164764 (+ 34117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.243351 (+1078587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.243391 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:06.243857 (+   466us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:06.243912 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.482435 (+1238523us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000fb4d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:07.482501 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.482725 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2480041856}
I20260709 13:02:07.491777  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:07.491977  1693 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:02:07.492551  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:07.495867  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:07.495190  1616 consensus_meta.cc:287] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.001s
I20260709 13:02:07.499516  1616 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:07.501250  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:07.497097  5836 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:07.502609  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:07.502943  5836 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.503571  2271 raft_consensus.cc:2393] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:07.511526  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:07.514829  1617 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.521481  5843 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:07.488623  5907 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:07.527328  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.542323  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2696) took 3031 ms. Trace:
I20260709 13:02:07.545965  2234 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:07.557354  1543 rpcz_store.cc:276] 0709 13:02:04.510468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.484778 (+974310us) service_pool.cc:224] Handling call
0709 13:02:07.541815 (+2057037us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54003b4554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:07.542106 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1421006592}
I20260709 13:02:07.553294  1690 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:07.554128  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:07.560329  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 832) took 1371 ms. Trace:
I20260709 13:02:07.561131  5907 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:07.562276  5684 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:07.563232  5907 raft_consensus.cc:697] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:02:07.563745  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1896) took 1796 ms (client timeout 2043 ms). Trace:
I20260709 13:02:07.561628  1616 rpcz_store.cc:276] 0709 13:02:06.188520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.528132 (+1339612us) service_pool.cc:224] Handling call
0709 13:02:07.560233 (+ 32101us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:07.564276  1618 rpcz_store.cc:269] 0709 13:02:05.767325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.787340 (+ 20015us) service_pool.cc:224] Handling call
0709 13:02:07.563306 (+1775966us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540016f654. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:07.563553 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472654592}
I20260709 13:02:07.565862  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:07.566705  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:07.547205  1615 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:07.569444  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:07.568929  5907 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:07.569772  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1790) took 1524 ms (client timeout 2021 ms). Trace:
W20260709 13:02:07.570245  1615 rpcz_store.cc:269] 0709 13:02:06.045104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.481547 (+1436443us) service_pool.cc:224] Handling call
0709 13:02:07.569687 (+ 88140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.568133  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:07.570458  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2894) took 1289 ms (client timeout 1650 ms). Trace:
W20260709 13:02:07.574335  1540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.399s	user 0.016s	sys 0.038s
W20260709 13:02:07.574970  1540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.400s	user 0.017s	sys 0.039s
I20260709 13:02:07.574860  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:07.574893  1616 raft_consensus.cc:2393] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
W20260709 13:02:07.574054  1688 rpcz_store.cc:269] 0709 13:02:06.280785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.281514 (+   729us) service_pool.cc:224] Handling call
0709 13:02:07.569176 (+1287662us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b5800003998. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19eee 0000000000375939 00007f5c6fa8d1e0 00007f5c6fb560c4 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:02:07.570364 (+  1188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16206720}
I20260709 13:02:07.575698  1618 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:07.581182  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 838) took 1461 ms. Trace:
I20260709 13:02:07.581810  1540 rpcz_store.cc:276] 0709 13:02:06.119574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.120069 (+   495us) service_pool.cc:224] Handling call
0709 13:02:06.120327 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.120858 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.120885 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.121300 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.578572 (+1457272us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:07.579751 (+  1179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.580869 (+  1118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.580910 (+    41us) raft_consensus.cc:1685] finished
0709 13:02:07.580920 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.581101 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4749,"raft.queue_time_us":1605,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":21138,"thread_start_us":1400481,"threads_started":1,"wal-append.queue_time_us":391889,"wal-append.run_cpu_time_us":2078,"wal-append.run_wall_time_us":1021163}
I20260709 13:02:07.583936  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:07.585489  1618 raft_consensus.cc:2410] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:02:07.585976  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1898) took 1818 ms. Trace:
I20260709 13:02:07.586397  1618 rpcz_store.cc:276] 0709 13:02:05.767983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.580187 (+1812204us) service_pool.cc:224] Handling call
0709 13:02:07.585905 (+  5718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.578799  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:07.587836  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:07.588457  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:07.593663  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:07.593943  1616 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:07.594381  1623 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:07.594547  1693 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:07.595279  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:07.596204  1695 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:07.596418  1616 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.597293  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:07.598114  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1792) took 1527 ms. Trace:
I20260709 13:02:07.597298  1617 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:07.601691  1617 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:07.590420  1621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1901) took 1821 ms (client timeout 1805 ms). Trace:
W20260709 13:02:07.591439  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 641) took 1675 ms (client timeout 2142 ms). Trace:
I20260709 13:02:07.571287  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:07.598443  1618 rpcz_store.cc:276] 0709 13:02:06.070819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.596973 (+1526154us) service_pool.cc:224] Handling call
0709 13:02:07.598060 (+  1087us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:07.614652  1621 rpcz_store.cc:269] 0709 13:02:05.768808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.783157 (+ 14349us) service_pool.cc:224] Handling call
0709 13:02:07.590160 (+1807003us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54000d20d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:07.590313 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082569600}
I20260709 13:02:07.616114  1615 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
W20260709 13:02:07.606511  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.608171  5843 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:07.608728  1662 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:07.610649  2231 connection.cc:256] RPC call timeout handler was delayed by -1.2567981569999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
I20260709 13:02:07.618049  1621 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13. Ops: [9.6-12.7]
I20260709 13:02:07.618574  1540 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:07.618767  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1913) took 1784 ms. Trace:
W20260709 13:02:07.619028  2231 connection.cc:256] RPC call timeout handler was delayed by -1.2090981569999713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
I20260709 13:02:07.619200  1621 rpcz_store.cc:276] 0709 13:02:05.834456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.616071 (+1781615us) service_pool.cc:224] Handling call
0709 13:02:07.617742 (+  1671us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:07.618476 (+   734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.618688 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:07.619699  2231 leader_election.cc:336] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.841s (SENT)
W20260709 13:02:07.615314  1689 rpcz_store.cc:269] 0709 13:02:05.916388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.916764 (+   376us) service_pool.cc:224] Handling call
0709 13:02:07.591178 (+1674414us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b5400146c54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:07.591323 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2021390080}
I20260709 13:02:07.621580  5685 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:07.611150  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:07.622314  5685 raft_consensus.cc:697] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:07.622635  1619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1798) took 1375 ms (client timeout 1812 ms). Trace:
W20260709 13:02:07.623121  1619 rpcz_store.cc:269] 0709 13:02:06.247782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.610710 (+1362928us) service_pool.cc:224] Handling call
0709 13:02:07.622580 (+ 11870us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:07.627002  2231 leader_election.cc:336] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.872s (SENT)
W20260709 13:02:07.630640  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.634379  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:07.636758  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1909) took 1829 ms (client timeout 1577 ms). Trace:
W20260709 13:02:07.637109  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.609747  1616 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:07.598733  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2925) took 1081 ms. Trace:
I20260709 13:02:07.621675  5843 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:07.637265  1620 rpcz_store.cc:269] 0709 13:02:05.807709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.829563 (+ 21854us) service_pool.cc:224] Handling call
0709 13:02:07.636298 (+1806735us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54003a0a54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:07.636496 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614925696}
I20260709 13:02:07.642060  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1899) took 1863 ms. Trace:
I20260709 13:02:07.645720  1617 rpcz_store.cc:276] 0709 13:02:05.768275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.600923 (+1832648us) service_pool.cc:224] Handling call
0709 13:02:07.601411 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.629827 (+ 28416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.631741 (+  1914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.646436  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1922) took 1002 ms. Trace:
I20260709 13:02:07.641958  1695 rpcz_store.cc:276] 0709 13:02:06.517080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.526715 (+  9635us) service_pool.cc:224] Handling call
0709 13:02:07.595584 (+1068869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.596598 (+  1014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.598530 (+  1932us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400146c50. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:07.598666 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457409408}
I20260709 13:02:07.646824  1616 rpcz_store.cc:276] 0709 13:02:06.644460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.595003 (+950543us) service_pool.cc:224] Handling call
0709 13:02:07.646384 (+ 51381us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:07.647660  2231 connection.cc:256] RPC call timeout handler was delayed by -1.0434981569999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
I20260709 13:02:07.664915  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:07.669543  1689 raft_consensus.cc:3055] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:07.669953  1689 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:07.671066  1689 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:07.655647  5685 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:07.672389  1539 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.674871  5843 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:07.677492  1689 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.681788  1623 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:07.682471  1617 raft_consensus.cc:1240] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:07.682598  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1921) took 1038 ms. Trace:
I20260709 13:02:07.685842  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1916) took 1782 ms. Trace:
I20260709 13:02:07.686192  1617 rpcz_store.cc:276] 0709 13:02:05.901295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.657171 (+1755876us) service_pool.cc:224] Handling call
0709 13:02:07.682244 (+ 25073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.683098 (+   854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.683329 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.683395  1623 rpcz_store.cc:276] 0709 13:02:06.644102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.593271 (+949169us) service_pool.cc:224] Handling call
0709 13:02:07.682519 (+ 89248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.692644  1688 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.688548  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 828) took 1597 ms. Trace:
I20260709 13:02:07.694316  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1914) took 1841 ms. Trace:
I20260709 13:02:07.694629  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:07.695546  1695 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:07.694921  1615 rpcz_store.cc:276] 0709 13:02:05.853280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.632729 (+1779449us) service_pool.cc:224] Handling call
0709 13:02:07.634554 (+  1825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.634880 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:07.635162 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.693979 (+ 58817us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.694033 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:07.694085 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.694157 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.694263 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8458,"prepare.queue_time_us":736,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"thread_start_us":49926,"threads_started":1}
I20260709 13:02:07.697810  1615 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.699627  2231 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:07.694993  1622 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:02:07.701907  1622 pending_rounds.cc:85] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 4
I20260709 13:02:07.701690  1623 rpcz_store.cc:276] 0709 13:02:06.091242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.687687 (+1596445us) service_pool.cc:224] Handling call
0709 13:02:07.688018 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.688228 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.688252 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.688292 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:07.688326 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.688381 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.688472 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.699162  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 830) took 1582 ms. Trace:
I20260709 13:02:07.706295  1619 rpcz_store.cc:276] 0709 13:02:06.116927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.697978 (+1581051us) service_pool.cc:224] Handling call
0709 13:02:07.698417 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.698735 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.698771 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.698844 (+    73us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:07.698888 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.698954 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.699082 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.702327  1622 pending_rounds.cc:107] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:07.710374  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:07.711139  1693 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:07.711817  5739 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:07.712255  5739 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:07.712612  5739 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.710033  1622 raft_consensus.cc:2889] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:07.718986  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.720512  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1793) took 1607 ms. Trace:
I20260709 13:02:07.720921  1622 rpcz_store.cc:276] 0709 13:02:06.113530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.694042 (+1580512us) service_pool.cc:224] Handling call
0709 13:02:07.694447 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.720129 (+ 25682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.720454 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.724021  5792 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.724804  5792 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:07.730578  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:07.730681  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:07.730641  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54504 (request call id 660) took 1600 ms. Trace:
I20260709 13:02:07.732337  5669 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:07.724192  1623 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:02:07.732635  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 1903) took 1963 ms (client timeout 2127 ms). Trace:
I20260709 13:02:07.733256  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 831) took 1592 ms. Trace:
I20260709 13:02:07.732445  2269 rpcz_store.cc:276] 0709 13:02:06.130250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.134880 (+  4630us) service_pool.cc:224] Handling call
0709 13:02:06.135228 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.809992 (+674764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.730256 (+920264us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54005a0354. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:07.730515 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221278592}
I20260709 13:02:07.734215  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2901) took 1332 ms. Trace:
I20260709 13:02:07.734717  1696 rpcz_store.cc:276] 0709 13:02:06.402189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.402378 (+   189us) service_pool.cc:224] Handling call
0709 13:02:07.734006 (+1331628us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400148054. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:07.734166 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535551872}
I20260709 13:02:07.733883  1623 rpcz_store.cc:276] 0709 13:02:06.140769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.717212 (+1576443us) service_pool.cc:224] Handling call
0709 13:02:07.723778 (+  6566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.733010 (+  9232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.733185 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.736953  2231 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:07.739686  5669 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:07.740061  1620 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:07.740348  5669 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:07.742666  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:07.733183  1614 rpcz_store.cc:269] 0709 13:02:05.769432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.962672 (+193240us) service_pool.cc:224] Handling call
0709 13:02:07.732323 (+1769651us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400314f54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:07.732457 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261387008}
I20260709 13:02:07.744074  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:07.744791  1614 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:07.740847  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1917) took 1785 ms. Trace:
I20260709 13:02:07.745476  1620 rpcz_store.cc:276] 0709 13:02:05.955081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.664598 (+1709517us) service_pool.cc:224] Handling call
0709 13:02:07.703934 (+ 39336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.740560 (+ 36626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.740750 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.745996  1614 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:07.746601  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1800) took 1323 ms. Trace:
I20260709 13:02:07.747468  1623 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:07.748775  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1797) took 1520 ms. Trace:
I20260709 13:02:07.751377  5914 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:07.746897  1614 rpcz_store.cc:276] 0709 13:02:06.423598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.745551 (+1321953us) service_pool.cc:224] Handling call
0709 13:02:07.745848 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.746391 (+   543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.746558 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.756337  1623 rpcz_store.cc:276] 0709 13:02:06.227982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.738259 (+1510277us) service_pool.cc:224] Handling call
0709 13:02:07.738649 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.748564 (+  9915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.748727 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.746810  1620 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:02:07.759119  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1801) took 1304 ms. Trace:
I20260709 13:02:07.759536  1620 rpcz_store.cc:276] 0709 13:02:06.454535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.746276 (+1291741us) service_pool.cc:224] Handling call
0709 13:02:07.746598 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.758848 (+ 12250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.759069 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.757218  1614 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:07.754807  2231 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:07.767875  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1804) took 1136 ms. Trace:
I20260709 13:02:07.769979  1614 rpcz_store.cc:276] 0709 13:02:06.627665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.756611 (+1128946us) service_pool.cc:224] Handling call
0709 13:02:07.757015 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.764090 (+  7075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.764339 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.765264  1539 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:02:07.777525  1617 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:07.777935  1688 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:07.779210  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1786) took 1743 ms. Trace:
I20260709 13:02:07.779748  1617 rpcz_store.cc:276] 0709 13:02:06.035835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.705937 (+1670102us) service_pool.cc:224] Handling call
0709 13:02:07.774224 (+ 68287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.778037 (+  3813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.779151 (+  1114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.735631  5792 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:07.781277  1615 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:07.783133  5870 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:07.792459  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.794420  5843 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.795672  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 834) took 1167 ms. Trace:
I20260709 13:02:07.795943  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:07.796725  2269 raft_consensus.cc:2368] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:02:07.795145  5843 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:07.796948  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:07.797878  2266 raft_consensus.cc:2393] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:07.799003  5843 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:07.800029  5736 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:07.800756  5736 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:07.801515  5793 consensus_queue.cc:1059] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:07.803007  5736 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:07.804158  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:07.804544  5843 consensus_queue.cc:1059] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:07.805999  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1912) took 1982 ms. Trace:
I20260709 13:02:07.806214  5804 raft_consensus.cc:3055] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:07.806761  5804 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:07.806528  1618 rpcz_store.cc:276] 0709 13:02:05.823161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.615868 (+1792707us) service_pool.cc:224] Handling call
0709 13:02:07.622416 (+  6548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.631449 (+  9033us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:07.631493 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.644441 (+ 12948us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.683611 (+ 39170us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:07.683650 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.683756 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.805687 (+121931us) raft_consensus.cc:1685] finished
0709 13:02:07.805715 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.805896 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6557,"raft.queue_time_us":8849,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":10726,"thread_start_us":38761,"threads_started":1,"wal-append.queue_time_us":134672}
I20260709 13:02:07.808118  5804 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:07.809052  1618 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:07.809239  5804 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.809727  5853 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:07.785735  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 833) took 1157 ms. Trace:
I20260709 13:02:07.815600  1623 rpcz_store.cc:276] 0709 13:02:06.627889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.758200 (+1130311us) service_pool.cc:224] Handling call
0709 13:02:07.764745 (+  6545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.785298 (+ 20553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.785327 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.785394 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:07.785471 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.785557 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.785667 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.817534  1614 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:07.818450  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1806) took 1190 ms. Trace:
I20260709 13:02:07.818506  1663 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:07.819080  1547 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:07.819648  5736 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:07.820016  1663 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:07.820916  5934 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:07.821230  1663 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:07.820492  5736 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:07.822299  5935 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:07.822883  5935 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:07.824031  5935 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:07.825750  1621 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:07.826474  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1809) took 1196 ms. Trace:
I20260709 13:02:07.826788  1621 rpcz_store.cc:276] 0709 13:02:06.629617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.825230 (+1195613us) service_pool.cc:224] Handling call
0709 13:02:07.825526 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.826227 (+   701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.826412 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.827037  5563 raft_consensus.cc:3055] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:07.827725  5563 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:07.828751  5563 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:07.830195  5563 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.834378  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 2903) took 1418 ms. Trace:
I20260709 13:02:07.837702  1689 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 12. (term mismatch)
I20260709 13:02:07.838389  1689 pending_rounds.cc:85] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 11
I20260709 13:02:07.834872  1692 rpcz_store.cc:276] 0709 13:02:06.415824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.415974 (+   150us) service_pool.cc:224] Handling call
0709 13:02:07.834117 (+1418143us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540009b0d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:07.834283 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262274816}
I20260709 13:02:07.838788  1689 pending_rounds.cc:107] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 10.12
I20260709 13:02:07.840669  1689 raft_consensus.cc:2889] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:07.786520  1617 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:02:08.094928  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 835) took 1466 ms. Trace:
I20260709 13:02:08.095309  1617 rpcz_store.cc:276] 0709 13:02:06.628649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.780738 (+1152089us) service_pool.cc:224] Handling call
0709 13:02:07.786087 (+  5349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.094590 (+308503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.094839 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.784933  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 829) took 1671 ms. Trace:
I20260709 13:02:08.096624  1617 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:08.096469  1615 rpcz_store.cc:276] 0709 13:02:06.113923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.697199 (+1583276us) service_pool.cc:224] Handling call
0709 13:02:07.697583 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.784623 (+ 87040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.784869 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.097365  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1919) took 1454 ms. Trace:
I20260709 13:02:07.821318  5934 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.097918  1615 raft_consensus.cc:1275] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:08.098232  5934 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:08.098493  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1812) took 1182 ms. Trace:
I20260709 13:02:08.098835  1615 rpcz_store.cc:276] 0709 13:02:06.915977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.097328 (+1181351us) service_pool.cc:224] Handling call
0709 13:02:08.097568 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.098270 (+   702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.098445 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.100251  1615 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:08.101544  1615 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:07.796136  1620 rpcz_store.cc:276] 0709 13:02:06.628279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.760927 (+1132648us) service_pool.cc:224] Handling call
0709 13:02:07.777898 (+ 16971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.793384 (+ 15486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.793421 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.793464 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:07.793496 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.795508 (+  2012us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.795620 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:07.946378  5931 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.502s	user 0.000s	sys 0.004s
W20260709 13:02:07.930966  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.838161  1513 leader_election.cc:400] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:02:08.526580  1513 leader_election.cc:403] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:02:08.527210  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 726741us
I20260709 13:02:08.528204  1513 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:07.899228  1511 connection.cc:256] RPC call timeout handler was delayed by -2.88488552299998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
I20260709 13:02:08.126169  5934 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:08.543222  1511 connection.cc:256] RPC call timeout handler was delayed by -2.769685523000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
W20260709 13:02:07.883057  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.545656  5934 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:08.545979  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.546763  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.097693  1617 rpcz_store.cc:276] 0709 13:02:06.643394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.096069 (+1452675us) service_pool.cc:224] Handling call
0709 13:02:08.096387 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.097165 (+   778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.097321 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.120932  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1796) took 1920 ms. Trace:
I20260709 13:02:07.817714  1623 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:07.983672  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1918) took 1340 ms. Trace:
I20260709 13:02:08.558868  1621 rpcz_store.cc:276] 0709 13:02:06.642915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.827819 (+1184904us) service_pool.cc:224] Handling call
0709 13:02:07.828136 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.828395 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:07.829015 (+   620us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.983256 (+154241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.983304 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:07.983392 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.983498 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.983612 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":167,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":75375,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":153785,"threads_started":1,"wal-append.queue_time_us":80640}
I20260709 13:02:08.278530  1586 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:07.809684  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1807) took 1181 ms. Trace:
I20260709 13:02:07.818977  1614 rpcz_store.cc:276] 0709 13:02:06.628431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.770690 (+1142259us) service_pool.cc:224] Handling call
0709 13:02:07.779883 (+  9193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.818207 (+ 38324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.818397 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:08.221688  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.061609  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 240450us
I20260709 13:02:08.565588  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:08.277650  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.568229  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.568773  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.855937  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 101291us
I20260709 13:02:08.572196  1514 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:08.572902  2231 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:08.574332  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:08.176458  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 313644us
I20260709 13:02:08.182214  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:53842 (request call id 4) took 3674 ms. Trace:
I20260709 13:02:07.828025  5736 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:08.579100  5936 raft_consensus.cc:2764] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:02:08.580935  5936 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:08.581785  5936 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:08.582201  5936 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.787065  5739 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:08.314855  5741 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:08.384492  1615 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:07.767697  5763 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:08.577014  2270 rpcz_store.cc:276] 0709 13:02:04.507440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.511156 (+  3716us) service_pool.cc:224] Handling call
0709 13:02:08.181812 (+3670656us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54006cf554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab38853 00007f5c6fb0660a 00007f5c6908c7d4 00007f5c6908c762 00007f5c6908c691 00007f5c6908c60c 00007f5c6908b8c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:08.181964 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541404544}
I20260709 13:02:07.853420  5669 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:08.596087  5669 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:08.196985  5817 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.345s	user 0.009s	sys 0.007s
I20260709 13:02:08.308471  5870 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:08.599654  5854 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:08.314314  5877 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:08.602453  5937 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:08.264966  5889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.020s	sys 0.006s
W20260709 13:02:08.606660  5889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.758s	user 0.025s	sys 0.007s
I20260709 13:02:07.871196  5861 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:08.608747  5861 raft_consensus.cc:697] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:08.609750  5861 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:08.610123  5937 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:08.391836  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 826) took 2453 ms. Trace:
I20260709 13:02:08.613535  1616 rpcz_store.cc:276] 0709 13:02:05.938479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.655491 (+1717012us) service_pool.cc:224] Handling call
0709 13:02:07.686934 (+ 31443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.763963 (+ 77029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.764011 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.324453 (+560442us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.351558 (+ 27105us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:08.351596 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.351668 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.391594 (+ 39926us) raft_consensus.cc:1685] finished
0709 13:02:08.391614 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.391750 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2102,"raft.queue_time_us":10364,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":26620,"threads_started":1,"wal-append.queue_time_us":26427}
I20260709 13:02:08.395602  1587 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:08.399937  5963 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:08.616997  5963 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:08.400754  5964 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:08.442538  5381 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:08.503615  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2923) took 1991 ms. Trace:
I20260709 13:02:08.534894  5804 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:02:08.619745  5870 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:08.620026  5967 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:08.620257  5804 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:08.620679  5804 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.621064  5804 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:08.547232  1511 connection.cc:256] RPC call timeout handler was delayed by -2.6012670079999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 13:02:08.619757  1691 rpcz_store.cc:276] 0709 13:02:06.512637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.523587 (+ 10950us) service_pool.cc:224] Handling call
0709 13:02:06.523900 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.528398 (+  4498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.528423 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.528787 (+   364us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.835584 (+306797us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b18000f9940. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de0d1 00007f5c6aaf9a0f
0709 13:02:06.922657 (+ 87073us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:06.923142 (+   485us) log.cc:844] Serialized 14 byte log entry
0709 13:02:06.923632 (+   490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.927598 (+  3966us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.945666 (+1018068us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:08.503193 (+557527us) raft_consensus.cc:1685] finished
0709 13:02:08.503214 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.503400 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4543,"prepare.queue_time_us":700,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":10297,"raft.queue_time_us":5583,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":13985,"spinlock_wait_cycles":9160832,"thread_start_us":69137,"threads_started":1,"wal-append.queue_time_us":870756}
W20260709 13:02:08.624058  1511 connection.cc:256] RPC call timeout handler was delayed by -2.455467007999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 13:02:08.624538  1511 connection.cc:256] RPC call timeout handler was delayed by -2.4284670079999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 13:02:08.624967  1511 connection.cc:256] RPC call timeout handler was delayed by -2.365414090999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 13:02:08.625315  1511 connection.cc:256] RPC call timeout handler was delayed by -2.2423418879999417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 13:02:08.625674  1511 connection.cc:256] RPC call timeout handler was delayed by -2.2394634529999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 13:02:08.626230  1511 connection.cc:256] RPC call timeout handler was delayed by -2.0799884130000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 13:02:08.626566  1511 connection.cc:256] RPC call timeout handler was delayed by -2.0591247419999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 13:02:08.626868  1511 connection.cc:256] RPC call timeout handler was delayed by -2.0395664170000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 13:02:08.628253  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 232769us
I20260709 13:02:08.629937  2270 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:08.630766  1587 leader_election.cc:336] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.547s (SENT)
I20260709 13:02:08.555812  1622 rpcz_store.cc:276] 0709 13:02:06.200468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.721672 (+1521204us) service_pool.cc:224] Handling call
0709 13:02:07.722088 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.722553 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.722579 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.723111 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.772151 (+ 49040us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:07.772207 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.772294 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.120577 (+348283us) raft_consensus.cc:1685] finished
0709 13:02:08.120621 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.120856 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1077,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"thread_start_us":48484,"threads_started":1,"wal-append.queue_time_us":62298}
I20260709 13:02:08.558483  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1808) took 1929 ms. Trace:
W20260709 13:02:08.561640  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 283159us
I20260709 13:02:08.631821  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:08.632136  1623 rpcz_store.cc:276] 0709 13:02:06.629245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.816807 (+1187562us) service_pool.cc:224] Handling call
0709 13:02:07.817213 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.558197 (+740984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.558426 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.633131  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:08.634419  1586 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:08.635260  1586 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:08.567533  5865 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:08.575969  2232 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:08.636397  5792 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:08.636457  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 60583.1us
I20260709 13:02:08.636653  5964 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:08.637142  5964 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:08.637362  5749 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:08.637753  5749 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.638078  5749 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:08.638250  5907 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:08.638761  5907 raft_consensus.cc:697] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:08.561467  1618 rpcz_store.cc:276] 0709 13:02:06.628794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.808481 (+1179687us) service_pool.cc:224] Handling call
0709 13:02:07.808829 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.809467 (+   638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.809635 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.587522  2263 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:08.641486  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 856) took 1157 ms. Trace:
I20260709 13:02:08.641806  2263 rpcz_store.cc:276] 0709 13:02:07.484079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.484355 (+   276us) service_pool.cc:224] Handling call
0709 13:02:08.334453 (+850098us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b580000ff98. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb17fc0 00007f5c6fb02929 00007f5c6fb023d2 00007f5c69079bd4
0709 13:02:08.334700 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.639909 (+305209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.641291 (+  1382us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b5400572e54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:08.641433 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584839680}
I20260709 13:02:08.643805  1586 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:08.644101  1543 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:08.636935  5792 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:08.644742  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:08.645272  5792 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:08.588231  5739 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:08.649720  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:08.651800  5381 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:08.652238  5381 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.652575  5381 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:08.587790  5563 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:08.654462  5563 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:08.654958  5563 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:08.589241  5853 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.655697  5853 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:08.656097  5963 consensus_queue.cc:1059] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:08.590440  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:08.598587  5817 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.747s	user 0.009s	sys 0.008s
I20260709 13:02:08.643635  5907 consensus_queue.cc:237] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:08.664341  5853 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:08.664776  5749 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:08.627204  1511 connection.cc:256] RPC call timeout handler was delayed by -2.0000480940000216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
I20260709 13:02:08.567076  1663 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:08.660506  5964 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:08.666452  1511 connection.cc:256] RPC call timeout handler was delayed by -1.7435791679999397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 13:02:08.669988  1511 connection.cc:256] RPC call timeout handler was delayed by -1.5707600949999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24980000000000002s for a response
W20260709 13:02:08.670300  1511 connection.cc:256] RPC call timeout handler was delayed by -1.5496864220000361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:02:08.670576  1511 connection.cc:256] RPC call timeout handler was delayed by -1.510086422000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 13:02:08.670848  1511 connection.cc:256] RPC call timeout handler was delayed by -1.4938864220000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 13:02:08.671123  1511 connection.cc:256] RPC call timeout handler was delayed by -1.4911864219999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 13:02:08.671387  1511 connection.cc:256] RPC call timeout handler was delayed by -1.4848864219999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 13:02:08.671689  1511 connection.cc:256] RPC call timeout handler was delayed by -1.3723864220000337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
W20260709 13:02:08.671978  1511 connection.cc:256] RPC call timeout handler was delayed by -1.3534864220000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 13:02:08.672247  1511 connection.cc:256] RPC call timeout handler was delayed by -1.3372864220000338s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
W20260709 13:02:08.672516  1511 connection.cc:256] RPC call timeout handler was delayed by -1.3025670079999827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31600000000000006s for a response
W20260709 13:02:08.672786  1511 connection.cc:256] RPC call timeout handler was delayed by -1.2999078990000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27040000000000003s for a response
W20260709 13:02:08.673132  1511 connection.cc:256] RPC call timeout handler was delayed by -1.2211864220000166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 13:02:08.673750  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 106804us
I20260709 13:02:08.684013  2268 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:08.676146  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:08.682844  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:08.685379  1511 connection.cc:256] RPC call timeout handler was delayed by -1.2157864220000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 13:02:08.685819  1511 connection.cc:256] RPC call timeout handler was delayed by -1.1626864220000357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 13:02:08.688680  5763 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:08.689777  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:08.690169  5381 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:08.699812  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:08.700459  1616 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:08.701043  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:08.701709  1617 raft_consensus.cc:2368] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
I20260709 13:02:08.703182  5763 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:08.703708  5763 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.703992  5381 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:08.704133  5763 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:08.690518  5804 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:08.691658  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:08.692219  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:08.679158  5865 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:08.706780  1620 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:08.706826  5865 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:08.678164  5749 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:08.684595  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:08.694736  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:08.684859  1623 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:08.707386  5865 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:08.710525  1623 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:08.717546  1692 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:08.718631  5964 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:08.720485  5804 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:08.720956  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:08.722337  1586 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:08.723585  5749 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:08.724013  5749 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:08.724383  5749 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:08.726588  5934 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:08.727677  1618 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:08.707854  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:08.708753  1622 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:08.709174  1691 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:02:08.732707  5761 consensus_queue.cc:1059] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:08.733568  5764 consensus_queue.cc:1059] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:08.733777  5761 raft_consensus.cc:3055] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:08.733819  5909 consensus_queue.cc:1048] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:08.734406  5761 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:08.709919  5792 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:08.734474  5764 raft_consensus.cc:3055] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:08.735613  5764 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:08.735765  1614 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:08.731845  5934 consensus_queue.cc:1059] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:02:08.736516  5764 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:08.737219  5934 raft_consensus.cc:3055] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:08.737596  5934 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:08.738296  5764 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:08.738443  5934 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:08.739768  5934 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:08.740672  5792 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:08.744977  5792 raft_consensus.cc:2764] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:02:08.743474  5761 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:08.746873  5761 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:08.723183  1586 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:08.748452  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:08.749359  1622 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:08.750526  5246 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:08.750852  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:08.784544  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 256398us
I20260709 13:02:08.752058  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:08.757930  5792 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:08.761221  5984 raft_consensus.cc:2764] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:08.771706  5447 consensus_queue.cc:1059] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:08.771039  5909 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:08.772114  5563 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:08.774513  5861 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:02:08.686157  1511 connection.cc:256] RPC call timeout handler was delayed by -1.1167864220000183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260709 13:02:08.805225  1587 leader_election.cc:336] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.756s (SENT)
I20260709 13:02:08.880769  1587 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:08.806566  1547 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:08.807000  2263 raft_consensus.cc:1240] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:08.806731  5865 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:08.887238  1511 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:08.888541  1662 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:08.807215  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:08.808490  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.817436  1616 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:08.872390  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:08.876739  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:08.891197  1688 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:08.878051  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:08.881906  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 110332us
W20260709 13:02:08.882184  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 73679.9us
I20260709 13:02:08.788069  5792 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:08.906049  1689 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:08.916487  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 344378us
I20260709 13:02:08.923949  1691 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:08.904350  5792 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:08.941776  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.873009  5763 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:08.947217  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:02:08.961781  1569 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc580 after lost signal to thread 430
I20260709 13:02:08.975272  5763 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:08.965188  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.966037  5987 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:08.965137  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 78042.7us
W20260709 13:02:08.964036  5972 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
I20260709 13:02:08.918489  5804 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:08.979761  1569 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc920 after lost signal to thread 433
W20260709 13:02:09.021252  1569 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc5c0 after lost signal to thread 1480
W20260709 13:02:09.023061  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 46698.5us
W20260709 13:02:09.046978  1569 debug-util.cc:398] Leaking SignalData structure 0x7b08000beea0 after lost signal to thread 1572
W20260709 13:02:09.048403  1569 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3bc0 after lost signal to thread 1647
W20260709 13:02:09.048712  1569 debug-util.cc:398] Leaking SignalData structure 0x7b08003dc700 after lost signal to thread 1648
W20260709 13:02:09.050412  1569 debug-util.cc:398] Leaking SignalData structure 0x7b0800230480 after lost signal to thread 1721
W20260709 13:02:09.060525  1569 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1d00 after lost signal to thread 2296
W20260709 13:02:09.063678  1569 debug-util.cc:398] Leaking SignalData structure 0x7b08002d81e0 after lost signal to thread 2297
W20260709 13:02:09.066130  1569 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9d00 after lost signal to thread 5712
I20260709 13:02:09.063795  1514 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:09.063527  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 175044us
I20260709 13:02:09.074873  1689 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
W20260709 13:02:09.076447  1661 leader_election.cc:336] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.524s (SENT)
I20260709 13:02:08.952399  5749 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:09.077225  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 272034us
W20260709 13:02:09.078145  1587 leader_election.cc:336] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.793s (SENT)
I20260709 13:02:09.078588  1587 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:09.083288  1688 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:09.083633  1511 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:09.084219  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 178644us
I20260709 13:02:09.058115  5936 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:09.100224  5804 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:09.101912  5804 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:09.103256  5981 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:09.103485  5804 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:09.104398  5975 log.cc:927] Time spent T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:09.083137  5963 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 13:02:09.110270  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 88229.8us
I20260709 13:02:09.107218  5989 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:09.089048  5909 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:02:09.113886  5865 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:09.117651  1661 leader_election.cc:336] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.540s (SENT)
I20260709 13:02:09.139370  2263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:09.103734  5994 consensus_queue.cc:1059] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:02:09.103767  5981 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:09.144587  1587 leader_election.cc:336] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.546s (SENT)
I20260709 13:02:09.147125  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:09.148149  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:09.149103  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 65702.8us
I20260709 13:02:09.149549  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:09.169286  1692 raft_consensus.cc:2410] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:02:09.150171  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.150854  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.151942  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.141479  2263 raft_consensus.cc:606] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:09.136219  5563 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:09.161303  5454 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:09.161372  5792 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:09.138833  5964 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:09.162209  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.162434  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:09.180985  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 62417.5us
W20260709 13:02:09.201678  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.220328  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.212538  1514 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:09.232448  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:09.232597  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:09.233355  1693 raft_consensus.cc:2368] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
I20260709 13:02:09.233626  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:09.233771  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:09.234047  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:09.234212  1692 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:02:09.234540  1690 raft_consensus.cc:2410] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:09.183815  5454 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:09.220242  5992 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:02:09.235076  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:09.239828  1692 raft_consensus.cc:2393] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:09.240994  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.235116  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:09.241935  1693 raft_consensus.cc:2410] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:09.242690  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.243637  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.244098  1693 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:09.246116  5804 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:09.239289  1697 raft_consensus.cc:2410] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:09.247311  5936 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:09.235348  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:09.252574  1693 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
W20260709 13:02:09.249085  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 58944.1us
I20260709 13:02:09.256598  1621 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:09.257006  1617 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:02:09.257493  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 113071us
W20260709 13:02:09.258394  1587 leader_election.cc:336] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.096s (SENT)
W20260709 13:02:09.261735  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 118863us
W20260709 13:02:09.261816  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 199143us
I20260709 13:02:09.179832  5981 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:09.272886  5792 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:09.275543  1445 catalog_manager.cc:5697] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 8 to 9, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 9 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:09.261798  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:09.267283  5381 raft_consensus.cc:3055] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:09.289355  1694 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:09.289556  1693 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:09.290403  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.295759  1621 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:09.298203  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:09.299050  1692 raft_consensus.cc:2393] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:09.304311  1694 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:09.304563  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:09.267283  5983 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:09.306262  1511 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:09.307015  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:09.286829  5381 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:09.307834  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.312788  1693 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:09.316242  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.306437  5763 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:09.322666  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 64318.1us
W20260709 13:02:09.323292  1587 leader_election.cc:336] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.594s (SENT)
I20260709 13:02:09.323680  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:09.308773  5983 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:09.325577  1661 leader_election.cc:336] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.744s (SENT)
I20260709 13:02:09.236304  5454 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:09.327276  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 141638us
I20260709 13:02:09.332222  2231 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:09.342334  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.342968  1692 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:09.342586  5381 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:09.343595  5739 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.344529  5979 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:09.345424  1587 leader_election.cc:336] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.148s (SENT)
I20260709 13:02:09.348018  5792 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:09.349094  5997 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:09.352835  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.309512  5937 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:02:09.357277  1693 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:09.357426  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:09.358681  1692 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:09.362684  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:09.328506  5804 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:09.356141  5739 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:09.364724  5739 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.365097  5969 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:02:09.366065  5969 consensus_queue.cc:1059] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:09.364058  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.368258  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.332835  5983 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:09.371248  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:09.372133  1694 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:09.319710  5669 consensus_queue.cc:1059] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:02:09.379930  2232 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:09.381543  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 55993.8us
W20260709 13:02:09.382231  1661 leader_election.cc:336] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.770s (SENT)
I20260709 13:02:09.382589  1661 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:09.384555  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.384348  1693 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:09.386237  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:09.350356  5246 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 13:02:09.398102  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3340 after lost signal to thread 430
W20260709 13:02:09.398504  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0aa0 after lost signal to thread 433
W20260709 13:02:09.399526  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08001fcbc0 after lost signal to thread 1480
W20260709 13:02:09.400154  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08001bbbe0 after lost signal to thread 1513
W20260709 13:02:09.401445  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8c00 after lost signal to thread 1572
W20260709 13:02:09.401793  1644 debug-util.cc:398] Leaking SignalData structure 0x7b0800335520 after lost signal to thread 1573
W20260709 13:02:09.402731  1644 debug-util.cc:398] Leaking SignalData structure 0x7b080033eda0 after lost signal to thread 1623
W20260709 13:02:09.407249  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 75078.5us
W20260709 13:02:09.409178  1644 debug-util.cc:398] Leaking SignalData structure 0x7b0800348180 after lost signal to thread 1647
W20260709 13:02:09.409508  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08003771a0 after lost signal to thread 1648
I20260709 13:02:09.383208  5998 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.389863  1694 raft_consensus.cc:2368] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10.
I20260709 13:02:09.392549  6006 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:09.392669  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:09.410611  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5600 after lost signal to thread 1721
W20260709 13:02:09.418136  1644 debug-util.cc:398] Leaking SignalData structure 0x7b080027fb80 after lost signal to thread 2231
I20260709 13:02:09.384259  5979 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:09.411139  5998 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:09.385708  5853 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:09.423714  1586 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:09.379498  6001 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:09.426900  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 81551.7us
W20260709 13:02:09.425460  1661 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.785s (SENT) [suppressed 78 similar messages]
I20260709 13:02:09.430902  1586 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:09.424880  1644 debug-util.cc:398] Leaking SignalData structure 0x7b080036de20 after lost signal to thread 2296
W20260709 13:02:09.435976  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08001a69c0 after lost signal to thread 2297
W20260709 13:02:09.436450  1644 debug-util.cc:398] Leaking SignalData structure 0x7b0800339c60 after lost signal to thread 5736
W20260709 13:02:09.436704  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08003cc540 after lost signal to thread 5739
W20260709 13:02:09.436977  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08003b92a0 after lost signal to thread 5763
W20260709 13:02:09.442824  1587 leader_election.cc:336] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.562s (SENT)
W20260709 13:02:09.443744  1587 leader_election.cc:336] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.656s (SENT)
W20260709 13:02:09.444638  6002 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:02:09.426129  5967 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:09.438714  5792 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:09.449596  5792 raft_consensus.cc:697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:09.450492  5792 consensus_queue.cc:237] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:09.452160  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08001fb760 after lost signal to thread 5861
I20260709 13:02:09.455251  2263 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:09.441399  1586 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:09.458787  1661 leader_election.cc:336] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.812s (SENT)
I20260709 13:02:09.459234  1661 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:09.462055  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.414630  5804 raft_consensus.cc:3055] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:09.515576  6005 raft_consensus.cc:3055] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:09.515377  5986 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:02:09.516188  2268 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:09.518092  6004 log.cc:927] Time spent T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:02:09.519615  5990 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:09.430464  5853 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:09.556743  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 112870us
I20260709 13:02:09.422008  5979 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:02:09.529958  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 88618.4us
W20260709 13:02:09.587314  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 128543us
W20260709 13:02:09.586623  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 153948us
I20260709 13:02:09.612295  1586 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:02:09.612973  1661 leader_election.cc:336] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.853s (SENT)
I20260709 13:02:09.613449  1661 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:09.614182  2231 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:09.617183  1587 leader_election.cc:336] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.186s (SENT)
I20260709 13:02:09.617724  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:09.460136  5563 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:09.630436  1586 leader_election.cc:400] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10.
I20260709 13:02:09.630910  1586 leader_election.cc:403] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:09.628609  1693 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:09.584990  5804 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:09.586025  5989 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:09.586232  5987 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.644466  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:09.645473  1617 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:09.646561  6001 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:09.648808  1621 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:09.650465  5563 raft_consensus.cc:697] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:09.651477  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:09.669898  1615 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:09.653808  1620 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:09.656737  1586 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:09.659190  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:09.671660  1623 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:09.670145  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 57202.7us
W20260709 13:02:09.673081  1661 leader_election.cc:336] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.861s (SENT)
I20260709 13:02:09.673471  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:09.662042  1587 leader_election.cc:336] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.661s (SENT)
I20260709 13:02:09.675061  5990 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:09.583576  6005 raft_consensus.cc:740] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:09.611497  5853 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:09.676496  6005 consensus_queue.cc:260] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:09.677960  6005 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:09.623605  5993 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 13:02:09.680495  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 867) took 1032 ms. Trace:
I20260709 13:02:09.680859  1540 rpcz_store.cc:276] 0709 13:02:08.648126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.651111 (+  2985us) service_pool.cc:224] Handling call
0709 13:02:08.651499 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.803847 (+152348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.803894 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.879147 (+ 75253us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.064684 (+185537us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:09.064735 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.064816 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.680292 (+615476us) raft_consensus.cc:1685] finished
0709 13:02:09.680314 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.680436 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70487,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":279687,"threads_started":2,"wal-append.queue_time_us":206147}
W20260709 13:02:09.683523  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 376056us
W20260709 13:02:09.667677  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 144924us
W20260709 13:02:09.674664  1661 leader_election.cc:336] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.896s (SENT)
I20260709 13:02:09.689199  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:09.629570  5865 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:09.629647  5984 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:09.623919  5991 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:09.629719  5936 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:02:09.683440  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 415954us
I20260709 13:02:09.695003  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:09.699295  1621 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:09.641172  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:09.663666  6008 consensus_queue.cc:1059] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
W20260709 13:02:09.810057  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 153433us
I20260709 13:02:09.689318  5998 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:09.684576  5907 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:09.686457  1622 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:02:09.835283  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 194229us
I20260709 13:02:09.695678  5909 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:09.802537  5736 raft_consensus.cc:3055] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:09.884040  1622 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:09.671583  5987 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:09.883317  5907 raft_consensus.cc:697] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:09.889468  5979 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:09.885749  5721 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:09.875640  5563 consensus_queue.cc:237] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:09.893065  5739 consensus_meta.cc:287] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.002s
I20260709 13:02:09.907747  5804 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:09.684875  1587 leader_election.cc:336] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.683s (SENT)
I20260709 13:02:09.939648  1587 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:09.938180  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.883960  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.934640  5739 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:09.954311  2270 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:09.976462  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 134886us
I20260709 13:02:09.887202  5736 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:10.006973  6013 log.cc:927] Time spent T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:02:09.996551  1514 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:10.009553  1615 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:10.009884  5736 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:09.975215  5721 raft_consensus.cc:697] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:10.029057  5739 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:10.040442  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 365768us
W20260709 13:02:10.044447  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.045957  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 108001us
I20260709 13:02:10.047955  1623 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:10.035321  1621 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:09.980589  6001 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:10.051952  5749 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:10.052624  6008 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:10.052227  5721 consensus_queue.cc:237] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.053352  6020 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:10.088410  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.055708  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.047640  1661 leader_election.cc:336] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.921s (SENT)
I20260709 13:02:10.055570  5804 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:10.050531  5986 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10.
I20260709 13:02:10.073913  5736 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:10.030191  5979 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:10.075958  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 390892us
W20260709 13:02:10.080112  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 209415us
W20260709 13:02:10.121158  1587 leader_election.cc:336] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.785s (SENT)
I20260709 13:02:10.121693  1587 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:10.104018  1661 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:10.074999  5984 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:10.124337  5984 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.131811  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:10.131834  5764 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:10.133353  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 102609us
W20260709 13:02:10.134666  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 87019.4us
W20260709 13:02:10.136646  1661 leader_election.cc:336] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.971s (SENT)
I20260709 13:02:10.137698  1661 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:10.140825  5764 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:10.141237  5981 consensus_meta.cc:287] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.000s
I20260709 13:02:10.142050  6006 raft_consensus.cc:3055] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:10.142452  6006 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:10.092970  5907 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.151827  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:02:10.153237  1661 leader_election.cc:336] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.974s (SENT)
I20260709 13:02:10.153896  1661 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:10.143492  6006 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:10.157630  6011 log.cc:927] Time spent T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:02:10.158380  6006 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.113412  5454 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:10.101554  6008 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:10.167474  2263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:53842
W20260709 13:02:10.174674  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 53556.7us
I20260709 13:02:10.141666  5981 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.162685  5989 raft_consensus.cc:697] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:10.188815  5934 raft_consensus.cc:3055] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:10.189383  5934 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:10.179629  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 368150us
I20260709 13:02:10.190395  5934 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:10.191982  1586 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:10.195444  5563 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:10.197988  5563 raft_consensus.cc:697] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:02:10.209887  6014 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.324s	user 0.000s	sys 0.004s
I20260709 13:02:10.211524  5877 raft_consensus.cc:993] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:02:10.212111  5877 raft_consensus.cc:1081] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:02:10.208390  5563 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:10.215827  5967 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:10.227773  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.227231  5967 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:10.232349  5967 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:10.228776  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.200230  1445 catalog_manager.cc:5697] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 6 to 7, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 7 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:10.201288  6010 raft_consensus.cc:3055] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:10.248976  6010 raft_consensus.cc:740] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:10.199524  5934 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.172809  5986 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.176642  5764 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.267901  1616 raft_consensus.cc:1240] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:10.276298  5853 consensus_meta.cc:287] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.003s
W20260709 13:02:10.285071  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 167357us
W20260709 13:02:10.287079  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 111720us
W20260709 13:02:10.292098  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 138898us
W20260709 13:02:10.292769  1661 leader_election.cc:336] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.998s (SENT)
I20260709 13:02:10.293107  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:10.318253  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.318976  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.319834  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.287179  5991 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:10.327258  1623 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:10.326301  1621 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:10.325704  1663 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:10.294466  5909 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:10.301956  5964 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.277077  5853 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.335346  1619 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:10.323753  5763 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:10.389249  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 216369us
W20260709 13:02:10.403813  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 111062us
W20260709 13:02:10.404716  1661 leader_election.cc:336] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.021s (SENT)
I20260709 13:02:10.409184  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:10.331852  5865 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:02:10.413089  5995 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:10.413756  5995 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.414340  6010 consensus_queue.cc:260] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.415578  6016 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:10.415655  6010 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.416210  6016 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.418385  6016 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:10.399325  5983 consensus_meta.cc:287] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.999s	user 0.004s	sys 0.008s
I20260709 13:02:10.318413  5764 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:02:10.427227  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:10.437399  1661 leader_election.cc:336] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.081s (SENT)
I20260709 13:02:10.438046  1661 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:10.445935  2268 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:02:10.446655  2263 raft_consensus.cc:606] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:10.447023  2263 raft_consensus.cc:614] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:10.452518  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.331732  5447 consensus_queue.cc:1059] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:02:10.333294  5998 consensus_queue.cc:1059] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:02:10.410642  5987 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:10.473711  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 135887us
I20260709 13:02:10.339659  5964 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:10.323908  5989 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:10.488989  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 163374us
I20260709 13:02:10.331913  5991 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.490507  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:10.478116  5763 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:10.338450  5909 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.428386  5983 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:10.507543  1587 leader_election.cc:336] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.808s (SENT)
I20260709 13:02:10.508630  1587 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:10.489410  5447 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:10.507355  5981 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:10.477246  6040 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:02:10.516863  6036 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:02:10.517238  6029 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:10.519749  1514 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:10.580344  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:10.581369  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:10.520054  5764 raft_consensus.cc:3055] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:10.502647  5995 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:10.522400  5865 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.536079  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 869) took 1270 ms. Trace:
I20260709 13:02:10.593398  1616 rpcz_store.cc:276] 0709 13:02:09.265638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.265758 (+   120us) service_pool.cc:224] Handling call
0709 13:02:09.267359 (+  1601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.271129 (+1003770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.535275 (+264146us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000fbed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:10.535887 (+   612us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300580736}
I20260709 13:02:10.537667  1445 catalog_manager.cc:5697] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 7 to 8, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 8 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.568454  5563 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.575030  5447 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.546500  5964 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:10.548527  5853 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:10.551070  5983 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:10.495645  5979 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:10.554939  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.519708  5381 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.578032  1623 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:10.584923  5764 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:10.540706  6035 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:02:10.597601  5865 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.400132  6008 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:10.613090  6005 consensus_meta.cc:287] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.935s	user 0.013s	sys 0.002s
W20260709 13:02:10.613968  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 94284.1us
W20260709 13:02:10.630358  6034 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:02:10.615780  5995 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:10.587809  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 80322.1us
W20260709 13:02:10.634932  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 144530us
W20260709 13:02:10.623591  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.637050  1663 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:10.642046  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 244837us
W20260709 13:02:10.618422  2232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.012s	sys 0.020s
I20260709 13:02:10.649760  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:10.650262  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.650350  2232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.012s	sys 0.021s
I20260709 13:02:10.620635  6039 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:10.653848  1514 leader_election.cc:400] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 7. Current term is 8.
W20260709 13:02:10.653937  1587 leader_election.cc:336] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.825s (SENT)
I20260709 13:02:10.655869  1587 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:10.643312  6030 log.cc:927] Time spent T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.232s	user 0.005s	sys 0.000s
I20260709 13:02:10.662344  1511 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:10.618472  5563 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:10.649487  5995 raft_consensus.cc:697] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:10.673905  1514 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:10.648730  5763 raft_consensus.cc:697] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:10.655436  5979 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:10.655014  6039 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.641623  5983 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:02:10.678462  1587 leader_election.cc:336] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.029s (SENT)
I20260709 13:02:10.651129  5934 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:02:10.666868  5997 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.647568  5865 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:10.686036  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.669358  5804 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:10.691756  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 254396us
W20260709 13:02:10.692426  1661 leader_election.cc:336] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.089s (SENT)
I20260709 13:02:10.693140  1661 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:10.700007  1540 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.700093  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:10.682729  6039 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:10.712277  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:10.742301  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 80106.3us
I20260709 13:02:10.744215  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:10.706244  6040 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:10.746192  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:10.749176  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.749483  1543 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:10.750737  1616 raft_consensus.cc:2376] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11. Re-sending same reply.
I20260709 13:02:10.746981  2268 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:10.745025  1614 raft_consensus.cc:2376] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12. Re-sending same reply.
I20260709 13:02:10.757143  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:10.764130  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.703351  6051 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:10.711392  6050 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:10.769560  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:10.772851  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:10.773772  1614 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:10.684477  5764 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:10.786978  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 130817us
I20260709 13:02:10.787933  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:10.755688  5979 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:10.789801  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:10.790680  1619 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 6.
I20260709 13:02:10.712117  5991 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:10.781240  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:10.804806  1623 raft_consensus.cc:2376] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9. Re-sending same reply.
W20260709 13:02:10.793372  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 100959us
I20260709 13:02:10.793455  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:10.794176  6033 log.cc:927] Time spent T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:02:10.794054  1514 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:10.794744  6048 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.795270  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:10.795579  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:10.770200  5736 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.799463  6046 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:10.801250  1618 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13. Ops: [9.6-12.7]
W20260709 13:02:10.808570  1661 connection.cc:256] RPC call timeout handler was delayed by -1.057763379999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
W20260709 13:02:10.812307  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 44864.1us
I20260709 13:02:10.767113  5934 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:10.813364  5986 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.817303  6015 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.854s	user 0.004s	sys 0.000s
I20260709 13:02:10.817646  1618 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:10.817517  1514 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:10.782011  5763 consensus_queue.cc:237] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:10.831336  1661 leader_election.cc:336] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.158s (SENT)
I20260709 13:02:10.832818  1542 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.817811  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:10.833757  1623 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:10.835945  1548 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:10.837275  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:10.803128  5909 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:10.818985  6008 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:10.842621  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:02:10.815152  6006 consensus_meta.cc:287] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.656s	user 0.013s	sys 0.000s
I20260709 13:02:10.839637  1540 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:10.763049  6052 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:02:10.810941  6040 raft_consensus.cc:697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:10.781424  5995 consensus_queue.cc:237] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:10.844877  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1824) took 1185 ms. Trace:
I20260709 13:02:10.821429  5934 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:10.819775  6005 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:10.838215  5986 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:10.847831  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 141084us
I20260709 13:02:10.831982  6049 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.849984  1617 rpcz_store.cc:276] 0709 13:02:09.659160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.686789 (+ 27629us) service_pool.cc:224] Handling call
0709 13:02:09.697720 (+ 10931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.042703 (+344983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:10.042745 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:10.049939 (+  7194us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.378157 (+328218us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:10.378343 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.627796 (+249453us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540016e754. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:10.627850 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.844520 (+216670us) raft_consensus.cc:1685] finished
0709 13:02:10.844540 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.844795 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58392,"raft.queue_time_us":108714,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":16046,"spinlock_wait_cycles":658097408,"thread_start_us":324021,"threads_started":1,"wal-append.queue_time_us":446443}
I20260709 13:02:10.832710  5979 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:10.865065  5979 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:10.867579  6037 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:10.834697  6046 raft_consensus.cc:697] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:10.856921  6044 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
I20260709 13:02:10.859619  6053 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.861970  6049 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:10.862946  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:10.864151  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.872073  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 81076.5us
I20260709 13:02:10.871582  5984 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:10.881922  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 875) took 1502 ms. Trace:
I20260709 13:02:10.848290  5736 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:10.877949  1661 leader_election.cc:336] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.246s (SENT)
I20260709 13:02:10.792022  6050 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.881852  1548 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:10.882513  1539 rpcz_store.cc:276] 0709 13:02:09.379837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.380304 (+   467us) service_pool.cc:224] Handling call
0709 13:02:09.383614 (+  3310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.396109 (+ 12495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.396138 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.399265 (+  3127us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.625097 (+225832us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:09.625143 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.625244 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.650062 (+1024818us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:10.879162 (+229100us) raft_consensus.cc:1685] finished
0709 13:02:10.879195 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.881844 (+  2649us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31673,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":13163,"spinlock_wait_cycles":14005504,"thread_start_us":169124,"threads_started":1,"wal-append.queue_time_us":424481}
I20260709 13:02:10.888880  6046 consensus_queue.cc:237] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:10.889940  6049 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:10.890213  6060 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.890439  6050 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:10.855326  5447 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:10.856972  6005 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.891597  5934 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:10.790391  6051 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:10.893610  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 54329.6us
I20260709 13:02:10.894631  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:10.890745  6060 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.900419  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:10.900921  6005 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:10.901432  5986 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:10.821558  6048 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:10.903970  6048 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:10.885375  6062 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.908357  6039 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:10.910081  6040 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:10.881835  5563 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:10.911182  5749 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.913098  1511 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:10.917997  1542 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:02:10.887951  5984 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.931289  6008 raft_consensus.cc:697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:10.887748  6037 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:10.938839  5865 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:10.939821  6054 log.cc:927] Time spent T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:02:10.940320  1662 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:10.940758  6026 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:10.941454  6026 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:10.943049  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.943956  2263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:10.895820  6010 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:10.944583  2263 raft_consensus.cc:606] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:10.956028  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 99791.6us
I20260709 13:02:10.958969  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:10.961174  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:10.937593  2232 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:10.968729  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:10.968955  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 55940.4us
I20260709 13:02:10.970053  1689 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:10.919443  5736 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.973480  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:10.976444  1693 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.976400  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:10.974834  1691 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:10.982049  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:10.982695  1689 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:10.984647  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:10.944747  6062 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.988914  1696 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:10.985540  5804 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:10.993758  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:10.995581  6047 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:02:10.999392  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:10.986066  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:11.001585  1695 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:10.967402  5447 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:10.956257  6048 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.955878  6060 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:10.968233  5865 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:10.996765  5934 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:10.935405  5749 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:10.985466  6059 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:11.012743  1692 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:10.946635  5721 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:02:10.885417  6053 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.017836  1693 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
W20260709 13:02:11.036718  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.061556  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.072201  1661 leader_election.cc:336] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.553s (SENT)
I20260709 13:02:11.072471  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:10.956365  6052 consensus_queue.cc:1059] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:02:11.009222  5447 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:10.975472  5984 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:11.023223  6062 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:02:11.075825  6037 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:11.092708   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:02:11.093499  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:11.094597  1695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:58526
I20260709 13:02:11.095189  1695 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:11.095574  1695 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.089490  1586 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:11.100492  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:11.074484  5804 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:10.982570  6010 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.021493  6048 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:11.104398  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 105135us
I20260709 13:02:11.026608  6039 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:11.107859  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 112024us
I20260709 13:02:11.127485  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:11.113341  1690 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:11.083056  6059 raft_consensus.cc:697] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:02:11.090022  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.097836  5447 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:11.024236  5865 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.116603  5381 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:11.128291  6026 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:11.155520  6066 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:11.156519  6066 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:11.157389  6066 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.158362  5865 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:11.148415  6059 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.148378  6070 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:11.164098  6070 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:11.165390  6070 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:11.168015  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:11.168918  2263 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
W20260709 13:02:11.150292  6043 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.629s	user 0.003s	sys 0.000s
I20260709 13:02:11.171789  1691 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:11.150868  6053 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:11.143546  6052 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:11.130963  6051 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:11.089359  6008 consensus_queue.cc:237] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:11.176798  6052 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:11.099246  5997 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:02:11.130515  5964 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:02:11.155642  5381 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.109381  5804 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:11.176126  6064 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:02:11.154350  5984 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:11.183053  1688 raft_consensus.cc:2410] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:02:11.187256  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.234534  1662 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:11.226435  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:11.227145  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:11.152423  5454 consensus_meta.cc:287] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.979s	user 0.012s	sys 0.000s
I20260709 13:02:11.143464  6039 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:11.242462  2270 raft_consensus.cc:2393] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
W20260709 13:02:11.134212  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 60402.9us
W20260709 13:02:11.245639  1661 leader_election.cc:336] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.677s (SENT)
W20260709 13:02:11.243121  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 116573us
I20260709 13:02:11.246295  2268 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
W20260709 13:02:11.246397  6069 log.cc:927] Time spent T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:02:11.246543  5991 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:11.247290  6025 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.767s	user 0.003s	sys 0.000s
I20260709 13:02:11.228434  5381 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:11.232017  5804 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:11.257069  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.251475  1586 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:11.276939  1689 raft_consensus.cc:1240] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:11.277199  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 143566us
I20260709 13:02:11.278885  1691 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
W20260709 13:02:11.280244  1661 leader_election.cc:336] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.020s (SENT)
I20260709 13:02:11.232191  5983 consensus_queue.cc:1059] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:02:11.249758  5991 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:11.256304  6052 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:11.295658  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 148259us
W20260709 13:02:11.296365  1661 leader_election.cc:336] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.069s (SENT)
I20260709 13:02:11.249882  6039 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.284789  5997 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.308836  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:11.309489  6048 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:11.312085  6040 consensus_queue.cc:1059] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:11.295145  5991 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:11.321486  1661 leader_election.cc:336] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.985s (SENT)
W20260709 13:02:11.326247  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 46215us
I20260709 13:02:11.297240  5986 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:11.331072  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:11.320771  6001 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:11.359367  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:11.358062  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:11.318429  6010 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:11.361634  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:11.361764  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:11.365245  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2953) took 2047 ms. Trace:
I20260709 13:02:11.334875  5986 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.365634  1694 rpcz_store.cc:276] 0709 13:02:09.317480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.413268 (+ 95788us) service_pool.cc:224] Handling call
0709 13:02:09.413544 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.428693 (+ 15149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.429527 (+   834us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.610955 (+181428us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.038141 (+427186us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:10.086545 (+ 48404us) log.cc:844] Serialized 14 byte log entry
0709 13:02:10.087072 (+   527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.087273 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.197452 (+110179us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b1800255580. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:02:11.246541 (+1049089us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:11.365028 (+118487us) raft_consensus.cc:1685] finished
0709 13:02:11.365053 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.365190 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47993,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":1677,"raft.queue_time_us":9535,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":6688,"spinlock_wait_cycles":11603456,"thread_start_us":297381,"threads_started":1,"wal-append.queue_time_us":669175}
W20260709 13:02:11.372166  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 51591.6us
I20260709 13:02:11.319877  5997 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:11.359807  6022 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.389830  6022 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.392213  6022 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:11.397235  5997 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:11.356846  6048 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 13:02:11.408149  6071 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:02:11.408525  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:02:11.380023  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 58585.9us
W20260709 13:02:11.409799  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.409926  1661 leader_election.cc:336] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 3.146s (SENT)
I20260709 13:02:11.410518  1661 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:11.381644  5721 consensus_queue.cc:1059] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:11.385766  5764 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.414093  1614 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:11.388729  6039 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:11.420023  6086 consensus_queue.cc:1059] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:11.421821  1588 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:11.422662  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.423645  5984 raft_consensus.cc:3055] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:11.428562  5984 raft_consensus.cc:740] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:11.429248  5995 raft_consensus.cc:3055] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:11.429612  5984 consensus_queue.cc:260] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.364925  6052 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:11.369416  5563 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.432854  6006 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:11.433141  5563 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:11.431285  5984 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.372618  6001 raft_consensus.cc:697] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:11.436246  6001 consensus_queue.cc:237] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.436141  1445 catalog_manager.cc:5697] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.437757  1445 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 7 to 8, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 8 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:11.439495   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:02:11.442067  6045 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.907s	user 0.000s	sys 0.007s
I20260709 13:02:11.443077  5721 raft_consensus.cc:3055] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:11.443543  5721 raft_consensus.cc:740] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:11.444337  5721 consensus_queue.cc:260] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:11.444849  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52838 (request call id 254) took 26276 ms (client timeout 15000 ms). Trace:
I20260709 13:02:11.445501  5721 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.445606  5736 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.429674  5995 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:11.446502  5749 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:11.448658  2231 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:11.449323  5817 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:11.369961  6040 consensus_queue.cc:1243] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer 27308aae2ef347ccba1b27e7f6f04334 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:02:11.483687  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 106315us
I20260709 13:02:11.458113  1445 catalog_manager.cc:5697] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:02:11.380470  6087 log.cc:927] Time spent T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:02:11.368587  5986 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:11.505944  1695 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.509456  1542 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:11.514189  1690 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:11.518980  1695 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:11.523084  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.435360  5563 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:11.526823  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 78244.3us
I20260709 13:02:11.485145  6022 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.501262  5983 consensus_queue.cc:1243] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer 27308aae2ef347ccba1b27e7f6f04334 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:11.536304  1445 catalog_manager.cc:5697] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 1 to 8, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 8 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.501693  6006 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.540016  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 150396us
I20260709 13:02:11.419196  5447 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:11.548010  1587 leader_election.cc:336] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.983s (SENT)
I20260709 13:02:11.518953  6005 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:11.523350  5865 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.523610  6053 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:11.552757  1445 catalog_manager.cc:5697] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:11.480818  5736 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:11.557521  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 147627us
I20260709 13:02:11.542693  6048 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:11.559947  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.562608  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.514448  5969 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:02:11.517750  5741 consensus_queue.cc:1059] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:02:11.565200  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:11.570264  1691 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:11.565861  1688 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:11.568006  1614 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:11.568215  1616 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:11.568512  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:11.572084  1619 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:11.572849  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:11.575398  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:11.575817  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.576048  1695 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:11.576134  1694 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:02:11.576913  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 62937.2us
I20260709 13:02:11.578104  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:11.578395  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.578960  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.579340  1623 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:11.582108  1623 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:11.574361  1445 catalog_manager.cc:5697] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 8 to 9, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 9 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:11.584039  1616 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: [8.6-9.7]
I20260709 13:02:11.583945  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:11.586895  1692 raft_consensus.cc:2410] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:11.586290  1445 catalog_manager.cc:5697] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:02:11.587711  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 179255us
I20260709 13:02:11.545007  6022 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:11.594085  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.550693  6006 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.590365  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.591557  1586 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:11.603329  1621 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:11.596793  1511 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:11.549638  6078 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:02:11.596673  1661 leader_election.cc:336] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.785s (SENT)
I20260709 13:02:11.561005  5865 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:11.609840  1445 catalog_manager.cc:5697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.620584  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.621856  1621 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:11.633257  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.565696  5995 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.656700  1445 catalog_manager.cc:5697] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:02:11.664968  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 130979us
I20260709 13:02:11.637137  6048 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:11.673135  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 84558.7us
I20260709 13:02:11.674433  1511 leader_election.cc:400] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
I20260709 13:02:11.674839  1511 leader_election.cc:403] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:11.680667  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.681510  1615 raft_consensus.cc:2393] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 12: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:02:11.445222  1442 rpcz_store.cc:269] 0709 13:01:45.168860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.169107 (+   247us) service_pool.cc:224] Handling call
0709 13:02:11.444640 (+26275533us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:02.459524 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:02.568095 (+108571us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:02.568153 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:02:02.568171 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:02.927241 (+359070us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:03.016356 (+ 89115us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:03.024156 (+  7800us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:02:03.632087 (+607931us) tablet.cc:701] Row locks acquired
0709 13:02:03.651671 (+ 19584us) write_op.cc:260] PREPARE: finished
0709 13:02:03.720143 (+ 68472us) write_op.cc:270] Start()
0709 13:02:03.745697 (+ 25554us) write_op.cc:276] Timestamp: P: 1783602123679140 usec, L: 0
0709 13:02:03.749137 (+  3440us) op_driver.cc:348] REPLICATION: starting
0709 13:02:03.915731 (+166594us) log.cc:844] Serialized 7885 byte log entry
0709 13:02:05.704010 (+1788279us) op_driver.cc:464] REPLICATION: finished
0709 13:02:05.824131 (+120121us) write_op.cc:301] APPLY: starting
0709 13:02:05.824267 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:06.569741 (+745474us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:06.582350 (+ 12609us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:06.844711 (+262361us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:06.845746 (+  1035us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:02:06.845842 (+    96us) write_op.cc:312] APPLY: finished
0709 13:02:06.847940 (+  2098us) log.cc:844] Serialized 180 byte log entry
0709 13:02:07.760530 (+912590us) spinlock_profiling.cc:243] Waited 46.1 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c67a340ac 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b
0709 13:02:08.607128 (+846598us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:08.624094 (+ 16966us) write_op.cc:454] Released schema lock
0709 13:02:08.624170 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:08.624815 (+   645us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:08.624856 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1016807,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":110149,"apply.run_cpu_time_us":72033,"apply.run_wall_time_us":2800598,"cfile_cache_hit":78,"cfile_cache_hit_bytes":81588,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":2,"lbm_read_time_us":18241,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":11,"num_ops":20,"prepare.queue_time_us":306632,"prepare.run_cpu_time_us":11381,"prepare.run_wall_time_us":1504311,"replication_time_us":1944329,"spinlock_wait_cycles":106130688,"thread_start_us":2104164,"threads_started":3,"wal-append.queue_time_us":1052388,"wal-append.run_cpu_time_us":1391,"wal-append.run_wall_time_us":1002011}]]}
W20260709 13:02:11.687628  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 96136.3us
I20260709 13:02:11.684569  1511 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:11.689917  1586 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:11.691887  6039 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:11.692026  5749 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:11.669531  6001 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:11.699589  6001 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.700079  6001 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:11.700896  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.670910  5995 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:11.695895  5749 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:11.696944  5563 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:11.698148  6016 raft_consensus.cc:3055] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:11.698829  6092 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:02:11.698909  5817 raft_consensus.cc:3055] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:11.676400  1445 catalog_manager.cc:5697] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 4 to 9, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 9 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:02:11.690348  6066 consensus_meta.cc:287] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.004s
I20260709 13:02:11.692550  6039 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:11.776648  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.718274  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.672998  6005 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:02:11.716935  5563 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.717799  6016 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:11.719300  5817 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:11.752676  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.753849  1445 catalog_manager.cc:5697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 7 to 10, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 10 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.713984  5447 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:11.759622  6066 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.765136  5865 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:11.768038  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 47501.3us
W20260709 13:02:11.769071  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.775812  6022 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:11.751708  5375 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:02:11.683651  6088 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:02:11.777557  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 110328us
I20260709 13:02:11.792997  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:11.823243  1695 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:11.787166  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.819913  1619 raft_consensus.cc:2410] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:11.778326  6039 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.827283  1621 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:11.823640  1445 catalog_manager.cc:5697] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.826162  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:11.828409  1693 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:11.825511  1623 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
W20260709 13:02:11.813651  6093 log.cc:927] Time spent T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:02:11.834482  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.780232  5563 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:11.838033  1661 leader_election.cc:336] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.485s (SENT)
I20260709 13:02:11.844046  1661 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:11.820003  5381 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.000s
I20260709 13:02:11.848435  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:11.839763  1615 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:11.775890  5736 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:11.836736  1548 raft_consensus.cc:1240] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:11.850474  1623 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:02:11.833518  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 320694us
W20260709 13:02:11.818768  6097 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:02:11.851692  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.869019  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 151871us
I20260709 13:02:11.852044  6053 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:11.877123  1511 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:11.852304  6006 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:11.865486  6042 raft_consensus.cc:3055] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:11.872969  6059 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.014s	sys 0.036s
I20260709 13:02:11.868817  5656 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:11.895376  6085 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:11.853936  5381 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:11.900168  1445 catalog_manager.cc:5697] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 2 to 7, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 7 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:11.904116  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.901886  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:11.911216  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.916180  1615 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:11.922176  6102 raft_consensus.cc:993] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:02:11.922839  6102 raft_consensus.cc:1081] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
W20260709 13:02:11.923056  6100 log.cc:927] Time spent T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:02:11.923377  5991 consensus_meta.cc:287] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.000s
I20260709 13:02:11.923851  5991 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:11.927722  6068 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.778s	user 0.004s	sys 0.002s
I20260709 13:02:11.895844  6042 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:11.892117  6005 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 13:02:11.922300  6099 log.cc:927] Time spent T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:02:11.929288  5804 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.000s
I20260709 13:02:11.930670  5804 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.932564  5381 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:11.932667  5986 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:11.933616  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.956302  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 97470.1us
I20260709 13:02:11.933964  5991 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:11.935377  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.959784  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.960547  1619 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:11.961620  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:11.936163  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.936934  5656 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:11.937568  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.939158  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:11.940729  1617 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:11.899858  5817 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.899716  6016 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:11.874325  6001 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:11.947623  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:11.950085  5984 consensus_meta.cc:287] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.515s	user 0.003s	sys 0.006s
I20260709 13:02:11.952248  1445 catalog_manager.cc:5697] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:11.954025  1695 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:11.899782  6059 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.014s	sys 0.037s
I20260709 13:02:11.956307  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:11.968689  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:11.971361  1691 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:11.971905  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:11.972522  1622 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:11.972584  1445 catalog_manager.cc:5697] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 4 to 6, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 6 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:11.975930  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:11.979307  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:11.979569  1691 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:11.983237  1697 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:11.985901  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:11.987113  1619 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:02:11.964685  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.963897  1618 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:11.970693  1540 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:11.996322  2270 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:02:11.960718  5995 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.999958  1619 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:12.000316  1618 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:12.000675  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:58526
I20260709 13:02:12.001737  1691 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:12.002369  1691 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:12.004128  1619 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:02:11.970850  1587 leader_election.cc:336] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.283s (SENT)
I20260709 13:02:12.005956  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:12.033967  6103 log.cc:927] Time spent T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.211s	user 0.000s	sys 0.003s
W20260709 13:02:12.031263  6063 log.cc:927] Time spent T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.882s	user 0.005s	sys 0.000s
I20260709 13:02:12.013803  1691 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.054769  1616 raft_consensus.cc:2368] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:12.055760  1445 catalog_manager.cc:5697] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 5 to 6, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 6 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:12.064730  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.977869  5381 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.981181  5817 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:12.070573  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:11.929244  6042 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:12.085157  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 114338us
I20260709 13:02:12.085467  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54488 (request call id 720) took 1276 ms. Trace:
I20260709 13:02:12.073128  1445 catalog_manager.cc:5697] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 6 to 8, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 8 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:12.085925  1587 leader_election.cc:336] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 3.162s (SENT)
I20260709 13:02:12.072268  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:12.086787  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:12.041162  6082 raft_consensus.cc:3055] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:12.091835  1691 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:12.090286  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 131752us
I20260709 13:02:12.085873  2268 rpcz_store.cc:276] 0709 13:02:10.793088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.793217 (+   129us) service_pool.cc:224] Handling call
0709 13:02:12.069622 (+1276405us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54005055d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:12.069763 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011745152}
I20260709 13:02:12.051641  6008 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:12.067143  6016 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.104260  1445 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:12.107332  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:12.108523  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:12.109193  2265 raft_consensus.cc:3055] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:12.109570  2234 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:12.074221  5749 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:12.109983  2265 raft_consensus.cc:740] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:12.013270  5995 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:12.093248  5997 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:12.116092  2265 consensus_queue.cc:260] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.100920  6052 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.088078  6101 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:12.129957  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 190893us
I20260709 13:02:12.095666  6082 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:12.105891  6066 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:12.133647  1511 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:12.132062  1445 catalog_manager.cc:5697] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 6 to 8, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 8 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:12.084901  5381 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:12.144486  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.119727  6042 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.117394  6022 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:12.131189  5997 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.135551  6101 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:12.166836  6110 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:02:12.111747  5656 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:12.174401  6109 log.cc:927] Time spent T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:12.174669  5995 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:12.176829  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:12.177085  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 43514.6us
I20260709 13:02:12.177872  1511 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:02:12.181160  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 93477.8us
I20260709 13:02:12.182369  1586 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:12.182686  2266 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
W20260709 13:02:12.192147  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 71666us
I20260709 13:02:12.196187  6022 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:12.202899  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:12.208325  1691 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:12.211334  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.157680  6006 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:12.213940  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.158699  6059 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:12.221692  1662 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:12.224663  1511 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:12.160395  5997 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:12.227128  1662 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:12.230160  5967 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:12.232156  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 51491.9us
I20260709 13:02:12.140792  6052 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:12.219931  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 134004us
I20260709 13:02:12.203994  6008 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:12.220990  6066 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:12.304371  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.254587  5804 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:12.305703  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.257197  6098 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:12.298481  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:02:12.298739  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.170109  6101 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:12.203756  5964 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:12.221092  6022 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:12.257279  5995 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:12.303759  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 194265us
W20260709 13:02:12.308992  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.262156  5986 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:12.348284  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:12.348603  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:12.349267  2268 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
W20260709 13:02:12.297940  1587 leader_election.cc:336] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 3.196s (SENT)
I20260709 13:02:12.257841  5656 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:02:12.313621  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.256192  6006 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:12.350347  1587 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:12.324065  6114 log.cc:927] Time spent T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:02:12.321807  6111 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:02:12.316187  5381 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:12.336529  6001 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:12.355479  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:12.366997  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:12.370581  1614 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:12.370716  2263 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:12.363821  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:12.372430  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 67282.2us
I20260709 13:02:12.347890  5995 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:12.346848  5964 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:02:12.385849  6088 consensus_meta.cc:287] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.565s	user 0.003s	sys 0.007s
I20260709 13:02:12.386811  6088 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
I20260709 13:02:12.397948  1691 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
W20260709 13:02:12.399897  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 139752us
I20260709 13:02:12.347571  6022 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.405911  6052 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:12.406886  6022 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:12.410533  5563 consensus_meta.cc:287] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.001s
I20260709 13:02:12.411530  5991 raft_consensus.cc:2764] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 13:02:12.413103  6039 consensus_meta.cc:287] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.572s	user 0.007s	sys 0.003s
I20260709 13:02:12.312326  6082 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:12.346781  6098 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.393092  5381 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:12.434331  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.380663  5995 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:12.443307  2272 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:12.445756  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:12.446326  2268 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:12.444207  6082 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.428611  6039 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:12.425155  5563 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.476090  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:12.476349  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.476389  1615 raft_consensus.cc:2393] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 12: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:02:12.470177  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 74516.3us
W20260709 13:02:12.482438  6076 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 1.334s	user 0.002s	sys 0.003s
I20260709 13:02:12.485651  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 692) took 1466 ms. Trace:
I20260709 13:02:12.486047  1690 rpcz_store.cc:276] 0709 13:02:11.018927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.130468 (+111541us) service_pool.cc:224] Handling call
0709 13:02:11.130767 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.517940 (+387173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.485439 (+967499us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400352d54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:12.485598 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881380736}
I20260709 13:02:12.489303  2268 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
W20260709 13:02:12.489718  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.490674  5991 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.491338  5991 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:12.492090  6120 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:02:12.492296  6083 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.889s	user 0.000s	sys 0.003s
W20260709 13:02:12.493391  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.493690  5991 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:12.480099  6129 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:12.495975  6129 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:12.497287  6117 log.cc:927] Time spent T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 13:02:12.499148  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.501384   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:12.517549  6039 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:12.519456  6098 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:12.519587  6039 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:12.520246  6039 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.522833  6008 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:12.523332  6008 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.524158  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 901) took 1067 ms. Trace:
I20260709 13:02:12.524549  1548 rpcz_store.cc:276] 0709 13:02:11.456579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.456701 (+   122us) service_pool.cc:224] Handling call
0709 13:02:11.456993 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.850779 (+393786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.523938 (+673159us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b540027c9d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:12.524101 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872790400}
I20260709 13:02:12.525424  6008 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:12.526710  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.528282  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 727) took 1080 ms. Trace:
I20260709 13:02:12.528749  2270 rpcz_store.cc:276] 0709 13:02:11.447688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.450598 (+  2910us) service_pool.cc:224] Handling call
0709 13:02:11.450985 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.996968 (+545983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.527951 (+530983us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54008309d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:12.528205 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238728960}
I20260709 13:02:12.530043  6039 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:12.531796  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 51108.4us
I20260709 13:02:12.534930  1691 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:02:12.537349  1691 pending_rounds.cc:85] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 10
I20260709 13:02:12.538213  1691 pending_rounds.cc:107] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:02:12.538501  1691 raft_consensus.cc:2889] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:12.490984  1663 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:12.539592  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:12.536525  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:12.543720  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 65997.7us
W20260709 13:02:12.550961  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 113377us
W20260709 13:02:12.553920  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 63031.9us
I20260709 13:02:12.555130  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:12.557106  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:12.558624  1619 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:12.558909  1663 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:12.559773  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:02:12.560312  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.562692  1619 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:12.580933  6006 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:12.581512  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.582420  1543 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:12.582481  1623 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:12.584937  2265 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:12.587517  5563 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:12.475901  6001 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:02:12.594772  1545 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:12.563272  5991 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:12.561067  6053 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:12.568531  5656 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:12.569026  5995 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.570078  6129 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:12.570650  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:12.605386  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.605515  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.468111  5964 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:12.570910  5817 consensus_queue.cc:1059] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:02:12.628136  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 57544.2us
I20260709 13:02:12.629441  1514 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:12.629585  5995 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:12.630354  6078 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:12.630618  6053 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:12.631036  6078 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:12.631582  6078 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.631933  6078 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:12.632316  6048 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:12.633678  6048 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:12.574354  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:12.575346  6008 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:12.634799  1697 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:12.597003  5991 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.635967  5991 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:12.571213  6104 consensus_queue.cc:1059] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:12.636282  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:12.577922  6132 log.cc:927] Time spent T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.125s	user 0.000s	sys 0.002s
I20260709 13:02:12.636734  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.550662  5979 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:02:12.637854  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:12.591349  1619 raft_consensus.cc:1217] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Deduplicated request from leader. Original: 5.4->[6.5-9.7]   Dedup: 7.6->[9.7-9.7]
I20260709 13:02:12.638576  1619 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: [6.5-9.7]
I20260709 13:02:12.638989  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.639626  1544 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:02:12.640946  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:12.642241  6078 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:12.575979  5804 consensus_queue.cc:1059] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:12.645198  5804 raft_consensus.cc:3055] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:12.645678  5804 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:12.646607  6078 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:12.646503  5804 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:12.597863  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:12.647835  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:12.648190  6101 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.650233  6101 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:12.604005  1617 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:12.551939  6066 consensus_queue.cc:1059] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:02:12.606168  1543 raft_consensus.cc:2393] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:12.651041  6066 consensus_queue.cc:1243] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer 27308aae2ef347ccba1b27e7f6f04334 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:12.570760  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.562409  5934 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:12.612602  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:12.653375  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.656279  1689 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.657030  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.657799  1540 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:12.659431  1547 raft_consensus.cc:2368] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
I20260709 13:02:12.659545  2270 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:12.660275  1539 raft_consensus.cc:2410] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:02:12.660574  1662 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:12.660641  2265 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:02:12.663597  5995 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:12.663884  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.664084  5995 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:12.665050  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.665112  5995 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.666189  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.667896  6122 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.668773  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.669693  2269 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:12.667227  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:12.670496  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.671103  1540 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
W20260709 13:02:12.625927  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 66210us
I20260709 13:02:12.628088  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:12.631071  6053 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:12.631659  5969 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:12.574782  1588 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:12.593209  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:12.638576  1546 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:02:12.618037  1587 leader_election.cc:336] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.945s (SENT)
I20260709 13:02:12.578951  5997 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.672411  1691 raft_consensus.cc:2410] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:12.690896  1587 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:12.691470  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 116745us
I20260709 13:02:12.690980  1662 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:12.681540  1663 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:12.700474  1663 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:12.664057  5817 raft_consensus.cc:3055] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:12.706882  1545 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:12.708278  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:12.709683  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:12.660959  6066 raft_consensus.cc:3055] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:12.713142  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.714869  1545 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:12.719622  1542 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:12.721817  1689 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
W20260709 13:02:12.722807  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 104794us
W20260709 13:02:12.723763  1587 leader_election.cc:336] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.988s (SENT)
I20260709 13:02:12.724269  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:12.723114  1547 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:12.690548  6053 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:12.728529  1540 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:12.727353  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.745381  1689 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:02:12.708068  5804 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.711601  6042 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:12.743050  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:12.747661  6042 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.747939  1542 raft_consensus.cc:2368] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13.
I20260709 13:02:12.748050  6042 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:12.745407  6101 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:12.754633  1539 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:12.724201  6052 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:12.757474  6052 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.757826  6052 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:12.759895  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 1832) took 1161 ms. Trace:
I20260709 13:02:12.760316  1620 rpcz_store.cc:276] 0709 13:02:11.600142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.605544 (+  5402us) service_pool.cc:224] Handling call
0709 13:02:11.628172 (+ 22628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.406005 (+777833us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b180048c5e0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c6a6e64bc 00007f5c67a3448b 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a4e455 00007f5c6ab36060 00007f5c6ab36bfb 00007f5c6ab4164b
0709 13:02:12.406154 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.406181 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.406636 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.478963 (+ 72327us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:12.479042 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.479284 (+   242us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.759598 (+280314us) raft_consensus.cc:1685] finished
0709 13:02:12.759618 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.759837 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34497,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4569,"spinlock_wait_cycles":7853824,"thread_start_us":116499,"threads_started":2,"wal-append.queue_time_us":305022}
I20260709 13:02:12.703078  5563 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:12.764942  1544 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:12.733745  1663 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:12.711174  5817 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:12.713136  5934 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:12.769393  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:12.713905  6066 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:02:12.785463  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 189120us
I20260709 13:02:12.787364  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.767156  5989 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:12.797719  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:12.798408  1547 raft_consensus.cc:2376] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10. Re-sending same reply.
I20260709 13:02:12.788574  1546 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:12.800659  5995 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:12.801302  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.799280  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.774401  1544 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:12.668468  6122 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:12.775959  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 73169.4us
I20260709 13:02:12.776293  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:12.775818  1545 raft_consensus.cc:2368] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14.
I20260709 13:02:12.801319  5995 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:12.769726  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 45995.9us
I20260709 13:02:12.802789  1546 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
W20260709 13:02:12.834898  1587 leader_election.cc:336] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.223s (SENT)
I20260709 13:02:12.774852  5563 raft_consensus.cc:697] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:12.835376  1587 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:12.835791  1586 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:12.818651  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 84970.6us
I20260709 13:02:12.802829  1547 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
W20260709 13:02:12.815339  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.834163  1539 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:12.842051  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:12.846743  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.852768  1545 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:02:12.852974  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.858551  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.864061  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.860054  1546 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:02:12.854516  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:12.865612  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 174704us
W20260709 13:02:12.866400  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:12.866871  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:12.868544  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.867471  1662 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:12.869686  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:12.872258  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.871227  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.814898  6156 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:12.851298  6039 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:12.881711  6156 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.845937  6135 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.886965  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.876704  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.888197  1547 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:12.880228  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:12.880424  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:12.813961  6155 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:12.889669  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 54804.6us
I20260709 13:02:12.892657  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:12.895182  1695 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:12.896081  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.899443  1548 raft_consensus.cc:2376] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9. Re-sending same reply.
I20260709 13:02:12.900635  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:12.901693  1548 raft_consensus.cc:2368] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14.
I20260709 13:02:12.904331  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:12.904799  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.904444  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:12.886544  5997 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:12.906728  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:12.905548  1545 raft_consensus.cc:2393] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:02:12.908053  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.910282  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:12.861577  6102 consensus_queue.cc:1059] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:02:12.892618  6098 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:12.915709  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:12.924870  1618 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
W20260709 13:02:12.918933  1587 leader_election.cc:336] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.155s (SENT)
I20260709 13:02:12.920966  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:12.933456  1587 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:12.934178  1617 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:12.912731  1695 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:12.891755  6155 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.926534  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.927989  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:12.873071  6019 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:02:12.900617  6001 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:12.930159  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:12.931867  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.951880  6016 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:12.953586  6122 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:12.954694  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:12.846743  6136 consensus_queue.cc:1059] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:02:12.928455  5563 consensus_queue.cc:237] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.912240  6066 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:12.920372  5907 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:12.959429  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.901588  6135 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.036762  6078 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:13.079177  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 211858us
I20260709 13:02:12.960139  6156 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:12.874542  5817 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:12.959473  1541 raft_consensus.cc:2410] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:02:13.014443  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.016520  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:13.016539  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:13.021175  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:12.950735  6052 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:13.024051  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 94365.1us
W20260709 13:02:13.030107  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 60864.9us
I20260709 13:02:13.039273  2270 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:13.023494  6005 raft_consensus.cc:3055] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:13.043740  1545 raft_consensus.cc:2410] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:02:13.042342  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:13.080284  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.093519  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 60902.6us
I20260709 13:02:13.099763  1588 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:13.017517  6155 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:13.108191  1547 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:13.117492  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:13.117946  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.119134  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:13.120077  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 201171us
W20260709 13:02:13.120889  1587 leader_election.cc:336] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.608s (SENT)
I20260709 13:02:13.121467  1587 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:13.042111  6098 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:13.123711  2270 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:13.125340  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:13.126960  1539 raft_consensus.cc:2376] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10. Re-sending same reply.
I20260709 13:02:13.128077  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:13.129310  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.108211  5381 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:13.130590  1547 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:13.131047  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:13.131434  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.105465  6005 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:13.135062  1544 raft_consensus.cc:2410] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:13.059738  5991 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.136293  1548 raft_consensus.cc:2368] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13.
I20260709 13:02:13.141191  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:13.123870  5817 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:13.128473  6066 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:13.130548  5989 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:13.165127  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:13.164201  6098 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.172924  5991 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:13.173782  6147 log.cc:927] Time spent T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:13.093580  5907 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:13.147364  6101 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.134780  5997 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:13.175678  6101 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:13.177836  6101 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:13.179797  5995 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:13.179883  5907 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:13.168983  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.181785  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.181941  1539 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:02:13.183058  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:13.169215  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:13.167251  6135 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:13.189815  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.196501  1545 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:13.196357  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.198168  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:13.175714  6157 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:13.194940  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:13.201267  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:13.202104  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:13.128832  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 286811us
I20260709 13:02:13.172598  6052 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:13.207871  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:13.208485  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 90731.5us
I20260709 13:02:13.206485  1514 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:13.186583  6134 raft_consensus.cc:3055] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:13.211046  1588 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:13.223527  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.223313  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:13.226511  2270 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:13.201022  6156 raft_consensus.cc:2764] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:13.228112  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.229508  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:13.231794  1539 raft_consensus.cc:2368] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
I20260709 13:02:13.234889  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.235399  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.236362  1545 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:13.207515  5997 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.238886  1547 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.240756  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.211941  6078 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:13.220481  5969 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:13.201929  6042 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.231770  6162 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:13.245708  1539 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:13.246567  6165 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:13.256003  1546 raft_consensus.cc:2410] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:13.219744  6134 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:13.253005  1545 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:13.233415  5563 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:13.253532  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.247431  5989 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.261901  1539 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:13.268291  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.221058  6005 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:13.287035  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.301019  1539 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:13.328490  1547 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:02:13.261081  6163 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:13.269896  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.245837  5997 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.340003  1547 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:13.341132  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.315448  6166 log.cc:927] Time spent T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:02:13.343466  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.277611  5989 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:13.339138  6066 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:13.386217  6066 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.388520  5989 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:13.276870  5563 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:13.390861  6042 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:13.352481  2269 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:13.262364  6165 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.276980  6156 consensus_queue.cc:1059] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 13:02:13.352248  6053 consensus_meta.cc:287] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.000s
I20260709 13:02:13.392797  6053 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:13.393575  6165 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:13.355350  6141 log.cc:927] Time spent T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.546s	user 0.004s	sys 0.019s
I20260709 13:02:13.277148  5995 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:02:13.314049  6162 raft_consensus.cc:697] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:13.265610  6052 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 13:02:13.402482  1511 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35712 dropped due to backpressure: service queue is full with 50 items [suppressed 1 similar messages]
W20260709 13:02:13.370345  6153 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.571s	user 0.002s	sys 0.005s
I20260709 13:02:13.373912  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:13.268776  5991 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:02:13.345131  6151 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:13.416704  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:13.381583  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.383785  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.390234  5563 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:13.393872  6042 raft_consensus.cc:3055] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:13.354586  5997 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:13.366257  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.400633  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.431048  1540 raft_consensus.cc:2410] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:13.368707  6134 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:13.403378  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:13.433704  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.417281  5989 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:13.404644  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.406765  6053 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:13.417237  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 153626us
I20260709 13:02:13.416646  5967 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:13.441573  1547 raft_consensus.cc:2410] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:13.433956  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.429104  6042 raft_consensus.cc:740] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:13.447093  5964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.005s	sys 0.017s
W20260709 13:02:13.455674  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.416857  6155 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.446702  5989 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:13.462018  5989 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:13.339372  6163 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:13.470243  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.440402  5804 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:13.455529  5964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.007s	sys 0.018s
W20260709 13:02:13.476329  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.407039  1512 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:53718 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2738)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2741)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2742)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2743)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2732)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2747)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2733)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2725)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2726)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2722)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2734)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2735)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2739)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2736)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2731)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2727)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2729)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2744)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2745)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2746)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1928)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1932)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1935)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1942)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1945)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 925)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 926)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 927)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 928)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1951)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1953)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1955)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2721)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2728)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2748)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2750)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 929)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 930)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 931)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 932)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 933)
I20260709 13:02:13.448101  6162 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:13.471643  6070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.009s	sys 0.047s
I20260709 13:02:13.478145  1663 leader_election.cc:400] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:13.421625  6151 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:13.486137  6115 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.853s	user 0.005s	sys 0.005s
I20260709 13:02:13.486253  1663 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:13.483951  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 53110.2us
W20260709 13:02:13.487171  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.487291  6151 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:13.488348  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 2986) took 1633 ms. Trace:
W20260709 13:02:13.488850  1661 leader_election.cc:336] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.658s (SENT)
I20260709 13:02:13.489768  1620 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:13.488696  1693 rpcz_store.cc:276] 0709 13:02:11.855096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.863800 (+  8704us) service_pool.cc:224] Handling call
0709 13:02:11.878154 (+ 14354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:11.878901 (+   747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.878954 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:11.902313 (+ 23359us) log.cc:844] Serialized 52 byte log entry
0709 13:02:12.011613 (+109300us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:12.069915 (+ 58302us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.073391 (+  3476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.073483 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.505835 (+432352us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b180026b780. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:02:12.613468 (+107633us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b180026b780. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:02:13.474012 (+860544us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:13.488127 (+ 14115us) raft_consensus.cc:1685] finished
0709 13:02:13.488147 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.488287 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3170,"prepare.queue_time_us":62257,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":45,"raft.queue_time_us":4737,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":6016,"spinlock_wait_cycles":65746688,"thread_start_us":75832,"threads_started":1,"wal-append.queue_time_us":168997}
I20260709 13:02:13.464617  5967 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:13.485466  6070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.009s	sys 0.047s
W20260709 13:02:13.488996  6171 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:13.504726  1663 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:13.479285  5804 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:13.511659  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.514046  6176 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:13.514519  6176 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.514868  6176 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:13.497268  6053 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:13.523072  6066 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:13.492431  6155 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:13.529112  1543 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:13.526328  6140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.018s	sys 0.019s
I20260709 13:02:13.508200  6151 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:13.537680  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:13.533766  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:13.541814  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:13.541962  1691 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:02:13.547798  1690 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:13.492051  6042 consensus_queue.cc:260] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.531545  5669 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:13.537223  6140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.018s	sys 0.019s
I20260709 13:02:13.573488  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.574249  5967 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:13.574698  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.575971  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.577427  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.578403  1542 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:13.579751  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:13.580220  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:13.581100  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.584755  1542 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:13.584496  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:13.587735  2268 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:13.588936  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:13.589639  1661 leader_election.cc:336] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.840s (SENT)
W20260709 13:02:13.590305  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 85644us
I20260709 13:02:13.591014  1663 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:13.613288  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.621027  6150 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:13.545931  6151 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.623535  5804 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:13.625195  6151 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:13.625836  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:13.626444  6053 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:13.627120  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:13.627811  1542 raft_consensus.cc:2368] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10.
I20260709 13:02:13.626516  1690 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 6.
I20260709 13:02:13.629114  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:13.629941  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:13.630728  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.635669  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.640699  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:13.641095  1690 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:13.642174  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 51223.2us
I20260709 13:02:13.638964  2231 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:13.642954  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:13.647150  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:13.633785  6182 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:02:13.648447  1542 raft_consensus.cc:2393] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 10: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:13.571596  5669 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:13.644310  5454 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:13.658751  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.647974  6052 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:13.661505  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:13.661028  6052 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.653283  5967 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.666399  2265 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:13.667706  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.659039  6163 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:13.648581  6160 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:02:13.677507  6173 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.678144  6173 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.680699  6173 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:13.665405  6052 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:13.689520  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.664193  6189 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.076s	user 0.001s	sys 0.001s
I20260709 13:02:13.707973  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.665642  6155 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:13.704890  6195 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:02:13.713528  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:13.723374  6185 log.cc:927] Time spent T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:02:13.663968  6053 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:02:13.704093  5967 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.725230  5979 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:13.739794  5979 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:13.741286  6126 raft_consensus.cc:3055] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:13.740949  5979 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.741712  6126 raft_consensus.cc:740] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:13.742316  5979 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:13.735970  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:13.744635  1662 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:13.744827  1696 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
W20260709 13:02:13.745671  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.746626  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 166763us
I20260709 13:02:13.757519  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.758389  1545 raft_consensus.cc:2393] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:13.742614  6126 consensus_queue.cc:260] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:13.737732  1689 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:13.736289  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.780604  1615 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:13.781275  1661 leader_election.cc:336] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.017s (SENT)
I20260709 13:02:13.779599  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.785064  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:13.779908  5934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.014s	sys 0.036s
W20260709 13:02:13.790848  5934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.015s	sys 0.036s
I20260709 13:02:13.791144  5934 raft_consensus.cc:697] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:13.794603  1661 leader_election.cc:336] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.161s (SENT)
I20260709 13:02:13.795233  1661 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:13.775400  6053 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:13.802071  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:13.804678  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1912) took 1024 ms. Trace:
W20260709 13:02:13.803298  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 160417us
I20260709 13:02:13.803980  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.805240  1544 rpcz_store.cc:276] 0709 13:02:12.778873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.834255 (+ 55382us) service_pool.cc:224] Handling call
0709 13:02:13.802780 (+968525us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54000c6054. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:13.802965 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636603648}
W20260709 13:02:13.792146  6142 log.cc:927] Time spent T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.836s	user 0.006s	sys 0.010s
I20260709 13:02:13.804714  1616 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:02:13.782609  6126 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:13.810352  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.814685  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.816112  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:13.817528  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.820284  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:13.806651  6053 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:13.793205  6122 consensus_queue.cc:1059] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:02:13.814249  6165 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:13.824040  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.824815  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.826680  1542 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:02:13.824463  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:13.828281  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.829587  2272 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:02:13.830497  1545 raft_consensus.cc:2393] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:13.831540  6162 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:02:13.832759  6146 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.961s	user 0.008s	sys 0.015s
W20260709 13:02:13.834427  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.837538  6042 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:13.841732  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.812541  5454 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:02:13.843853  5454 consensus_queue.cc:1243] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Peer 27308aae2ef347ccba1b27e7f6f04334 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:13.845275  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 709) took 1311 ms. Trace:
I20260709 13:02:13.845513  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 1886) took 1212 ms. Trace:
I20260709 13:02:13.846060  1541 rpcz_store.cc:276] 0709 13:02:12.632990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.635891 (+  2901us) service_pool.cc:224] Handling call
0709 13:02:13.845322 (+1209431us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b540023f0d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:13.845458 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740992768}
W20260709 13:02:13.830052  6193 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:02:13.848496  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.849202  1547 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:13.798108  5934 consensus_queue.cc:237] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:13.854933  1587 leader_election.cc:336] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.687s (SENT)
I20260709 13:02:13.855786  1587 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:13.858186  1693 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:13.845856  5967 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:13.813802  6176 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.868330  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.868602  1545 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:13.869242  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1928) took 1034 ms. Trace:
I20260709 13:02:13.869812  1546 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:13.871814  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.872478  1542 raft_consensus.cc:2368] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10.
I20260709 13:02:13.824119  6053 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:13.869627  1545 rpcz_store.cc:276] 0709 13:02:12.835307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.868078 (+1032771us) service_pool.cc:224] Handling call
0709 13:02:13.868427 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.869023 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.869185 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40064}
I20260709 13:02:13.884917  6135 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:13.887082  1545 raft_consensus.cc:3055] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:13.894699  1545 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:13.896080  1545 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.845726  1694 rpcz_store.cc:276] 0709 13:02:12.533806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.546672 (+ 12866us) service_pool.cc:224] Handling call
0709 13:02:12.547027 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.552650 (+  5623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.552858 (+   208us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.553334 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.828859 (+275525us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:12.828920 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.829017 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.791837 (+962820us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b2400208c58. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c678d79c4 00007f5c678d5acb 00007f5c67a90dc9 00007f5c67a90a55 00007f5c67a9009d 00007f5c6a6c210e 00007f5c6a6d988c 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221
0709 13:02:13.844858 (+ 53021us) raft_consensus.cc:1685] finished
0709 13:02:13.844880 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.845194 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6120,"spinlock_wait_cycles":72126208,"thread_start_us":264887,"threads_started":1,"wal-append.queue_time_us":328940}
I20260709 13:02:13.900243  1545 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:13.904596  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 49702.7us
I20260709 13:02:13.893757  6005 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:13.894305  1546 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:13.909168  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:13.914158  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:13.915833  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:13.917661  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.918735  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:13.933882  1616 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
W20260709 13:02:13.934374  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.936717  1616 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:13.937413  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:13.940196  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:13.941604  1615 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:02:13.944834  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:13.945549  1544 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:02:13.946419  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.947481  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:13.905864  6078 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.954151  1546 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:13.927882  6135 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:13.894711  6039 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:13.953855  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.960747  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:13.962100  1546 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:13.939853  5979 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.974504  5877 raft_consensus.cc:3055] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:13.974992  5877 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:13.976689  6052 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:13.978622  6176 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:13.978864  6052 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:13.965178  6039 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:13.993530  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.993722  1545 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:13.995381  1545 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:02:13.996547  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:13.998427  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:13.959889  6078 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:14.011498  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.012627  1588 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:14.014997  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.019364  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.971199  5979 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:14.030257  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:14.032498  5997 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:14.033128  5997 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.033601  5997 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:14.034585  5979 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:14.037858  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1900) took 1387 ms. Trace:
I20260709 13:02:14.038535  1543 rpcz_store.cc:276] 0709 13:02:12.655702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.714225 (+ 58523us) service_pool.cc:224] Handling call
0709 13:02:12.759816 (+ 45591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.531359 (+771543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.037536 (+506177us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b540027bfd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:14.037772 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763750144}
I20260709 13:02:14.041021  1544 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:02:14.040822  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.041625  1544 pending_rounds.cc:85] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 6
I20260709 13:02:14.042178  1544 pending_rounds.cc:107] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 9.7
W20260709 13:02:14.042438  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.042484  1544 raft_consensus.cc:2889] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:14.052224  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:14.054181  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:14.085481  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.092496  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 70984.3us
W20260709 13:02:14.097568  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.159224  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.168287  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.189194  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.249878  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:14.250272  1688 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
W20260709 13:02:14.261865  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.264714  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.297370  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1969) took 1112 ms. Trace:
I20260709 13:02:14.299922  1663 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:14.300464  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 49349.3us
I20260709 13:02:14.307324  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.313867  1620 rpcz_store.cc:276] 0709 13:02:13.185430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.185566 (+   136us) service_pool.cc:224] Handling call
0709 13:02:13.204362 (+ 18796us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:13.490310 (+285948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.253585 (+763275us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b5400067554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:14.297306 (+ 43721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655820672}
I20260709 13:02:14.314446  2234 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:14.314553  1543 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:02:14.276037  1540 raft_consensus.cc:1240] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:14.341881  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 332802us
W20260709 13:02:14.297058  6205 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:02:14.249490  5979 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:14.249481  6202 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:14.344959  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 45088.4us
I20260709 13:02:14.363521  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:14.350339  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.304306  5969 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:14.304476  5381 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:14.365932  1539 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:14.400806  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2742) took 1032 ms. Trace:
I20260709 13:02:14.401187  1539 rpcz_store.cc:276] 0709 13:02:13.368006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.350065 (+982059us) service_pool.cc:224] Handling call
0709 13:02:14.400742 (+ 50677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:14.365367  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 1966) took 1230 ms. Trace:
I20260709 13:02:14.402315  1619 rpcz_store.cc:276] 0709 13:02:13.135238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.135480 (+   242us) service_pool.cc:224] Handling call
0709 13:02:13.135804 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:13.179825 (+ 44021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.179866 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:13.180315 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.336660 (+156345us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:13.336720 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.346489 (+1009769us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b54000d2ad4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:14.346548 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.346611 (+    63us) raft_consensus.cc:1685] finished
0709 13:02:14.346630 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.365297 (+ 18667us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16641,"raft.queue_time_us":1839,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":14373,"spinlock_wait_cycles":100337920,"thread_start_us":155896,"threads_started":1,"wal-append.queue_time_us":174902}
I20260709 13:02:14.409431  1696 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:14.331491  6047 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.342063  6112 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.420797  1547 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:14.430652  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1945) took 1467 ms. Trace:
I20260709 13:02:14.421875  1548 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:14.432760  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1932) took 1551 ms. Trace:
I20260709 13:02:14.433332  1548 rpcz_store.cc:276] 0709 13:02:12.881766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.359814 (+1478048us) service_pool.cc:224] Handling call
0709 13:02:14.413066 (+ 53252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.432430 (+ 19364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.432688 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:14.366613  6162 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:14.431154  1547 rpcz_store.cc:276] 0709 13:02:12.963022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.359395 (+1396373us) service_pool.cc:224] Handling call
0709 13:02:14.420566 (+ 61171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.430273 (+  9707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.430578 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:14.029269  5877 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:14.408773  6042 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:14.465595  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.468559  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.472939  2269 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:02:14.478088  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.428368  6112 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.411475  6176 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:02:14.448313  6162 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.385628  6202 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:14.413636  5969 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:14.419499  5381 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:14.521817  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.521842  5381 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:14.438376  6047 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:14.439056  5979 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:14.524107  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.500525  6112 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:14.534978  1661 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.009s (SENT) [suppressed 31 similar messages]
I20260709 13:02:14.510680  6162 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:13.402987  1511 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:35712 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2738)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2741)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2742)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2743)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2732)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2747)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2733)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2725)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2726)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2722)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2734)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2735)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2739)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2736)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2731)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2727)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2729)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2744)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2745)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2746)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1928)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1932)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1935)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1942)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1945)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 925)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 926)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 927)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 928)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1951)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1953)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1955)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2721)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2728)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2748)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2750)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 929)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 930)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 931)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 932)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 933)
W20260709 13:02:14.549149  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.510913  6176 consensus_queue.cc:1243] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 27308aae2ef347ccba1b27e7f6f04334 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:02:14.551203  5997 consensus_meta.cc:287] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.004s
I20260709 13:02:14.551774  5997 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:14.554562  5997 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:14.524365  5877 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:14.540207  6210 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:02:14.559703  1541 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:14.560474  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 925) took 1459 ms. Trace:
W20260709 13:02:14.564109  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.560865  1542 rpcz_store.cc:276] 0709 13:02:13.101095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.906064 (+804969us) service_pool.cc:224] Handling call
0709 13:02:13.954827 (+ 48763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:13.955153 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.955178 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:13.956717 (+  1539us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.250818 (+294101us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:14.250876 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.250946 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.559241 (+308295us) raft_consensus.cc:1685] finished
0709 13:02:14.559262 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.560409 (+  1147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":277978,"threads_started":1,"wal-append.queue_time_us":490686}
W20260709 13:02:14.535337  6208 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 13:02:14.569120  1587 leader_election.cc:336] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.041s (SENT)
I20260709 13:02:14.543699  6202 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:14.542688  6047 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:14.536674  5979 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:14.541021  5969 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:14.562373  6078 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:14.570372  6053 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.003s
I20260709 13:02:14.567402  5907 raft_consensus.cc:3055] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:02:14.632941  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.609692  5907 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:14.645478  1693 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:14.646034  1693 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:14.654965  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:14.674809  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:14.646991  1693 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:14.677170  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.613291  6053 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:14.636082  6078 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.685550  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:14.686388  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:14.691664  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.692835  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.678889  5721 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.696014  1586 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:14.698120  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2728) took 1334 ms. Trace:
I20260709 13:02:14.694057  6086 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:14.700939  1546 rpcz_store.cc:276] 0709 13:02:13.363241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.969528 (+606287us) service_pool.cc:224] Handling call
0709 13:02:13.969891 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.970134 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:14.367869 (+397735us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.697710 (+329841us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.697785 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:14.697838 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.697925 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.698057 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20434,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":717,"thread_start_us":619482,"threads_started":2}
I20260709 13:02:14.709061  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:14.688863  6078 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:14.689456  5907 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:14.715481  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 328707us
W20260709 13:02:14.723088  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.698108  6101 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 13:02:14.735858  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.698094  5721 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:14.741613  5721 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:14.741956  6199 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.934s	user 0.000s	sys 0.004s
W20260709 13:02:14.744685  6216 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:02:14.713467  6221 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:14.710333  6086 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:14.755834  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.760643  1547 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:14.747534  5907 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:14.756255  6221 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.778254  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:14.773106  6214 log.cc:927] Time spent T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:02:14.774242  6221 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:14.798087  6005 consensus_meta.cc:287] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.862s	user 0.010s	sys 0.000s
W20260709 13:02:14.802724  6039 consensus_meta.cc:287] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.799s	user 0.009s	sys 0.000s
W20260709 13:02:14.785061  6215 log.cc:927] Time spent T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:02:14.837001  1547 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:14.809861  6096 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.803210  6039 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:14.842962  6053 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:14.852618  6096 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:14.855159  1615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.027s	sys 0.075s
W20260709 13:02:14.856459  1615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.028s	sys 0.076s
W20260709 13:02:14.857118  1614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.000s	sys 0.016s
W20260709 13:02:14.858121  1614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.000s	sys 0.016s
I20260709 13:02:14.862089  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.862802  1547 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:14.863616  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.864557  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.865160  1547 raft_consensus.cc:2393] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 10: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:14.825129  6162 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:14.872316  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.855012  6096 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:14.875138  1547 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:14.878768  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:14.879714  2268 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:02:14.881227  1513 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:14.877044  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.882531  1546 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:14.883162  1539 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:14.848906  6112 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:14.885464  5979 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.887845  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.889250  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2750) took 1518 ms. Trace:
I20260709 13:02:14.884039  6078 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:14.890348  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.902050  1545 rpcz_store.cc:276] 0709 13:02:13.370710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.996406 (+625696us) service_pool.cc:224] Handling call
0709 13:02:13.996765 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:13.997280 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.997320 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:14.002448 (+  5128us) log.cc:844] Serialized 52 byte log entry
0709 13:02:14.610172 (+607724us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:14.626498 (+ 16326us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.626694 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.626765 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.888973 (+262208us) raft_consensus.cc:1685] finished
0709 13:02:14.889005 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.889174 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16112,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":519,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":14686,"thread_start_us":301609,"threads_started":1,"wal-append.queue_time_us":472028}
I20260709 13:02:14.913465  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:14.906059  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 320420us
W20260709 13:02:14.919162  1587 leader_election.cc:336] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 3.144s (SENT)
I20260709 13:02:14.907999  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.920473  1546 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 6.
I20260709 13:02:14.922390  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:14.923281  1546 raft_consensus.cc:2410] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:14.897205  6221 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:14.894654  5979 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.927063  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:14.928601  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:14.929073  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:14.930688  1547 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:14.925917  6039 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:14.938632  1693 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:14.938975  6112 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:14.941382  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:14.927485  5979 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.927017  6086 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:14.954468  1547 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:14.955665  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.955956  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.960521  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:14.960772  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.968654  5669 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:14.973136  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 935) took 1464 ms. Trace:
I20260709 13:02:14.974061  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:14.980659  6219 log.cc:927] Time spent T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:02:14.984828  1542 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:14.998884  1693 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:02:14.985184  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:14.989353  1587 leader_election.cc:336] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.200s (SENT)
I20260709 13:02:14.990656  1539 rpcz_store.cc:276] 0709 13:02:13.509230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.401866 (+892636us) service_pool.cc:224] Handling call
0709 13:02:14.805067 (+403201us) spinlock_profiling.cc:243] Waited 9.18 ms on lock 0x7b5800093398. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb17fc0 00007f5c6fb02929 00007f5c6fb023d2 00007f5c69079bd4
0709 13:02:14.805330 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.887032 (+ 81702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.972889 (+ 85857us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b54003b5e54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:14.973076 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199669888}
I20260709 13:02:15.002081  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.003100  1539 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:15.004663  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:15.005625  1615 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:15.007299  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.007932  1547 raft_consensus.cc:2376] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9. Re-sending same reply.
I20260709 13:02:14.993175  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:15.012012  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.012813  1542 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:15.018648  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.019553  1547 raft_consensus.cc:2410] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:15.021422  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:14.984951  1546 raft_consensus.cc:2410] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:15.018877  5907 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.031138  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.032734  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.020524  6162 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:15.034543  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.036278  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.038164  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.038416  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.041142  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.041851  1539 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.043515  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1935) took 2160 ms. Trace:
I20260709 13:02:15.044086  1541 rpcz_store.cc:276] 0709 13:02:12.882920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.016902 (+1133982us) service_pool.cc:224] Handling call
0709 13:02:14.559500 (+542598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.560117 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.043188 (+483071us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400303c50. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:15.043373 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246815616}
I20260709 13:02:15.048517  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.048789  1547 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:15.050808  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.051519  1542 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:15.056306  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.056627  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.056936  1542 raft_consensus.cc:2376] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10. Re-sending same reply.
I20260709 13:02:15.057394  1541 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:15.059922  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.060616  1542 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:02:15.062299  1546 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:15.063246  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.000078  1693 pending_rounds.cc:85] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 10
I20260709 13:02:15.052208  1615 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:15.066335  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:15.054611  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 65290.4us
I20260709 13:02:15.066949  1547 raft_consensus.cc:2376] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10. Re-sending same reply.
W20260709 13:02:15.067886  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.063931  1546 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:15.069887  1541 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:15.069767  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.068445  1693 pending_rounds.cc:107] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:02:15.070979  1693 raft_consensus.cc:2889] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:15.071377  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.035873  5907 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.074404  1546 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:02:15.055980  6202 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:15.074926  1546 pending_rounds.cc:85] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 6
I20260709 13:02:15.077615  1546 pending_rounds.cc:107] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:02:15.078677  1546 raft_consensus.cc:2889] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:15.062637  6162 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:15.064373  6134 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.075001  6221 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:15.084069  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:15.084710  1618 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:15.085376  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.086024  1546 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:15.083060  6202 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.097052  1618 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:15.098016  6202 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:15.098577  6218 log.cc:927] Time spent T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.410s	user 0.001s	sys 0.001s
I20260709 13:02:15.101150  2268 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:15.101434  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:15.107695  2265 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:15.107851  6235 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:02:15.108409  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 933) took 1702 ms. Trace:
I20260709 13:02:15.108855  1543 rpcz_store.cc:276] 0709 13:02:13.406263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.389173 (+982910us) service_pool.cc:224] Handling call
0709 13:02:15.107679 (+718506us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5800093398. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb17fc0 00007f5c6fb02929 00007f5c6fb023d2 00007f5c69079bd4
0709 13:02:15.107882 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.108083 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.108110 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:15.108157 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:15.108195 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.108249 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.108356 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30290176}
I20260709 13:02:15.115499  2265 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:15.080658  6156 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.120082  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 938) took 1112 ms. Trace:
I20260709 13:02:15.120375  6156 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.120527  1548 rpcz_store.cc:276] 0709 13:02:14.008070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.470576 (+462506us) service_pool.cc:224] Handling call
0709 13:02:14.528390 (+ 57814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.571818 (+ 43428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.571865 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.571922 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:14.571982 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.119872 (+547890us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b54000a73d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:15.119918 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.120028 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99287936}
I20260709 13:02:15.122002  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 1955) took 1976 ms. Trace:
I20260709 13:02:15.122705  6156 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:15.122556  1544 rpcz_store.cc:276] 0709 13:02:13.145795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.949142 (+803347us) service_pool.cc:224] Handling call
0709 13:02:13.965896 (+ 16754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.046974 (+ 81078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.121798 (+1074824us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b54000c6054. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:15.121949 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171913088}
W20260709 13:02:15.125767  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.126645  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.075325  6155 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:02:15.104944  6162 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.129487  6162 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:15.109484  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:15.131054  6016 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:15.131760  6016 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:15.132849  6016 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.104338  2269 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:02:15.137236  1587 leader_election.cc:336] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.510s (SENT)
I20260709 13:02:15.083961  1542 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:02:15.150379  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.151082  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.084065  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.153112  1547 raft_consensus.cc:2376] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10. Re-sending same reply.
I20260709 13:02:15.155890  1619 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:15.157661  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.157330  1541 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:15.159487  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:15.168921  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:15.168916  2269 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:02:15.170295  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:15.166568  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.178241  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:15.179257  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:15.180464  1622 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:15.180683  1587 leader_election.cc:336] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.555s (SENT)
W20260709 13:02:15.181669  1587 leader_election.cc:336] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.568s (SENT)
W20260709 13:02:15.182477  1587 leader_election.cc:336] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.649s (SENT)
I20260709 13:02:15.182945  1587 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:15.184652  1539 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
W20260709 13:02:15.186231  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.186668  1587 leader_election.cc:336] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.654s (SENT)
W20260709 13:02:15.201736  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.192310  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:02:15.196770  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.187175  2232 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:15.207481  1693 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:15.203150  1663 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:15.216374  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:15.218361  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.218988  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:15.219703  1689 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.218621  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.221912  1697 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:15.209620  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.223193  1541 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:15.195384  5381 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:15.249542  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.241359  1622 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:02:15.244544  1588 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:15.250619  1547 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 8: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:15.266366  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.251150  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.271853  1689 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:02:15.185817  6139 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:02:15.276816  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.287061  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:15.288017  2268 raft_consensus.cc:2410] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:02:15.288676  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:15.291401  2265 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:15.291512  2234 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:15.297684  5991 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:15.243767  6112 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:15.297222  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:15.301581  5997 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:15.303653  1539 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:15.308434  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.308578  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.310292  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:15.313161  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.323251  1547 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:15.323082  1688 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.316718  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.249814  6226 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:02:15.322579  1694 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:15.334291  1688 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
W20260709 13:02:15.336733  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.345965  5979 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.349517  5997 raft_consensus.cc:697] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:15.350819  5997 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.355436  6226 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:15.356345  1545 raft_consensus.cc:2368] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 7. Current term is 8.
I20260709 13:02:15.300397  6221 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:02:15.348981  5979 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:15.321208  6112 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.368831  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:15.368952  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 124483us
I20260709 13:02:15.367651  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.377950  2234 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:15.376395  1547 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:15.325964  6126 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.358301  6226 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:15.358629  5991 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:15.377705  1621 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:15.397404  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.398124  1539 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.404443  2269 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:02:15.404807  2269 pending_rounds.cc:85] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Aborting all ops after (but not including) 11
I20260709 13:02:15.405038  2269 pending_rounds.cc:107] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:02:15.405350  2269 raft_consensus.cc:2889] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:15.355561  6059 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:02:15.375818  6112 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.411707  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.415867  1542 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:15.417260  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:15.417850  1620 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
W20260709 13:02:15.418649  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 215570us
I20260709 13:02:15.397845  5907 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:15.427881  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:15.408115  6134 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.403905  6005 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:15.466353  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.388008  6006 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:02:15.462935  1692 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:15.472353  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.467798  1697 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:15.472923  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.469069  1690 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:15.474022  1696 raft_consensus.cc:2410] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:15.460398  1539 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:15.420009  6098 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:15.428035  6101 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:02:15.466995  6209 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.056s	user 0.004s	sys 0.006s
I20260709 13:02:15.449620  6053 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:15.484428  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.462185  6202 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:15.482123  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.488240  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:15.449858  6224 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:02:15.501668  2231 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:15.485838  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:15.499939  1690 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:15.502770  1691 raft_consensus.cc:2368] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:02:15.487852  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:15.477079  6005 raft_consensus.cc:697] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:15.468761  6134 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.505301  1586 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:15.513072  5989 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:15.513484  5989 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:15.513602  1586 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:15.513888  5989 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.515599  6086 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:15.516078  6086 raft_consensus.cc:697] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:15.516932  6086 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:15.483680  6098 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.493604  6202 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:15.520998  1621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33892 (request call id 904) took 1759 ms (client timeout 1678 ms). Trace:
I20260709 13:02:15.521522  6098 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:15.521394  1621 rpcz_store.cc:269] 0709 13:02:13.761486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.774383 (+ 12897us) service_pool.cc:224] Handling call
0709 13:02:15.520815 (+1746432us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54000fcdd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:15.520936 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3645449856}
I20260709 13:02:15.521814  6202 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:15.522662  1691 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:15.523844  1691 raft_consensus.cc:1217] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[9.5-9.5]   Dedup: 9.5->[]
I20260709 13:02:15.524268  1691 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:02:15.524708  2234 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:15.525231  1691 raft_consensus.cc:1217] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Deduplicated request from leader. Original: 6.5->[7.6-9.7]   Dedup: 9.7->[]
I20260709 13:02:15.525712  1691 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: [7.6-9.7]
W20260709 13:02:15.527812  6241 log.cc:927] Time spent T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:02:15.527837  6126 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:15.529377  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.509196  2231 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:15.536725  1691 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:15.548398  1691 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:15.550237  1697 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:15.485117  6101 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:15.553958  6101 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:15.483357  5991 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:15.558714  6005 consensus_queue.cc:237] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.560163  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:15.560868  1697 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:15.492538  6053 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:15.563738  6053 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:15.550514  6243 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:02:15.567834  1691 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:15.569499  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:15.570200  2268 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
W20260709 13:02:15.573525  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 59077.2us
I20260709 13:02:15.577744  5997 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:02:15.580773  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.581213  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.581506  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.583025  1662 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:15.511737  5907 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:15.621090  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:15.621773  2272 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:15.585099  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.622737  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.585637  6134 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:15.588724  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.589417  6162 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:15.589546  6156 consensus_queue.cc:1059] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:15.591480  6108 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:15.594066  1587 leader_election.cc:336] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.901s (SENT)
I20260709 13:02:15.635658  1587 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:15.595942  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:15.598656  1588 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:15.638279  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.601153  1662 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:15.630790  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:15.640473  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.642957  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 48949.5us
W20260709 13:02:15.643628  1587 leader_election.cc:336] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.063s (SENT)
I20260709 13:02:15.643989  1587 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:15.637539  2268 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
W20260709 13:02:15.645006  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 46455us
I20260709 13:02:15.645465  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.567761  6225 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:15.646567  1588 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:15.650036  1617 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:15.646147  1691 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:15.647480  2266 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:02:15.648247  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.621368  6196 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:15.621165  5907 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.651715  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.652546  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.669627  1693 raft_consensus.cc:2393] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:15.669917  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.670540  1697 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:15.670571  6156 consensus_queue.cc:1059] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:15.649171  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:15.665992  6258 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:15.671484  6156 raft_consensus.cc:3055] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:15.671841  6258 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.671947  6156 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:15.672341  6258 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:15.654786  6249 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:02:15.657047  5749 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:15.657775  6226 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.660338  2272 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:15.662500  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.708858  6226 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:15.709573  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.710737  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:15.664125  6139 consensus_queue.cc:1059] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:15.711561  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.712055  6139 raft_consensus.cc:3055] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:15.712443  6139 raft_consensus.cc:740] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:15.712663  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.671795  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2765) took 1042 ms. Trace:
I20260709 13:02:15.713325  6139 consensus_queue.cc:260] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:15.713757  1545 rpcz_store.cc:276] 0709 13:02:14.630624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.913106 (+282482us) service_pool.cc:224] Handling call
0709 13:02:15.671637 (+758531us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b540027c9d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:15.671744 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016176896}
I20260709 13:02:15.714557  6139 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.643105  6108 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.715876  6108 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:15.717542  6112 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.718604  2268 raft_consensus.cc:1240] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:15.676141  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:15.719380  1688 raft_consensus.cc:2393] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:15.713879  1697 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:15.549793  6202 consensus_queue.cc:1059] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
W20260709 13:02:15.676573  1661 leader_election.cc:336] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.630s (SENT)
I20260709 13:02:15.642838  5995 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:02:15.676342  1621 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:15.721834  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 45293.7us
I20260709 13:02:15.652127  6101 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:15.652411  6244 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:15.741062  5989 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:15.650512  5934 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:02:15.673746  5907 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.672880  6156 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.746141  6156 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:15.703531  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:15.704836  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:15.712525  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.751691  1615 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:15.678013  5749 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:15.722424  1661 leader_election.cc:336] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.642s (SENT)
I20260709 13:02:15.758055  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:15.735277  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.759881  1544 raft_consensus.cc:2368] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:02:15.743191  5989 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:15.763792  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.737156  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.736719  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.737772  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:15.738569  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.738834  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.766230  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.766537  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.767931  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.768765  1540 raft_consensus.cc:2368] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:02:15.769552  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.770735  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.739396  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.740223  1694 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:02:15.771790  1694 pending_rounds.cc:85] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 5
I20260709 13:02:15.772158  1694 pending_rounds.cc:107] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:15.772521  1694 raft_consensus.cc:2889] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:15.741385  6244 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:15.773249  1548 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:15.773389  1539 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:15.774148  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.748874  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.774717  1548 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.775285  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.776330  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:15.776805  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.777354  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.651974  6134 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:15.735806  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.779520  5995 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:15.743218  6112 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:15.780069  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.781169  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.782177  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:15.782912  6247 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:02:15.783694  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.783921  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.784276  1547 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:15.784986  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.764462  6249 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:15.785820  1547 raft_consensus.cc:2393] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:15.785979  5934 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:15.786530  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.790663  1661 leader_election.cc:400] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
I20260709 13:02:15.790997  1661 leader_election.cc:403] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:15.778403  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.763938  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.723598  1513 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:15.774435  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.798979  1661 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:15.783218  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.799701  1539 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:15.740653  6202 raft_consensus.cc:3055] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:15.773764  6244 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.745107  6196 consensus_queue.cc:1059] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:15.807860  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:15.784938  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.808655  1544 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:15.760407  5749 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:15.772378  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.810767  1692 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:15.810787  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 45752.7us
W20260709 13:02:15.813771  1661 leader_election.cc:336] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.850s (SENT)
I20260709 13:02:15.800096  1621 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:15.804512  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.805217  1548 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:02:15.803597  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.800767  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.800100  1545 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:02:15.796458  6176 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 7. Current term is 8.
W20260709 13:02:15.816790  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 93402.4us
W20260709 13:02:15.817345  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.763075  1587 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:15.787177  6108 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.810190  6258 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:15.819829  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 56836.6us
I20260709 13:02:15.824649  1587 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:15.816138  1540 raft_consensus.cc:1240] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:15.816568  2232 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:15.804790  6202 raft_consensus.cc:740] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:15.828572  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.829330  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.831658  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:15.831944  6134 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:15.832034  5997 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:15.829689  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.833410  1545 raft_consensus.cc:2376] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10. Re-sending same reply.
I20260709 13:02:15.833326  6098 consensus_queue.cc:1059] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:15.834072  6096 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:15.830662  5989 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:15.836198  5989 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:15.836584  5989 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:15.831703  1548 raft_consensus.cc:2376] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11. Re-sending same reply.
I20260709 13:02:15.795897  6155 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:02:15.846881  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.832326  1689 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.848224  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.795702  6169 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:02:15.813426  5991 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:15.824606  6249 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:15.819178  6016 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:15.844954  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.863068  1539 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:15.827605  6139 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:15.830828  5995 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:15.857038  1689 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:15.857946  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:15.827301  6162 raft_consensus.cc:3055] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:15.860627  1511 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:15.861765  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:15.842833  1621 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:15.867446  6016 raft_consensus.cc:697] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:15.864380  5997 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:02:15.865808  6169 consensus_queue.cc:1243] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:15.872146  6202 consensus_queue.cc:260] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:15.841820  6096 raft_consensus.cc:697] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:15.864827  1587 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:15.876070  5995 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.884377  6202 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.881788  5979 consensus_queue.cc:1059] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:02:15.885483  5979 consensus_queue.cc:1243] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:15.881960  6078 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:15.885618  6096 consensus_queue.cc:237] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.888861  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:15.889504  5934 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:15.885972  5995 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:15.889886  5934 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:15.890710  5934 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:15.850742  6134 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:02:15.892302  5381 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:15.892690  6016 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.875103  6162 raft_consensus.cc:740] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:15.895737  1587 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:15.896103  6162 consensus_queue.cc:260] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.896347  5381 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:15.885987  5979 raft_consensus.cc:3055] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:15.897794  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:15.899060  1511 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:15.899608  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:15.900169  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:15.897737  5997 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.913659  1511 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:15.911127  5979 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:15.918293  6082 consensus_queue.cc:1059] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:02:15.897352  6162 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:15.913342  6240 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:15.915076  6078 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:15.933887  6262 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:02:15.935283  6078 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:15.936440  5749 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:15.936971  6258 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:15.923931  6134 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:15.928082  5934 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:15.946650  1661 leader_election.cc:336] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.995s (SENT)
I20260709 13:02:15.923259  5979 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:15.946846  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 47352.5us
I20260709 13:02:15.951263  1587 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:15.953838  1661 leader_election.cc:336] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.164s (SENT)
I20260709 13:02:15.956815  1661 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:15.958377  6169 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:15.964098  5979 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:15.986030  1587 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:15.996583  1587 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:15.976229  5749 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:16.016613  1663 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:15.992234  6098 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:16.022393  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:16.023138  1692 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:16.025693  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:16.026090  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 112483us
I20260709 13:02:16.027484  1691 raft_consensus.cc:2393] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:16.010423  5563 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:16.029090  1511 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:16.014191  6139 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:16.032857  5989 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.025616  6244 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:16.038425  2269 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:16.040772  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:16.043671  6263 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:02:16.045301  1692 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:16.046366  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:16.037431  1511 leader_election.cc:400] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:02:16.033746  6016 consensus_queue.cc:1059] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:02:16.049868  1511 leader_election.cc:403] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:16.065135  6082 consensus_queue.cc:1243] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:16.198100  6053 raft_consensus.cc:3055] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:02:16.154763  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.065066  1622 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:16.062778  1586 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:16.219200  6078 raft_consensus.cc:3055] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:16.196774  5991 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.037386  6240 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:16.058997  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:16.219928  5991 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:16.084154  1688 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:16.047689  6108 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:16.220299  6240 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:16.095115  1617 raft_consensus.cc:1240] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:16.195371  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.226572  6240 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.058614  1618 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:16.220376  6244 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:16.049098  1691 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:16.229357  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 170430us
W20260709 13:02:16.225970  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 163274us
W20260709 13:02:16.231309  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.233201  5877 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:16.233763  5877 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:16.234380  6108 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:16.219715  6078 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:16.217801  6053 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:16.220973  6139 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:16.240633  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 174967us
I20260709 13:02:16.239162  1586 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:16.259219  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.210942  5563 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:16.266263  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:16.276624  1692 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:02:16.228924  6240 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:16.267390  1691 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:16.225611  5979 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:02:16.277000  1692 pending_rounds.cc:85] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 11
I20260709 13:02:16.282006  1692 pending_rounds.cc:107] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:02:16.282369  1692 raft_consensus.cc:2889] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:16.281412  1689 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:16.275332  6006 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:16.145434  6273 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.186s
I20260709 13:02:16.276733  6139 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:16.079674  5907 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:16.293181  6240 raft_consensus.cc:3055] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:16.307011  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 271776us
I20260709 13:02:16.329712  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:16.332491  2270 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:02:16.333735  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:16.299060  6006 raft_consensus.cc:697] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:16.309713  2265 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:16.336297  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:16.319960  6240 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:16.347348  1511 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:16.349772  6279 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:16.350551  6279 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:16.351336  6283 consensus_queue.cc:1059] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:16.352070  6283 consensus_queue.cc:1243] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:16.352530  6283 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:16.331030  5877 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:16.356899  1511 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:16.354034  6283 raft_consensus.cc:3055] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:16.366133  1511 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:16.367403  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:16.367987  1620 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:16.368327  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:16.364742  6283 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:16.354060  6006 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:16.370384  6283 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.371670  6283 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:16.334153  6016 consensus_queue.cc:1059] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:02:16.335979  6285 consensus_queue.cc:1059] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:02:16.337847  6134 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:02:16.349901  5991 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:16.341722  6277 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:02:16.388087  6269 log.cc:927] Time spent T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.201s	user 0.003s	sys 0.001s
I20260709 13:02:16.306205  6053 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.392638  1511 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:16.362838  5979 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:16.377977  6280 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:16.396164  1511 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:16.397083  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:16.398999  2269 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:16.397758  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:02:16.400890  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 120680us
I20260709 13:02:16.406594  1511 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:16.407195  2269 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:16.410336  2231 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:16.395296  6273 raft_consensus.cc:3055] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:16.392657  6287 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:16.415508  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:16.421200  1548 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:16.421464  2268 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:16.398080  5997 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:16.375226  6139 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.424422  6280 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:16.444393  5989 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:16.447896  6086 raft_consensus.cc:3055] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:16.451637  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.417778  6286 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:16.451565  6284 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:02:16.390581  6240 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.472415  6240 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:16.427325  6228 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:16.429550  5979 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:16.480648  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:16.480768  5907 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:16.412613  6273 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:16.483239  6273 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.484514  6273 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:16.486119  6053 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:16.469676  6086 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:16.488021  6086 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.491766  1620 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:16.492957  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:16.494735  2270 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:16.515443  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:16.518215  1622 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:16.490274  6228 raft_consensus.cc:697] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:16.446942  6078 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.494321  6086 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:16.556516  1618 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:02:16.539508  6162 consensus_meta.cc:287] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.003s
W20260709 13:02:16.562369  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 143885us
W20260709 13:02:16.583928  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 177436us
I20260709 13:02:16.584967  1690 raft_consensus.cc:2410] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:16.584776  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:16.599601  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:16.605618  1588 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:16.631649  1511 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:16.632093  1618 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:16.632409  5381 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:16.549244  5979 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:02:16.549428  6285 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:02:16.647502  2272 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:16.604872  6078 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:16.662575  1511 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:16.633697  6082 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:16.652966  6260 log.cc:927] Time spent T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:16.602185  6162 consensus_queue.cc:1059] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 13:02:16.676667  1661 leader_election.cc:336] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.013s (SENT)
I20260709 13:02:16.668551  6280 consensus_queue.cc:1059] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:02:16.678751  6294 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:16.679518  6294 consensus_queue.cc:1243] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:16.680299  6280 raft_consensus.cc:3055] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:16.680742  6280 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:16.681586  6280 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.682951  6280 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:16.686138  1661 leader_election.cc:336] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 2.104s (SENT)
I20260709 13:02:16.654481  6126 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
W20260709 13:02:16.705488  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 47098.1us
I20260709 13:02:16.668744  6271 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:16.710208  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 113403us
I20260709 13:02:16.651338  5997 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:02:16.652758  6176 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:02:16.670707  6285 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:16.714190  2231 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:16.721969  6098 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:16.711666  5991 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:02:16.731568  6098 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:16.735127  6098 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:16.736747  6016 raft_consensus.cc:3055] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:16.737130  6016 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:16.737851  6016 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.738942  6016 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:16.708889  5934 raft_consensus.cc:3055] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:16.762881  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 156150us
W20260709 13:02:16.766961  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 131434us
W20260709 13:02:16.766470  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 102061us
W20260709 13:02:16.769263  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.770885  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.771107  2234 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:16.772887  1661 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:16.774569  1661 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:16.772019  5381 raft_consensus.cc:697] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:16.781208  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:16.655431  6228 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:16.786648  1695 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:02:16.787715  1689 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:02:16.788096  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:16.790606  1661 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:16.762897  5934 raft_consensus.cc:740] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:16.798537  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:16.798771  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:16.799582  1545 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:16.802093  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:16.803076  1546 raft_consensus.cc:2393] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 7: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:16.804101  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:16.808434  1511 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:16.810077  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:16.811556  1661 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:16.793433  6240 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.812862  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:16.813302  6240 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.813930  1543 raft_consensus.cc:2410] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:16.815074  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:16.815780  1543 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:16.816046  6285 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.816507  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:16.817126  1543 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:02:16.816694  6285 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.817934  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:16.818784  1543 raft_consensus.cc:2410] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:16.819676  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:16.820606  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:16.821327  1543 raft_consensus.cc:2410] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:16.822098  1543 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:16.822394  1543 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:16.805024  1541 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:16.772012  6167 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:16.829952  1541 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:02:16.823616  5381 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:16.764846  6224 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:02:16.833626  1541 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:16.823051  1543 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.836136  1543 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:16.776966  6244 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:16.791200  6273 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:16.838303  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:16.793756  6176 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:16.793093  6225 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:16.854703  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:16.823127  5934 consensus_queue.cc:260] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.855881  6102 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.856326  6302 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:16.828598  6162 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:16.828776  6169 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:16.828723  6082 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:16.793889  6303 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:16.848281  6285 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:16.846277  6096 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:02:16.872156  6302 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:16.882954  6162 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:16.854564  6273 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:16.923894  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:16.910787  5934 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:16.928764  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:16.937290  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:16.940213  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:16.939483  6082 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:16.881397  6102 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:16.920965  6240 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:16.925180  6162 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:16.938946  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.923888  6302 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:16.961617  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 150168us
I20260709 13:02:16.952788  5381 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:16.962507  1661 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:16.943186  6277 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:16.947616  6006 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:16.935359  6221 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.966602  1661 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:16.973193  1661 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:16.980252  6309 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:02:16.984194  6313 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:16.984675  6313 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:16.985014  6313 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:16.990301  1661 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:16.968993  6303 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.009471  1661 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:17.021476  6244 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:16.989010  6169 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:17.025842  6176 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:17.032728  6096 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.040805  6102 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:17.042515  6098 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:17.026757  6319 log.cc:927] Time spent T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:02:16.974395  6221 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:17.062469  6221 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:17.059099  6096 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:17.064903  6096 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:17.068140  6273 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:17.076176  6162 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:17.078091  6162 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:17.081710  6302 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:17.083273  6302 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:17.084939  6313 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:17.085904  6303 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.087003  6313 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:16.662847   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:17.136847  1544 raft_consensus.cc:2410] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:17.137815  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:17.139153  1547 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
W20260709 13:02:17.161888  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 221613us
I20260709 13:02:17.165570  1587 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:17.165362  1661 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:17.170449  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:17.173338  1587 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:17.225819  6250 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:17.226367  6250 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:17.226766  6250 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:17.239584  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.261505  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:17.267642  6322 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:17.272202  6302 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:17.272766  6302 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:17.273223  6302 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:17.276732  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 105338us
I20260709 13:02:17.272222  6290 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:17.282542  6016 consensus_meta.cc:287] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.003s
W20260709 13:02:17.280872  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 105437us
I20260709 13:02:17.285527  1546 raft_consensus.cc:2410] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:02:17.312139  1543 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:17.281280  6162 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.324469  1543 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:02:17.327710  6279 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:02:17.332746  6162 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:17.281826  6290 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:17.337215  6290 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:17.339406  2232 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:17.280853  6303 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:02:17.344901  5934 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.345669  5934 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:17.346489  6320 log.cc:927] Time spent T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:02:17.347836  6313 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:17.348807  5934 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:17.348868  6313 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:17.350152  6228 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:17.350616  6228 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:17.351017  6228 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:17.353340  1543 pending_rounds.cc:85] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 5
I20260709 13:02:17.353812  1543 pending_rounds.cc:107] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:02:17.354192  1543 raft_consensus.cc:2889] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:17.361264  1587 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:17.365301  6139 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.365463  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:17.366168  6139 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:17.369549  5749 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:17.376580  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:17.378108  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:17.378618  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:17.380509  2270 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:17.337736  1542 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:17.382829  1546 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:17.367153  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:17.390424  1546 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:17.391031  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:17.392962  6313 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:17.393617  6273 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:17.394219  6273 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:17.396631  6273 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:17.400601  1689 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:17.400792  1539 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:17.407631  5934 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.408371  5934 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:17.411159  6134 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:17.450248  1692 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:17.451153  5934 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:17.453765  1692 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:17.455809  6162 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:17.459128  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:17.466059  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 81516.1us
I20260709 13:02:17.499838  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:17.500190  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:17.501379  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:17.503063  1696 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:17.501549  1693 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:17.504163  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:17.505012  1695 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:17.508728  6139 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:17.510663  6139 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:17.523617  1547 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:02:17.525238  6053 consensus_meta.cc:287] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 1.039s	user 0.013s	sys 0.004s
I20260709 13:02:17.521018  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:17.527702  5877 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:17.526855  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:17.557475  1539 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
W20260709 13:02:17.583236  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 46564.4us
I20260709 13:02:17.538547  6313 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.608810  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:17.610873  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:17.610327  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:17.621662  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:17.627308  1547 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:17.635176  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 56117.8us
I20260709 13:02:17.635495  2269 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 13:02:17.636448  6332 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:02:17.637316  1514 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:17.638345  6273 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:17.639451  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:17.642490  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 45608.4us
I20260709 13:02:17.643270  6134 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:17.644804  6280 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:17.644994  6134 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:17.645442  6280 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:17.656920  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:17.657850  1540 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:02:17.639098  1514 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:17.670154  1622 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:17.620589  6313 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:17.714749  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:17.715771  1623 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:17.717214  1623 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:02:17.718325  6338 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:17.720377  6290 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:17.721148  6240 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:17.724277  6345 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:02:17.728319  6250 consensus_meta.cc:287] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.001s
W20260709 13:02:17.730136  6098 consensus_meta.cc:287] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.005s
W20260709 13:02:17.715888  6347 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:02:17.715039  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:17.728757  6250 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:17.741393  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 114382us
I20260709 13:02:17.740582  6240 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.776032  1692 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
W20260709 13:02:17.776700  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.780803  6240 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:17.782433  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:17.783550  6078 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:17.784114  6078 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:17.776731  1692 pending_rounds.cc:85] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 7
I20260709 13:02:17.787719  1692 pending_rounds.cc:107] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:02:17.788018  1692 raft_consensus.cc:2889] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:17.788551  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 149565us
I20260709 13:02:17.798066  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:17.794165  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:17.803107  6294 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:17.803335  6348 log.cc:927] Time spent T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:02:17.803707  1619 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:17.783339  6240 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:17.816833  6307 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:17.827936  6307 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:17.927634  1661 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:17.928970  6244 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:18.005950  6240 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.006547  6240 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.008363  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.018677  6240 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:18.019969  6354 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
W20260709 13:02:18.023623  6349 log.cc:927] Time spent T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:02:18.023743  6287 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.024552  6287 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.029695  5934 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:18.030542  5934 consensus_queue.cc:1243] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:02:18.042373  6228 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.691s	user 0.008s	sys 0.001s
W20260709 13:02:18.046097  6302 consensus_meta.cc:287] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.772s	user 0.008s	sys 0.003s
I20260709 13:02:18.027189  6287 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.046554  6302 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.007851  6273 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.048223  6273 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.050465  6273 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:17.979514  6250 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.053180  6139 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:18.053849  6139 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.042852  6228 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:18.099251  1690 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:18.106061  2272 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:18.101969  6336 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:02:18.105214  6322 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:18.109861  6322 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.110400  6221 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:18.111263  6221 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.112135  6322 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.113893  6221 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.095255  6305 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:18.116299  6305 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.117085  1697 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:18.120249  6240 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:18.125576  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 196029us
I20260709 13:02:18.127136  6221 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.121246  6305 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.127888  6221 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:18.129720  6139 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.143388  1661 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:18.146159  6176 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:18.130266  6240 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.148264  1661 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:18.148698  6006 consensus_meta.cc:287] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 1.177s	user 0.020s	sys 0.009s
I20260709 13:02:18.149991  6006 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:18.149452  6240 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.155009  6176 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:18.157466  1661 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.162292  6176 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:18.162837  6176 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.163223  6176 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:18.163369  6302 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:18.156630  6228 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.175715  6176 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.179535  6176 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:18.165518  6221 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:18.185052  1661 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:18.194952  6240 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.195860  6240 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.198112  6240 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.205776  2231 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:18.206632  6228 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:18.209107  6302 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:18.212191  1695 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:02:18.212579  6228 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:18.212244  6302 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.213420  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.214151  1697 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:02:18.215452  6302 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:18.217010  6337 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.714s	user 0.005s	sys 0.009s
I20260709 13:02:18.220641  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:18.207800  6176 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:18.222524  2231 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:18.224898  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:18.219828  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2824) took 1414 ms. Trace:
I20260709 13:02:18.231453  6005 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:18.235936  6176 raft_consensus.cc:697] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:18.245445  6096 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:02:18.254887  6280 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:18.227926  1544 rpcz_store.cc:276] 0709 13:02:16.805847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.178088 (+372241us) service_pool.cc:224] Handling call
0709 13:02:17.178709 (+   621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.179399 (+   690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.182530 (+  3131us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.269805 (+ 87275us) log.cc:844] Serialized 26 byte log entry
0709 13:02:17.467318 (+197513us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:17.485284 (+ 17966us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.485746 (+   462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.485806 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.205284 (+719478us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b1800161c20. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a51522 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:02:18.216248 (+ 10964us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:18.219605 (+  3357us) raft_consensus.cc:1685] finished
0709 13:02:18.219630 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.219762 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238,"prepare.queue_time_us":19257,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":61717,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":1707,"spinlock_wait_cycles":83310336,"thread_start_us":176522,"threads_started":1,"wal-append.queue_time_us":207613}
I20260709 13:02:18.268246  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.269037  1689 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
W20260709 13:02:18.269470  6351 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.208s	user 0.000s	sys 0.002s
I20260709 13:02:18.270253  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.270908  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.271095  1691 raft_consensus.cc:2410] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:18.271070  6240 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.276816  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.279322  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:18.280907  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:18.272312  6273 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.282215  6273 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.284962  6273 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.285573  6240 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.287021  6078 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.288187  6240 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.265646  6302 consensus_queue.cc:1059] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:02:18.274133  6287 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.275837  6280 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.300886  6280 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.308135  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.309430  1696 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:18.307708  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:18.308413  6287 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.311077  1547 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:18.312541  6287 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.308136  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.322160  1697 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:18.329348  6280 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.330192  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:18.331467  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:18.332041  1541 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:18.340432  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:18.345485  6287 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:18.346319  6287 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.349117  6287 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.360662  6280 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:18.362764  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.367506  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:18.362191  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:18.369539  1688 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:18.371568  6176 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.373369  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:18.377902  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.378634  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.379050  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.379885  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.380119  1696 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:18.380613  1697 raft_consensus.cc:2393] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:18.379428  1688 raft_consensus.cc:2393] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:18.383107  1548 pending_rounds.cc:85] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 6
I20260709 13:02:18.383211  6307 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.383523  1548 pending_rounds.cc:107] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:02:18.383808  1548 raft_consensus.cc:2889] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:18.384217  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.384835  1688 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:18.383728  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.385816  6280 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:18.388361  6353 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.383s	user 0.010s	sys 0.004s
I20260709 13:02:18.388808  6280 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.392334  6053 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.394037  6313 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:18.398331  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:18.402875  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:18.407657  1443 catalog_manager.cc:5697] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.411113  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3099) took 1003 ms. Trace:
I20260709 13:02:18.411374  1663 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:18.411537  1690 rpcz_store.cc:276] 0709 13:02:17.407947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.437745 (+ 29798us) service_pool.cc:224] Handling call
0709 13:02:17.447904 (+ 10159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.099743 (+651839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.410884 (+311141us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b5400097ed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:18.411040 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1482191744}
I20260709 13:02:18.412650  1663 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.413945  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:18.368644  1546 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:18.417943  6313 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:18.419114  6313 consensus_queue.cc:1059] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:18.420693  6313 raft_consensus.cc:3055] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:18.421180  6313 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:18.383850  6086 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.427345  6086 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.430068  6086 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:18.414731  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 47097.3us
I20260709 13:02:18.414840  1443 catalog_manager.cc:5697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.416505  6360 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.417078  6053 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:18.436885  6053 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.437635  6053 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:18.440227  1514 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:18.422492  6313 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.452060  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.455579  1692 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:18.499050  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:18.517549  6305 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:18.450822  6280 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:18.517887  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.524019  1541 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:18.524071  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.524776  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.523095  1690 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:18.527242  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.527544  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.488281  6360 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.526396  1694 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:18.514726  5934 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.482843  6273 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:18.533509  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 49130.2us
I20260709 13:02:18.536386  1587 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:02:18.532823  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 106685us
I20260709 13:02:18.539821  1690 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
W20260709 13:02:18.540021  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 67586.7us
I20260709 13:02:18.543167  2232 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:18.545035  5877 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:18.547592  1511 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.549151  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:18.550860  1511 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.551040  6078 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:18.536304  1692 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:18.586077  6078 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.591972  6078 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.595345  6101 consensus_queue.cc:1059] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:18.596668  6162 raft_consensus.cc:3055] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:18.597061  6162 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:18.598033  6162 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:18.577845  6360 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.602381  6240 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:18.602805  6240 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.603140  6240 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.603597  1697 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:18.604470  6078 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.571558  6305 consensus_queue.cc:1059] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:02:18.607676  6273 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.609688  6273 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.559788  6313 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.611029  6078 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.621232  6101 raft_consensus.cc:3055] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:18.621784  6101 raft_consensus.cc:740] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:18.623827  6305 raft_consensus.cc:3055] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:18.624333  6305 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:18.625308  6305 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.626868  6305 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.622778  6101 consensus_queue.cc:260] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.631589  6101 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.551812  6280 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.573243  6134 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:18.644006  6134 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.644527  6134 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.645356  6280 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:18.648336  6365 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.645972  6280 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.649086  6365 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:18.650990  6280 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.655431  6162 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:18.665424  1443 catalog_manager.cc:5697] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 8 to 9, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 9 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:18.667052  6360 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:18.589185  1511 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.668303  6280 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:18.668875  6280 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.669278  6280 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.668229  1443 catalog_manager.cc:5697] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.672693  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:18.676177  6280 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:18.668232  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 79106.4us
I20260709 13:02:18.670379  1443 catalog_manager.cc:5697] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.677245  1511 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.678087  1511 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.678228  6273 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:18.678613  6273 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.678736  6078 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:18.678989  6273 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:18.679163  6078 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:18.679613  6078 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:18.683831  1511 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.684891  1511 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.685789  6294 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:18.686159  6294 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.686623  6294 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:18.686084  1511 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.668845  6365 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:18.739852  6287 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:18.764461  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 185653us
W20260709 13:02:18.765861  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 186994us
I20260709 13:02:18.634735  6053 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.765905  1443 catalog_manager.cc:5697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:18.773340  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 87322.7us
I20260709 13:02:18.675318  6240 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.776566  1511 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.762583  6287 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:18.787499  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:18.769850  6280 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.812625  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.816437  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.817067  1615 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:18.817538  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.817867  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.818485  1615 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:18.819376  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.825100  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.825115  1615 raft_consensus.cc:2410] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:18.823487  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.812997  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.840058  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.818174  1617 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:18.804963  1443 catalog_manager.cc:5697] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.823836  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.806442  6287 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.823123  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:18.852319  1619 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:18.852910  1623 raft_consensus.cc:2410] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:18.853348  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.855544  1443 catalog_manager.cc:5697] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 3 to 7, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 7 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:18.890733  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.896808  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.897169  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.897480  1623 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:18.897835  1622 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:18.898799  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.899569  1614 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:18.899912  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.900588  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:18.901619  1622 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.902019  6280 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:18.902417  6280 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.902760  6280 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.903682  6360 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:18.904263  6360 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:18.906427  6360 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:18.907594  6176 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:18.908356  6176 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.908900  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.909539  1620 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:18.910604  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.911799  6378 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:18.912369  6313 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:18.912878  6313 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.915568  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:18.916163  1621 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:18.916739  6176 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:18.907032  6360 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:18.917196  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:18.917625  6360 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:18.920889  6379 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:18.912317  6378 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.921537  6379 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:18.921926  6379 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.925452  6280 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.923295  6378 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.932057  6280 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:18.935711  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:18.937137  1622 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
W20260709 13:02:18.941193  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.919219  2265 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
W20260709 13:02:18.942334  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 126096us
I20260709 13:02:18.819229  6376 consensus_queue.cc:1059] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 13:02:18.943329  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 166839us
W20260709 13:02:18.946324  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 125123us
I20260709 13:02:18.952066  1511 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.952702  6365 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:18.952921  6280 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:18.953601  6280 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.953454  6365 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:18.954073  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.954191  6280 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:18.944660  6354 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:02:18.919938  6313 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:18.965710  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.966704  1690 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:18.969164  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:18.969870  1690 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.959045  1661 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.974057  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:18.974670  1697 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.974117  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.975737  1692 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:18.977609  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:18.979148  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:18.979933  1692 raft_consensus.cc:2393] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:02:18.981073  1445 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52824 (request call id 229) took 19797 ms (client timeout 15000 ms). Trace:
I20260709 13:02:18.983021  6322 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:18.983275  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:18.983867  1620 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.958518  6364 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:18.987572  6307 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:18.988098  6364 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.990307  6364 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:18.987607  6367 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:18.991394  6367 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.991772  6367 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:18.990815  6364 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:18.994266  6364 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:18.996243  6364 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:18.978753  1661 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:18.997457  6134 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.001278  6176 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:19.001976  6176 raft_consensus.cc:697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:18.978156  1588 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:19.004961  6372 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:19.005163  6322 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:19.005602  6322 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.005949  6322 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:18.956260  6365 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:19.008291  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:19.008612  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:19.008921  1622 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:02:19.009110  1618 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:19.014369  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:19.014963  1622 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:19.016731  6377 raft_consensus.cc:3055] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:19.017145  6377 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:19.017225  6273 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.018002  6377 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.019719  6244 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:19.020270  6244 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:19.022334  6244 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:19.022574  6078 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.024006  1663 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:19.024788  6313 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:19.028398  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:19.028924  6053 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:18.970775  5934 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:19.029947  5934 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.031492  1586 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:19.032146  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 44760.1us
I20260709 13:02:19.032279  5934 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:19.033903  6250 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:19.034370  6250 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:19.034813  6250 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:19.038738  1618 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:19.039839  6307 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:19.040009  6006 consensus_queue.cc:1059] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:19.041508  6006 raft_consensus.cc:3055] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:19.041926  6006 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:18.988430  6240 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:19.050884  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:19.055619  1692 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:19.056794  1663 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:19.057283  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.058069  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:19.048280  1690 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:19.064558  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:19.064638  1622 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:19.068455  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:19.071281  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:19.072300  1622 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:19.019308  6377 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:19.074481  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:19.071154  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:19.075865  1546 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:19.078689  1620 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:19.079958  1514 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:19.081056  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:19.100257  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 43582us
I20260709 13:02:19.101401  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:19.105868  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:19.106750  1539 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:19.089395  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:19.061949  6134 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:19.110472  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:19.111049  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:19.108822  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:19.111093  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:19.111959  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:19.109668  1542 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:19.110157  6053 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:19.053905  6378 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:19.125293  1696 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:19.115886  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:19.111426  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:19.019325  6273 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:19.121296  1540 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:19.115226  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:19.042886  6006 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.119885  1544 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:02:19.126904  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:19.139019  1539 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:19.136742  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:19.141002  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:19.141686  1693 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.108394  6364 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:19.150324  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:19.151199  1617 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:19.151572  1622 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:19.003084  6176 consensus_queue.cc:237] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.147883  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:19.160979  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:19.042783  6367 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.133473  6240 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:19.176066  1663 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:19.182364  1663 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:19.183087  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 70166.1us
I20260709 13:02:19.168136  6273 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:19.172811  6244 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:19.222321  1663 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:18.981519  1445 rpcz_store.cc:269] 0709 13:01:59.183428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.216084 (+ 32656us) service_pool.cc:224] Handling call
0709 13:01:59.563919 (+347835us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b54000393d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa8090 00007f5c6ab46f3a 00007f5c708fd1cc 00007f5c709fb37e 00007f5c6eebc2a4 00007f5c6eebc232 00007f5c6eebc161 00007f5c6eebc0dc 00007f5c6eebb392 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:18.980825 (+19416906us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:12.789487 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:12.790305 (+   818us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:12.790366 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:02:12.790393 (+    27us) tablet.cc:662] Decoding operations
0709 13:02:12.792786 (+  2393us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:12.792906 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:12.792946 (+    40us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:02:12.795196 (+  2250us) tablet.cc:701] Row locks acquired
0709 13:02:12.795250 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:02:12.803642 (+  8392us) write_op.cc:270] Start()
0709 13:02:12.803833 (+   191us) write_op.cc:276] Timestamp: P: 1783602132795391 usec, L: 0
0709 13:02:12.803858 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:02:12.804838 (+   980us) log.cc:844] Serialized 8635 byte log entry
0709 13:02:13.490322 (+685484us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c67a340ac 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b
0709 13:02:13.864021 (+373699us) op_driver.cc:464] REPLICATION: finished
0709 13:02:14.002141 (+138120us) write_op.cc:301] APPLY: starting
0709 13:02:14.027898 (+ 25757us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:14.899093 (+871195us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:14.899139 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:15.331165 (+432026us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:15.387979 (+ 56814us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:02:15.403619 (+ 15640us) write_op.cc:312] APPLY: finished
0709 13:02:15.502485 (+ 98866us) log.cc:844] Serialized 196 byte log entry
0709 13:02:15.724302 (+221817us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:15.724494 (+   192us) write_op.cc:454] Released schema lock
0709 13:02:15.724552 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:15.727751 (+  3199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:15.727781 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2216373,"reported_tablets":50,"spinlock_wait_cycles":12796672,"child_traces":[["op",{"apply.queue_time_us":131490,"apply.run_cpu_time_us":90221,"apply.run_wall_time_us":1725571,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96175,"num_ops":22,"prepare.queue_time_us":327187,"prepare.run_cpu_time_us":43979,"prepare.run_wall_time_us":837524,"raft.queue_time_us":138726,"raft.run_cpu_time_us":40830,"raft.run_wall_time_us":88283,"replication_time_us":1059923,"spinlock_wait_cycles":71696640,"thread_start_us":1467704,"threads_started":5,"wal-append.queue_time_us":1131716,"wal-append.run_cpu_time_us":34555,"wal-append.run_wall_time_us":2212585}]]}
I20260709 13:02:19.162285  6378 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.259490  6378 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:19.173862  6364 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:19.262820  6364 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:19.243017  6294 consensus_meta.cc:287] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.003s
I20260709 13:02:19.274398  1621 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:19.277313  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:19.278102  6367 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:19.240507  6393 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:19.275808  6364 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:19.279814  6006 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:19.272820  5934 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:19.302769  1539 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:19.309531  1693 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:02:19.256428  6244 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:19.315009  1586 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:19.354328  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 132099us
I20260709 13:02:19.356532  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:19.357429  1697 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
W20260709 13:02:19.359930  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 45229.1us
W20260709 13:02:19.362793  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 154785us
I20260709 13:02:19.362991  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:19.280063  6294 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:19.445437  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 302933us
I20260709 13:02:19.470988  1514 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:19.458328  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:19.461733  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:19.463898  1614 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:02:19.389881  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.352056  6162 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.696s	user 0.006s	sys 0.005s
I20260709 13:02:19.361232  6377 raft_consensus.cc:2764] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:19.472715  1514 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:02:19.457963  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 303545us
W20260709 13:02:19.469574  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 161127us
I20260709 13:02:19.481218  1514 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:19.469705  1586 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:19.491636  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 111882us
I20260709 13:02:19.495498  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:19.339448  6381 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:19.359000  6078 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:19.529758  6392 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:02:19.535346  1544 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:19.536696  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:19.550338  1540 raft_consensus.cc:2368] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13.
I20260709 13:02:19.352805  6379 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:19.529762  6287 consensus_meta.cc:287] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.667s	user 0.007s	sys 0.001s
I20260709 13:02:19.547520  6078 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:19.562937  6078 raft_consensus.cc:697] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:19.563889  6294 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:19.564007  6078 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.545344  6411 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:19.558427  6139 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:19.587858  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 61646.1us
I20260709 13:02:19.551759  6381 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:19.580814  6250 consensus_meta.cc:287] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.000s
W20260709 13:02:19.576577  6322 consensus_meta.cc:287] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.005s
I20260709 13:02:19.603470  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:19.648232  1540 raft_consensus.cc:2368] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 13. Current term is 14.
I20260709 13:02:19.571679  6287 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:19.619695  6385 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 13:02:19.606501  6411 raft_consensus.cc:697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:19.609380  6403 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.613863  6322 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:19.638116  6280 consensus_meta.cc:287] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.000s
I20260709 13:02:19.607393  6381 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.607802  6139 raft_consensus.cc:697] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:19.608700  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:19.624744  1617 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:19.625309  1663 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:19.631867  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:19.625629  6244 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:19.557399  6402 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:19.608342  6250 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:19.667683  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 101435us
W20260709 13:02:19.604178  1692 consensus_meta.cc:287] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.001s
I20260709 13:02:19.680182  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:19.688489  1692 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
W20260709 13:02:19.688308  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 207042us
I20260709 13:02:19.692687  1621 raft_consensus.cc:2368] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15.
I20260709 13:02:19.693302  1514 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:19.693637  6322 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:19.695974  6386 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:19.697343  6381 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:19.698666  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:19.699608  1622 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:19.702571  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:19.703047  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:19.703820  1615 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:19.703728  1616 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:19.698534  6386 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:02:19.732451  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 44926.3us
I20260709 13:02:19.685370  6273 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:19.733780  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:19.741007  1620 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:19.732309  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 45943.2us
I20260709 13:02:19.686832  6402 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:19.748325  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:19.749189  1546 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:19.671506  6280 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.732170  6415 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:19.772877  6386 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.774583  1615 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:19.745097  6402 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.768158  6273 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.791671  6415 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.798592  6139 consensus_queue.cc:237] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.801736  1547 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:19.804134  6406 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:02:19.668582  6403 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.804193  1542 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:19.810796  6403 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:19.767639  6411 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.816126  6287 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:19.817605  6379 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:19.836005  1541 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:19.849051  6287 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:19.849726  6287 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:19.858625  6287 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:19.864214  6280 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:19.795116  6415 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:19.931778  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.949486  6418 log.cc:927] Time spent T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:02:19.981093  1620 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:19.989805  6402 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:19.982525  1511 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:19.994974  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:20.007227  2272 raft_consensus.cc:2393] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 14: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:20.007345  1511 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:19.995831  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:20.008718  1511 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:20.009779  6411 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:20.010142  6411 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:20.010481  6411 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.998355  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:19.992946  6360 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:20.008831  6280 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:19.981182  1546 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:02:20.012243  2263 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:20.016992  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:20.021554  6305 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:20.022311  6305 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:20.025436  6305 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:20.017982  6287 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:20.029374  6387 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.718s	user 0.004s	sys 0.003s
W20260709 13:02:20.049443  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 424184us
I20260709 13:02:20.032028  6365 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:20.052431  6244 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:20.053057  6244 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:20.053534  6360 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:20.053864  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 254143us
I20260709 13:02:20.054121  6360 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:20.054651  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:20.054189  6244 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:20.055361  1688 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:20.055783  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:20.055954  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:20.056334  1697 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:20.056572  1693 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:20.079879  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:20.057724  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:20.056962  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:20.085722  1690 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:20.072682  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:20.057289  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:20.086644  1692 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.073050  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:20.087286  1688 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:20.088018  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:20.088663  1661 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:20.089466  2263 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:20.037618  6287 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:20.093403  6399 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:20.093643  6176 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:20.093971  6399 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:20.094406  6399 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.094242  6176 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:20.095798  6280 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:20.096295  6280 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:20.098217  6280 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:20.067940  5877 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.098765  1692 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:20.101012  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:20.101140  1690 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:20.101579  1694 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:20.101985  5877 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:20.099644  6287 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.103042  2265 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:20.056417  6360 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:20.106815  1697 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:20.092855  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:20.109089  5877 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:20.110474  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 2037) took 1050 ms. Trace:
I20260709 13:02:20.110853  1541 rpcz_store.cc:276] 0709 13:02:19.060499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.074222 (+ 13723us) service_pool.cc:224] Handling call
0709 13:02:20.110263 (+1036041us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54002b3c54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:20.110394 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1749092736}
I20260709 13:02:20.112607  1688 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.120322  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:20.121253  1541 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:20.134079  2232 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:20.117050  1588 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:20.135682  1691 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:20.137637  1661 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:20.140326  1661 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:20.151144  1661 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:20.152297  6053 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:20.151607  6305 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:20.171571  6053 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:20.176582  6053 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.176723  6408 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:20.177397  6408 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.155663  6302 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:20.148490  6404 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:02:20.177865  6408 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:20.153903  6411 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:20.193001  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 51298.8us
I20260709 13:02:20.180055  6305 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:20.180716  6302 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:20.187655  6360 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:20.200314  6402 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:20.203812  6360 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:20.204448  6360 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.204068  6305 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:20.163870  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:02:20.216253  1620 raft_consensus.cc:606] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:20.216842  1688 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:20.194486  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:20.221493  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3122) took 1142 ms. Trace:
W20260709 13:02:20.219177  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 68081.2us
I20260709 13:02:20.239485  1511 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:20.241026  1661 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:20.241235  1511 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:20.243270  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:20.243690  1661 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:20.245056  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:20.246053  1688 raft_consensus.cc:2393] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:02:20.232236  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 75387.2us
I20260709 13:02:20.196421  6302 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:20.265408  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:20.265986  1691 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:20.268833  1688 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:20.192777  6364 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:02:20.222414  6428 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 13:02:20.276716  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 118290us
I20260709 13:02:20.274492  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:20.273568  1511 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:20.236465  6176 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:20.227612  6162 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:20.221902  1689 rpcz_store.cc:276] 0709 13:02:19.075786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.075898 (+   112us) service_pool.cc:224] Handling call
0709 13:02:19.076214 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.108029 (+ 31815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.108062 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.114720 (+  6658us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.281965 (+167245us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:19.337799 (+ 55834us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.027628 (+689829us) spinlock_profiling.cc:243] Waited 7.51 ms on lock 0x7b1800177580. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c679cbc0a 00007f5c7110b219 00007f5c67a53a40 00007f5c67a4e4e4 00007f5c67a4e455 00007f5c6ab36060 00007f5c6ab48716 00007f5c6ab59287 00007f5c6ab59208
0709 13:02:20.027791 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.027868 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.126693 (+ 98825us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b1800177580. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:02:20.216728 (+ 90035us) raft_consensus.cc:1685] finished
0709 13:02:20.216888 (+   160us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.217140 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46884,"prepare.queue_time_us":57691,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":724665,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":8119,"spinlock_wait_cycles":22476032,"thread_start_us":118854,"threads_started":1,"wal-append.queue_time_us":215459}
I20260709 13:02:20.263787  6409 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:20.203325  6287 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:20.268133  6240 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:20.268373  6381 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:20.236403  6411 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:20.283864  6386 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:20.277208  6420 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:20.280026  1511 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:20.318099  6378 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:20.318648  6378 raft_consensus.cc:697] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:20.236568  6399 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:20.321754  1511 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:20.306686  6240 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:20.310796  6176 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:20.309765  6405 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.338001  1690 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:20.337970  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:20.315081  6420 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:20.338500  1691 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:20.340163  1546 raft_consensus.cc:1275] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:20.315316  6381 raft_consensus.cc:697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:20.352453  1692 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:20.309000  6432 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:20.364120  6381 consensus_queue.cc:237] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:20.353890  1697 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:20.355619  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.355232  6280 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:20.356549  6437 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.319591  6378 consensus_queue.cc:237] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:20.340708  6240 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:20.362044  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:20.353750  6405 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:20.338114  6402 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:20.322095  6386 raft_consensus.cc:697] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:20.306612  6409 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:20.361692  6053 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:20.377884  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:20.369724  6420 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:20.378806  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.339934  6273 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:02:20.404695  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:20.409065  1694 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:20.414311  1688 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:20.417424  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:20.418308  1696 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:20.401014  6370 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:20.398572  6402 raft_consensus.cc:697] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:20.403858  6389 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:20.379890  6437 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:20.436908  6399 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:20.439172  6405 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:20.441385  6409 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:20.442065  6386 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:20.443073  6053 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:20.446033  1694 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:20.449927  6360 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:20.450984  1693 raft_consensus.cc:1240] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:20.450783  1696 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:20.429951  6370 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:20.453891  6370 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:20.422633  6302 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:20.457684  6086 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:20.430712  6389 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:20.478026  1692 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:20.631956  6369 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:20.632670  6369 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:20.634999  6369 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:20.820492  6447 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 13:02:20.949250  6389 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:20.950731  6437 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:20.489035  6402 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:21.072707  6408 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.875s	user 0.004s	sys 0.007s
I20260709 13:02:21.073354  6408 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:21.110445  6408 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:21.376621  6444 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
W20260709 13:02:21.880208  6420 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.471s	user 0.007s	sys 0.004s
I20260709 13:02:21.880893  6420 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:21.882100  1545 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
W20260709 13:02:21.794678  6402 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.003s	sys 0.008s
W20260709 13:02:21.899200  6402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.003s	sys 0.009s
I20260709 13:02:22.096491  6420 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:22.100886  6240 consensus_meta.cc:287] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.705s	user 0.013s	sys 0.010s
I20260709 13:02:22.101423  6240 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:22.103708  6240 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:22.219671  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.222371  6452 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:22.223206  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2844) took 2742 ms (client timeout 1657 ms). Trace:
W20260709 13:02:22.224131  1539 rpcz_store.cc:269] 0709 13:02:19.480718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.495171 (+ 14453us) service_pool.cc:224] Handling call
0709 13:02:22.222868 (+2727697us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b540027bfd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:22.223066 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171454848}
I20260709 13:02:22.223083  6452 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:22.228909  6452 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:22.229967  6452 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:22.230933  6452 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:22.233994  6452 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:22.235711  6452 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:22.236163  6453 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:22.236343  6452 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:22.237068  6453 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:22.239675  1694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.766s	user 0.013s	sys 0.017s
W20260709 13:02:22.241465  1694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.768s	user 0.013s	sys 0.017s
I20260709 13:02:22.239544  6452 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:22.244573  6452 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:22.245371  6452 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:22.243765  6454 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:22.247829  6452 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:22.248072  6454 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:22.249377  6452 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:22.249918  6452 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:22.252202  6452 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:22.253793  6456 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:22.254391  6456 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:22.250224  6454 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:22.255779  6454 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.256315  6454 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:22.256704  6456 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:22.257249  6456 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.257688  6456 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:22.258958  6454 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:22.260035  6456 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:22.264286  6454 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.264938  6454 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:22.267324  6454 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:22.271890  6453 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:22.264426  6456 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.272801  6456 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:22.275153  6456 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:20.819208  6360 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:22.282308  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1984) took 1839 ms. Trace:
I20260709 13:02:22.282752  1696 rpcz_store.cc:276] 0709 13:02:20.443063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.452322 (+  9259us) service_pool.cc:224] Handling call
0709 13:02:20.454534 (+  2212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.465290 (+ 10756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.465322 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.469206 (+  3884us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.486217 (+ 17011us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:20.486277 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.486343 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:22.282068 (+1795725us) raft_consensus.cc:1685] finished
0709 13:02:22.282089 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.282250 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3102,"raft.queue_time_us":3808,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5117,"thread_start_us":9895,"threads_started":1,"wal-append.queue_time_us":10414,"wal-append.run_cpu_time_us":3209,"wal-append.run_wall_time_us":1584872}
I20260709 13:02:22.284538  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 808) took 1825 ms. Trace:
I20260709 13:02:22.284777  1696 rpcz_store.cc:276] 0709 13:02:20.458885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.283956 (+1825071us) service_pool.cc:224] Handling call
0709 13:02:22.284205 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.284339 (+   134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.284353 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:22.284381 (+    28us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:22.284402 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.284434 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.284501 (+    67us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:22.285822  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 809) took 1816 ms. Trace:
I20260709 13:02:22.286021  1696 rpcz_store.cc:276] 0709 13:02:20.469639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.285290 (+1815651us) service_pool.cc:224] Handling call
0709 13:02:22.285496 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.285609 (+   113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.285623 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:22.285650 (+    27us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:22.285673 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.285703 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.285763 (+    60us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:22.287014  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 810) took 1801 ms. Trace:
I20260709 13:02:22.287214  1696 rpcz_store.cc:276] 0709 13:02:20.485678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.286501 (+1800823us) service_pool.cc:224] Handling call
0709 13:02:22.286724 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.286836 (+   112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.286851 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:22.286874 (+    23us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:22.286892 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.286922 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.286980 (+    58us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:22.299337  6457 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.300014  6457 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:22.302245  6457 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:22.314026  2265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54488 (request call id 762) took 2231 ms (client timeout 1708 ms). Trace:
W20260709 13:02:22.314514  2265 rpcz_store.cc:269] 0709 13:02:20.083011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.083176 (+   165us) service_pool.cc:224] Handling call
0709 13:02:22.313746 (+2230570us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b540040ddd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:22.313908 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33120512}
W20260709 13:02:22.730459  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.112048  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.948634  1588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.132:39517 timed out after 1.607s (SENT) [suppressed 26 similar messages]
I20260709 13:02:23.250689  6459 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:23.251363  6459 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.253675  6459 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.254151  6459 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:23.254822  6459 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.256189  6460 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:23.257035  6459 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.256732  6460 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.257647  6459 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:23.258167  6459 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.260073  6460 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.260679  6460 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.260246  6459 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.261165  6460 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.261816  6459 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:23.262358  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 2048) took 2925 ms (client timeout 1708 ms). Trace:
I20260709 13:02:23.262312  6459 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.263372  6460 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.264281  6459 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.264464  6460 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.265089  6460 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:23.267915  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 319467us
W20260709 13:02:23.262892  1545 rpcz_store.cc:269] 0709 13:02:20.337247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.344727 (+  7480us) service_pool.cc:224] Handling call
0709 13:02:23.262140 (+2917413us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540027b0d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:23.262275 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3462267648}
I20260709 13:02:23.271400  6459 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.267598  6460 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.272312  6460 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.272205  6459 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.272964  6460 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.274490  6459 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.274996  6459 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.275197  6460 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.275533  6459 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.275803  6460 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.277443  6460 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:20.477243  6086 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.278622  6459 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.279712  6460 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.279215  6459 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.280730  6086 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.280944  6462 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.281201  6459 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.281621  6462 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.283459  6459 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.283849  6462 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.284207  6460 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.284765  6460 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.287113  6460 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.288141  6460 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:23.288805  6460 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:23.287739  1511 connection.cc:256] RPC call timeout handler was delayed by -1.4740816919999702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 13:02:23.290848  1511 connection.cc:256] RPC call timeout handler was delayed by -1.3254851729999473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 13:02:23.306236  6443 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 2.211s	user 0.023s	sys 0.080s
I20260709 13:02:23.310977  6250 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.319159  6460 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.320164  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3136) took 2921 ms. Trace:
I20260709 13:02:23.320561  1690 rpcz_store.cc:276] 0709 13:02:20.398947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.399604 (+   657us) service_pool.cc:224] Handling call
0709 13:02:20.413599 (+ 13995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.318263 (+2904664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.318296 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.318336 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:23.318371 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.319909 (+  1538us) spinlock_profiling.cc:243] Waited 2.9 s on lock 0x7b540035e3d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:23.319957 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.320087 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6679480576}
W20260709 13:02:23.323872  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.325558  6250 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.326149  6250 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.328572  6250 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.344553  6382 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.345270  6382 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:23.348097  6381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.861s	user 0.013s	sys 0.024s
W20260709 13:02:23.348801  6381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.862s	user 0.013s	sys 0.024s
W20260709 13:02:23.351883  2231 connection.cc:256] RPC call timeout handler was delayed by -1.2134177139999451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 13:02:23.356377  6384 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.357093  6384 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.371547  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.371843  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:23.372268  1543 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:23.372488  1545 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:23.373337  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.376746  1546 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:23.378970  6126 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.379611  6126 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.381644  6293 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.382225  6293 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.384370  6290 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.385193  6290 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.394719  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3134) took 3005 ms. Trace:
I20260709 13:02:23.356443  6394 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.396512  6394 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.398895  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.401981  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:23.402747  2272 raft_consensus.cc:2368] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:02:23.395236  1692 rpcz_store.cc:276] 0709 13:02:20.389924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.390383 (+   459us) service_pool.cc:224] Handling call
0709 13:02:20.390778 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.478601 (+ 87823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.394444 (+2915843us) spinlock_profiling.cc:243] Waited 86.9 ms on lock 0x7b5400391554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:23.394647 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199923968}
I20260709 13:02:23.407658  6294 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.408386  6294 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.413645  6384 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.418015  6126 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.421926  6382 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.424444  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.427917  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.429057  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.430115  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:23.431219  1586 connection.cc:256] RPC call timeout handler was delayed by -1.5132150109999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
I20260709 13:02:23.431142  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.431715  6134 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.432302  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.432469  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.525104  6431 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.433911  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3125) took 3112 ms. Trace:
I20260709 13:02:23.434438  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.563647  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.436416  6302 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:23.444008  1477 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2000 after lost signal to thread 433
W20260709 13:02:23.568960  1477 debug-util.cc:398] Leaking SignalData structure 0x7b0800335320 after lost signal to thread 1480
W20260709 13:02:23.570623  1477 debug-util.cc:398] Leaking SignalData structure 0x7b080032c600 after lost signal to thread 1572
W20260709 13:02:23.570971  1477 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1960 after lost signal to thread 1573
I20260709 13:02:23.446291  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.447655  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.448433  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3126) took 3126 ms. Trace:
I20260709 13:02:23.448698  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.450129  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.451313  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.451521  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:23.574725  1618 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:23.452627  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.452837  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:23.453501  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:23.576875  1622 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:02:23.453847  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.453985  6460 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.454445  6459 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:23.585718  6459 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.588544  6394 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.593458  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.595080  2268 raft_consensus.cc:2368] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:02:23.559527  6404 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.596593  6404 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.593796  6382 consensus_queue.cc:1059] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:02:23.456137  6462 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.599871  6462 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.602506  6462 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.456881  6461 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.603747  6461 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.606145  6461 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.460623  6434 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.461313  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:23.611248  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:02:23.461791  6381 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.462000  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:23.611832  1615 raft_consensus.cc:606] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:23.463580  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:23.469756  6465 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.470106  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.614259  1696 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:23.609180  1586 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:23.472434  6273 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.476370  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:23.484210  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.620509  1691 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:23.488899  6290 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.489324  6280 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.635929  6280 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.636986  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.638034  6280 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.638157  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.490446  6293 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:23.497283  1514 connection.cc:256] RPC call timeout handler was delayed by -2.8615344290000166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
I20260709 13:02:23.497408  6466 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.642357  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.642545  6466 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.643867  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.644136  1543 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
W20260709 13:02:23.639276  1513 connection.cc:256] RPC call timeout handler was delayed by -2.3940218380000147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 13:02:23.645215  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:23.645736  1514 connection.cc:256] RPC call timeout handler was delayed by -2.31247661499998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 13:02:23.645809  6461 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.645673  6280 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.646425  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.618011  6244 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:23.646620  6461 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.646719  6280 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.647116  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.647320  6244 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.648689  6461 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.648929  6280 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.645682  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.650919  6244 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:23.645388  1513 connection.cc:256] RPC call timeout handler was delayed by -2.1843218380000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260709 13:02:23.622475  6465 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.653594  6465 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:23.654749  1621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1943) took 4284 ms (client timeout 2149 ms). Trace:
W20260709 13:02:23.655190  1621 rpcz_store.cc:269] 0709 13:02:19.356127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.356285 (+   158us) service_pool.cc:224] Handling call
0709 13:02:23.640539 (+4284254us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54000d39d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:23.640714 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771122560}
I20260709 13:02:23.622400  6452 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:23.663887  6452 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.501349  6287 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.639592  6439 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.666251  6162 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.666983  6439 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.667356  6162 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.669415  6439 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:23.669610  1661 connection.cc:256] RPC call timeout handler was delayed by -1.6519875560000514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 13:02:23.670029  1661 connection.cc:256] RPC call timeout handler was delayed by -1.2343875560000583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
I20260709 13:02:23.670400  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:02:23.670676  6463 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:02:23.503284  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.671687  6364 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:23.671782  6463 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:23.672399  6463 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:23.672252  6364 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.523715  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3131) took 3177 ms. Trace:
I20260709 13:02:23.673534  6463 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:23.498179  2232 connection.cc:256] RPC call timeout handler was delayed by -1.6772131080000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 13:02:23.519249  1663 connection.cc:256] RPC call timeout handler was delayed by -2.3445043680000595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
I20260709 13:02:23.507207  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.508818  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3129) took 3166 ms. Trace:
I20260709 13:02:23.536645  6360 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.541625  1544 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:23.544875  1545 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:02:23.433341  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.560159  1540 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:23.564296  1690 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:23.565207  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.565721  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.565904  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:23.504982  6416 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.563962  1542 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
W20260709 13:02:23.567082  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.566310  1587 connection.cc:256] RPC call timeout handler was delayed by -3.4667080009999722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
I20260709 13:02:23.578435  2234 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:23.583860  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.567001  6134 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.584759  6460 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.599291  6382 raft_consensus.cc:3055] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:23.607777  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 90158.8us
I20260709 13:02:23.673769  1695 rpcz_store.cc:276] 0709 13:02:20.346144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.346250 (+   106us) service_pool.cc:224] Handling call
0709 13:02:20.346452 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.346626 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:20.429923 (+ 83297us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.496610 (+ 66687us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.247999 (+2751389us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b18000c1de0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a51522 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:02:23.305503 (+ 57504us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:23.523355 (+217852us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.523431 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:23.523491 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.523548 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.523662 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3026493,"prepare.queue_time_us":2890419,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":74,"raft.queue_time_us":3028920,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5491,"spinlock_wait_cycles":21457664,"thread_start_us":123795,"threads_started":2,"wal-append.queue_time_us":534618}
I20260709 13:02:23.698626  1539 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:23.697149  1541 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:23.696391  1546 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.572577  1697 rpcz_store.cc:276] 0709 13:02:20.322001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.322190 (+   189us) service_pool.cc:224] Handling call
0709 13:02:20.353723 (+ 31533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.367813 (+ 14090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.448230 (+3080417us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b5400140d50. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:23.448375 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71648128}
W20260709 13:02:23.610307  1477 debug-util.cc:398] Leaking SignalData structure 0x7b08003aef80 after lost signal to thread 1647
I20260709 13:02:23.613116  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 1982) took 3177 ms. Trace:
W20260709 13:02:23.701071  1477 debug-util.cc:398] Leaking SignalData structure 0x7b08001b2a80 after lost signal to thread 1721
I20260709 13:02:23.700920  1692 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
W20260709 13:02:23.701539  1477 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3d40 after lost signal to thread 1722
I20260709 13:02:23.628506  6367 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.629171  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:23.702654  1696 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.608866  6431 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.615360  6404 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.603122  6462 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:02:23.630059  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:23.632642  6365 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.632727  6302 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.633309  5934 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.633833  6313 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.641537  6381 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:23.651899  1513 connection.cc:256] RPC call timeout handler was delayed by -2.1834218380000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 13:02:23.730957  1513 connection.cc:256] RPC call timeout handler was delayed by -2.15732183800003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
W20260709 13:02:23.731295  1513 connection.cc:256] RPC call timeout handler was delayed by -2.133921837999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:02:23.731572  1513 connection.cc:256] RPC call timeout handler was delayed by -2.1168218380000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 13:02:23.731835  1513 connection.cc:256] RPC call timeout handler was delayed by -2.0709218380000038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 13:02:23.732161  1513 connection.cc:256] RPC call timeout handler was delayed by -1.9836218380000332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
W20260709 13:02:23.732487  1513 connection.cc:256] RPC call timeout handler was delayed by -1.9386218380000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 13:02:23.732887  1513 connection.cc:256] RPC call timeout handler was delayed by -1.9296218380000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
W20260709 13:02:23.733242  1513 connection.cc:256] RPC call timeout handler was delayed by -1.9269218379999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
I20260709 13:02:23.666213  6432 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.669997  6439 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.710592  6293 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:23.532743  6294 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.714147  6462 consensus_queue.cc:1243] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:23.563373  1688 rpcz_store.cc:276] 0709 13:02:20.321230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.321341 (+   111us) service_pool.cc:224] Handling call
0709 13:02:20.321590 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.414882 (+ 93292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.433688 (+3018806us) spinlock_profiling.cc:243] Waited 92.5 ms on lock 0x7b540035cd54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:23.433859 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212661632}
I20260709 13:02:23.526484  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3124) took 3202 ms. Trace:
I20260709 13:02:23.676138  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:23.696298  1663 connection.cc:256] RPC call timeout handler was delayed by -2.2266043680000394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
W20260709 13:02:23.646196  1514 connection.cc:256] RPC call timeout handler was delayed by -2.0775766149999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 13:02:23.696949  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.703814  1477 debug-util.cc:398] Leaking SignalData structure 0x7b08003f60c0 after lost signal to thread 2296
W20260709 13:02:23.746856  1663 connection.cc:256] RPC call timeout handler was delayed by -2.2123552580000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 13:02:23.747587  1477 debug-util.cc:398] Leaking SignalData structure 0x7b0800228a80 after lost signal to thread 2297
I20260709 13:02:23.746619  1689 rpcz_store.cc:276] 0709 13:02:20.320486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.320613 (+   127us) service_pool.cc:224] Handling call
0709 13:02:20.323843 (+  3230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.324195 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.324224 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.332797 (+  8573us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.458618 (+125821us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:20.493353 (+ 34735us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.522825 (+3029472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.522946 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.523020 (+    74us) raft_consensus.cc:1685] finished
0709 13:02:23.523039 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.523220 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3036663,"prepare.queue_time_us":34752,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":3044602,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":6967,"thread_start_us":125539,"threads_started":2,"wal-append.queue_time_us":114183,"wal-append.run_cpu_time_us":2632,"wal-append.run_wall_time_us":1027360}
W20260709 13:02:23.748425  1477 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9aa0 after lost signal to thread 6362
W20260709 13:02:23.698769  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 120413us
I20260709 13:02:23.735468  6367 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.750399  6431 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:23.750876  6367 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.700405  1694 rpcz_store.cc:276] 0709 13:02:20.435802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.447071 (+ 11269us) service_pool.cc:224] Handling call
0709 13:02:20.462999 (+ 15928us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:20.468955 (+  5956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.468985 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:20.471841 (+  2856us) log.cc:844] Serialized 52 byte log entry
0709 13:02:22.241894 (+1770053us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:22.243151 (+  1257us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.612826 (+1369675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.612907 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.612947 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:23.612957 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.613065 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1373697,"prepare.queue_time_us":1961,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":73,"raft.queue_time_us":1373410,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":12191,"thread_start_us":1769442,"threads_started":2,"wal-append.queue_time_us":641479,"wal-append.run_cpu_time_us":3259,"wal-append.run_wall_time_us":2126637}
I20260709 13:02:23.739467  6439 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.752123  6381 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.753263  6439 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.730412  6302 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.713068  1547 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.675179  6364 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:23.664402  6452 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:23.755892  6302 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:23.675308  6463 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:23.761750  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33072 (request call id 135) took 25677 ms (client timeout 15000 ms). Trace:
I20260709 13:02:23.645303  6466 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:23.734763  1546 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:23.724687  6365 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.764600  6460 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.765641  6365 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:23.765847  6459 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:23.730198  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 189929us
I20260709 13:02:23.670996  1619 raft_consensus.cc:606] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:23.705152  6437 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.738252  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:23.772611  1539 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.705056  6382 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:23.625223  6273 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.709966  6244 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.511128  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:23.776722  1587 connection.cc:256] RPC call timeout handler was delayed by -3.1985080009999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
I20260709 13:02:23.618463  6434 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.696776  1693 rpcz_store.cc:276] 0709 13:02:20.342087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.342727 (+   640us) service_pool.cc:224] Handling call
0709 13:02:20.348100 (+  5373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.451328 (+103228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.508568 (+3057240us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400128ed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:23.508756 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236237184}
I20260709 13:02:23.748174  6432 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.767601  1619 raft_consensus.cc:614] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:23.769162  1514 connection.cc:256] RPC call timeout handler was delayed by -1.9452766150000116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 13:02:23.705425  6360 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:23.778970  1514 connection.cc:256] RPC call timeout handler was delayed by -1.7661766150000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 13:02:23.779624  1514 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:23.781473  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:23.782948  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:23.774602  2234 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:23.771790  1513 leader_election.cc:400] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:02:23.784519  1513 leader_election.cc:403] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:23.743937  6162 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:23.746426  6293 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:02:23.796676  1662 connection.cc:256] RPC call timeout handler was delayed by -1.7207456419999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 13:02:23.762251  1443 rpcz_store.cc:269] 0709 13:01:58.084383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.084792 (+   409us) service_pool.cc:224] Handling call
0709 13:02:23.761658 (+25676866us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:19.240154 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:19.252181 (+ 12027us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:19.252236 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:02:19.252254 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:19.341578 (+ 89324us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:19.341668 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:19.341694 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:02:19.342481 (+   787us) tablet.cc:701] Row locks acquired
0709 13:02:19.342536 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:02:19.342701 (+   165us) write_op.cc:270] Start()
0709 13:02:19.342845 (+   144us) write_op.cc:276] Timestamp: P: 1783602139342639 usec, L: 0
0709 13:02:19.342864 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:02:19.490512 (+147648us) log.cc:844] Serialized 3218 byte log entry
0709 13:02:20.312734 (+822222us) op_driver.cc:464] REPLICATION: finished
0709 13:02:20.491814 (+179080us) write_op.cc:301] APPLY: starting
0709 13:02:20.846052 (+354238us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:21.811762 (+965710us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:21.811923 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:22.088070 (+276147us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:22.088527 (+   457us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:02:22.088595 (+    68us) write_op.cc:312] APPLY: finished
0709 13:02:22.089043 (+   448us) log.cc:844] Serialized 81 byte log entry
0709 13:02:22.096234 (+  7191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:22.096356 (+   122us) write_op.cc:454] Released schema lock
0709 13:02:22.096422 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:22.096906 (+   484us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:22.096933 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":14361,"mutex_wait_us":804607,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":141948,"apply.run_cpu_time_us":16826,"apply.run_wall_time_us":1619594,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37599,"num_ops":8,"prepare.queue_time_us":258985,"prepare.run_cpu_time_us":18743,"prepare.run_wall_time_us":536247,"raft.queue_time_us":329983,"raft.run_cpu_time_us":40738,"raft.run_wall_time_us":146502,"replication_time_us":943693,"thread_start_us":610233,"threads_started":5,"wal-append.queue_time_us":245570,"wal-append.run_cpu_time_us":38754,"wal-append.run_wall_time_us":2419624}]]}
W20260709 13:02:23.801162  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 129870us
I20260709 13:02:23.801999  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.803436  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.804905  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:23.805609  1546 raft_consensus.cc:2393] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 9: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:23.804551  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:23.734416  6313 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.808739  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.810714  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.734838  5934 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.776714  6367 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.812343  2269 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:23.818492  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.812704  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.814345  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.815153  1513 leader_election.cc:400] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:02:23.819949  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.820509  1541 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:23.710521  6416 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.780244  6439 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.797405  6459 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:23.798398  6381 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:23.821768  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.779241  6431 consensus_queue.cc:1048] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:02:23.824422  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.792546  6294 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:23.828229  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.801334  6384 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:23.859371  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.829684  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:23.822345  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.828547  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.853788  2231 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:23.860937  1543 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:23.806967  6293 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:23.801834  6134 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:23.821694  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:23.810611  6139 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.858727  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.777092  6437 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.852699  6459 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.811864  6162 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.852880  1542 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
I20260709 13:02:23.879523  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.780592  6244 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:23.834550  1539 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:23.855233  6381 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.865458  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.905956  1688 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:23.865826  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.906953  1695 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:23.907124  1547 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:23.866317  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.862679  6384 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:23.868207  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.869426  1544 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:23.869339  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:23.858831  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:23.864595  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:23.915791  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 46540.7us
I20260709 13:02:23.916410  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.917042  1693 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:23.917941  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.918376  1693 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:23.919704  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.879866  6290 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:23.907857  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:23.904954  6459 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.904201  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.911638  1697 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:23.867385  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.926501  1690 raft_consensus.cc:2410] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:23.913419  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.927132  1694 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:23.829943  6367 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.852164  6439 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.926429  1689 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 7.
W20260709 13:02:23.921775  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 98563.5us
I20260709 13:02:23.921430  1693 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:02:23.870805  1446 catalog_manager.cc:5697] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 5 to 7, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 7 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.866050  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.923254  1695 raft_consensus.cc:2368] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13.
I20260709 13:02:23.923906  1663 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:23.923720  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 170398us
I20260709 13:02:23.881587  6098 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:23.912775  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:23.932610  1688 raft_consensus.cc:2376] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15. Re-sending same reply.
I20260709 13:02:23.909546  6381 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:23.904198  6460 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:02:23.935199  1446 catalog_manager.cc:5697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 5 to 8, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 8 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:23.932863  1663 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:23.828888  6382 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.943439  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.925230  6290 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:23.944583  1695 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:23.880009  6139 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:23.946257  2231 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:24.030447  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 84264us
I20260709 13:02:24.031388  2231 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:23.940752  6431 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:23.921546  5877 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:24.026587  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.050859  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.910400  6162 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.033716  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:23.920498  6384 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:24.098057  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 167965us
I20260709 13:02:24.075524  5877 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:24.103955  5877 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:23.934475  6134 consensus_queue.cc:1059] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 13:02:24.026891  6290 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:24.110930  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:24.162956  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 359502us
I20260709 13:02:24.161478  1695 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
W20260709 13:02:24.163537  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 222401us
I20260709 13:02:23.974171  6471 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:24.174624  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.180675  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:23.944103  6098 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.225456  6367 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:24.227087  6098 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:24.230727  6459 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.182835  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.286101  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.287148  6459 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.287704  1540 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:24.181708  1662 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:24.183774  6476 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:24.185111  6086 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:24.287236  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.289703  6086 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.290570  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.291282  1688 raft_consensus.cc:2376] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10. Re-sending same reply.
I20260709 13:02:24.291886  6086 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.193917  6134 raft_consensus.cc:3055] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:24.194857  6434 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.201004  6162 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:24.292558  6134 raft_consensus.cc:740] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:24.202013  6244 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:24.188566  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 89785us
I20260709 13:02:24.207274  6139 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.209566  6432 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:24.215905  6416 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.217643  6452 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.218714  6313 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:24.219907  6439 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:24.098333  6096 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:24.293449  6134 consensus_queue.cc:260] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.294154  6096 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:24.294605  6096 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.294682  6134 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.295117  6452 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.289721  6367 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:24.296762  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 265437us
I20260709 13:02:24.297513  2231 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:24.222183  6382 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:24.223356  6437 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:24.224972  6471 raft_consensus.cc:697] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:24.307250  6471 consensus_queue.cc:237] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.233554  5877 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.089228  6475 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:24.237151  1446 catalog_manager.cc:5697] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 8 to 9, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 9 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.239343  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.314154  1697 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:24.315026  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.315026  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:24.316316  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.317569  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.318821  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.240357  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.241231  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.241348  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.241854  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.243201  1690 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:24.248636  6381 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.324227  6476 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:24.324599  1693 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:24.324689  6476 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:24.325572  6476 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.326808  6476 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:24.326840  1446 catalog_manager.cc:5697] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 6 to 7, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 7 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.328208  1689 raft_consensus.cc:2393] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:02:24.252645  1696 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
I20260709 13:02:24.329221  1586 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:24.248690  6479 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:24.279248  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.281596  6384 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.183370  6273 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:24.290030  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 110706us
I20260709 13:02:24.202675  5934 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:24.293327  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.322825  1691 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:24.250222  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.329483  1696 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:24.260802  6360 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:24.333470  1586 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:24.336146  1694 raft_consensus.cc:2393] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:02:24.341424  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.342362  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:24.345366  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.000s	sys 0.012s
W20260709 13:02:24.345774  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.000s	sys 0.012s
W20260709 13:02:24.346115  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 530723us
W20260709 13:02:24.348416  1587 connection.cc:256] RPC call timeout handler was delayed by -3.162508000999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 13:02:24.348583  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.348978  1587 connection.cc:256] RPC call timeout handler was delayed by -3.0482080009999777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
W20260709 13:02:24.349351  1587 connection.cc:256] RPC call timeout handler was delayed by -3.0140080009999792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 13:02:24.349721  1587 connection.cc:256] RPC call timeout handler was delayed by -2.9474080009999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
W20260709 13:02:24.350069  1587 connection.cc:256] RPC call timeout handler was delayed by -2.8687188959999617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 13:02:24.350399  1587 connection.cc:256] RPC call timeout handler was delayed by -2.5024188959999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
I20260709 13:02:24.346921  1661 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:24.353550  2268 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:24.353828  1661 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:24.336330  6479 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:24.340029  6134 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:24.358780  1623 raft_consensus.cc:1275] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:02:24.358141  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 60688.6us
I20260709 13:02:24.358592  1586 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:24.365006  2231 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:24.340351  6470 raft_consensus.cc:2764] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:24.372452  1586 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:24.359004  6452 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:24.328030  6475 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.337534  6139 consensus_queue.cc:1059] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:02:24.363504  5934 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:24.387905  5934 raft_consensus.cc:697] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:24.388815  5934 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.375496  6452 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.376578  6086 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:24.391139  6086 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.391671  6086 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.356490  6293 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.391093  6452 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.363379  6409 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:24.377792  6487 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:24.387084  6408 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:24.371753  6290 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.401396  6489 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:02:24.402176  6290 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.402245  6480 raft_consensus.cc:3055] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:24.402787  6480 raft_consensus.cc:740] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:24.404150  6293 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:24.404053  6086 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.405014  2265 raft_consensus.cc:1240] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:24.406291  6086 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.406643  5877 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.378876  1586 leader_election.cc:400] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13.
I20260709 13:02:24.409693  1586 leader_election.cc:403] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:24.357663  6481 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.359614  6479 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:24.440267  6481 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.442791  6481 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.396265  2231 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:24.443913  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 47733.9us
I20260709 13:02:24.448498  6398 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:24.396999  6487 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.397856  6408 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:24.395640  6409 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:24.449183  6408 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:24.449337  6398 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:24.449856  6409 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:24.450592  6398 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.363204  6134 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.454218  6134 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.404942  6475 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:24.357213  6360 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:24.402498  6489 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:24.455839  6489 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:02:24.456449  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.456830  6489 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.458129  6489 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:24.449123  6487 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:24.470057  6408 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.420825  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.470337  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:24.472167  6408 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.473965  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.474793  1688 raft_consensus.cc:2376] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 11. Re-sending same reply.
I20260709 13:02:24.424887  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.476179  1695 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.425191  2268 consensus_queue.cc:237] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.491995  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:24.493331  6479 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.427783  6452 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.518741  6452 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.519039  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:24.430056  6384 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:24.435006  6462 consensus_queue.cc:1059] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:24.436185  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.520399  6489 raft_consensus.cc:3055] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:24.520614  1694 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:24.520814  6489 raft_consensus.cc:740] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:24.521759  6489 consensus_queue.cc:260] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:24.522773  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 110228us
I20260709 13:02:24.522910  6489 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.523672  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.524268  1621 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:24.525184  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.527243  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:24.410121  6096 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.447818  6098 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:24.455713  6360 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.417438  6139 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13.
I20260709 13:02:24.404842  6480 consensus_queue.cc:260] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.409633  6381 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:24.459787  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.461709  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.462217  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:24.544457  1696 raft_consensus.cc:2410] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 16 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:02:24.462981  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.423851  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.545403  1693 raft_consensus.cc:2368] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10.
I20260709 13:02:24.498535  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:24.499914  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:24.500953  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:24.504248  1615 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:24.505797  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.547112  1617 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:24.506002  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.505932  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.546787  1661 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:24.548450  1623 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:24.548918  1661 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:24.515632  6409 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.552832  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:24.534430  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 358839us
I20260709 13:02:24.541445  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.555368  1690 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:24.542598  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 59611.3us
I20260709 13:02:24.549538  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.560788  1615 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:24.560798  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:24.563134  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.563592  1694 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:02:24.564406  1618 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:24.565194  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:24.566916  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.567654  1623 raft_consensus.cc:2393] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:24.568224  1540 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:24.568400  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.569100  1617 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 12: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:24.550141  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.570943  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.571521  1615 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:02:24.576223  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.577109  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:24.579738  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.580358  1692 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.540580  6360 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:24.582769  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.584764  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.584342  1588 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:24.491192  6487 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.593381  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.589774  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:24.590440  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:24.597124  1540 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:24.559749  6437 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:24.568993  6475 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:24.599174  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.602329  2272 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:24.605016  1691 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:24.599785  2270 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:24.609917  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.548516  6134 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.621651  1621 raft_consensus.cc:2393] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:24.622705  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.624372  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.611357  1690 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:24.625819  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.626353  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:24.615959  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.619966  1586 leader_election.cc:400] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10.
I20260709 13:02:24.627056  1586 leader_election.cc:403] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:24.620976  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:24.629884  2267 raft_consensus.cc:1240] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:24.632083  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.633131  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.633663  1692 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:24.635087  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.604002  6471 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.638391  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:24.640055  1688 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:24.641319  1688 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:24.642488  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:24.639724  6471 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.601926  6476 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:24.648106  6479 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.601616  6096 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.600616  6475 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:24.656332  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 49006us
I20260709 13:02:24.658088  1616 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:24.604463  6382 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:02:24.664619  1618 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 12: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:24.669126  1539 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:24.672470  1694 pending_rounds.cc:85] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 4
I20260709 13:02:24.672811  1694 pending_rounds.cc:107] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:24.673048  1694 raft_consensus.cc:2889] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:24.673578  1619 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:24.675344  6480 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:24.677784  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.678187  6134 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.680222  2232 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:24.612198  6437 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:24.682775  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.685210  2231 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:24.685900  6484 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.691393  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.692009  1691 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:24.689464  1695 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:24.692812  1547 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:24.692967  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.693480  1688 raft_consensus.cc:1240] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:24.664090  6475 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.693584  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:24.696903  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:24.695329  1586 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:24.697196  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:24.698215  1586 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:24.699647  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.690706  5934 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.694077  6370 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:24.700819  1615 raft_consensus.cc:2410] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:24.701079  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:24.709695  1544 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
I20260709 13:02:24.709116  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.708242  1614 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:24.708740  1586 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:24.701347  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:24.712397  1623 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:24.715890  6437 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.707942  6250 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:24.718148  1544 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:24.708773  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.720651  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:24.722805  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.723310  1614 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:24.724303  1692 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:24.702432  6487 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.734390  1692 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:24.735466  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.735436  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:24.737082  1691 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:24.737257  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:24.737799  1697 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:24.732949  1587 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:24.738665  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:24.739342  1690 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:24.726413  6293 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:24.725340  6370 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:24.745165  6370 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.731827  5877 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:02:24.701116  5934 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.751338  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:24.759644  6096 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:24.761513  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.763608  2234 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:24.765718  6482 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:24.766757  6293 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:24.703167  6409 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:24.767800  6293 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:24.743649  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:24.768339  1623 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:24.771101  6487 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:24.773579  2234 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:24.773694  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:24.776954  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:24.780946  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.787966  1623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cecec9af1f82495390a4640f3927241f"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:37742
W20260709 13:02:24.788585  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.780743  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:24.788971  1623 raft_consensus.cc:606] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:24.791571  1623 raft_consensus.cc:614] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:24.726257  6463 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:24.794916  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 62051.6us
I20260709 13:02:24.783131  1614 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:24.797989  2234 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:24.805161  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:24.731851  6250 raft_consensus.cc:697] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:24.810549  1690 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:24.804276  6487 raft_consensus.cc:697] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:24.816568  1587 leader_election.cc:400] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13.
I20260709 13:02:24.816915  1587 leader_election.cc:403] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:24.817559  6487 consensus_queue.cc:237] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.822860  6484 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 9. Current term is 10.
I20260709 13:02:24.824054  1616 raft_consensus.cc:2410] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:24.829698  6483 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:24.830543  2268 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:24.832000  2267 raft_consensus.cc:1240] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:24.803823  6382 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:24.837246  1587 leader_election.cc:400] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 13. Current term is 14.
I20260709 13:02:24.841807  1587 leader_election.cc:403] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:24.837957  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:24.838603  2234 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:24.807124  6419 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:24.844448  1587 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:24.845965  2234 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:24.842468  1544 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:24.814558  6463 raft_consensus.cc:697] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:24.848553  2234 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:24.887917  2271 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:24.815034  6086 consensus_queue.cc:1059] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:02:24.890453  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:24.836256  6098 consensus_queue.cc:1059] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:02:24.892171  1544 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:02:24.847096  6394 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:24.814873  6139 consensus_queue.cc:1059] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:02:24.911098  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:24.877807  6382 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:24.843873  6477 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13.
I20260709 13:02:24.851842  6126 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:24.933437  6500 log.cc:927] Time spent T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:02:24.898857  6471 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:24.847586  6492 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 13. Current term is 14.
W20260709 13:02:24.895176  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 46724.3us
I20260709 13:02:24.848232  6484 consensus_queue.cc:1059] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:02:24.852747  6481 consensus_queue.cc:1059] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:02:24.936113  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:24.901707  6479 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:24.939970  2234 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:24.942102  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:24.937366  6098 raft_consensus.cc:3055] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:02:24.949754  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 105391us
I20260709 13:02:24.952971  1620 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:24.960382  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:24.947701  6501 log.cc:927] Time spent T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:02:24.962616  1587 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:24.904142  6250 consensus_queue.cc:237] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.976523  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:24.948225  6479 raft_consensus.cc:697] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:24.958847  6434 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:24.979399  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:24.959003  6098 raft_consensus.cc:740] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:24.958582  6381 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:24.982337  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:24.941694  6463 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:24.988602  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:25.000679  1544 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:24.977471  6492 consensus_queue.cc:1059] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:02:24.977823  6475 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:25.017046  6475 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:25.018235  6479 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.005393  6484 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:02:24.978240  6481 consensus_queue.cc:1059] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:02:25.010238  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:25.011341  1511 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:25.009859  6098 consensus_queue.cc:260] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.021370  6484 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:25.022262  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:25.030110  1544 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:25.029351  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:24.986146  6381 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:25.004611  6139 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:25.003227  6509 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.028110  6462 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:25.047693  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:02:25.050421  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 65688.1us
I20260709 13:02:25.029619  6086 raft_consensus.cc:3055] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:25.043126  6139 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:25.055976  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.055892  1587 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:25.049254  6462 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:25.052426  6086 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:25.055295  6512 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:25.057693  6484 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.062669  6509 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:25.088588  6509 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:25.089058  6509 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.063077  6515 raft_consensus.cc:3055] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:25.091627  6515 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:25.092710  6381 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:25.092506  6515 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:25.057821  6139 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.093690  6515 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:25.066095  1587 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:25.073365  6452 raft_consensus.cc:3055] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:25.086611  6484 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:25.097592  6452 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:25.097740  6484 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.093477  6381 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:25.099941  1587 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:25.053452  6360 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:25.105942  6360 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:25.105728  6452 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.107733  1696 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:25.107399  6086 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:25.108445  6492 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.108810  6086 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.108901  6492 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:25.109552  6492 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.110226  6139 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.112319  6382 raft_consensus.cc:3055] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:25.112572  6139 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:25.112733  6382 raft_consensus.cc:740] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:25.113673  6382 consensus_queue.cc:260] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.068800  6462 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.127638  1587 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:25.129195  1587 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:25.130119  6512 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:25.130592  6512 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:25.131062  6512 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.135812  6477 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:25.136556  6477 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:25.137084  6477 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.144326  1587 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:25.154060  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 124708us
I20260709 13:02:25.157650  1587 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:25.154909  1511 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:25.152771  6139 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:25.176875  1587 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:25.179570  1511 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:25.181281  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:25.169088  6221 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.175659  6382 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.186769  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:25.178455  6250 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:25.184032  6514 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:25.190832  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.191151  6514 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.191584  6514 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.178361  6139 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:25.196410  6139 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.184183  6520 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:25.184319  6381 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:25.201289  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.201313  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.202157  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.203388  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.204887  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.206882  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.207356  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.207504  1618 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:25.208206  1619 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:25.209154  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.209100  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.211459  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.213096  5934 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:25.213239  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.213375  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.213923  1621 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:25.214702  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.215740  6523 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.215864  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.216584  6523 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.216717  1614 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:25.217617  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.218532  6462 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:25.218746  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.219918  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.220795  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.221956  1618 raft_consensus.cc:1240] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:25.190860  6250 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:25.228124  6250 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:25.186112  6437 consensus_queue.cc:1048] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:02:25.207214  6381 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:25.231909  6381 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.235743  6480 raft_consensus.cc:3055] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:25.236291  6480 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:25.237087  6480 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:25.239106  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.239523  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.218766  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.235670  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.244443  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.245512  1615 raft_consensus.cc:2393] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:25.248320  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.249637  6509 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:25.250236  6462 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:25.252418  1622 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:25.257025  1586 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:25.261252  1623 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:25.263618  1623 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:25.251798  6509 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:25.271260  1614 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:25.274448  6520 raft_consensus.cc:697] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:25.276899  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.274595  1617 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:25.279417  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.282155  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.283231  1623 raft_consensus.cc:2410] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:25.287889  1616 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:25.287994  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.290391  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:25.290763  6525 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:02:25.296094  6398 raft_consensus.cc:2955] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 4 to 8, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:25.270233  6514 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:25.304759  6514 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:25.305975  1540 raft_consensus.cc:2955] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 4 to 8, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:25.306566  6381 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.309674  6492 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.270531  6139 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.313511  6381 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:25.313796  6139 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:25.289402  6511 consensus_queue.cc:1059] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:02:25.320874  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:25.268708  6484 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.324759  6512 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:25.327059  6512 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:25.270102  6476 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:02:25.328348  6476 raft_consensus.cc:3055] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:25.328719  6476 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:25.328867  6452 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:25.329604  6476 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.330753  6476 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.331456  1432 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 953db44baef24f55a28e65ff051866d1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:25.333359  6134 raft_consensus.cc:3055] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:25.333752  6134 raft_consensus.cc:740] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:25.334548  6480 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.334524  6134 consensus_queue.cc:260] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.336561  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:25.337317  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:25.338613  1617 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 13: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:25.276463  6463 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:25.339826  1694 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:25.341820  1620 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:25.341723  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:25.345269  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:25.350703  1622 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:25.356021  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:25.374198  2271 raft_consensus.cc:1240] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:25.376461  1614 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:25.355885  6134 raft_consensus.cc:3060] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.319005  6477 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:25.384215  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.362614  6463 raft_consensus.cc:697] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:25.397819  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.275630  6520 consensus_queue.cc:237] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:25.398680  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 213182us
W20260709 13:02:25.401949  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 215220us
I20260709 13:02:25.402958  1511 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:25.403465  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.404539  1618 raft_consensus.cc:2393] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:25.406375  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:25.406648  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.407544  1621 raft_consensus.cc:2393] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:25.410044  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.400799  1663 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:25.413765  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:25.414889  1511 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:25.447664  1614 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:25.449972  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.451063  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.405686  6381 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.452242  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.453020  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.461069  1614 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:25.454056  1511 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:25.456907  1540 raft_consensus.cc:1240] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:25.461580  1622 raft_consensus.cc:1240] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:25.461642  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.462504  1621 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:25.468492  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.463256  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.488631  1691 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:25.490391  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.468484  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:25.492471  1663 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:25.413633  6492 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:25.489722  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.492762  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:25.494517  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:25.403015  6437 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:02:25.496191  1616 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:25.408227  6462 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:02:25.500475  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.498466  1614 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:25.497922  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:25.452267  6489 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.455273  6360 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:25.504568  1618 raft_consensus.cc:2376] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10. Re-sending same reply.
I20260709 13:02:25.510887  2271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:25.502651  1621 raft_consensus.cc:2393] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:25.505903  1696 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:02:25.464898  6523 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:25.508774  1663 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:25.502596  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.521667  1616 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:25.493455  6381 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.519960  1617 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:25.511755  2271 raft_consensus.cc:606] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:25.409765  6528 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 13:02:25.519079  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:25.524694  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:25.526988  1619 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.527711  1614 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:25.507278  6462 consensus_queue.cc:1243] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:25.499361  5934 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:25.507515  6475 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:25.516233  6098 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.503803  6367 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:25.499181  6530 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.495379  6384 consensus_queue.cc:1059] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:02:25.517652  6360 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:25.520893  6484 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:25.561486  6477 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:25.574702  1618 raft_consensus.cc:1240] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:25.576964  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 68251.8us
I20260709 13:02:25.489831  6463 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:25.578291  1616 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:25.578933  2231 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:25.579320  1663 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:25.554560  6367 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:25.563226  5934 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:25.581408  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 93425.1us
I20260709 13:02:25.579903  1619 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:25.565598  6360 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:25.586409  1695 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:25.534574  6408 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:02:25.555020  6512 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:02:25.523175  6533 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.059s
W20260709 13:02:25.644747  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 60956.6us
I20260709 13:02:25.639479  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:25.645742  1694 raft_consensus.cc:2368] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:25.641189  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:25.646538  1697 raft_consensus.cc:2393] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:25.641515  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:25.550096  6489 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:02:25.644793  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 59249.9us
I20260709 13:02:25.647061  1690 raft_consensus.cc:2368] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:25.650710  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:25.582970  6367 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:25.650063  6096 raft_consensus.cc:2804] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:25.666496  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:25.673007  6250 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:25.674750  6529 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:02:25.677568  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.680735  6536 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:02:25.626986  6381 consensus_queue.cc:1059] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:02:25.687237  6520 raft_consensus.cc:3055] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:25.701498  6520 raft_consensus.cc:740] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:25.702364  6520 consensus_queue.cc:260] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:25.703557  6520 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:25.709445  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61889.8us
I20260709 13:02:25.650342  6533 consensus_queue.cc:1243] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:02:25.713171  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 124109us
W20260709 13:02:25.710340  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 58448us
I20260709 13:02:25.626847  6530 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:25.729050  1621 raft_consensus.cc:1240] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:25.729446  1619 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 13:02:25.640266  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.712102  1623 raft_consensus.cc:1240] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:25.711592  6398 consensus_queue.cc:1059] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:02:25.717204  6096 raft_consensus.cc:697] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:25.754259  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:25.755077  1544 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
W20260709 13:02:25.716818  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 130911us
I20260709 13:02:25.720146  6384 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:25.750916  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:25.758374  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:25.759092  1544 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.759482  1547 raft_consensus.cc:2410] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:25.751539  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:25.751964  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:25.761803  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:25.762657  1540 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:25.766079  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:25.776801  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.776940  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:25.777875  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:25.777865  1547 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.657462  5934 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:02:25.791675  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:25.789463  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:25.794207  6408 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:25.789887  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:25.798842  1543 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:25.788774  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 69474.5us
I20260709 13:02:25.797837  1615 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:02:25.796627  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:25.801707  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:25.788914  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:25.793994  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:25.802517  1546 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:25.804924  1661 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:25.806209  1511 leader_election.cc:400] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:25.806663  1511 leader_election.cc:403] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:25.787791  6537 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.810895  1539 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:02:25.811383  1540 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:25.812171  1661 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:25.812922  1620 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:25.815482  1547 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:25.797112  5934 consensus_queue.cc:1243] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:25.823869  1545 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:25.824103  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:25.802364  6311 consensus_queue.cc:1059] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:02:25.834714  6311 raft_consensus.cc:3055] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:25.824658  6437 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:25.835112  6311 raft_consensus.cc:740] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:25.835705  6437 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.838912  6096 consensus_queue.cc:237] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.836199  6311 consensus_queue.cc:260] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.853299  6311 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.820700  6470 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:25.866466  6538 log.cc:927] Time spent T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:02:25.822815  6489 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
W20260709 13:02:25.872798  6534 log.cc:927] Time spent T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.239s	user 0.003s	sys 0.002s
I20260709 13:02:25.880077  1543 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:25.890206  1544 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 8.
I20260709 13:02:25.891166  1696 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:02:25.889075  1546 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:25.823063  6537 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.907546  6537 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:25.912936  6537 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:25.923065  6530 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:25.923920  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:25.923928  6530 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.927176  6530 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:25.942315  1514 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:25.944530  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:25.946784  6126 raft_consensus.cc:3055] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:25.949371  6383 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:25.949659  6126 raft_consensus.cc:740] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:25.953780  6489 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:25.955830  6126 consensus_queue.cc:260] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.957224  1514 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:25.956094  6483 raft_consensus.cc:3055] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:25.958247  6483 raft_consensus.cc:740] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:25.958451  6528 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:25.959062  6483 consensus_queue.cc:260] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:25.960284  6528 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:25.961848  6545 log.cc:927] Time spent T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:02:25.947062  6537 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:25.972270  1544 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:25.973635  1541 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:02:25.976349  1542 raft_consensus.cc:2410] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:25.976464  1545 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:25.952091  6367 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:25.987004  6367 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:25.987684  1688 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:25.950977  6398 consensus_queue.cc:1059] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:02:25.974267  6250 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:26.007222  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 190778us
I20260709 13:02:26.031047  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:26.034720  1511 leader_election.cc:400] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:26.036594  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:26.038142  1690 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:26.037763  1511 leader_election.cc:403] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:26.040895  1692 raft_consensus.cc:1217] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Deduplicated request from leader. Original: 5.2->[6.3-10.5]   Dedup: 6.3->[8.4-10.5]
I20260709 13:02:26.038961  1514 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.010028  1623 raft_consensus.cc:1240] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:26.042604  1514 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.048066  1511 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:26.041458  1692 pending_rounds.cc:85] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 3
I20260709 13:02:26.050443  1692 pending_rounds.cc:107] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:02:26.050746  1692 raft_consensus.cc:2889] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:26.052450  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:26.047199  1663 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:26.040603  6542 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:26.056169  6542 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:26.058178  6126 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.060140  6489 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:26.068100  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:26.068449  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:26.070181  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:26.071287  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:26.071964  1543 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:26.072804  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:26.076304  1663 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:26.077332  1663 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:26.045058  6523 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:26.047060  6533 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.127887  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:26.129364  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:26.133811  1587 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.131194  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:26.131142  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:26.134909  1619 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:26.135612  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:26.102301  6383 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:02:26.091615  6537 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.095666  6471 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:26.102136  6541 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:26.139189  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:26.161216  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:26.164603  1623 raft_consensus.cc:2376] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10. Re-sending same reply.
I20260709 13:02:26.165259  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:26.096105  6528 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:26.139894  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:26.168481  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:26.169531  1618 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 13: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:26.126827  6367 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:26.091909  6408 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.068s
W20260709 13:02:26.164114  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 340074us
I20260709 13:02:26.051275  6360 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:26.173480  1661 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:26.094496  6530 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 13:02:26.170536  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 126680us
I20260709 13:02:26.162048  6520 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.102873  6475 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:02:26.137244  6547 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:02:26.095022  6381 consensus_queue.cc:1059] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:02:26.159616  6134 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:26.168717  6528 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.166508  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.168722  6512 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:26.163540  6471 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.168462  6250 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:26.206008  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 67871.6us
W20260709 13:02:26.140893  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 98375.2us
I20260709 13:02:26.213783  1689 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:26.203137  1661 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:26.173269  6541 raft_consensus.cc:697] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:26.229312  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.206559  6437 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.213356  6134 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.160539  6533 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:26.223452  6528 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.226641  6476 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.226853  6471 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:26.248307  1446 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52808 (request call id 201) took 35495 ms (client timeout 15000 ms). Trace:
I20260709 13:02:26.208702  6523 consensus_queue.cc:1059] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:02:26.242396  6381 consensus_queue.cc:1243] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:26.236141  6480 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:26.246160  6134 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.244067  6096 consensus_queue.cc:1059] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:02:26.259618  6530 raft_consensus.cc:2764] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:26.240479  6250 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:26.249245  1446 rpcz_store.cc:269] 0709 13:01:50.748749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.748999 (+   250us) service_pool.cc:224] Handling call
0709 13:02:26.244357 (+35495358us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:24.628751 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:24.629312 (+   561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:24.629352 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:02:24.629369 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:24.679702 (+ 50333us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:24.679782 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:24.679811 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:02:24.680201 (+   390us) tablet.cc:701] Row locks acquired
0709 13:02:24.680218 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:02:24.680352 (+   134us) write_op.cc:270] Start()
0709 13:02:24.680463 (+   111us) write_op.cc:276] Timestamp: P: 1783602144680310 usec, L: 0
0709 13:02:24.680488 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:02:24.730481 (+ 49993us) log.cc:844] Serialized 1706 byte log entry
0709 13:02:25.117833 (+387352us) op_driver.cc:464] REPLICATION: finished
0709 13:02:25.443474 (+325641us) write_op.cc:301] APPLY: starting
0709 13:02:25.443599 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:25.446803 (+  3204us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:25.446899 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:25.634977 (+188078us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:25.635219 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:02:25.635270 (+    51us) write_op.cc:312] APPLY: finished
0709 13:02:25.682624 (+ 47354us) log.cc:844] Serialized 49 byte log entry
0709 13:02:25.682845 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:25.682971 (+   126us) write_op.cc:454] Released schema lock
0709 13:02:25.683035 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:25.683613 (+   578us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:25.683661 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46543,"reported_tablets":42,"spinlock_wait_cycles":10112,"child_traces":[["op",{"apply.queue_time_us":325301,"apply.run_cpu_time_us":9097,"apply.run_wall_time_us":240121,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20863,"num_ops":4,"prepare.queue_time_us":122396,"prepare.run_cpu_time_us":38057,"prepare.run_wall_time_us":347997,"raft.queue_time_us":99645,"raft.run_cpu_time_us":25426,"raft.run_wall_time_us":229363,"replication_time_us":437167,"thread_start_us":515493,"threads_started":4,"wal-append.queue_time_us":270958}]]}
I20260709 13:02:26.261164  6462 consensus_queue.cc:1059] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:02:26.258476  6476 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:26.262666  6520 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:02:26.305187  1616 raft_consensus.cc:1240] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:26.305847  6549 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 13:02:26.306640  6557 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:02:26.307476  6553 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:02:26.311323  6559 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:26.310588  6563 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:02:26.331640  1616 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
W20260709 13:02:26.357286  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 317682us
I20260709 13:02:26.363551  6560 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:26.364558   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:26.364887  6542 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:26.366014  6558 log.cc:927] Time spent T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:26.366539   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:26.368126  6476 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:26.370446  6250 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:26.373140  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 206697us
I20260709 13:02:26.375288  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:26.282074  6541 consensus_queue.cc:237] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:26.377249  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:26.382797  2265 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:26.384193  1662 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:26.385159  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:26.401944  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:26.330490  6567 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.404945  1587 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.406765  2271 raft_consensus.cc:2393] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
W20260709 13:02:26.360875  6311 consensus_meta.cc:287] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.005s
W20260709 13:02:26.412650  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 211591us
I20260709 13:02:26.414664  1661 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:26.430878  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:26.432478  1661 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:26.327979  6550 consensus_queue.cc:1059] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:02:26.439066  1587 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.447389  6512 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.446838  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:26.448426  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.357575  6360 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:26.362838  6470 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.409785  6476 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.426190  6533 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:26.434326  6481 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:26.478263  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:26.406301  6542 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:26.500385  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 53642.9us
I20260709 13:02:26.577189  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:26.485646  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 228315us
I20260709 13:02:26.475780  6530 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:26.476791  6480 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:26.594991  1661 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:26.597362  1514 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.604394  1661 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:26.520330  6475 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.612625  1514 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.614564  1661 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:26.570925  6557 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:02:26.617935  6556 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.621392  6398 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.629127  6479 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.615490  6533 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:02:26.668999  6479 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:26.672612  6479 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:26.660835  1661 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:26.644580  6492 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.664657  6462 consensus_queue.cc:1059] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:02:26.656028  6489 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.666898  6398 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:26.420428  6567 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:26.525696  6573 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:26.593586  6476 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.572708  6542 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:26.502298  6512 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:26.645539  1514 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.597005  6470 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:26.593793  6530 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:26.711473  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 65997.4us
W20260709 13:02:26.695482  6126 consensus_meta.cc:287] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.004s
I20260709 13:02:26.678702  6569 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.701085  6566 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:26.675755  6492 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:26.712759  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 273792us
I20260709 13:02:26.713492  1514 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.719147  1617 raft_consensus.cc:1240] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:26.676770  6462 raft_consensus.cc:3055] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:26.678784  6539 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.726058  1514 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.710229  6542 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.685527  6475 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:26.729503  1514 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:26.738188  1514 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:26.682765  6398 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:26.733693  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:26.733639  1587 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.712687  6489 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.715257  6530 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.687579  6568 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:26.731570  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:26.739180  1616 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 16.
I20260709 13:02:26.746488  1587 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.742740  1618 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:26.741498  6566 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:02:26.761461  6566 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:26.710605  6476 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:26.768468  1587 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:26.728293  6462 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:26.730180  6533 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.730270  6559 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.747481  6523 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.756206  6250 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.756022  6573 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.779736  6585 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.775573  6480 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:26.758683  6452 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:02:26.778085  6471 consensus_meta.cc:287] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.519s	user 0.004s	sys 0.005s
I20260709 13:02:26.781400  6481 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.748672  6475 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:26.735532  6470 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:02:26.784194  6489 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.772324  6134 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:26.811756  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 73640us
I20260709 13:02:26.778709  6370 consensus_queue.cc:1059] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:02:26.788528  6568 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:26.814706  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:26.815207  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 46848.5us
W20260709 13:02:26.818114  6580 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:26.813946  6586 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.825896  1514 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:26.816521  6528 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.001s
W20260709 13:02:26.830922  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 53937.8us
I20260709 13:02:26.831403  6592 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.832929  1691 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:02:26.822175  6512 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:26.786573  6250 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:26.820608  1587 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:26.798408  6471 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:26.836797  6523 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:26.847213  1587 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:26.788705  6585 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:26.878329  1587 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.880124  1689 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:26.882050  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:26.883162  6589 consensus_queue.cc:1059] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:26.883893  6134 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:26.884229  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:26.884459  6481 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.884820  1623 raft_consensus.cc:2376] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12. Re-sending same reply.
I20260709 13:02:26.885679  1616 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:26.885908  1623 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:02:26.886540  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:26.886873  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:26.888175  1622 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:02:26.888535  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:26.798034  6462 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:26.889142  1619 raft_consensus.cc:2376] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11. Re-sending same reply.
I20260709 13:02:26.904407  1694 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:26.904795  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:26.905345  1619 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:26.889293  1622 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:26.908313  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:26.893389  1548 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:26.895920  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:26.886613  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:26.909807  1616 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:26.901449  1663 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:26.888616  1623 raft_consensus.cc:2376] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9. Re-sending same reply.
I20260709 13:02:26.903247  1546 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:02:26.903288  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 80112.2us
I20260709 13:02:26.838176  6470 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:26.915202  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 213463us
I20260709 13:02:26.915853  6599 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:26.918959  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:26.919248  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:26.920258  1546 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.917346  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:26.918613  1622 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:26.923352  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:26.823438  6568 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:26.882146  6452 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:26.926206  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 100376us
I20260709 13:02:26.890048  6512 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.910223  6481 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.827188  6586 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:26.927335  1514 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.930382  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:26.844146  6367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.014s	sys 0.019s
I20260709 13:02:26.931548  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:26.931831  1619 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:26.930131  1586 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.945735  1587 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:26.928699  1622 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:26.836076  6528 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:26.843679  6592 consensus_queue.cc:1059] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:02:26.960201  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:26.933187  6462 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:26.943804  6367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.015s	sys 0.019s
I20260709 13:02:26.935461  6480 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.943883  6523 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.939762  1514 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.963429  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:26.928958  6567 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:26.944511  6481 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:26.978336  6567 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.947367  1546 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:26.979990  6481 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:26.980362  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:26.981083  1546 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:26.982085  1546 pending_rounds.cc:85] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 5
I20260709 13:02:26.982309  1546 pending_rounds.cc:107] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:26.982527  1546 raft_consensus.cc:2889] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:26.936371  6134 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:02:26.944108  6591 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:26.960777  6492 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:26.977253  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:26.972204  1539 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:26.924188  6470 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:26.986194  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 46491.9us
I20260709 13:02:27.010602  1514 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:26.983959  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 66953us
I20260709 13:02:26.970443  6476 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:26.968245  6367 raft_consensus.cc:697] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:26.974543  6592 consensus_queue.cc:1243] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:27.037843  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:27.034780  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.039320  1514 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:26.992523  6452 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.049170  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:26.964169  6573 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:02:27.011042  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 99025.1us
I20260709 13:02:27.047253  1587 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:27.055312  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:27.057750  1663 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:26.992093  6597 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.973697  6480 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.045173  6523 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.063599  6528 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:27.023593  6591 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.067706  6471 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:27.049376  6592 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.043565  6589 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.076135  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 2024) took 1199 ms. Trace:
I20260709 13:02:27.069911  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:27.008947  6437 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:02:27.047209  6489 consensus_queue.cc:1059] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:02:27.072393  1514 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:27.051034  6475 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:27.060510  6476 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:27.058526  6582 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.061466  6556 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.088964  6595 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.122s
I20260709 13:02:27.091600  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:27.092319  1541 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:27.093214  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:27.093499  1587 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:27.093773  1541 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:27.094647  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:27.077574  1695 rpcz_store.cc:276] 0709 13:02:25.876523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.877466 (+   943us) service_pool.cc:224] Handling call
0709 13:02:25.877727 (+   261us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:25.878049 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.878077 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:25.878606 (+   529us) log.cc:844] Serialized 52 byte log entry
0709 13:02:26.158675 (+280069us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:26.267601 (+108926us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.271154 (+  3553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.271230 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.064614 (+793384us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b2400208ce8. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c678d79c4 00007f5c678d5acb 00007f5c67a90dc9 00007f5c67a90a55 00007f5c67a8ffb0 00007f5c6a706488 00007f5c6a706be8 00007f5c6a6de398 00007f5c6a6d976a 00007f5c6a6d8bb6
0709 13:02:27.068097 (+  3483us) raft_consensus.cc:1685] finished
0709 13:02:27.075887 (+  7790us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.076060 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26531,"prepare.queue_time_us":26893,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":13844,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":10654,"spinlock_wait_cycles":60077952,"thread_start_us":370876,"threads_started":2,"wal-append.queue_time_us":302109}
I20260709 13:02:27.087349  6596 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 13:02:27.087756  6528 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:27.089290  6565 log.cc:927] Time spent T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.820s	user 0.005s	sys 0.000s
I20260709 13:02:27.086615  6581 consensus_queue.cc:1059] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 13:02:27.095177  1541 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:27.071764  6370 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:27.106355  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.110481  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 52912.3us
I20260709 13:02:27.112771  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:27.113135  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 183101us
I20260709 13:02:27.113381  1690 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:02:27.114806  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:27.115324  1690 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:27.115633  1696 raft_consensus.cc:1275] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:02:27.117560  1696 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:27.118644  1696 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:27.119549  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:27.124506  1661 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:27.104274  1689 raft_consensus.cc:2955] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 4 to 8, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:27.128925  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:27.130251  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:27.130877  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:27.131768  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:27.134351  1617 raft_consensus.cc:2393] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:27.100286  6452 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:27.099926  6489 consensus_queue.cc:1243] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer 27308aae2ef347ccba1b27e7f6f04334 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:27.137056  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:27.141981  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:27.142556  1617 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:27.143291  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:27.143906  1617 raft_consensus.cc:2368] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:27.144538  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:27.145099  1622 raft_consensus.cc:2368] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:27.146183  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:27.109845  6383 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.110579  6250 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:27.067760  6367 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.110736  6592 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.110862  6476 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:27.171550  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:27.164266  1587 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:02:27.167073  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 54090.9us
I20260709 13:02:27.180054  6134 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:27.135236  6591 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:27.168131  6581 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:27.137204  6475 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:27.138403  6585 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:27.140671  6556 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:27.180430  6134 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.125927  6370 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.166841  6573 raft_consensus.cc:3055] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:27.181205  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:27.169538  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:27.211817  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:27.213344  1514 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:27.214416  6610 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.189083  6603 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:27.189560  6604 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:27.185482  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 2092) took 1053 ms. Trace:
I20260709 13:02:27.215404  6603 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:27.186160  6530 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.215893  6603 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.215564  6604 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.217835  6604 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:27.193235  6523 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:27.217902  6530 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:27.218876  1690 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:27.220367  1514 leader_election.cc:400] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:27.198966  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:27.222378  1614 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:27.223807  1614 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:27.186337  6581 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.183944  6586 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:27.204543  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:27.176312  6250 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.147168  6452 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.199398  2231 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:27.175237  6599 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:27.232604  1514 leader_election.cc:400] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:27.215623  1615 rpcz_store.cc:276] 0709 13:02:26.129058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.129696 (+   638us) service_pool.cc:224] Handling call
0709 13:02:26.133905 (+  4209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:26.134210 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.134235 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:26.134616 (+   381us) log.cc:844] Serialized 26 byte log entry
0709 13:02:26.231830 (+ 97214us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:26.231885 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.231977 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.088732 (+856755us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:27.176335 (+ 87603us) raft_consensus.cc:1685] finished
0709 13:02:27.176357 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.182158 (+  5801us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":601,"spinlock_wait_cycles":16430208,"thread_start_us":27313,"threads_started":1,"wal-append.queue_time_us":75387}
I20260709 13:02:27.168239  6383 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.210276  6134 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.235321  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:27.175850  6592 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.206605  6360 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:27.181602  6471 consensus_queue.cc:1059] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:02:27.236383  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:27.183339  6568 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:27.221760  6589 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:27.210723  6573 raft_consensus.cc:740] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:27.240705  2231 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:27.231549  6581 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.242668  1688 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
W20260709 13:02:27.243034  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 62467.3us
I20260709 13:02:27.258149  1615 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:27.254478  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:27.241297  6523 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:27.209662  6475 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.254105  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:27.260718  6408 consensus_queue.cc:1048] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:02:27.346933  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:27.348531  6592 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:27.344233  6612 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:27.399179   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:27.304589  6608 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:27.245414  6533 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:02:27.331975  6611 raft_consensus.cc:3055] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:27.333374  6618 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:27.284736  6476 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:27.333086  6606 log.cc:927] Time spent T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:02:27.235713  6556 consensus_queue.cc:1059] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:02:27.350198  6599 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.356460  6370 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:27.242775  6098 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:27.284447  1663 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:27.242558  6480 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:27.292711  1688 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:27.336169  6383 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:27.349735  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:27.260905  6597 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:27.355154  6539 consensus_meta.cc:287] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.620s	user 0.007s	sys 0.000s
I20260709 13:02:27.237128  6250 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.260869  6126 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:27.242152  6586 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:27.397909  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 273443us
I20260709 13:02:27.392251  6523 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.428867  6618 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:27.611884  6623 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:02:27.612422  6624 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:27.430716  6611 raft_consensus.cc:740] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:27.396037  6585 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.528954  6398 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.529897  6588 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:27.586119  6463 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:27.611599  6523 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:27.389854  6603 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.431401  6608 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.624976  6134 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.445012  6573 consensus_queue.cc:260] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:27.634153  6569 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.903s	user 0.010s	sys 0.000s
I20260709 13:02:27.635501  6475 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:27.641770  6542 consensus_meta.cc:287] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.883s	user 0.010s	sys 0.002s
I20260709 13:02:27.596707  6616 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.601330  6586 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.600092  6539 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:27.647195  6552 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 1.471s	user 0.008s	sys 0.015s
W20260709 13:02:27.649514  6621 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:02:27.619697  6625 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:27.659385  6573 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.672921  6625 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:27.679513  6625 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.662768  6608 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:27.664597  6603 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:27.662987  6587 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.781s	user 0.002s	sys 0.015s
I20260709 13:02:27.660797  6586 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:27.659570  6569 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:27.683996  6571 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 1.051s	user 0.004s	sys 0.015s
I20260709 13:02:27.680672  6581 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.687109  6581 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:27.663710  6561 raft_consensus.cc:3055] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:27.688030  6561 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:02:27.687081  6632 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:02:27.690876  6610 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:27.296123  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 58148.6us
W20260709 13:02:27.729224  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.729915  1541 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:27.732331  1540 raft_consensus.cc:1217] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[8.5-15.8]   Dedup: 9.6->[13.7-15.8]
I20260709 13:02:27.733022  1540 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16. Ops: [8.5-15.8]
I20260709 13:02:27.576894  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:27.735030  1542 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:27.352198  1548 raft_consensus.cc:2410] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:27.738281  1543 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
W20260709 13:02:27.739632  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.740839  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 2093) took 1611 ms. Trace:
I20260709 13:02:27.741420  1620 rpcz_store.cc:276] 0709 13:02:26.129331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.129447 (+   116us) service_pool.cc:224] Handling call
0709 13:02:26.129739 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:26.130070 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.130107 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:26.132844 (+  2737us) log.cc:844] Serialized 26 byte log entry
0709 13:02:26.411854 (+279010us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:26.704073 (+292219us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.704271 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.704322 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.682913 (+978591us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:27.740098 (+ 57185us) raft_consensus.cc:1685] finished
0709 13:02:27.740316 (+   218us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.740608 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":288096,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":2672,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":24911,"spinlock_wait_cycles":14321024,"thread_start_us":474135,"threads_started":2,"wal-append.queue_time_us":496513}
W20260709 13:02:27.590583  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 306289us
I20260709 13:02:27.750200  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 2027) took 1714 ms. Trace:
I20260709 13:02:27.751897  1691 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:27.750753  1692 rpcz_store.cc:276] 0709 13:02:26.035966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.036083 (+   117us) service_pool.cc:224] Handling call
0709 13:02:26.040706 (+  4623us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:26.091326 (+ 50620us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:26.786395 (+695069us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b18003355c0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a4e455 00007f5c6e5363c7 00007f5c6ab489a7 00007f5c6ab580bf 00007f5c6ab58038
0709 13:02:26.913838 (+127443us) log.cc:844] Serialized 14 byte log entry
0709 13:02:27.175181 (+261343us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:27.176746 (+  1565us) log.cc:844] Serialized 52 byte log entry
0709 13:02:27.176882 (+   136us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:27.178132 (+  1250us) log.cc:844] Serialized 14 byte log entry
0709 13:02:27.204142 (+ 26010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.204217 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:27.680456 (+476239us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b18003355c0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:02:27.749474 (+ 69018us) raft_consensus.cc:1685] finished
0709 13:02:27.749530 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.749878 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67344,"prepare.queue_time_us":94416,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":123629,"raft.run_cpu_time_us":485,"raft.run_wall_time_us":40082,"spinlock_wait_cycles":38309632,"thread_start_us":315181,"threads_started":2,"wal-append.queue_time_us":269261}
I20260709 13:02:27.753095  1545 raft_consensus.cc:3055] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:27.753501  1545 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:27.754779  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 2029) took 1484 ms. Trace:
I20260709 13:02:27.755191  1545 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.769724  1545 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.756258  1622 raft_consensus.cc:2368] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:27.772464  1544 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:27.755230  1694 rpcz_store.cc:276] 0709 13:02:26.270706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.270857 (+   151us) service_pool.cc:224] Handling call
0709 13:02:26.281901 (+ 11044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.904891 (+622990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.754158 (+849267us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b5400140d54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:27.754537 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431103360}
I20260709 13:02:27.601897  6126 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.805768  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:27.806658  6126 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.647840  6434 raft_consensus.cc:3055] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:27.654551  6463 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.811720  6471 consensus_queue.cc:1059] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:27.812155  6434 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:27.813776  6471 raft_consensus.cc:3055] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:27.814371  6471 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:27.814839  6463 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:27.653023  6452 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:27.650770  6098 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:27.822408  6098 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.822774  6250 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:27.826709  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:27.827102  6311 raft_consensus.cc:3055] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:27.827670  6311 raft_consensus.cc:740] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:27.827998  1694 raft_consensus.cc:2393] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:27.829270  6311 consensus_queue.cc:260] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.736246  1442 catalog_manager.cc:5697] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 6 to 9, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 9 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:02:27.811201  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 53314.7us
I20260709 13:02:27.814165  6434 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.808056  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:27.660112  6542 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.652110  6398 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:27.819818  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 88366.8us
W20260709 13:02:27.827404  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.836373  6434 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.836503  1442 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.837700  6381 raft_consensus.cc:3055] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:27.840631  1663 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:27.840656  1619 raft_consensus.cc:2410] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:02:27.830189  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:27.858117  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:27.854151  6381 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:27.652319  6588 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.661432  6616 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.659767  6611 consensus_queue.cc:260] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.689018  6561 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.613126  6618 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.875182  6398 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:27.884984  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:27.893530  1543 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.891285  1697 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
W20260709 13:02:27.901741  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61351.3us
I20260709 13:02:27.901849  6591 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:27.902905  1663 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:27.902779  6591 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.905397  6599 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:27.905865  6581 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:27.908664  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 44518.8us
I20260709 13:02:27.909605  1617 raft_consensus.cc:2393] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:27.909009  6475 consensus_queue.cc:1059] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:27.910282  6599 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:27.910537  6542 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:27.911667  6618 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:27.914113  1545 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:02:27.914593  1545 pending_rounds.cc:85] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 7
I20260709 13:02:27.914922  1693 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:27.915524  5877 raft_consensus.cc:3055] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:27.935458  5877 raft_consensus.cc:740] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:27.916785  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 1998) took 1031 ms. Trace:
I20260709 13:02:27.916430  6381 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.917404  5934 raft_consensus.cc:3055] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:27.922432  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:27.929090  6475 raft_consensus.cc:3055] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:27.928851  6610 consensus_queue.cc:1059] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:02:27.900238  6360 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.930562  6611 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:27.905613  6591 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:27.901477  6559 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:27.936252  1623 rpcz_store.cc:276] 0709 13:02:26.885593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.886664 (+  1071us) service_pool.cc:224] Handling call
0709 13:02:27.916395 (+1029731us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b54000d2fd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:27.916598 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2774912}
I20260709 13:02:27.912359  6599 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.940897  5934 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:27.934188  1545 pending_rounds.cc:107] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:02:27.941126  6475 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:27.951926  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:27.952648  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:27.953452  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:27.953455  1546 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:27.954146  6381 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:27.954782  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:27.956672  1442 catalog_manager.cc:5697] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.960112  5877 consensus_queue.cc:260] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.961665  5877 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:27.963910  6471 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:27.949908  1545 raft_consensus.cc:2889] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:27.989456  6608 consensus_queue.cc:1059] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:02:27.982824  1661 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:27.995257  1442 catalog_manager.cc:5697] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.998967  6588 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:27.999467  6134 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.001137  5934 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.002935  5934 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.004130  6489 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.004813  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.005075  6489 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:28.007529  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 58775.9us
I20260709 13:02:27.983220  6581 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.014478  6581 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.016984  6586 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:27.990581  6559 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.020134  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:28.021052  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2903) took 1123 ms. Trace:
W20260709 13:02:28.021948  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 51068.9us
I20260709 13:02:28.021499  1542 rpcz_store.cc:276] 0709 13:02:26.897903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.898033 (+   130us) service_pool.cc:224] Handling call
0709 13:02:28.020386 (+1122353us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b540027b5d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:28.020787 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864324864}
I20260709 13:02:27.963011  6475 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.021453  1623 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:28.046846  1543 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
W20260709 13:02:27.981858  6541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.259s	user 0.016s	sys 0.029s
I20260709 13:02:27.998005  1442 catalog_manager.cc:5697] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 9 to 11, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 11 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.054374  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:28.019308  6586 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.059306  6470 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.061764  1544 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:02:28.061399  1442 catalog_manager.cc:5697] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:28.090004  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2899) took 1177 ms. Trace:
I20260709 13:02:28.062701  6483 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.956694  6540 consensus_queue.cc:1059] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:02:28.058633  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:28.067291  1621 raft_consensus.cc:1240] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:28.079460  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.056082  6541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.430s	user 0.016s	sys 0.030s
I20260709 13:02:28.090466  1545 rpcz_store.cc:276] 0709 13:02:26.894905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.895008 (+   103us) service_pool.cc:224] Handling call
0709 13:02:26.910867 (+ 15859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.752863 (+841996us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400491220. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6aab5dc0 00007f5c6ab401c0 00007f5c6ab41231 00007f5c6ab3dd8f 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c
0709 13:02:28.030246 (+277383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.072524 (+ 42278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529946368}
I20260709 13:02:28.106294  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:28.108777  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.079802  6537 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 13:02:28.110384  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 55586.7us
I20260709 13:02:28.112385  6542 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:28.136678  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.121148  6463 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:28.139331  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.139654  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 2109) took 1009 ms. Trace:
I20260709 13:02:28.184023  6463 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.184749  1617 rpcz_store.cc:276] 0709 13:02:27.130422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.144350 (+ 13928us) service_pool.cc:224] Handling call
0709 13:02:28.139430 (+995080us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b5400114754. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:28.139589 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1749944576}
I20260709 13:02:28.141055  6559 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:28.145108  6528 consensus_meta.cc:287] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.037s	user 0.008s	sys 0.010s
I20260709 13:02:28.145170  1618 raft_consensus.cc:1240] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:28.145522  6561 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.147450  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.147801  6311 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.149016  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3190) took 1030 ms. Trace:
I20260709 13:02:28.148931  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.186493  6463 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.150020  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.134317  1442 catalog_manager.cc:5697] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:28.138141  6098 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.191998  6098 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.194561  2271 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:28.153967  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.188757  1693 rpcz_store.cc:276] 0709 13:02:27.118233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.118760 (+   527us) service_pool.cc:224] Handling call
0709 13:02:27.119005 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.946585 (+827580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.148703 (+202118us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54001284d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:28.148953 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1752882560}
I20260709 13:02:28.154881  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.197032  2265 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 17: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:28.194217  1442 catalog_manager.cc:5697] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.201313  1442 catalog_manager.cc:5697] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.203045  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.204370  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.205086  2265 raft_consensus.cc:2368] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:28.205536  6489 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.204384  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.157913  6126 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.158845  6616 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.160152  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 1128) took 1083 ms. Trace:
W20260709 13:02:28.162184  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.163736  1620 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
W20260709 13:02:28.164211  6639 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.157s	user 0.001s	sys 0.001s
I20260709 13:02:28.164533  1587 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:28.167680  6475 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:28.168828  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.171792  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 2101) took 1157 ms. Trace:
I20260709 13:02:28.173883  6471 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.176779  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 2100) took 1204 ms. Trace:
W20260709 13:02:28.179406  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 207048us
W20260709 13:02:28.182945  6523 consensus_meta.cc:287] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.527s	user 0.013s	sys 0.000s
I20260709 13:02:28.183203  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 2110) took 1052 ms. Trace:
I20260709 13:02:28.137480  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 2105) took 1008 ms. Trace:
I20260709 13:02:28.218791  1547 rpcz_store.cc:276] 0709 13:02:27.013591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.735749 (+722158us) service_pool.cc:224] Handling call
0709 13:02:27.736325 (+   576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.944913 (+208588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.944958 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:27.950069 (+  5111us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:27.950108 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.096799 (+146691us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54000a7dd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:28.096844 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.096965 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366188416}
W20260709 13:02:28.221375  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 54794.4us
W20260709 13:02:28.225267  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.227290  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.224295  1442 catalog_manager.cc:5697] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.230134  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:28.227743  1622 rpcz_store.cc:276] 0709 13:02:27.129524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.152208 (+ 22684us) service_pool.cc:224] Handling call
0709 13:02:28.131508 (+979300us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400315954. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:28.137417 (+  5909us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235135232}
I20260709 13:02:28.235634  2265 raft_consensus.cc:2393] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:28.225670  1541 rpcz_store.cc:276] 0709 13:02:26.972810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.733959 (+761149us) service_pool.cc:224] Handling call
0709 13:02:28.022140 (+288181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:28.067697 (+ 45557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.067731 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:28.068269 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:02:28.112861 (+ 44592us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:28.112899 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.112969 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.175499 (+ 62530us) raft_consensus.cc:1685] finished
0709 13:02:28.175518 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.176510 (+   992us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540027b5d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:28.176707 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6600,"raft.queue_time_us":22513,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"spinlock_wait_cycles":661620992,"thread_start_us":44162,"threads_started":1,"wal-append.queue_time_us":99429}
I20260709 13:02:28.243552  6533 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:02:28.244176  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.244140  6533 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:28.249864  6625 consensus_meta.cc:287] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
I20260709 13:02:28.250358  6625 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.222463  1548 rpcz_store.cc:276] 0709 13:02:27.014491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.743657 (+729166us) service_pool.cc:224] Handling call
0709 13:02:27.744195 (+   538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.745919 (+  1724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.745971 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:27.746865 (+   894us) log.cc:844] Serialized 26 byte log entry
0709 13:02:27.879477 (+132612us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:27.882786 (+  3309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.882868 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.171427 (+288559us) raft_consensus.cc:1685] finished
0709 13:02:28.171447 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.171607 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62791,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":251,"thread_start_us":121968,"threads_started":1,"wal-append.queue_time_us":420251}
W20260709 13:02:28.255620  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 69032.7us
I20260709 13:02:28.255787  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.256476  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:28.258271  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.260377  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.262933  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:28.263180  1697 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 13:02:28.265852  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2913) took 1175 ms. Trace:
I20260709 13:02:28.266227  1539 rpcz_store.cc:276] 0709 13:02:27.090430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.757247 (+666817us) service_pool.cc:224] Handling call
0709 13:02:27.757814 (+   567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.758461 (+   647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.758499 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:27.759273 (+   774us) log.cc:844] Serialized 26 byte log entry
0709 13:02:27.858878 (+ 99605us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:27.859528 (+   650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.869009 (+  9481us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.265563 (+396554us) raft_consensus.cc:1685] finished
0709 13:02:28.265581 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.265698 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49690,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"thread_start_us":92880,"threads_started":1,"wal-append.queue_time_us":143852}
I20260709 13:02:28.267145  6616 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:28.267992  6616 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.270570  6616 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.272887  6537 consensus_queue.cc:1059] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:28.274019  6537 raft_consensus.cc:3055] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:28.274447  6537 raft_consensus.cc:740] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:02:28.275641  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 111273us
I20260709 13:02:28.276430  1587 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:28.277882  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:28.278928  6452 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:28.279436  6452 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.279624  6591 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:28.279754  6512 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:28.279964  6452 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.280303  6512 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.280385  6591 raft_consensus.cc:697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:28.280860  6512 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.281579  6591 consensus_queue.cc:237] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:28.283777  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.288717  6588 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:28.289130  6512 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.289875  1662 leader_election.cc:400] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:28.290174  1662 leader_election.cc:403] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.289541  6588 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.291630  6537 consensus_queue.cc:260] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.216862  6134 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:02:28.292701  6588 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.292903  6537 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.294108  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.225602  6528 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:28.276918  1442 catalog_manager.cc:5697] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 5 to 8, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 8 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.291287  6512 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:28.298830  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 68326.9us
I20260709 13:02:28.301453  6126 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.225302  6581 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:02:28.303224  6581 consensus_queue.cc:1243] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer c20847a6dcea4c2a9cbaf35a2171e33d log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:28.307542  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:28.307658  6250 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:02:28.309702  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 53322.3us
I20260709 13:02:28.227398  1614 rpcz_store.cc:276] 0709 13:02:27.130642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.224375 (+ 93733us) service_pool.cc:224] Handling call
0709 13:02:27.224570 (+   195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.744596 (+520026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.744656 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:27.745790 (+  1134us) log.cc:844] Serialized 26 byte log entry
0709 13:02:27.880436 (+134646us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:27.880478 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.069406 (+188928us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b5400068454. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:28.069464 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.182744 (+113280us) raft_consensus.cc:1685] finished
0709 13:02:28.182764 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.183028 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52143,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":10482,"spinlock_wait_cycles":1193604992,"thread_start_us":133575,"threads_started":1,"wal-append.queue_time_us":381137}
I20260709 13:02:28.310640  1442 catalog_manager.cc:5697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.312601  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:28.331795  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:28.332259  1546 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:28.332497  1541 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.334117  6098 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:28.335652  2234 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:28.336249  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:28.336328  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 102811us
I20260709 13:02:28.336853  1697 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:28.337893  6584 raft_consensus.cc:3055] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:28.338335  6584 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:28.339504  6584 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.340612  6584 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.340276  1442 catalog_manager.cc:5697] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.338989  2234 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:28.346735  2232 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:28.271193  6616 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:28.316591  6541 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:28.238389  6523 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.375672  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.377645  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:28.367911  5877 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:28.383275  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 69616.7us
I20260709 13:02:28.387548  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:28.389567  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 71617.9us
I20260709 13:02:28.389688  1661 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:28.392021  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 79532us
I20260709 13:02:28.370244  6463 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:28.398169  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:28.398701  6573 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:28.399080  6618 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:28.399608  5934 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:28.401734  1588 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:28.400928  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:28.403520  6616 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.405892  6523 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.406143  5934 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.399283  6573 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.409027  6573 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.410277  6573 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:28.410626  6573 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.410956  6573 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.400944  6463 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.411623  6463 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:28.374897  6098 consensus_queue.cc:1059] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:02:28.416632  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:28.417843  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:28.418593  1663 leader_election.cc:336] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 2.024s (SENT)
I20260709 13:02:28.419066  1663 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:28.415695  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.420572  1546 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:02:28.382927  5877 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.440928  2232 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:28.453761  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.406095  6616 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.453886  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:28.449553  5877 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:28.466331  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 64814.1us
I20260709 13:02:28.465415  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:28.473554  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 48080.2us
I20260709 13:02:28.468815  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:28.457683  6540 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:28.465920  6523 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.486213  6540 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.510618  1586 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:28.505457  6569 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.514881  6569 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.516959  6569 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.519546  6489 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:28.520138  6489 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.522110  6489 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:28.523772  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 105213us
I20260709 13:02:28.526171  6476 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.526901  6476 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.529155  6476 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.530514  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.531527  6433 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:28.531953  6433 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.532298  6433 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.535629  6437 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:28.536373  6520 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:28.536904  6520 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.538872  6520 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.540251  6590 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.540836  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.540756  6590 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.553371  6533 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.499127  6625 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:28.568025  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 119564us
I20260709 13:02:28.570297  1514 leader_election.cc:400] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:28.570641  1514 leader_election.cc:403] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.571215  1540 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:28.514295  6597 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:28.573999  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 2099) took 1609 ms. Trace:
I20260709 13:02:28.574355  1540 rpcz_store.cc:276] 0709 13:02:26.964211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.733759 (+769548us) service_pool.cc:224] Handling call
0709 13:02:27.734191 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.571622 (+837431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.573780 (+  2158us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54003b6854. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:28.573946 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1924528384}
I20260709 13:02:28.583853  1545 raft_consensus.cc:2410] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:28.587060  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:28.587747  1696 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.588009  6590 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:28.571086  6134 raft_consensus.cc:3055] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:28.589082  6134 raft_consensus.cc:740] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:02:28.590184  6639 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:28.505820  6559 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:28.590109  6134 consensus_queue.cc:260] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.494719  6512 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.630144  6512 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.632233  6512 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.614532  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:28.634655  6528 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:28.635361  6528 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.637359  6528 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.614797  1541 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:28.555169  6574 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:28.638568  6574 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.638926  6574 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.641747  6618 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:28.620013  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 169177us
I20260709 13:02:28.620594  6452 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.600065  6540 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.622085  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:28.625159  6523 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:28.600383  6134 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.628237  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:28.629019  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:28.629597  6381 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
W20260709 13:02:28.638252  6658 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:02:28.662744  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.646659  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:28.649534  6574 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.651882  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.642270  6618 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.643641  1696 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:28.663666  1694 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:28.671334  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:28.663678  6608 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.678968  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 108880us
W20260709 13:02:28.679787  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.660211  6475 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:28.681705  1618 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:28.667677  6471 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:28.651394  6463 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.685973  1693 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
W20260709 13:02:28.689147  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 178628us
I20260709 13:02:28.692396  6539 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:28.693259  6656 log.cc:927] Time spent T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.126s	user 0.000s	sys 0.002s
I20260709 13:02:28.693106  6539 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.696560  6452 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.677870  6537 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:28.679193  6581 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:28.690883  1617 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:28.680740  6250 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.702317  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.704739  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.705533  1694 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:28.688108  6098 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:28.708297  6603 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:02:28.711527  6659 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.128s	user 0.000s	sys 0.002s
I20260709 13:02:28.712276  6475 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.714198  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:28.714485  6475 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.714954  6542 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.715487  6542 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.715911  6452 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:28.716711  6452 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.717440  6542 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:28.721728  6512 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:28.721036  6591 consensus_queue.cc:1059] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:28.719309  6452 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.723193  6250 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.726099  6250 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.719861  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:28.722501  6512 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.728981  1614 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 17: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:28.700412  6541 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:28.727561  6528 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:28.707113  6381 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.703656  6471 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.731287  6618 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.729386  6512 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.728924  1511 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:28.733222  6664 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.733845  6528 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:28.730613  6381 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.734606  6528 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:28.737339  6528 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.733755  6664 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.700760  6537 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:28.740988  6381 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.741572  6537 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.742727  6664 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.744442  5877 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.745760  2234 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:28.746762  5877 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.749462  6537 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.751005  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:28.752012  6098 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.719336  6433 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.754168  6098 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:28.754561  1618 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 14.
W20260709 13:02:28.764593  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.768018  6603 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.730968  6250 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.770376  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:28.772378  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.695344  6539 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.770907  6250 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.777281  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.778228  1541 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:28.779990  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:28.781292  1618 raft_consensus.cc:2368] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:28.781994  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:28.790796  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:28.791939  1542 raft_consensus.cc:2393] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:28.722352  6476 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.795754  1540 raft_consensus.cc:1240] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:28.801822  2268 raft_consensus.cc:2368] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
I20260709 13:02:28.807049  2234 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:28.809587  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.759033  5877 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:28.799664  6098 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.700325  6608 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.813357  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:28.815819  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.818964  6126 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:28.824077  1618 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:28.826297  2270 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 17: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:28.797843  6618 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:28.829218  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:28.830318  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.844210  1547 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.834579  1622 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:02:28.835516  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.835702  6586 consensus_queue.cc:1059] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:28.836840  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:28.839881  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:28.842278  1621 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:28.842494  6603 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:28.842824  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.830994  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:28.814793  5877 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.872182  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:28.873546  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:28.874307  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:28.874858  1689 raft_consensus.cc:3060] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.873553  1618 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:28.879979  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.881645  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.825780  6126 raft_consensus.cc:697] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 14 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:02:28.892344  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.883625  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:28.884132  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:28.886920  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:28.882833  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:28.895937  1662 leader_election.cc:400] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
I20260709 13:02:28.896459  1662 leader_election.cc:403] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.898087  1620 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:28.894369  1688 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:28.899748  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:28.859850  6539 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:28.875849  5877 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:28.900660  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:28.874658  6541 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:28.828734  6476 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.827844  6098 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.875633  6618 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.916451  6381 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.923636  6573 consensus_meta.cc:287] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.003s
I20260709 13:02:28.914238  6523 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:28.927032  6475 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.944768  6573 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.945176  6471 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.928172  6574 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:28.947281  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:28.951040  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:28.958093  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.958352  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.919379  6539 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:28.941458  6437 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.957674  1615 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:28.963393  1690 raft_consensus.cc:2393] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:28.964895  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.965672  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:28.968024  1614 raft_consensus.cc:2393] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:28.966308  1688 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:28.964903  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:28.974357  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.948974  6603 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.955791  6537 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.971920  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:28.950018  5934 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.977696  1691 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:02:28.942884  6541 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:28.986228  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.987675  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:28.988780  6618 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.988870  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.989524  1688 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:28.990049  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:28.990594  1622 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.990553  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:28.996245  6476 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:28.998023  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:28.999048  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:28.999540  1688 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:29.000633  1547 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:29.005219  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.006995  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:29.007149  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:28.953537  6381 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.008286  2232 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:29.010437  1540 raft_consensus.cc:2410] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:29.010048  5934 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.012104  6608 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:29.013188  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:29.013273  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:29.013576  5934 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:29.013919  1690 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.015954  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:29.016641  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:29.008400  1622 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:29.018139  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:29.008904  1663 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:28.969704  6437 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.015383  6573 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:29.015712  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.013875  1614 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:29.024293  1615 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:29.025014  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:29.025180  1692 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:29.030640  1514 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:29.033279  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.033895  1547 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:29.039934  5934 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:29.045189  6671 log.cc:927] Time spent T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Append to log took a long time: real 0.092s	user 0.002s	sys 0.000s
W20260709 13:02:29.047854  6670 log.cc:927] Time spent T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:02:29.048413  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 50147.4us
I20260709 13:02:29.049345  1663 leader_election.cc:400] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:29.050241  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:29.024437  6586 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:29.056707  6539 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:29.057199  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:29.057848  1543 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:29.010569  6537 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.060343  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:29.061299  6539 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:28.977699  6126 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.055265  6489 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:29.094393  1697 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 17.
I20260709 13:02:29.095122  1617 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:29.095168  1690 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:29.023833  1622 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:29.066383  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:29.098881  1694 raft_consensus.cc:2410] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:29.099659  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:29.100095  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.024379  6463 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:29.030391  1586 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.916s (SENT) [suppressed 39 similar messages]
I20260709 13:02:29.096424  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:29.056766  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:29.097321  1621 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:29.101202  1688 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
W20260709 13:02:29.102272  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 214567us
I20260709 13:02:29.066615  1691 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 14.
I20260709 13:02:29.065865  6541 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:29.064769  6381 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:29.073338  1689 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:29.113297  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.103710  1663 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:29.116988  1697 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:29.066358  6250 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:29.094543  6489 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.068766  6098 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:29.123034  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.126242  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:29.127890  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.128959  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.132035  1587 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:29.133641  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.133751  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:29.136200  1694 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 17: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:29.112813  6599 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:29.122401  6676 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:02:29.032618  6603 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.063341  5877 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.142724  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:29.149821  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:29.101750  6618 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:02:29.097528  6471 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:02:29.162932  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:29.127221  6489 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:29.122087  6433 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:29.115689  6539 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:02:29.172358  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:29.167971  1587 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:29.204619  1543 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
W20260709 13:02:29.256455  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 88502.9us
I20260709 13:02:29.151376  6608 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.159919  5934 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:29.163097  6675 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.151726  6541 consensus_queue.cc:1059] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:02:29.171980  6437 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:29.298956  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 187322us
I20260709 13:02:29.160285  6625 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 13:02:29.302038  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:29.315521  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:29.316239  1621 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:29.172072  6591 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.128s
I20260709 13:02:29.327667  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:29.331475  2270 raft_consensus.cc:2393] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:29.298527  6581 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:29.294203  6537 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:02:29.328974  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 298583us
I20260709 13:02:29.351879  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:29.388026  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:29.395465  1619 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.288568  6597 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:29.302975  6381 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:29.392892  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:29.403080  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:29.390539  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 109449us
I20260709 13:02:29.417881  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:29.422063  1514 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:29.416625  2268 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:29.301779  5934 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:02:29.391070  6608 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.427577  1618 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:29.329805  6586 raft_consensus.cc:697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:29.415331  6537 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.429495  6674 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:29.430642  6581 raft_consensus.cc:697] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:02:29.429152  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 331064us
I20260709 13:02:29.435470  6573 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.436206  6512 raft_consensus.cc:3055] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:29.472477  6512 raft_consensus.cc:740] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:29.472446  6573 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.437686  6098 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.473641  6098 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.474831  6573 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:29.439488  6528 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:29.442799  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:29.476085  1622 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:29.447803  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:29.448674  1543 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:29.477813  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:29.478688  1692 raft_consensus.cc:2393] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:29.452445  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:29.423117  6541 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:29.453198  1547 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:29.455237  6599 raft_consensus.cc:3055] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:02:29.456506  6680 log.cc:927] Time spent T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:02:29.457340  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:29.457636  6679 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.341361  6591 consensus_queue.cc:1243] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:29.460279  1621 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:29.463131  1587 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:29.466992  1588 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:29.460847  6540 consensus_meta.cc:287] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.791s	user 0.008s	sys 0.004s
I20260709 13:02:29.477873  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.487574  1690 raft_consensus.cc:2393] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:29.487954  1543 raft_consensus.cc:2393] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:29.452032  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.482380  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.467710  6618 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:29.488865  2234 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:29.492599  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:29.494704  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:29.469412  6674 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:29.497893  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.495491  1694 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:29.499301  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:29.500001  1692 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:29.497478  6476 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:29.501250  1547 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:02:29.425530  6597 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.502390  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.503935  6597 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:29.461261  6381 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.506266  6381 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:29.506807  6537 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:29.509932  6581 consensus_queue.cc:237] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.512880  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.513473  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.501389  6476 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:29.480701  6599 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:29.526497  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:29.486910  6098 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:29.492102  6311 raft_consensus.cc:3055] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:29.468055  6608 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.486485  6528 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:29.536255  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:29.511698  6674 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:29.538743  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:29.539553  1689 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:02:29.493274  6618 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:29.478070  6586 consensus_queue.cc:237] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.495102  6573 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:29.539920  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:29.544366  2270 raft_consensus.cc:2368] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
W20260709 13:02:29.498838  6475 consensus_meta.cc:287] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
W20260709 13:02:29.561461  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 403760us
I20260709 13:02:29.561442  2271 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:29.577942  1693 pending_rounds.cc:85] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 6
I20260709 13:02:29.580175  1621 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.580773  1693 pending_rounds.cc:107] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:02:29.581411  1693 raft_consensus.cc:2889] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:29.561642  1689 pending_rounds.cc:85] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 7
I20260709 13:02:29.582079  1689 pending_rounds.cc:107] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:02:29.582448  1689 raft_consensus.cc:2889] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:29.581554  1588 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:29.491353  6679 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.536029  6542 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:29.587174  1663 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:29.496204  6540 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.614599  1621 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:29.539892  5877 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:29.580659  6573 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.537176  6311 raft_consensus.cc:740] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:29.524008  6541 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.586318  6675 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.586879  6475 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
I20260709 13:02:29.615906  6539 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.653561  2265 raft_consensus.cc:2368] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:29.609709  6250 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:29.586663  1694 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:02:29.630616  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 206143us
I20260709 13:02:29.564646  6489 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.627251  6573 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:29.665759  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:29.618788  6528 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.667119  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:29.667028  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:29.670449  1622 raft_consensus.cc:2368] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:02:29.670596  1514 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:29.679664  1623 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:29.655174  6250 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.680936  1618 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:29.681742  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:29.686405  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:29.668772  6416 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:29.687765  1541 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 13: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:29.690222  6489 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:29.691848  6489 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:29.692752  6311 consensus_queue.cc:260] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.692723  6489 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:29.661944  6476 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.695681  6489 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:29.699707  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 201778us
I20260709 13:02:29.700495  2231 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:29.703128  1514 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:29.664621  6695 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.712409  1514 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:29.692204  6608 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:29.624863  6599 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.683987  6250 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.684854  6693 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.680804  6537 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:29.658057  6539 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.727783  2231 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:29.728533  6433 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:29.651500  6618 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.694108  6311 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.679982  6675 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.734961  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:29.771345  1547 raft_consensus.cc:3060] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.749445  6528 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:29.759641  6512 consensus_queue.cc:260] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.723076  6416 raft_consensus.cc:697] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:29.733469  6608 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:29.728566  6684 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:02:29.722067  6523 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:29.780975  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.769160  6599 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:29.797243  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.809187  1513 leader_election.cc:400] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:02:29.819202  1513 leader_election.cc:403] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:29.725742  6695 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.794660  6523 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.826443  6523 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:29.783376  6433 raft_consensus.cc:697] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 17 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:29.784600  6528 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:29.789530  6688 raft_consensus.cc:2804] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:29.736172  6693 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.849246  1547 raft_consensus.cc:2468] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:29.840471  1619 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
W20260709 13:02:29.855254  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 63585.6us
I20260709 13:02:29.783581  6537 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.865731  6416 consensus_queue.cc:237] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.873745  6625 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:29.877830  1586 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:29.898834  2234 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:29.900298  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:29.901098  1621 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:29.907146  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 2116) took 1098 ms. Trace:
W20260709 13:02:29.908628  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 291633us
I20260709 13:02:29.920749  1663 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:29.919390  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:29.922829  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 45133.5us
I20260709 13:02:29.923894  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:29.925204  1586 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:29.861078  6701 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.965577  6311 raft_consensus.cc:2804] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:29.899523  6699 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:29.966341  6311 raft_consensus.cc:697] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:29.898208  6540 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:29.968146  6539 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:29.968874  6539 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:29.968922  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 48281.5us
I20260709 13:02:29.968008  6311 consensus_queue.cc:237] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.970743  1663 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:29.971701  6696 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:29.972265  6696 raft_consensus.cc:697] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:29.973124  6696 consensus_queue.cc:237] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.976488  6675 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:29.977209  6675 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:29.977619  6675 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:29.978068  6675 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.963024  6250 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.981642  6250 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:29.984409  6523 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.985212  6489 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:29.907593  1542 rpcz_store.cc:276] 0709 13:02:28.808812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.813145 (+  4333us) service_pool.cc:224] Handling call
0709 13:02:28.827906 (+ 14761us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:28.828251 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.828290 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:28.837642 (+  9352us) log.cc:844] Serialized 26 byte log entry
0709 13:02:28.975570 (+137928us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:28.975611 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.975677 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:29.867480 (+891803us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b24004167f8. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c678d79c4 00007f5c678d5acb 00007f5c67a90dc9 00007f5c67a90a55 00007f5c67a8ffb0 00007f5c6a706488 00007f5c6a706be8 00007f5c6a6de398 00007f5c6a6d976a 00007f5c6a6d8bb6
0709 13:02:29.869103 (+  1623us) raft_consensus.cc:1685] finished
0709 13:02:29.881357 (+ 12254us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.907073 (+ 25716us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78824320,"thread_start_us":136037,"threads_started":1,"wal-append.queue_time_us":203149}
I20260709 13:02:29.945603  6433 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.897256  6625 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:29.901959  6679 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:29.916209  6541 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:29.856606  6528 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:29.948035  6134 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:29.949096  6537 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:29.952841  6695 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:29.953437  6698 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:29.966593  6699 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.944877  6693 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:30.042958  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.060169  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.062747  1617 raft_consensus.cc:2368] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14.
I20260709 13:02:30.048295  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:29.959095  6098 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:30.054407  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:29.987293  6523 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.059067  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.046085  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.069248  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.063702  2270 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:30.094532  1621 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:02:30.061354  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 342213us
I20260709 13:02:30.096361  1513 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:30.097295  1514 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:02:30.098366  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.100418  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:30.103331  2270 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:30.104756  1513 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:30.099485  1616 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:30.110248  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.142532  1621 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:30.059252  6708 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:30.061549  6537 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
I20260709 13:02:30.146216  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.149595  1620 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:30.150588  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:30.146373  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.043495  6691 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:02:30.063527  6528 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.064985  6489 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.064924  6098 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:30.063300  6699 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.151396  1617 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:30.152762  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:30.153662  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:30.154484  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.156764  1689 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:30.171141  1694 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:30.174345  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.175365  1617 raft_consensus.cc:2368] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
I20260709 13:02:30.158316  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:30.144549  6475 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:30.177114  1620 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.101050  6693 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:30.180444  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:30.181582  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.100514  6561 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.183049  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.170635  6698 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:30.169024  6098 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:30.171710  6523 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:30.175176  6707 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:30.173682  6528 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:30.178628  6685 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.017s	sys 0.034s
I20260709 13:02:30.178891  6540 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.183681  6489 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:30.192454  6688 raft_consensus.cc:697] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:30.193682  6698 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:30.233176  6688 consensus_queue.cc:237] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.203168  6707 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.198418  6523 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.237219  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:30.200395  6685 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.017s	sys 0.035s
I20260709 13:02:30.190929  6693 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:30.235217  6710 log.cc:927] Time spent T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:30.200675  6528 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:30.180341  6475 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:30.200014  6537 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:30.150717  6708 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:30.235549  6573 consensus_meta.cc:287] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.002s
I20260709 13:02:30.175634  6625 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:30.193915  6561 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:30.273283  6098 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.273713  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:30.275301  1539 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:30.275344  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:30.280146  6719 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.237399  6489 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:30.280849  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 355704us
I20260709 13:02:30.314029  1586 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:30.242043  6698 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.314652  1542 raft_consensus.cc:2393] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 10: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:30.315312  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:30.276805  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 235484us
I20260709 13:02:30.318542  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:30.240909  6523 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.319823  1548 raft_consensus.cc:2410] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:30.342551  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:30.265437  6528 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.346830  1546 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:30.235587  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 334706us
I20260709 13:02:30.232012  6540 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:30.352043  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.376127  6712 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:30.376495  6708 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.376556  6540 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.377095  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:30.298278  6716 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:30.352876  6728 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:30.378192  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3200) took 1504 ms. Trace:
I20260709 13:02:30.354346  1586 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:30.380102  6718 log.cc:927] Time spent T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:02:30.380694  1586 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:30.302047  6603 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.364128  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:30.378610  1690 rpcz_store.cc:276] 0709 13:02:28.874206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.499471 (+625265us) service_pool.cc:224] Handling call
0709 13:02:29.499837 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.500222 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.500259 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:29.536624 (+ 36365us) log.cc:844] Serialized 26 byte log entry
0709 13:02:29.864540 (+327916us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:29.864579 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.864876 (+   297us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.377958 (+513082us) raft_consensus.cc:1685] finished
0709 13:02:30.377990 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.378139 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85925,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":118,"thread_start_us":240671,"threads_started":1,"wal-append.queue_time_us":490312}
I20260709 13:02:30.385576  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:30.387717  1620 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:30.388476  1617 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: [11.8-12.9]
I20260709 13:02:30.389456  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.392130  6581 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:30.393793  6707 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.394076  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:30.394338  6707 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:30.395567  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:30.395629  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:30.396158  6722 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:02:30.396857  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:30.398844  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:30.394121  6728 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:30.319239  6625 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.320763  6134 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:30.320070  6717 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:30.394848  6707 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.403602  1586 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:30.422230  1586 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:30.423007  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:30.423878  1586 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:30.423848  2272 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:30.410825  2234 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:30.415340  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:30.420356  1542 raft_consensus.cc:1217] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[8.5-16.8]   Dedup: 9.6->[13.7-16.8]
I20260709 13:02:30.426311  1542 pending_rounds.cc:85] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 6
I20260709 13:02:30.426314  1690 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:30.426710  1542 pending_rounds.cc:107] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:02:30.426964  1542 raft_consensus.cc:2889] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:30.284426  6573 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.430776  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:30.386729  6708 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.433915  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:30.429705  1547 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:30.320508  6537 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.431293  2270 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.438180  1619 raft_consensus.cc:2368] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:30.416926  6581 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:30.446348  1586 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:30.453416  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:30.432149  6603 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:30.435127  6728 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:30.437546  6732 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:30.341384  6719 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:30.454859  6250 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:30.475898  6581 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:30.515584  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:30.491892  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3215) took 1477 ms. Trace:
W20260709 13:02:30.497139  2265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54488 (request call id 785) took 2063 ms (client timeout 1534 ms). Trace:
I20260709 13:02:30.503551  6729 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.517211  1696 rpcz_store.cc:276] 0709 13:02:29.014215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.531639 (+517424us) service_pool.cc:224] Handling call
0709 13:02:29.538197 (+  6558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.861910 (+323713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.861950 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:29.865856 (+  3906us) log.cc:844] Serialized 26 byte log entry
0709 13:02:30.178927 (+313071us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:30.276159 (+ 97232us) log.cc:844] Serialized 14 byte log entry
0709 13:02:30.284069 (+  7910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.284348 (+   279us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.491602 (+207254us) raft_consensus.cc:1685] finished
0709 13:02:30.491631 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.491807 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43517,"prepare.queue_time_us":121501,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":157531,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":17673,"thread_start_us":661443,"threads_started":3,"wal-append.queue_time_us":545935}
I20260709 13:02:30.505406  6537 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.504068  1548 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:30.511991  6733 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:30.516709  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:30.519927  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 109195us
I20260709 13:02:30.520516  2272 raft_consensus.cc:2368] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
W20260709 13:02:30.475275  6674 consensus_meta.cc:287] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.857s	user 0.012s	sys 0.000s
W20260709 13:02:30.517310  2265 rpcz_store.cc:269] 0709 13:02:28.433920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.434043 (+   123us) service_pool.cc:224] Handling call
0709 13:02:30.496899 (+2062856us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540068ddd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:30.497045 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2716526848}
I20260709 13:02:30.465018  6541 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:30.511766  6701 consensus_meta.cc:287] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 13:02:30.519008  1546 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:30.533749  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:30.432477  6717 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:30.550186  6717 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.550879  6717 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:30.444701  6708 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:30.552153  6713 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.210s	user 0.004s	sys 0.000s
I20260709 13:02:30.454620  6134 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:02:30.554371  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3217) took 1539 ms. Trace:
I20260709 13:02:30.554778  1693 rpcz_store.cc:276] 0709 13:02:29.015095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.536399 (+521304us) service_pool.cc:224] Handling call
0709 13:02:29.577687 (+ 41288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:29.622226 (+ 44539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.622274 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:29.627596 (+  5322us) log.cc:844] Serialized 52 byte log entry
0709 13:02:30.111092 (+483496us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:30.111400 (+   308us) log.cc:844] Serialized 14 byte log entry
0709 13:02:30.122131 (+ 10731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.122228 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.300272 (+178044us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b18002a81a0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a51522 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:02:30.524865 (+224593us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:30.554131 (+ 29266us) raft_consensus.cc:1685] finished
0709 13:02:30.554156 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.554309 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42711,"prepare.queue_time_us":151,"prepare.run_cpu_time_us":161,"prepare.run_wall_time_us":2764,"raft.queue_time_us":147418,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":15785,"spinlock_wait_cycles":60158976,"thread_start_us":430998,"threads_started":1,"wal-append.queue_time_us":564120}
I20260709 13:02:30.556234  6708 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.558655  6708 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:30.544241  1547 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:30.536850  6674 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:30.515494  6693 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:30.521188  6732 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.562408  1614 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:30.516556  6591 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:30.559381  6708 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:30.495322  6475 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:30.584908  2270 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:30.528514  6733 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.567022  6707 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.563555  6098 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.569691  6732 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:30.540696  6711 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.319s	user 0.004s	sys 0.001s
I20260709 13:02:30.564133  6717 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:30.562254  6674 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.575815  6701 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:30.601413  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 155933us
I20260709 13:02:30.598625  1511 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:30.565810  6489 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.581835  6573 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.576054  6561 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.575053  6528 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.571185  6719 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.610872  6717 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.610570  6701 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:02:30.608371  6599 consensus_meta.cc:287] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.798s	user 0.006s	sys 0.006s
I20260709 13:02:30.601671  6732 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:30.597118  6733 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.564884  6523 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:30.640558  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.594863  6541 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.643525  2232 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:30.641471  1615 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:30.658896  2232 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:30.642927  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:30.660535  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.534957  6729 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.663285  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.658957  1539 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
W20260709 13:02:30.672211  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 218885us
I20260709 13:02:30.674449  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:30.675236  1547 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:30.674510  1586 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:30.677390  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:30.677685  1540 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:30.679266  1586 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:30.669768  6719 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:30.681717  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:30.683389  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.684434  1586 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:30.689198  1588 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:30.669100  6574 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:30.690402  1615 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:30.670361  6540 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:30.661545  6744 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:30.690481  6603 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.693256  1586 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:30.643920  6732 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.703222  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.710528  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:30.711879  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:30.705214  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.701823  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:30.716040  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.724304  1615 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:30.716221  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:30.716776  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:30.718262  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:30.680220  5934 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:30.693408  6574 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:30.719158  6675 consensus_meta.cc:287] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.741s	user 0.012s	sys 0.000s
I20260709 13:02:30.719592  6476 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:30.720091  1586 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:30.721640  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.731987  6541 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.734009  6729 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.735626  6528 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.735746  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3216) took 1721 ms. Trace:
I20260709 13:02:30.726356  6574 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.736133  1688 rpcz_store.cc:276] 0709 13:02:29.014641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.532978 (+518337us) service_pool.cc:224] Handling call
0709 13:02:29.533364 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:29.553956 (+ 20592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.554008 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:29.609560 (+ 55552us) log.cc:844] Serialized 26 byte log entry
0709 13:02:29.902708 (+293148us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:29.921789 (+ 19081us) log.cc:844] Serialized 14 byte log entry
0709 13:02:29.955813 (+ 34024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.955891 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:30.522033 (+566142us) spinlock_profiling.cc:243] Waited 6.59 ms on lock 0x7b2400208ce8. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c678d79c4 00007f5c678d5acb 00007f5c67a90dc9 00007f5c67a90a55 00007f5c67a9009d 00007f5c6a6c210e 00007f5c6a6d988c 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221
0709 13:02:30.729614 (+207581us) raft_consensus.cc:1685] finished
0709 13:02:30.735547 (+  5933us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.735688 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61187,"prepare.queue_time_us":19080,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":188691,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":17291,"spinlock_wait_cycles":15159168,"thread_start_us":274708,"threads_started":1,"wal-append.queue_time_us":527910}
I20260709 13:02:30.728269  5934 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.739586   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:30.743775  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:30.744064  6741 log.cc:927] Time spent T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:02:30.744446  1614 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
W20260709 13:02:30.745877  6699 consensus_meta.cc:287] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.001s
I20260709 13:02:30.746284  6699 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:30.747011  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.747762  1621 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:30.748499  6595 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:02:30.750123  5934 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.750155  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:30.728899  6540 raft_consensus.cc:697] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:30.753202  6540 consensus_queue.cc:237] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.753877  6618 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.757539  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.758399  6698 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.760519  6698 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.761113  1543 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:30.700922  6591 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:30.763468  6675 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.767961  1691 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:30.771770  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:30.693256  1588 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:30.725065  2268 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.725184  1692 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.725270  1548 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:30.684518  6573 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:30.723083  1618 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:30.686100  6719 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:30.696746  6098 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:30.789736  1514 leader_election.cc:400] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11.
W20260709 13:02:30.791198  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 98001.2us
I20260709 13:02:30.791849  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:30.792620  1621 raft_consensus.cc:2368] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
W20260709 13:02:30.792678  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 72738.2us
I20260709 13:02:30.794085  1514 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:30.795584  1514 leader_election.cc:400] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
W20260709 13:02:30.796057  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.796674  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:30.797468  1661 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:30.689899  6745 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.783919  6675 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.787845  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:30.788160  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:30.788874  1662 leader_election.cc:400] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:30.783941  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:30.800381  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:30.800978  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:30.792047  1588 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:30.802834  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:30.730028  6476 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.814028  1662 leader_election.cc:403] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:30.816756  1619 raft_consensus.cc:2368] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:30.815979  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:30.818331  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:30.820714  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.814805  1623 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.822065  1695 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:30.828207  1692 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:30.790853  6719 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.844560  1661 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:30.821942  6539 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.846354  6437 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:30.833226  1514 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:30.828984  6698 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:30.821957  5934 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:02:30.853806  6729 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:30.807806  6751 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:02:30.852098  1514 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:30.799685  6597 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:30.812527  6573 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:30.855177  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 70863.2us
I20260709 13:02:30.854200  6729 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.857828  1514 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:30.857990  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:30.812630  6746 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:30.833300  6541 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:30.844486  6476 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.868921  6732 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:30.846191  6381 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:30.872027  1663 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:30.829154  6591 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:02:30.858644  6539 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:30.873929  6539 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:30.862370  1615 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:30.852180  6625 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:30.865296  6699 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.859756  6701 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:30.866061  6707 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.849735  6250 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:02:30.876585  1618 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:30.858580  6573 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.888919  1546 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:02:30.893384  1619 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:30.903873  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:30.892714  1616 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:30.902983  6687 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:30.863586  1661 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:30.829371  6747 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:30.873276  1663 leader_election.cc:400] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14.
I20260709 13:02:30.883589  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.854456  6437 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:30.940258  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.940726  6437 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:30.941886  6437 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:30.900159  6523 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.863283  6746 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.888336  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2940) took 1764 ms. Trace:
I20260709 13:02:30.943547  6746 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.906775  6687 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.943862  1541 rpcz_store.cc:276] 0709 13:02:29.124901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.133391 (+  8490us) service_pool.cc:224] Handling call
0709 13:02:30.888152 (+1754761us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54000c4254. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:30.888285 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1272564096}
I20260709 13:02:30.945268  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:30.945768  6687 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.946367  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:30.946988  1541 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:30.888007  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:30.947677  1543 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.949250  6476 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:30.949378  6733 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.951699  6476 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.952785  1663 leader_election.cc:403] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:30.896727  6603 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:30.940320  6747 raft_consensus.cc:697] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:30.941180  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:30.941982  1618 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:30.827441  6745 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:30.955067  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 81928.2us
I20260709 13:02:30.955932  1663 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:30.858438  5934 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
W20260709 13:02:30.953212  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 89696.4us
I20260709 13:02:30.886075  1615 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:30.860435  6698 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:30.976095  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:30.969924  6708 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.978042  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:31.000129  2267 raft_consensus.cc:2368] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
I20260709 13:02:30.978356  1616 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:31.000972  2268 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:30.978621  1587 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:31.004802  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.005515  1688 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:30.967821  1545 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:30.974661  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:30.979192  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:30.979363  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:30.969779  6747 consensus_queue.cc:237] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:30.971696  1615 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:30.959347  6599 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14.
W20260709 13:02:31.011521  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 55651.2us
I20260709 13:02:31.012607  1663 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:30.954316  6618 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:30.971715  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:30.980909  1511 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:30.963743  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:31.013731  1541 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.889006  6701 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.014264  1513 leader_election.cc:400] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
I20260709 13:02:30.862329  6729 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:30.906441  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 58305.4us
I20260709 13:02:30.886881  1623 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:30.969050  6745 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:30.990651  1547 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:31.023423  1691 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:31.007071  1540 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 6.
I20260709 13:02:31.007807  2269 raft_consensus.cc:2368] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:31.009176  2265 raft_consensus.cc:2393] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:31.008874  5934 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.009421  1692 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:31.016960  6437 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:30.964418  1543 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:31.010368  1661 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:31.014791  1513 leader_election.cc:403] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:02:31.015352  1695 raft_consensus.cc:1275] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:31.015872  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:31.021962  1663 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:30.907519  6573 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.022780  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.045472  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:31.011525  6603 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.875540  6541 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.016571  6618 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.035532  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:31.047878  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:31.022312  6701 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.048629  1663 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:31.046437  1543 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:31.005275  6574 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:31.054636  6574 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:31.055089  6625 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:31.023711  6733 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:31.025597  6707 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:31.044167  6726 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:02:31.050817  6599 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.051366  6697 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:31.079746  6697 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.080228  6697 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.080509  1616 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:31.081310  6573 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:31.052455  6618 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.083585  6694 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:31.070479  6539 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:31.055220  6250 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:31.087775  6539 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.047106  1693 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:31.088167  6539 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:31.088897  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:31.089942  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:31.090435  1693 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.080421  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 2119) took 1633 ms. Trace:
I20260709 13:02:31.091675  1696 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:31.056788  2272 raft_consensus.cc:2368] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13.
I20260709 13:02:31.058090  6433 consensus_queue.cc:1059] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:31.058948  6586 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:31.060559  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:31.065093  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.065411  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.065831  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.073694  1623 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:31.071298  6625 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.074863  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.036549  5934 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.091774  6698 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.094805  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:31.103062  6433 raft_consensus.cc:3055] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:31.091718  1544 rpcz_store.cc:276] 0709 13:02:29.446846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.448798 (+  1952us) service_pool.cc:224] Handling call
0709 13:02:29.449192 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.482807 (+ 33615us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:29.781507 (+298700us) log.cc:844] Serialized 14 byte log entry
0709 13:02:30.152828 (+371321us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:30.152898 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:30.152960 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.080214 (+927254us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b540023f0d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:31.080258 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.080369 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":443564,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":44546,"raft.run_cpu_time_us":4497,"raft.run_wall_time_us":31742,"spinlock_wait_cycles":76751232,"thread_start_us":656459,"threads_started":2,"wal-append.queue_time_us":446968}
I20260709 13:02:31.112807  6701 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.047245  6584 consensus_queue.cc:1059] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:02:31.083611  6573 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:31.118467  6584 raft_consensus.cc:3055] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:31.118860  6584 raft_consensus.cc:740] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:31.070222  6705 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:02:31.120394  6584 consensus_queue.cc:260] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:31.097255  1689 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:31.111491  6433 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:31.122014  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:31.026218  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:02:31.122841  1619 raft_consensus.cc:606] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:31.122464  6433 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:31.123199  1619 raft_consensus.cc:614] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:31.099633  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:31.060696  6541 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:31.125939  1692 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:02:31.111155  1694 raft_consensus.cc:2393] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:31.114801  6701 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:31.099557  1541 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:31.124756  1586 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:31.109742  1695 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.096565  6688 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:02:31.127022  1692 pending_rounds.cc:85] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 6
I20260709 13:02:31.106611  6625 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.093644  6707 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:31.072678  1588 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:31.130599  1692 pending_rounds.cc:107] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:02:31.126696  1543 raft_consensus.cc:1275] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:31.134495  1692 raft_consensus.cc:2889] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:31.135511  6696 consensus_queue.cc:1059] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:02:31.142103  6696 raft_consensus.cc:3055] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:31.142508  6696 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:31.131887  6540 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:02:31.143306  6696 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.144443  6696 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.132011  6574 consensus_queue.cc:1048] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:02:31.124153  6433 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:31.158223  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:31.160517  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 87911.9us
I20260709 13:02:31.166183  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.088167  6250 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:31.173368  6250 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:31.168497  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.174113  1694 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:31.174546  1693 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:31.175165  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.153298  6471 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:02:31.166237  6573 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:31.175493  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.175854  6746 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.176278  1693 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:31.177115  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.177155  6603 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:31.177884  6746 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:31.178030  1693 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:31.178431  5934 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:31.179112  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:31.179804  2271 raft_consensus.cc:2393] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:31.180732  6723 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:31.182945  6574 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:31.153056  6134 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.187090  1695 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
W20260709 13:02:31.187840  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 330087us
I20260709 13:02:31.188491  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:31.189811  1514 leader_election.cc:400] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:31.190714  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:31.170554  6729 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.196949  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:31.197273  6729 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:31.197512  1691 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.192998  6250 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.199736  6250 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:31.202103  6724 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.852s	user 0.000s	sys 0.004s
I20260709 13:02:31.202427  6250 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:31.205389  6537 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:31.205852  6537 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.136693  6707 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.206208  6537 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.210029  6719 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.211006  1539 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.190021  2231 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:31.213009  6705 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:31.213644  6705 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:02:31.193598  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.194612  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.194896  6584 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.225863  1663 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:31.195159  6573 raft_consensus.cc:697] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:31.227363  6759 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:31.228157  6573 consensus_queue.cc:237] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:31.231778  1662 leader_election.cc:400] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13.
I20260709 13:02:31.231891  1691 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:31.232161  1662 leader_election.cc:403] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:31.232782  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.220396  6574 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.242899  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.222947  1620 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:31.224725  6471 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.246193  6471 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:31.247085  6574 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:31.248495  6471 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:31.225064  6512 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.249364  6574 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:31.239782  6250 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 13:02:31.252818  6758 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:02:31.214681  6705 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:31.224879  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.255940  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.225530  6694 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.233618  5934 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:31.265820  5934 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.236186  6759 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13.
I20260709 13:02:31.234755  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:31.221067  1586 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:31.244798  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:31.269649  1616 raft_consensus.cc:2393] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 12: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:31.161298  6618 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.220309  1539 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:31.245303  1588 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:31.260821  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.273975  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:31.274192  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:31.274641  2272 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:31.268440  1615 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
W20260709 13:02:31.280994  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 60017.4us
I20260709 13:02:31.282610  1586 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:31.284807  1663 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:31.285696  6719 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:31.285048  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 94424.2us
I20260709 13:02:31.287317  1514 leader_election.cc:400] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
I20260709 13:02:31.288132  1514 leader_election.cc:400] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:31.288796  1514 leader_election.cc:403] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:31.292124  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:31.295064  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 49835.4us
I20260709 13:02:31.298956  1662 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:31.295369  1692 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:31.239642  6434 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:02:31.301005  6476 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:31.270422  6694 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.302183  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:02:31.302812  1615 raft_consensus.cc:606] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:31.303833  6694 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:31.305445  6618 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:31.306653  6625 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.309401  1618 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:31.309198  6697 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:31.340197  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.322538  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:31.315260  6581 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:31.312222  6674 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.371711  1615 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.371538  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:31.270150  6599 consensus_queue.cc:1059] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:02:31.373917  5934 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:31.374709  1689 raft_consensus.cc:2368] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13.
I20260709 13:02:31.377751  1690 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:31.319439  6696 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:31.316856  6471 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:31.312363  6728 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:31.398556  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:31.386251  6696 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:31.402352  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.404821  6625 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:31.408306  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:31.408922  1623 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.388517  6618 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:31.384413  6581 raft_consensus.cc:697] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:31.384446  6674 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:31.410387  6728 raft_consensus.cc:697] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:31.385185  6471 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.436779  6732 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:31.436951  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 456079us
I20260709 13:02:31.437613  6381 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:31.422367  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:31.427317  6755 log.cc:927] Time spent T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.283s	user 0.000s	sys 0.002s
W20260709 13:02:31.428615  6757 log.cc:927] Time spent T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:02:31.434252  1623 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:31.437990  1511 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:31.410652  6696 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.454573  6541 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.455737  6699 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:31.456291  6699 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.456662  6541 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:31.457369  1693 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:02:31.446350  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.459095  1690 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:31.447057  5934 raft_consensus.cc:3055] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:31.448344  6744 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.448877  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:31.453794  1663 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:31.437990  6381 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:31.412606  6537 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:31.462214  1691 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:02:31.462674  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 448534us
I20260709 13:02:31.460688  5934 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:31.444064  6471 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:31.472146  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:31.409488  6707 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.439553  6618 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.468434  6717 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10.
I20260709 13:02:31.439718  6539 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.487812  2272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:31.489737  2272 raft_consensus.cc:606] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:31.490154  2272 raft_consensus.cc:614] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:31.474618  6381 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.475474  6437 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:31.496210  1695 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:31.495774  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 207815us
I20260709 13:02:31.495697  5934 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.497146  1514 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:31.470214  6574 consensus_queue.cc:1048] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:02:31.519564  5934 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.521487  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:31.522264  1547 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.528008  1688 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:31.529724  1513 leader_election.cc:400] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:31.532793  1695 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
W20260709 13:02:31.537665  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 99745.3us
I20260709 13:02:31.538321  1511 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:31.538955  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:31.539567  1543 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:31.552147  1547 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
W20260709 13:02:31.589267  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.634173  6599 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.634893  6599 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.540745  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:31.645121  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 148090us
I20260709 13:02:31.539754  1586 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:02:31.649396  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 90008.5us
I20260709 13:02:31.436982  6728 consensus_queue.cc:237] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.503490  6698 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:31.666752  1540 raft_consensus.cc:2393] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:02:31.671928  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 133668us
I20260709 13:02:31.672678  1511 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:31.651829  2232 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:31.680217  1541 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:02:31.673666  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 134005us
I20260709 13:02:31.528950  6437 raft_consensus.cc:697] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:31.532922  6744 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:31.679517  6761 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:02:31.687502  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:02:31.688397  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 138069us
I20260709 13:02:31.646879  6699 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:31.671298  6523 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:31.700626  6437 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.702394  1511 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:31.784610  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 82331.2us
I20260709 13:02:31.785878  1511 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:31.662760  6763 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.750725  6697 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:31.751909  6599 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:31.685050  6751 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:31.696177  6705 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.690261  6134 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.686295  6717 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:02:31.753185  6765 log.cc:927] Time spent T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:02:31.723557  6597 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.693712  6719 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.535688  6581 consensus_queue.cc:237] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.707121  6744 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.724764  2232 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:31.811805  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 87136.7us
I20260709 13:02:31.733880  6483 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:02:31.793515  6763 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:31.699190  1586 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:31.795961  6751 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.788307  6708 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:31.790004  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:02:31.820519  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 121553us
I20260709 13:02:31.823624  1542 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:31.800979  6523 raft_consensus.cc:697] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:31.797072  6705 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:31.809134  6747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.016s	sys 0.000s
I20260709 13:02:31.806322  1615 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:31.815304  6719 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:31.844753  6381 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:31.847115  6766 log.cc:927] Time spent T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260709 13:02:31.848403  1546 raft_consensus.cc:1240] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:31.824524  6751 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.852492  6744 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:31.853353  6768 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:02:31.855203  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.839041  6747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.017s	sys 0.000s
I20260709 13:02:31.856343  6708 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:31.856864  6708 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.858824  6708 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:31.839545  6705 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.860261  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:31.860904  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:31.809514  6717 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.862684  6573 raft_consensus.cc:2764] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:02:31.863381  6717 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:31.843618  6719 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.860941  1692 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:02:31.815785  6767 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.412s	user 0.001s	sys 0.001s
I20260709 13:02:31.865437  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:31.866149  1692 raft_consensus.cc:2368] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:31.823637  6134 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:31.866852  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.835927  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:31.867719  1691 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.816004  6433 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:31.817260  6707 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:31.838178  6539 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:31.868358  6523 consensus_queue.cc:237] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:31.839613  6745 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:31.863909  6573 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:31.824340  1586 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:31.873769  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 49507.6us
I20260709 13:02:31.874547  1692 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:31.881136  1546 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:02:31.873890  2234 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:31.876827  1663 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:31.882952  1546 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:31.882992  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8820554e3d9a4662b150408d84019889"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:02:31.884330  1620 raft_consensus.cc:606] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:31.884670  1620 raft_consensus.cc:614] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:31.885456  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:31.886050  1539 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:31.886891  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:31.887365  1539 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:31.891623  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:31.891829  1586 leader_election.cc:400] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13.
I20260709 13:02:31.892223  1622 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:31.894871  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:31.895375  1621 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:31.896317  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:31.899003  1663 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:31.900134  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:31.901923  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:31.902608  1619 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:31.903306  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:31.904033  1617 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:31.917164  1689 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:31.918418  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:31.919039  1622 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.921561  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:31.922472  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:31.923889  1543 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:31.926841  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:31.927567  1619 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:31.933710  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:31.934850  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:31.944945  1544 raft_consensus.cc:2368] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13.
I20260709 13:02:31.944811  1691 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
W20260709 13:02:31.950191  6732 consensus_meta.cc:287] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.000s
I20260709 13:02:31.950635  6732 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.951666  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:31.952800  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:31.953504  1540 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 13: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:31.954206  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:31.959106  6779 log.cc:927] Time spent T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:31.960479  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:31.961555  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:31.955206  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:31.963164  1540 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:31.925625  6694 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:31.967024  6694 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.926244  6574 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:31.968463  6574 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:31.968840  6574 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.969182  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 1179) took 1195 ms. Trace:
I20260709 13:02:31.969594  1548 rpcz_store.cc:276] 0709 13:02:30.773894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.019218 (+245324us) service_pool.cc:224] Handling call
0709 13:02:31.019577 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.457967 (+438390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.457996 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.476838 (+ 18842us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.822074 (+345236us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:31.822100 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.822143 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:31.968973 (+146830us) raft_consensus.cc:1685] finished
0709 13:02:31.968994 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.969118 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":493380,"raft.queue_time_us":442369,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3152,"thread_start_us":320898,"threads_started":1,"wal-append.queue_time_us":455758}
I20260709 13:02:31.971838  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:31.971349  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:31.901369  6707 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:31.973018  1540 raft_consensus.cc:2393] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:31.978401  1511 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:31.980611  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.984256  1548 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:31.985374  1622 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:31.942315  1539 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:31.982082  1514 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:31.990643  6732 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.990872  6674 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:31.991632  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:31.992619  1615 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:31.993517  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:31.888046  6747 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:31.997555  1621 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:32.000494  2272 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:02:32.029732  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 51390.9us
I20260709 13:02:32.035434  1511 leader_election.cc:400] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:32.035800  1511 leader_election.cc:403] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:31.992841  6381 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:32.038578  1514 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:31.995223  6694 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:32.038347  1663 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:32.044780  1663 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:32.089304  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 56089.6us
I20260709 13:02:32.094338  6697 raft_consensus.cc:2764] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:02:32.096068  6697 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:32.096714  6697 raft_consensus.cc:697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:32.097755  6697 consensus_queue.cc:237] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:32.099946  6744 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:31.901772  6696 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.102200  6574 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.103101  6696 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:32.104372  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 65875.9us
I20260709 13:02:32.109223  1511 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:32.109583  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:32.110379  1615 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:32.126964  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:31.999882  6707 raft_consensus.cc:697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:32.040367  6732 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:32.134624  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 3235) took 1060 ms. Trace:
I20260709 13:02:32.142395  1688 rpcz_store.cc:276] 0709 13:02:31.065100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.065204 (+   104us) service_pool.cc:224] Handling call
0709 13:02:32.125481 (+1060277us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b5400148554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:32.125611 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":989583744}
I20260709 13:02:32.135566  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:32.137373  1587 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:32.161849  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:32.129315  6717 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:32.167528  1615 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
W20260709 13:02:32.166797  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 136433us
I20260709 13:02:32.111543  6744 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:32.133358  6745 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:32.172600  2272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "953db44baef24f55a28e65ff051866d1"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:53842
W20260709 13:02:32.161863  6771 log.cc:927] Time spent T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:02:32.174777  1663 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:32.173946  2272 raft_consensus.cc:606] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:32.183946  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:32.185745  2265 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:32.157215  6250 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:32.187575  1688 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:32.193367  6416 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.194005  6416 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.134153  6751 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:32.201113  1545 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:02:32.204219  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.206645  1688 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:02:32.208302  1688 pending_rounds.cc:85] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 8
I20260709 13:02:32.208745  1688 pending_rounds.cc:107] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:02:32.208985  1688 raft_consensus.cc:2889] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:32.173262  6603 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:32.174292  6745 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:32.176116  6717 raft_consensus.cc:697] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:32.163205  6705 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.191771  6599 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:32.222687  1540 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:32.172588  6512 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:02:32.183259  6744 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:32.222216  6745 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:32.250319  6781 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:02:32.213068  6756 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:02:32.221061  6381 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:32.231734  6599 raft_consensus.cc:697] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:32.222091  6603 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:32.255057  6574 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:32.259455  6471 consensus_meta.cc:287] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.771s	user 0.007s	sys 0.003s
W20260709 13:02:32.281301  6788 log.cc:927] Time spent T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:32.232826  6707 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:32.277396  6784 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
W20260709 13:02:32.306308  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 136746us
I20260709 13:02:32.319916  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:32.324406  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:32.325424  1622 raft_consensus.cc:2368] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 12. Current term is 13.
I20260709 13:02:32.278753  6471 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:32.336974  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:32.307564  6759 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.340518  2234 leader_election.cc:400] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 12. Current term is 13.
W20260709 13:02:32.347570  6762 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.869s	user 0.000s	sys 0.006s
I20260709 13:02:32.348055  1617 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:32.269613  6717 consensus_queue.cc:237] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:32.327759  6756 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:02:32.366674  1690 raft_consensus.cc:2368] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15.
W20260709 13:02:32.367660  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.370925  2234 leader_election.cc:403] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:32.373435  6759 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:32.391009  6794 log.cc:927] Time spent T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:02:32.337030  6599 consensus_queue.cc:237] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.367344  6751 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:32.380434  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 53914.9us
I20260709 13:02:32.399073  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:32.381978  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 920) took 1077 ms. Trace:
W20260709 13:02:32.391779  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.394649  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:32.374752  6719 consensus_meta.cc:287] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 13:02:32.295954  6747 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:32.397509  6759 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:32.399467  6437 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:32.380836  6603 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:32.401193  1691 rpcz_store.cc:276] 0709 13:02:31.305049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.973459 (+668410us) service_pool.cc:224] Handling call
0709 13:02:31.973715 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.974067 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.974107 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.974541 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.184434 (+209893us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:32.184474 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.184538 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.381772 (+197234us) raft_consensus.cc:1685] finished
0709 13:02:32.381792 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.381921 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":192327,"threads_started":1,"wal-append.queue_time_us":312505}
I20260709 13:02:32.423983  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:32.433318  2265 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:32.377912  6705 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:32.437736  6790 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for earlier term 12. Current term is 13.
W20260709 13:02:32.439742  6800 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:02:32.440419  6799 log.cc:927] Time spent T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:02:32.420751  6747 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:32.446291  6744 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:32.391515  6696 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:32.395810  6539 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:32.437009  6437 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:32.481418  6801 log.cc:927] Time spent T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:02:32.482798  6437 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:32.431512  6719 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:32.470431  6798 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:02:32.504941  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:32.506364  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:32.464745  6250 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:02:32.532543  1618 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:02:32.535706  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 147834us
I20260709 13:02:32.535955  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:32.538065  1543 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:32.537297  1621 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:32.539134  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:32.539976  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:32.540136  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:32.531879  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:32.541672  1621 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:32.541772  1619 raft_consensus.cc:2393] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:32.544612  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:32.499814  6471 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:32.545253  1614 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:32.532948  6768 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:02:32.551990  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 126909us
I20260709 13:02:32.474364  6539 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.489499  6744 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:32.473284  6696 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.573532  1543 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:32.547644  1586 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:32.552716  1661 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:32.545655  6694 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:32.554332  6528 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.542665  6437 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.635603  6437 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:32.638016  6437 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:32.578709  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:02:32.638980  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 60341.8us
I20260709 13:02:32.642096  1661 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:32.630548  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 82995.1us
I20260709 13:02:32.644958  6416 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:02:32.650599  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:32.633424  6804 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:32.651245  1622 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:32.553252  6708 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:32.553691  6381 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:32.565784  6471 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:32.639263  6437 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:32.630251  6599 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:32.676244  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3242) took 1608 ms. Trace:
I20260709 13:02:32.676793  1693 rpcz_store.cc:276] 0709 13:02:31.067321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.178655 (+111334us) service_pool.cc:224] Handling call
0709 13:02:31.178970 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.457787 (+278817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.675970 (+1218183us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b540022f954. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:32.676186 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639746944}
I20260709 13:02:32.655997  6807 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:32.631121  6744 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:32.653231  6528 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:32.679006  6437 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:32.663146  6381 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:32.703737  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:32.670312  6471 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.713007  1544 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:32.676213  6708 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.727933  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:32.700711  6599 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.730757  6537 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:32.703119  6437 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:32.732414  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:32.692035  6707 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:32.746022  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 103983us
I20260709 13:02:32.747985  1661 leader_election.cc:400] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13.
I20260709 13:02:32.750916  1661 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:32.748445  6707 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:32.754419  6697 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:32.756688  1661 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:32.759999  6707 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:32.760783  6686 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.761307  6686 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.728076  6618 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:32.763557  2272 raft_consensus.cc:2393] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:32.700995  6811 consensus_queue.cc:1059] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:02:32.772050  1514 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:32.765933  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 918) took 1549 ms. Trace:
I20260709 13:02:32.775899  1692 rpcz_store.cc:276] 0709 13:02:31.216964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.889091 (+672127us) service_pool.cc:224] Handling call
0709 13:02:31.889360 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.889678 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.889715 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.932795 (+ 43080us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.168441 (+235646us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:32.168510 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.168598 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.762920 (+594322us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b540034c4a0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6aab3dbe 00007f5c6aabe930 00007f5c6aabe8d8 00007f5c6aabe858 00007f5c6aabe813 00007f5c6aabda9c 00007f5c709a9626 00007f5c709a3dd8 00007f5c6aafa7cb 00007f5c6aafd2c0
0709 13:02:32.765622 (+  2702us) raft_consensus.cc:1685] finished
0709 13:02:32.765644 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.765871 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":450,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":19477,"spinlock_wait_cycles":5549440,"thread_start_us":204638,"threads_started":1,"wal-append.queue_time_us":221722}
I20260709 13:02:32.780642  1514 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:32.763392  6686 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:32.784924  1663 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:32.759438  1661 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:32.744405  6599 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:32.779739  6698 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:02:32.782549  6751 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:32.778259  6717 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:32.768755  6719 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:32.768392  6539 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:32.793633  6707 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:32.800189  6537 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:32.801491  6745 consensus_meta.cc:287] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.002s
I20260709 13:02:32.809819  6707 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.813843  6707 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:32.781600  6697 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:02:32.792500  6694 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:32.835439  6708 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:32.842010  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 58716.7us
I20260709 13:02:32.842947  1514 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:32.845746  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:32.844383  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:32.840579  6811 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:32.812963  6745 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:32.844830  6813 log.cc:927] Time spent T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:02:32.812450  6747 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:32.859898  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 100523us
I20260709 13:02:32.861871  1661 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:32.844985  6694 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:32.846154  6708 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:32.838757  1614 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
W20260709 13:02:32.858753  6814 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:02:32.853047  6812 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:02:32.868911  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:32.863094  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 74414.7us
I20260709 13:02:32.869025  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:32.857859  6816 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:02:32.854995  6811 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:32.879981  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:32.882889  1693 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:02:32.879781  6818 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:02:32.871011  6528 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:32.883876  6822 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:32.884299  6811 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:32.885636  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:32.886309  1617 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 14.
I20260709 13:02:32.888167  6599 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:32.896466  6539 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.897102  2234 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:32.896999  6539 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.897862  2265 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:32.897958  6416 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:32.898438  6416 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.898794  6416 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:32.903079  1663 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:32.868178  6698 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:32.915228  1693 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:32.878468  6381 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:32.870733  6694 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:32.919144  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3251) took 1634 ms. Trace:
I20260709 13:02:32.919615  1689 rpcz_store.cc:276] 0709 13:02:31.284652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.929014 (+644362us) service_pool.cc:224] Handling call
0709 13:02:31.929382 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.929797 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.929837 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.930399 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:02:32.499848 (+569449us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b180029d220. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de0d1 00007f5c6aaf9a0f
0709 13:02:32.645164 (+145316us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:32.645311 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:32.645706 (+   395us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.918854 (+273148us) raft_consensus.cc:1685] finished
0709 13:02:32.918874 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:32.919088 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":10446,"spinlock_wait_cycles":27274496,"thread_start_us":132439,"threads_started":1,"wal-append.queue_time_us":754235}
I20260709 13:02:32.902904  6471 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:32.908769  6697 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:32.932947  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 2074) took 1719 ms. Trace:
I20260709 13:02:32.933413  1695 rpcz_store.cc:276] 0709 13:02:31.213373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.270704 (+ 57331us) service_pool.cc:224] Handling call
0709 13:02:32.932786 (+1662082us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540035e3d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:32.932892 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467410176}
I20260709 13:02:32.945097  6694 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:32.913650  6810 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:02:32.940146  6697 raft_consensus.cc:697] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:32.959885  6437 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.993395  6437 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:32.993695  6823 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:32.993929  6437 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:32.994215  6823 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.994411  6437 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:32.996263  6823 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:32.993419   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:02:33.000381  6780 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 1.048s	user 0.009s	sys 0.012s
I20260709 13:02:32.989228  6745 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:33.001587  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 2069) took 1789 ms. Trace:
I20260709 13:02:33.001935  1697 rpcz_store.cc:276] 0709 13:02:31.212053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.729070 (+517017us) service_pool.cc:224] Handling call
0709 13:02:31.735524 (+  6454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.765268 (+ 29744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.765315 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:31.766898 (+  1583us) log.cc:844] Serialized 26 byte log entry
0709 13:02:31.808690 (+ 41792us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:31.808748 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.808839 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:32.999819 (+1190980us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:33.001309 (+  1490us) raft_consensus.cc:1685] finished
0709 13:02:33.001329 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.001531 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22682,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6124,"spinlock_wait_cycles":31503104,"thread_start_us":32219,"threads_started":1,"wal-append.queue_time_us":50273}
I20260709 13:02:33.003897  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:33.004571  1546 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:33.005040  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 2156) took 1117 ms. Trace:
I20260709 13:02:33.005335  1546 rpcz_store.cc:276] 0709 13:02:31.887386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.003641 (+1116255us) service_pool.cc:224] Handling call
0709 13:02:33.004987 (+  1346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:33.019134  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:33.020092  1689 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:32.981904  6618 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.024442  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:33.006937  6416 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.027449  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:33.028059  1695 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.031965  6416 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:33.034175  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:33.035701  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:33.035894  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:33.036352  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:33.036525  1614 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:33.036423  1615 raft_consensus.cc:2393] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:33.049510  1623 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:33.039108  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:33.080435  1619 raft_consensus.cc:1275] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:33.085953  1695 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:33.029206  6618 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.052995  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:33.087031  1618 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:33.091399  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:33.100559  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:33.105198  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:33.106038  2265 raft_consensus.cc:2368] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:33.037537  6437 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:33.053483  1663 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:33.089412  6827 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:02:33.110965  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 57606.1us
I20260709 13:02:33.119580  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:33.095137  1623 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:33.117940  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:33.128603  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:33.129161  1697 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:33.129324  1693 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 17: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:33.130283  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:33.131655  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:33.131860  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:33.135825  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:33.139081  1547 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:33.128002  6471 consensus_queue.cc:1048] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:02:33.139572  6745 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:33.140218  6745 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:33.142686  6745 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:33.146183  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:33.146879  1689 raft_consensus.cc:2368] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:33.149514  1688 raft_consensus.cc:2368] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:33.100559  6696 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:33.107707  6825 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.039649  6707 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:33.132947  6819 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:33.130110  6489 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:33.143257  6745 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:33.170379  1511 leader_election.cc:400] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15.
W20260709 13:02:33.171356  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 90477.2us
I20260709 13:02:33.175462  1697 raft_consensus.cc:2410] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:33.196004  1695 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:02:33.091789  6697 consensus_queue.cc:237] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:33.167063  6790 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:33.205672  1511 leader_election.cc:403] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:33.212042  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 48137.6us
I20260709 13:02:33.184007  6824 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.170558  6825 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:33.194777  6696 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:33.212702  6381 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:33.177434  6819 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.185678  6489 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.222178  6819 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:33.186650  6745 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.215237  6824 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.214480  6686 raft_consensus.cc:993] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:02:33.220093  6790 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.227372  6489 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:33.244202  6581 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.244720  6581 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:33.245602  6747 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:33.247274  6817 raft_consensus.cc:3055] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:33.247711  6817 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:33.247895  6698 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:33.248486  6698 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.250978  6698 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:33.252761  6539 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:33.227700  6745 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:33.229344  6825 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:33.232873  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:33.254650  6744 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:33.233944  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2966) took 1096 ms. Trace:
I20260709 13:02:33.264424  1544 rpcz_store.cc:276] 0709 13:02:32.137749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.137881 (+   132us) service_pool.cc:224] Handling call
0709 13:02:32.158901 (+ 21020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.714412 (+555511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.233732 (+519320us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54000a9bd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:33.233888 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1273245056}
I20260709 13:02:33.240259  1692 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:33.240386  6686 raft_consensus.cc:1081] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:02:33.240772  1697 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:33.266640  6437 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:33.241478  6824 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:33.270234  6437 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.271392  6381 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15.
I20260709 13:02:33.222728  6696 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.238085  1586 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:33.274078  6696 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:33.274804  6824 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:33.239917  6829 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:33.259918  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:33.277866  6618 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:33.278092  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 2962) took 1366 ms. Trace:
I20260709 13:02:33.278466  1543 rpcz_store.cc:276] 0709 13:02:31.911518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.961342 (+ 49824us) service_pool.cc:224] Handling call
0709 13:02:33.277922 (+1316580us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b5400303254. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:33.278029 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324663552}
I20260709 13:02:33.282254  1539 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:33.283288  6707 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:33.256940  6581 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:33.284109  6581 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:33.268482  6745 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.268630  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:33.288899  6745 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:33.284677  6719 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:33.290588  6719 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.291647  6745 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:33.292923  6512 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:33.293298  6098 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:33.293709  6098 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:33.292901  6719 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:33.296149  6437 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:33.287854  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 1197) took 1448 ms. Trace:
I20260709 13:02:33.294450  6098 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:33.298749  1542 rpcz_store.cc:276] 0709 13:02:31.839068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.839384 (+   316us) service_pool.cc:224] Handling call
0709 13:02:31.867648 (+ 28264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.868081 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:31.868120 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.988433 (+1120313us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b2c000e1a38. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:02:32.988795 (+   362us) log.cc:844] Serialized 26 byte log entry
0709 13:02:33.152554 (+163759us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:33.152596 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.152659 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.287582 (+134923us) raft_consensus.cc:1685] finished
0709 13:02:33.287602 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.287798 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":942,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":14323072,"thread_start_us":73313,"threads_started":1,"wal-append.queue_time_us":241411}
I20260709 13:02:33.297187  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:33.254591  6811 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:33.324970  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 2960) took 1414 ms. Trace:
I20260709 13:02:33.326560  1540 rpcz_store.cc:276] 0709 13:02:31.910870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.976342 (+ 65472us) service_pool.cc:224] Handling call
0709 13:02:31.976717 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.226797 (+250080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.299579 (+1072782us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54000a91d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:33.324911 (+ 25332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564989184}
I20260709 13:02:33.326051  6098 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:33.331785  6719 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:33.332340  6719 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.332625  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:33.333585  1622 raft_consensus.cc:2368] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:33.334456  6719 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:33.335454  1622 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:33.336594  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:33.337374  6483 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.357138  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:33.340076  6817 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:33.361398  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:33.362041  1546 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:33.368027  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:33.368139  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:33.369297  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:33.370565  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:33.373700  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:33.374486  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:33.375074  1697 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:33.372947  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:33.378443  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 330160us
I20260709 13:02:33.342417  6707 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.343833  1663 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:33.273167  6790 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:33.345618  6811 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:33.356905  6483 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.337939  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:33.218746  1511 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:33.408258  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 193428us
I20260709 13:02:33.409721  1511 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:33.396337  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:33.390177  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:33.399833  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:33.412873  1614 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:33.398684  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:33.413250  1544 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.380075  1618 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:02:33.416041  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:33.417585  1511 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:33.405859   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:33.242690  6819 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:33.415019  6707 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:33.423789  6817 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:33.526299  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 108887us
I20260709 13:02:33.737702  1511 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:33.691555  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 489898us
W20260709 13:02:33.706681  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 324485us
I20260709 13:02:33.377033  6381 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:33.433569  6745 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:33.721910  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.399981  6416 consensus_queue.cc:1059] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:02:33.722421  1689 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:33.412245  6835 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:02:33.690376  1548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.003s	sys 0.011s
I20260709 13:02:33.722735  1544 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
W20260709 13:02:33.776692  1548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.004s	sys 0.012s
I20260709 13:02:33.419940  6822 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:33.739356  1692 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:33.749555  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:33.748579  6381 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.753266  1616 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:33.739162  6759 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.778084  6759 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:33.778565  6822 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:33.779217  6381 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:33.779804  6381 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:33.779508  6822 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:33.780459  6759 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:33.781116  6581 consensus_queue.cc:1059] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:02:33.738246  6489 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:33.757678  6707 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:33.759513  1621 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:33.759847  6437 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:33.720386  6744 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:33.733269  6719 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:33.767573  6618 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:33.770680  6825 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:33.819840  6825 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:33.763954  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 326170us
I20260709 13:02:33.784749  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:33.747988  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.783464  6811 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:33.875941  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 45202.3us
I20260709 13:02:33.876753  1586 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:33.901932  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33072 (request call id 136) took 17115 ms (client timeout 15000 ms). Trace:
W20260709 13:02:33.913534  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 175891us
I20260709 13:02:33.817533  1514 leader_election.cc:400] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:33.938656  1511 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:33.923231  1514 leader_election.cc:403] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:33.876024  6537 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.822760  6744 raft_consensus.cc:697] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:33.897197  6790 raft_consensus.cc:3055] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:33.795989  6437 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:34.000049  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 61513.1us
I20260709 13:02:33.823113  6719 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.001302  6745 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:34.002113  1511 leader_election.cc:400] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:33.991860  6696 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.002825  6719 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.002753  1511 leader_election.cc:400] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:34.004886  6696 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.005447  1511 leader_election.cc:403] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:34.006014  6849 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 11. Current term is 12.
I20260709 13:02:34.006961  6696 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:34.007319  1511 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:34.008126  6719 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:33.848093  6618 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.010692  6618 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.011777  6483 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:33.956112  6134 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 13:02:34.017138  6098 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.686s	user 0.002s	sys 0.015s
W20260709 13:02:34.019771  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 202452us
I20260709 13:02:34.020007  6437 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.020869  6719 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:33.994117  6537 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:34.026755  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.006s	sys 0.022s
W20260709 13:02:34.027141  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.006s	sys 0.022s
I20260709 13:02:34.031122  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.031955  2263 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
W20260709 13:02:34.047079  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 308280us
I20260709 13:02:34.026280  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:33.999717  6573 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:33.903962  6811 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:33.994813  6790 raft_consensus.cc:740] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:34.065443  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:34.038512  6745 consensus_queue.cc:1059] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:02:34.082261  6537 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:34.094192  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.027959  6437 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:34.083765  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:34.118489  1544 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:34.118392  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:34.072050  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 45860.2us
I20260709 13:02:34.091794  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.119887  1545 raft_consensus.cc:2410] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:34.082885  6851 consensus_queue.cc:1059] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:34.060431  6489 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.124738  1514 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:34.068682  6573 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.131151  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.133778  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:34.134268  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.088972  6751 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:33.902392  1442 rpcz_store.cc:269] 0709 13:02:16.685058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.685267 (+   209us) service_pool.cc:224] Handling call
0709 13:02:16.753777 (+ 68510us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b5400002210. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a1a0b2 00007f5c70993a89 00007f5c7092bda6 00007f5c708fd088 00007f5c709fb37e 00007f5c6eebc2a4 00007f5c6eebc232 00007f5c6eebc161 00007f5c6eebc0dc
0709 13:02:33.800785 (+17047008us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:28.579729 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:28.580418 (+   689us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:28.580466 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:02:28.580492 (+    26us) tablet.cc:662] Decoding operations
0709 13:02:28.581666 (+  1174us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:28.581730 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:28.581760 (+    30us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:02:28.582885 (+  1125us) tablet.cc:701] Row locks acquired
0709 13:02:28.582937 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:02:28.583113 (+   176us) write_op.cc:270] Start()
0709 13:02:28.583294 (+   181us) write_op.cc:276] Timestamp: P: 1783602148583032 usec, L: 0
0709 13:02:28.583318 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:02:28.628792 (+ 45474us) log.cc:844] Serialized 5129 byte log entry
0709 13:02:29.583651 (+954859us) op_driver.cc:464] REPLICATION: finished
0709 13:02:30.396813 (+813162us) write_op.cc:301] APPLY: starting
0709 13:02:30.396907 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:30.611196 (+214289us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:30.611330 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:30.810984 (+199654us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:30.811345 (+   361us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:02:30.811391 (+    46us) write_op.cc:312] APPLY: finished
0709 13:02:30.811785 (+   394us) log.cc:844] Serialized 121 byte log entry
0709 13:02:30.887404 (+ 75619us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:30.981410 (+ 94006us) write_op.cc:454] Released schema lock
0709 13:02:31.010706 (+ 29296us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:31.070415 (+ 59709us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:31.072973 (+  2558us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":364296,"reported_tablets":29,"spinlock_wait_cycles":35302272,"child_traces":[["op",{"apply.queue_time_us":765118,"apply.run_cpu_time_us":45442,"apply.run_wall_time_us":639562,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58519,"num_ops":13,"prepare.queue_time_us":182379,"prepare.run_cpu_time_us":24670,"prepare.run_wall_time_us":233415,"raft.queue_time_us":448511,"raft.run_cpu_time_us":54016,"raft.run_wall_time_us":733464,"replication_time_us":951828,"spinlock_wait_cycles":5504,"thread_start_us":1100257,"threads_started":5,"wal-append.queue_time_us":358030,"wal-append.run_cpu_time_us":51020,"wal-append.run_wall_time_us":2442313}]]}
I20260709 13:02:34.136328  6851 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:34.132958  6537 raft_consensus.cc:3055] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:34.133006  6573 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.144145  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.152281  1539 raft_consensus.cc:2368] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:34.152525  1544 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:34.139187  6751 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.121631  6437 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.139979  6698 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:02:34.147511  6489 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:34.147555  6790 consensus_queue.cc:260] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.140348  6825 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.171581  6437 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.157874  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:34.178242  1661 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.658s (SENT) [suppressed 2 similar messages]
I20260709 13:02:34.179840  6825 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:34.180280  6790 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.180761  6745 raft_consensus.cc:3055] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:34.180573  6825 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.181180  6745 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:34.171312  6751 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:34.150134  6537 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:34.202231  6537 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:34.180286  6844 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:02:34.141947  6744 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.156083  6819 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:34.185720  6825 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:34.253166  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 377221us
I20260709 13:02:34.260628  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.265978  2232 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:34.268833  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 220921us
W20260709 13:02:34.271092  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 224337us
I20260709 13:02:34.248247  6745 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.274608  2234 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:34.262583  6852 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:02:34.269719  6811 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.275208  6723 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:34.280565  6863 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:34.280804  6745 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:34.285807  2232 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:34.287995  6863 raft_consensus.cc:697] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 15 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:34.289021  6863 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.291049  6719 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:34.292925  6790 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.293151  2232 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:34.298153  6381 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.518s	user 0.003s	sys 0.006s
I20260709 13:02:34.299026  6381 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:34.301605  6790 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:02:34.288146  6845 log.cc:927] Time spent T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.391s	user 0.002s	sys 0.002s
I20260709 13:02:34.283023  6723 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:34.304071  6723 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:34.308591  6790 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.309154  6790 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.311434  6790 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:34.317035  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.316753  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.317646  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.318186  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.317770  2263 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:34.320354  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.320725  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.322090  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:34.323288  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.295296  6864 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:34.326794  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:34.330402  6843 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.562s	user 0.005s	sys 0.007s
I20260709 13:02:34.332337  2263 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:02:34.332055  6865 log.cc:927] Time spent T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:34.334183  6864 raft_consensus.cc:697] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:34.336638  6573 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.336500  6864 consensus_queue.cc:237] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.338670  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.340341  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.344466  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.344926  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.348670  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.341559  6723 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.354647  6573 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.361918  6723 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:34.373236  6745 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:34.373893  6745 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.376703  6745 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:34.378057  6745 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.378587  6745 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.380605  6745 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:34.383473  1548 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:34.384529  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:34.385040  1548 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:34.391076  1548 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:34.392653  6864 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:34.393147  6864 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.395063  6864 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:34.395501  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:34.396564  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.397035  1548 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:34.397750  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.398252  1548 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:34.399013  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:34.422605  6839 log.cc:927] Time spent T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.653s	user 0.004s	sys 0.008s
I20260709 13:02:34.426194  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.426385  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.426931  1546 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 13: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:34.427031  1540 raft_consensus.cc:2376] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15. Re-sending same reply.
I20260709 13:02:34.429865  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:34.430419  1540 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:34.427783  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.432090  1546 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:34.432945  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.433946  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:34.452752  1546 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:34.453634  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.454592  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.455478  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.456816  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.457653  1546 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:02:34.459062  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.459708  1546 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:34.460628  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.461318  1546 raft_consensus.cc:2410] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:02:34.462855  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 325638us
I20260709 13:02:34.463124  1546 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:02:34.466078  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.471973  1540 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:34.473474  1540 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:02:34.486358  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.499475  1662 leader_election.cc:400] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:34.499733  6811 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.500356  6811 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.500963  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.502411  6811 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:34.499899  1662 leader_election.cc:403] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:34.503361  6599 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:34.503638  1662 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:34.503841  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 2091) took 1110 ms. Trace:
I20260709 13:02:34.504688  6599 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:34.505054  1662 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:34.506368  1662 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:34.506626  6822 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:34.507035  6858 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:34.507136  6822 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.508091  1662 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:34.508806  6858 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:34.509153  6858 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:34.509281  6822 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:34.507558  6811 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:34.509567  6858 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:34.510102  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:34.515702  6825 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:34.518532  6858 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.519588  1539 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:34.509409  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:34.523976  1695 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:34.525213  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:34.525838  1692 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:34.504246  1617 rpcz_store.cc:276] 0709 13:02:33.393807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.393907 (+   100us) service_pool.cc:224] Handling call
0709 13:02:33.394169 (+   262us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:33.739075 (+344906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.739108 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:33.746247 (+  7139us) log.cc:844] Serialized 52 byte log entry
0709 13:02:34.057455 (+311208us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:34.084386 (+ 26931us) log.cc:844] Serialized 14 byte log entry
0709 13:02:34.085001 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.085082 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.503630 (+418548us) raft_consensus.cc:1685] finished
0709 13:02:34.503652 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.503789 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":326256,"prepare.queue_time_us":26445,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":353269,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":29158,"thread_start_us":284381,"threads_started":1,"wal-append.queue_time_us":466210}
I20260709 13:02:34.531347  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:34.532248  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:34.533488  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:34.535358  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:34.536088  1695 raft_consensus.cc:2410] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:34.539011  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3269) took 1172 ms. Trace:
I20260709 13:02:34.539533  1688 rpcz_store.cc:276] 0709 13:02:33.366726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.366833 (+   107us) service_pool.cc:224] Handling call
0709 13:02:33.367106 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.367427 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.367455 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:33.367867 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.062576 (+694709us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:34.062644 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.062731 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.538799 (+476068us) raft_consensus.cc:1685] finished
0709 13:02:34.538823 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.538957 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":324124,"raft.queue_time_us":7204,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":26305,"thread_start_us":337628,"threads_started":1,"wal-append.queue_time_us":830050}
I20260709 13:02:34.542670  1511 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:34.543982  6745 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:34.553747  1511 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:34.554826  6858 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.555558  6745 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:34.555124  6744 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:34.556087  6512 raft_consensus.cc:3055] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:34.556540  6512 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:34.557029  1511 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:34.557343  6512 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.558588  6512 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:34.560245  6744 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:34.560652  6744 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.561010  6744 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:34.560961  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:02:34.567546  1589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.001s	sys 0.027s
W20260709 13:02:34.567895  1589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.002s	sys 0.027s
I20260709 13:02:34.570217  1544 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:34.570114  6744 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.570875  6857 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.570850  6573 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.571663  6857 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.573721  6857 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:34.574251  6573 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.576228  6573 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:34.584290  6744 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:34.587920  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:34.588488  1692 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:34.591719  1588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.018s	sys 0.011s
W20260709 13:02:34.592052  1588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.018s	sys 0.011s
W20260709 13:02:34.592957  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.637652  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.638636  1543 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:34.712661  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:34.713925  1621 raft_consensus.cc:2393] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:34.745895  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:34.746663  1697 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:34.747746  1511 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:34.755336  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:34.756295  1691 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 7.
I20260709 13:02:34.758006  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:02:34.771296  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.010s	sys 0.028s
W20260709 13:02:34.771776  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.010s	sys 0.028s
W20260709 13:02:34.776693  1661 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.008s	sys 0.006s
W20260709 13:02:34.777083  1661 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.008s	sys 0.006s
W20260709 13:02:34.777354  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 599094us
I20260709 13:02:34.779649  6868 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.780246  1541 raft_consensus.cc:1275] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:34.783066  6859 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.783911  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.009s	sys 0.016s
I20260709 13:02:34.783597  6859 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.784698  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.785396  1547 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:34.785521  6859 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:34.785831  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:34.787472  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.010s	sys 0.016s
I20260709 13:02:34.780328  6868 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.788550  1661 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:34.789796  1661 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:34.790352  6537 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:34.791741  1661 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:34.780512  1694 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:34.793076  1661 leader_election.cc:400] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:34.793773  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:34.799893  6859 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:34.801406  1548 raft_consensus.cc:2410] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:02:34.804167  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:34.811678  6859 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.813282  6855 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:34.813899  1692 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:34.814534  6859 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:34.812436  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:34.815083  6859 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:34.812659  1617 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:34.813803  6855 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.812638  1586 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:34.816133  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:34.816416  6719 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:34.830566  6719 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.817790  6859 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.817198  6825 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:34.831946  6825 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.832978  6859 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.820678  1661 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:34.832422  6822 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.826138  6855 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.829648  6759 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:34.838361  6855 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:34.841224  6825 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:34.841109  6855 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:34.841707  6825 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:34.841913  6855 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:34.842212  6825 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.838590  6859 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:34.846441  6859 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.846841  6859 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:34.838670  6822 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.835842  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:34.839286  6745 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:34.815456  1511 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:34.801822  6537 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:34.839897  6719 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.845371  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:34.855186  6822 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:34.875470  1546 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:34.845949  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:34.857939  1661 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:34.821012  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:34.876372  1543 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:34.878530  1661 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:34.879724  1661 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:34.821115  6868 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.838886  6759 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.877717  6822 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:34.843159  6855 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.883276  6719 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:34.910601  1546 raft_consensus.cc:2468] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:34.916054  6888 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:34.901139  6868 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:34.878391  6537 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.918243  6868 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:34.919987  6868 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:34.874868  6745 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.929292  6855 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:34.938819  6825 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:34.938169  1542 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:34.905098  6822 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:34.945838  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 130474us
I20260709 13:02:34.948796  6745 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.950665  6822 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:34.951278  6822 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:34.951498  6697 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:34.951915  6822 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:34.952236  6697 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:34.952411  6822 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:34.952953  6697 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:34.953349  6697 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:34.953722  6697 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:34.953922  6822 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.914851  6719 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:34.956049  6756 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:34.956599  6756 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:34.965375  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:34.966336  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:34.967099  1692 raft_consensus.cc:2393] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 7: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:34.966060  1690 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:34.968748  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:34.946552  6825 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:35.084815  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 205174us
I20260709 13:02:35.086701  1661 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:35.088039  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:35.173156  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.971729  6888 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:35.245545  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.969882  6856 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:34.973466  6886 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:35.054919  6759 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:35.054666  6719 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:35.285841  6887 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:35.301306  6887 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.292173  6381 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:35.295151  6825 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:35.346870  2269 consensus_meta.cc:287] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.785s	user 0.017s	sys 0.000s
I20260709 13:02:35.347365  2269 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:35.348804  1662 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:35.317222   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:35.321086  1615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.352s	user 0.014s	sys 0.019s
W20260709 13:02:35.350317  1615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.395s	user 0.015s	sys 0.019s
I20260709 13:02:35.351003  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 2183) took 1983 ms. Trace:
I20260709 13:02:35.325239  6759 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:35.350901  2234 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:35.328465  6134 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:35.329986  6756 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.298833  6868 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.334509  2265 raft_consensus.cc:1240] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:35.335405  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:35.284019  6888 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.339630  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:02:35.352202  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 264199us
I20260709 13:02:35.351452  1615 rpcz_store.cc:276] 0709 13:02:33.367265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.367405 (+   140us) service_pool.cc:224] Handling call
0709 13:02:33.722971 (+355566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.764939 (+ 41968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.764973 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:33.785815 (+ 20842us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.350677 (+1564862us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:35.350717 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.350782 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.350822 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:35.350832 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.350955 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41547,"raft.queue_time_us":70052,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":18309,"thread_start_us":1395164,"threads_started":1,"wal-append.queue_time_us":392188}
I20260709 13:02:35.330941  6437 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:35.335788  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:35.365873  6756 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.366528  6835 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:35.368582  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.444s	user 0.006s	sys 0.028s
I20260709 13:02:35.372130  2271 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.372395  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:35.375933  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.452s	user 0.007s	sys 0.028s
I20260709 13:02:35.350821  6825 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.376818  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:35.308347  6894 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:35.353405  6759 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.361155  6811 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:35.304703  6856 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.380072  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:35.345546  6854 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:35.363123  6134 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.380466  6751 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:35.388103  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:35.381914  6894 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.376260  6381 raft_consensus.cc:697] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:35.295399  6886 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.375741  6835 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.379873  6825 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:35.343348  6697 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.390690  1661 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:35.384222  6759 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:35.387535  6854 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.377336  6897 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:35.393097  6894 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:35.402145  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.378175  6756 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.404335  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:35.393914  6381 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.406628  6886 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.399998  6835 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:35.391137  6437 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:35.387758  6817 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:35.393864  6134 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.413189  6888 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:35.414443  6825 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.415550  2271 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
W20260709 13:02:35.416707  6859 consensus_meta.cc:287] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.005s
I20260709 13:02:35.389535  6811 raft_consensus.cc:697] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:35.417109  6856 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.451790  6859 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.452332  6811 consensus_queue.cc:237] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.417213  6868 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:35.417371  6697 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:35.391803  6751 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.387100  6887 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:35.384012  6902 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:35.454842  6902 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.403330  6822 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:35.390744  6903 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:35.425410  6897 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:35.426450  6849 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:35.432682  6437 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:35.681845  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:35.679689  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 275396us
W20260709 13:02:35.593552  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 100789us
I20260709 13:02:35.686396  1661 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:35.637208  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:35.690475  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.430296  6894 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:35.678683  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08003867c0 after lost signal to thread 433
I20260709 13:02:35.695148  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.715484  1547 raft_consensus.cc:2410] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:35.702245  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.716744  1540 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:35.716958  1539 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:35.552129  6697 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:35.599831  6857 consensus_queue.cc:1059] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.118s
I20260709 13:02:35.718055  6697 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.718482  6697 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:35.583690  6898 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.153s
I20260709 13:02:35.718017  6859 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.720975  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.688433  6437 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.459033  6134 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:35.602324  6512 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:35.590046  6855 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.004s
I20260709 13:02:35.687956  6581 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.739635  6581 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.740585  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.741755  6581 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.458067  6856 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:35.725762  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:35.742561  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.742872  1688 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:35.688277  6897 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.745142  1547 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:35.746133  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:35.747148  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.727608  6134 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.729403  6512 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.688149  6902 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:35.693866  6751 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.757963  6859 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:35.758237  1691 raft_consensus.cc:1240] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:35.758502  6859 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.759264  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:35.759757  6134 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.759859  1691 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:02:35.760406  6859 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.760957  6859 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:35.455700  6854 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:35.691615  6858 consensus_queue.cc:1048] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:02:35.761720  6512 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:35.762298  6512 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:35.691941  6903 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.762784  6512 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.734694  6822 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:35.735494  6894 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:35.720737  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 140108us
I20260709 13:02:35.750903  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.749524  6857 raft_consensus.cc:3055] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:35.720391  6817 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:35.782765  1688 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:02:35.744779  1690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "953db44baef24f55a28e65ff051866d1"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:58526
I20260709 13:02:35.790309  1690 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:35.790676  1690 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.755738  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.735105  6697 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.761431  6859 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:35.762539  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.756094  6581 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:35.764216  6903 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.734035  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.752112  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:35.781472  6825 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:35.781105  6817 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:35.808923  1692 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:35.781657  6857 raft_consensus.cc:740] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:35.804311  1547 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:35.797271  1587 connection.cc:256] RPC call timeout handler was delayed by -1.4412217349999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 13:02:35.813066  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:35.814038  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:35.754882  6856 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.814946  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:35.815536  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:35.815693  1618 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:35.810557  1696 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:02:35.814203  1621 raft_consensus.cc:2410] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:02:35.816097  1619 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:35.816547  6856 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:35.817073  6856 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.792333  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 2105) took 1268 ms. Trace:
I20260709 13:02:35.817517  6856 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.818925  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:35.819489  2272 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:35.819595  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:35.821424  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:35.821705  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:35.822077  1622 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:35.823977  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:35.823251  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:35.825301  1616 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:35.825749  1619 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:35.826176  6903 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.826633  6903 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.828146  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:35.828411  1587 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:35.817531  1693 rpcz_store.cc:276] 0709 13:02:34.524190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.630417 (+1106227us) service_pool.cc:224] Handling call
0709 13:02:35.630821 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.631081 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:35.661994 (+ 30913us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.792032 (+130038us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.792081 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:35.792125 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.792183 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.792284 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":84011,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":5379,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7437,"thread_start_us":158229,"threads_started":2}
W20260709 13:02:35.835551  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 45684.4us
I20260709 13:02:35.837158  2232 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:35.837810  6918 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.838279  6918 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.839737  1547 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:35.845263  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.846210  1540 raft_consensus.cc:2410] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:35.848455  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.849309  1546 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:02:35.851504  1539 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:02:35.853468  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.853632  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:35.854295  1545 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:35.856058  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:35.857102  1543 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:35.859862  2231 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:35.844409  1690 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.862345  1688 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:35.803841  6902 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:35.832005  6817 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:35.878198  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.879192  1544 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:35.877674  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:35.880914  1690 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:35.881011  1547 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:35.844201  6856 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.859714  6910 raft_consensus.cc:2804] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:35.808161  6581 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.845738  6134 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:35.891229  1718 debug-util.cc:398] Leaking SignalData structure 0x7b0800390540 after lost signal to thread 1480
I20260709 13:02:35.859768  6855 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:02:35.893005  1545 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
W20260709 13:02:35.899474  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe2e0 after lost signal to thread 1572
W20260709 13:02:35.899899  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe840 after lost signal to thread 1573
W20260709 13:02:35.900996  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5640 after lost signal to thread 1647
W20260709 13:02:35.901293  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08002f55c0 after lost signal to thread 1648
I20260709 13:02:35.880082  6902 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.859714  6857 consensus_queue.cc:260] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:35.919173  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:35.924494  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:35.925256  1692 raft_consensus.cc:2393] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 13: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:02:35.912511  6913 log.cc:927] Time spent T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:02:35.925951  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:35.908543  6852 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:35.939040  6512 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.940277  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:35.907932  6824 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:35.929319  6134 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.956223  6134 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.958249  6134 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.882318  6894 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.945211  6920 consensus_queue.cc:1059] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:35.947115  6859 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:35.948133  6918 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:35.962201  6918 raft_consensus.cc:3055] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:35.962561  6918 raft_consensus.cc:740] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:35.963371  6918 consensus_queue.cc:260] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:35.950469  6759 consensus_meta.cc:287] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.003s
I20260709 13:02:35.952531  6697 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:35.914535  6573 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:02:35.974576  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:35.969134  6835 consensus_meta.cc:287] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
W20260709 13:02:35.989483  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 100302us
I20260709 13:02:35.990455  2231 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:35.966957  6759 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:35.977713  6835 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:35.999895  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 152382us
W20260709 13:02:36.013510  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08003f4720 after lost signal to thread 1721
W20260709 13:02:36.013876  1718 debug-util.cc:398] Leaking SignalData structure 0x7b0800032fa0 after lost signal to thread 1722
I20260709 13:02:36.013739  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:36.014289  2271 raft_consensus.cc:3055] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:36.014607  2271 raft_consensus.cc:740] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:36.015972  1690 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:02:36.003659  1692 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:36.016490  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:35.989727  6910 raft_consensus.cc:697] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:36.021628  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.030586  2271 consensus_queue.cc:260] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.057955  1692 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:36.058303  2271 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.059010  6910 consensus_queue.cc:237] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.022472  1587 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:36.036849  6437 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.038143  6581 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:36.044171  6902 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:36.045703  6817 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.048547  1542 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:36.063850  6697 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:36.069481  1693 raft_consensus.cc:1240] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:36.048853  6903 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:36.052073  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.052600  1548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 2181) took 1696 ms (client timeout 1886 ms). Trace:
W20260709 13:02:36.070190  1548 rpcz_store.cc:269] 0709 13:02:34.356213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.398750 (+ 42537us) service_pool.cc:224] Handling call
0709 13:02:36.052406 (+1653656us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b540027bfd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:36.052540 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923495808}
I20260709 13:02:36.053647  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.002439  6921 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:36.072618  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.066236  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:36.067466  6573 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:36.069242  6697 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.051307  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.073786  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:36.085325  1542 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:36.072769  2271 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:36.085988  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:36.087282  1662 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:36.088337  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 2098) took 1581 ms (client timeout 1583 ms). Trace:
I20260709 13:02:36.088866  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:36.088855  1689 rpcz_store.cc:269] 0709 13:02:34.506829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.015938 (+1509109us) service_pool.cc:224] Handling call
0709 13:02:36.088275 (+ 72337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:36.091864  6573 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:36.097470  6573 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.099960  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.102180  1441 catalog_manager.cc:5697] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 10 to 11, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 11 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.105993  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:36.106818  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:36.107513  2272 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:36.108285  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:36.109508  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:36.110555  6856 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:36.111860  6928 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:02:36.113605  6599 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:36.114171  6599 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.116232  6756 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:36.092048  6822 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:36.129050  6930 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:36.129709  6930 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.072196  6921 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:36.131770  6921 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:36.133587  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6860 after lost signal to thread 2296
W20260709 13:02:36.133911  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08001a0160 after lost signal to thread 2297
I20260709 13:02:36.136612  6899 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.137109  6899 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.138684  6759 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:36.140201  6892 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.844s	user 0.004s	sys 0.005s
I20260709 13:02:36.137629  6744 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.141074  6744 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.141161  6897 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.142189  1545 raft_consensus.cc:1240] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:36.143169  6744 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:36.143190  6897 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:36.145951  6918 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.146286  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 1212) took 1303 ms. Trace:
I20260709 13:02:36.146674  1541 rpcz_store.cc:276] 0709 13:02:34.842898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.861312 (+ 18414us) service_pool.cc:224] Handling call
0709 13:02:34.875031 (+ 13719us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:34.886037 (+ 11006us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:34.946991 (+ 60954us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.309974 (+362983us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:35.312644 (+  2670us) log.cc:844] Serialized 52 byte log entry
0709 13:02:35.312791 (+   147us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:35.313040 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.345309 (+ 32269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.345376 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.714622 (+369246us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b1800473e00. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a1f2a6 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db
0709 13:02:36.139710 (+425088us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:36.146110 (+  6400us) raft_consensus.cc:1685] finished
0709 13:02:36.146130 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.146238 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58072,"prepare.queue_time_us":57486,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":565588,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":6043,"spinlock_wait_cycles":87992576,"thread_start_us":391690,"threads_started":3,"wal-append.queue_time_us":349124}
I20260709 13:02:36.149554  1688 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
W20260709 13:02:36.150681  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.150918  2232 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:36.152114  1513 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:36.152952  1587 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:02:36.158967  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 44280.8us
I20260709 13:02:36.160164  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.160012  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.161896  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.157976  6922 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:02:36.163247  6849 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:36.092469  6902 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:36.163873  6849 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:36.164103  6902 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:36.164582  6902 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.167070  6835 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:36.085129  6903 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:36.167567  6903 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:36.167706  6858 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:36.168599  6924 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:36.169019  6924 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.169341  6924 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.169464  6811 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:36.162525  1615 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:36.167994  6903 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:36.168467  6858 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.176541  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.153514  1513 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:36.179737  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:36.188530  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.189111  1586 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:36.191128  1586 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:36.192972  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.193733  1623 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:02:36.197813  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.201874  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.202929  1688 raft_consensus.cc:2393] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:36.204567  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.205914  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.171391  6822 raft_consensus.cc:697] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:36.211019  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.190356  1441 catalog_manager.cc:5697] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:36.212456  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.213778  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.215175  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:36.175802  6756 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:36.217192  1586 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:36.217257  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.222966  1688 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:36.172581  6751 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:36.157910  6437 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:36.222762  1441 catalog_manager.cc:5697] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 9 to 11, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 11 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.174443  6867 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:36.225142  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.225795  1623 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:36.226820  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.227643  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.228034  1586 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:36.229343  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:36.229660  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.188009  6897 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:36.236303  1692 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:02:36.207621  6851 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.241799  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:36.238487  1586 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:36.244481  1690 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:36.246974  1690 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:36.248442  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:36.248584  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:36.249393  1623 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:36.249742  1688 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:36.174433  6866 consensus_queue.cc:1059] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:02:36.222220  6856 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:36.252238  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.221853  6927 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.254567  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.254341  1441 catalog_manager.cc:5697] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 9 to 10, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 10 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.186685  6759 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:02:36.250643  1693 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:36.229188  6134 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:36.208467  6835 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:02:36.242075  6855 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:36.237746  6897 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.243059  6756 raft_consensus.cc:697] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:36.304083  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.304306  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.314812  1616 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:36.250937  6537 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:36.253170  6854 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.308928  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.315136  1623 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:36.237365  6512 consensus_queue.cc:1059] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:02:36.315245  1622 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:36.315781  1621 raft_consensus.cc:2468] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:36.318437  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.305112  1441 catalog_manager.cc:5697] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 7 to 11, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 11 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:36.239324  6751 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.320739  1621 raft_consensus.cc:2410] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:02:36.323185  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 164781us
I20260709 13:02:36.241803  6867 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:36.327025  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 124969us
I20260709 13:02:36.303176  6930 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:36.304693  6899 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:36.324801  6134 raft_consensus.cc:3055] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:36.350606  6134 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:36.351025  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 820) took 1830 ms. Trace:
I20260709 13:02:36.314134  6855 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:36.351893  6855 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:36.351549  6134 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.352665  6134 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.354961  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:36.329427  1661 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:36.355938  1541 raft_consensus.cc:1240] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:36.356969  1661 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:36.357327  6819 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:36.357715  6819 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:36.357769  1661 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:36.358237  6819 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.358721  6437 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:36.359328  6825 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.359899  6825 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.360141  6437 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:36.360674  6437 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:36.361140  6437 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.362036  6825 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:36.362565  6825 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:36.362985  6825 raft_consensus.cc:697] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:36.360023  2263 rpcz_store.cc:276] 0709 13:02:34.520553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.520698 (+   145us) service_pool.cc:224] Handling call
0709 13:02:34.520996 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.521349 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.521377 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.521811 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:02:36.042046 (+1520235us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b18003919c0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de0d1 00007f5c6aaf9a0f
0709 13:02:36.174294 (+132248us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:36.174329 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.174405 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:36.350648 (+176243us) raft_consensus.cc:1685] finished
0709 13:02:36.350668 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.350938 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":416,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5388,"spinlock_wait_cycles":2849152,"thread_start_us":132073,"threads_started":1,"wal-append.queue_time_us":1739439}
I20260709 13:02:36.364609  6697 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:36.368407  6867 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:36.337050  6756 consensus_queue.cc:237] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.386003  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:36.386554  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.387224  2266 raft_consensus.cc:2410] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:02:36.340129  6857 raft_consensus.cc:3060] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.316043  6822 consensus_queue.cc:237] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:36.348755  6932 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:02:36.408278  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 164049us
I20260709 13:02:36.355525  1547 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.370179  6437 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.317140  6897 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.415024  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:36.371963  6924 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.376569  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:36.351287  6751 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:36.336722  6858 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:36.384605  1441 catalog_manager.cc:5697] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 9 to 10, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 10 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.478009  1441 catalog_manager.cc:5697] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:36.392026  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:36.479471  1622 raft_consensus.cc:2368] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:36.480207  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.394253  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.481143  1617 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:36.481950  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.395066  1623 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:36.483110  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:36.484045  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.484990  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:36.398608  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 74464.2us
I20260709 13:02:36.407995  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.486316  1511 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:36.487833  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:36.413789  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:36.379009  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.451645  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:36.489355  1618 raft_consensus.cc:2410] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:36.489589  1615 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.419555  1588 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:36.432489  1547 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:36.490082  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.491043  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.459360  6921 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.460291  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:36.462533  6437 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:36.469607  6599 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:36.471398  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:36.503279  1614 raft_consensus.cc:2376] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15. Re-sending same reply.
I20260709 13:02:36.503443  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.427832  6859 consensus_queue.cc:1059] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:02:36.419687  6744 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:36.419309  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.419991  6381 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:36.493795  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 136096us
I20260709 13:02:36.493534  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.512629  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.501252  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:36.473048  6927 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:36.502480  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:36.505008  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.506655  2266 raft_consensus.cc:2368] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11.
W20260709 13:02:36.508661  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 89218.1us
I20260709 13:02:36.545295  1588 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:36.508842  1441 catalog_manager.cc:5697] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.409080  6581 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.543612  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.499681  6745 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.560813  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.576957  1614 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:36.493737  6817 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:36.562494  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.562759  1622 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:36.554741  1689 raft_consensus.cc:1813] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Handling vote request from an unknown peer 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:36.563520  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:36.499859  6489 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.565378  1586 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:36.567507  6134 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.599758  2232 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:36.420526  6512 consensus_queue.cc:1059] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 13:02:36.408792  6867 consensus_queue.cc:1059] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 13:02:36.600715  1615 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:36.579999  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:36.592450  1622 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:36.509274  6899 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:36.593755  1623 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:36.595570  1618 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:36.410264  6902 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.596182  1617 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:36.597029  1441 catalog_manager.cc:5697] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 6 to 7, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 7 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.597734  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.602741  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:36.603205  1586 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:36.589861  6910 raft_consensus.cc:3055] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:36.605384  6950 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:36.573794  6942 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:36.606423  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.573861  6856 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.581550  6573 raft_consensus.cc:3055] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:36.609617  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:36.609906  6134 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:36.632815  6134 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:36.633211  6134 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.611443  1614 raft_consensus.cc:2410] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:36.612457  1586 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:36.611377  1441 catalog_manager.cc:5697] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:36.614336  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:36.617254  1514 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:36.546039  6855 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.546514  6381 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.546144  6744 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.650144  6134 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.581204  6581 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:36.663738  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 54790.8us
I20260709 13:02:36.652109  1697 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:36.659588  2268 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:36.659384  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:36.659821  2263 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:36.660449  1621 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:36.642460  1588 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:36.676431  6134 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:36.676017  1441 catalog_manager.cc:5697] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:36.599529  6860 consensus_queue.cc:1059] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:02:36.681923  1588 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:36.622735  6910 raft_consensus.cc:740] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:36.631081  6859 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:36.631935  6573 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:02:36.694612  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 54012.6us
I20260709 13:02:36.574656  6825 consensus_queue.cc:237] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.648674  6922 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:36.607345  6489 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.660863  6927 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.661194  6854 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:36.724993  1540 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:36.662355  6899 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.733925  1621 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:36.733538  1441 catalog_manager.cc:5697] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.735049  1622 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:36.735143  1441 catalog_manager.cc:5697] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.735774  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.736793  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.738448  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.739732  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.740365  1618 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:36.741369  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.697579  6859 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.743431  1622 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:36.744405  6134 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:36.744526  1441 catalog_manager.cc:5697] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 6 to 7, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 7 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:36.719102  6512 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:36.750967  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.647607  6856 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:36.732256  6933 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:02:36.731122  6903 consensus_meta.cc:287] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.540s	user 0.002s	sys 0.006s
I20260709 13:02:36.647203  6849 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.738464  6851 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:36.736549  6854 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.763571  1539 raft_consensus.cc:1240] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:36.758677  1441 catalog_manager.cc:5697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 8 to 10, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 10 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.765552  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:36.767944  1441 catalog_manager.cc:5697] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:36.738454  6927 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.749277  6859 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.802152  1544 raft_consensus.cc:1240] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:36.784845  1441 catalog_manager.cc:5697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.804924  1441 catalog_manager.cc:5697] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 9 to 10, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 10 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.759817  6950 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:36.784343  6910 consensus_queue.cc:260] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.813175  6489 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:36.774289  6599 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:02:36.813918  6946 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:02:36.761895  6903 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.815591  1441 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 8 to 9, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 9 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.817078  6921 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:36.784616  6958 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:02:36.818854  1619 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:36.744110  6899 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.819015  1441 catalog_manager.cc:5697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 7 to 8, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 8 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.820919  6899 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:36.764732  6957 consensus_queue.cc:1059] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
W20260709 13:02:36.821863  6944 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:02:36.822777  6744 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:36.800351  6922 raft_consensus.cc:697] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:36.825145  6924 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:36.738621  6897 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.768332  6854 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:36.749665  6819 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:36.801812  6939 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.307s	user 0.001s	sys 0.001s
W20260709 13:02:36.856387  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 136375us
W20260709 13:02:36.802388  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 117412us
W20260709 13:02:36.807077  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 110798us
I20260709 13:02:36.854880  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:36.860307  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:36.855229  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 303428us
W20260709 13:02:36.857376  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 240169us
I20260709 13:02:36.861927  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:36.862393  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:36.823652  1441 catalog_manager.cc:5697] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 6 to 9, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 9 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:36.854694  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 172823us
I20260709 13:02:36.808346  6851 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.870872  1588 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:36.824774  6902 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:36.877211  1540 raft_consensus.cc:2393] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:36.878436  1663 leader_election.cc:400] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:36.877995  1441 catalog_manager.cc:5697] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 7 to 8, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 8 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.879521  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:36.880062  1539 raft_consensus.cc:2376] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12. Re-sending same reply.
I20260709 13:02:36.883229  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:36.880024  1663 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:36.884524  1539 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 15: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:36.884799  1514 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:36.859061  6745 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.886231  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:36.886791  1539 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:36.887985  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:36.874526  6744 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:36.881191  6512 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:36.890733  6971 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:36.897898  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:36.891456  6961 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:02:36.880172  6851 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.892043  6974 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:36.877986  6489 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.893673  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:36.765340  6573 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.890501  6697 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:36.896070  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:36.896273  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:36.896364  1588 leader_election.cc:400] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11.
I20260709 13:02:36.921550  1588 leader_election.cc:403] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:36.898597  1542 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:02:36.922220  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:36.922674  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:36.923703  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:36.899814  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:36.904753  1663 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:36.902457  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 45412.1us
I20260709 13:02:36.925323  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:36.908140  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 48651.3us
W20260709 13:02:36.908712  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 43825.6us
I20260709 13:02:36.889098  6945 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:36.929219  6978 consensus_queue.cc:1059] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:36.929766  6756 raft_consensus.cc:3055] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:36.911360  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:36.930140  6756 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:36.930284  6849 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:36.931914  6951 raft_consensus.cc:3055] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:36.932181  6897 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:36.932338  6951 raft_consensus.cc:740] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:36.910768  6866 raft_consensus.cc:3055] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:36.933106  6866 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:36.933300  6951 consensus_queue.cc:260] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.921495  1545 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:36.933979  6866 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:36.935076  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:36.882038  6904 consensus_queue.cc:1059] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:02:36.926334  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:36.928625  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:36.899272  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:36.937539  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.937425  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:36.942000  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:36.942559  1548 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:36.936094  1546 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:36.946949  1663 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:36.948693  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 63959.7us
I20260709 13:02:36.950129  1514 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:36.908833  6745 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:36.919579  6950 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:36.955219  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:36.957643  2268 raft_consensus.cc:2393] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:36.963121  1548 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:36.953945  1663 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:36.936088  6512 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.968206  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:37.002959  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 52909.3us
I20260709 13:02:36.931023  6756 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.015767  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:37.015250  1514 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:37.019716  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 65839.6us
I20260709 13:02:37.020687  1663 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:36.958313  6945 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:36.937063  6489 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:36.957759  6950 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:37.039822  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:37.034607  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:36.939787  6942 raft_consensus.cc:697] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:36.954492  6437 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.953015  6979 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.029415  1663 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:37.013870  6744 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:37.036641  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 94601.7us
I20260709 13:02:37.041478  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:36.924079  6974 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.052551  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:37.042737  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:37.059732  1546 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:36.969142  6745 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.037500  6697 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:37.060329  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:37.061373  1623 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:37.078483  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.063359  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.064692  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.065739  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.067389  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.080364  1692 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:37.080905  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.081344  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.068125  1690 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:37.082053  1692 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:37.070762  1587 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:37.024055  6967 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:37.039717  6899 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:37.040409  6950 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:36.957532  6599 consensus_queue.cc:1059] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.114s
I20260709 13:02:37.081501  1693 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:37.085165  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.024216  6849 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:02:37.087992  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.086000  1539 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:37.087653  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:37.051826  6537 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:37.122154  6972 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:02:37.122081  6537 consensus_queue.cc:1059] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:37.127431  6981 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:37.127990  6981 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.128408  6981 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:37.037554  6964 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:02:37.056794  6945 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.037286  6894 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:02:37.113355  2234 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:37.085649  6962 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:37.118016  1689 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:36.941380  6922 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.075353  6697 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:37.056522  6437 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.086238  1587 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:37.061162  6744 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:37.171391  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 85229.6us
W20260709 13:02:37.172412  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.173231  1587 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:37.135602  6819 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:37.143291  6970 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:02:37.149120  6962 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.151547  6904 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:37.170289  6697 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:37.175082  6966 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:37.222868  6966 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:37.223393  6966 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:37.235206  6759 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:37.235803  6759 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.189462  6962 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:37.237851  6759 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:37.238515  6984 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:37.238955  6984 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:37.239292  6984 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.244585  6744 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.148782  6924 consensus_queue.cc:1059] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:02:37.245918  6980 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:37.247360  6745 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.184482  6899 raft_consensus.cc:3055] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:37.252753  6899 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:37.253827  6899 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:37.264446  6976 log.cc:927] Time spent T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:02:37.143110  6917 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:02:37.268415  6489 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.277944  6437 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:37.174749  6902 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.112s
I20260709 13:02:37.282282  6902 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:37.282718  6902 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:37.285719  6974 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.185951  6851 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.283782  6902 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:37.366928  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 193744us
I20260709 13:02:37.369916  1542 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:37.371286  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:37.371315  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 238527us
I20260709 13:02:37.372340  1511 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:37.372850  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:37.373842  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:37.374641  6489 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.375123  1539 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:37.377667  6811 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:37.380220  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:37.174294  6942 consensus_queue.cc:237] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.381494  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:37.387686  6969 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:37.386727  6811 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.389873  6811 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:37.399361  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.373391  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:37.401208  1587 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:37.405009  1587 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:37.407896  1587 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:37.407356  6904 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.412672  6930 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:37.413089  6930 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:37.413467  6930 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:37.415370  6980 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:37.416882  6859 consensus_meta.cc:287] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.002s
I20260709 13:02:37.417229  6512 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11.
I20260709 13:02:37.417348  6859 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.418370  6483 raft_consensus.cc:3055] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:37.418888  6483 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:37.418392  1614 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:37.419675  6483 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.421186  6483 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:37.424752  6951 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:37.425168  6857 consensus_meta.cc:287] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 1.028s	user 0.011s	sys 0.000s
I20260709 13:02:37.430894  6966 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.431958  6973 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:37.454484  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.454972  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.403432  6902 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:37.436424  6859 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:37.437819  6954 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.536s	user 0.000s	sys 0.004s
I20260709 13:02:37.440047  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:37.433372  6927 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:37.444164  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:37.416712  6903 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.447124  1587 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:37.449685  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 76350.5us
I20260709 13:02:37.462699  6437 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:37.467243  6437 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.467741  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:37.469240  6437 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:37.469286  1511 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:37.472283  6950 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.474274  6950 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:37.455358  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.457734  6998 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:37.441366  6854 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.001s
I20260709 13:02:37.476965  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:37.476164  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.478863  1511 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:02:37.485318  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 424251us
I20260709 13:02:37.482903  6854 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.490018  6851 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:37.479326  6973 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.500238  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:37.455085  6930 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.505017  6966 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.505610  6817 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:37.501487  6489 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:37.500034  6851 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.501962  6993 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:37.479394  6974 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.512900  6993 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.502485  6973 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.502584  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 2104) took 1342 ms. Trace:
I20260709 13:02:37.455868  6697 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.504130  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:37.515661  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:37.514364  6437 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.516505  6437 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.516637  1661 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:37.518612  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:37.509637  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.519886  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:37.499025  6859 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:37.510259  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.499428  1514 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:37.510597  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.510902  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.511178  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.511719  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 2130) took 1058 ms. Trace:
I20260709 13:02:37.471308  6981 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.512354  6745 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:37.513278  6851 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:37.506129  6817 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.453526  6984 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.461903  6381 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:37.506822  6927 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:37.569129  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.525671  1661 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:37.560945  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:37.570906  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 71574.9us
W20260709 13:02:37.576030  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 56656.7us
I20260709 13:02:37.576745  1661 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:37.520820  1697 raft_consensus.cc:2410] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:37.515018  1619 rpcz_store.cc:276] 0709 13:02:36.160128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.160257 (+   129us) service_pool.cc:224] Handling call
0709 13:02:36.160510 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.819282 (+658772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.502338 (+683056us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b5400065c54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:37.502515 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513605504}
I20260709 13:02:37.574388  1690 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:37.521420  1623 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 18: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:37.570441  6822 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.498901  6950 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:02:37.569849  1616 rpcz_store.cc:276] 0709 13:02:36.453331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.594994 (+141663us) service_pool.cc:224] Handling call
0709 13:02:36.595300 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.598142 (+  2842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.598175 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.598667 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:02:36.744188 (+145521us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:36.744227 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.744299 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.437010 (+692711us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:37.506377 (+ 69367us) raft_consensus.cc:1685] finished
0709 13:02:37.506398 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.511653 (+  5255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2471,"raft.queue_time_us":2571,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":8531,"spinlock_wait_cycles":21444864,"thread_start_us":137375,"threads_started":1,"wal-append.queue_time_us":225359}
I20260709 13:02:37.581401  1661 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:37.570250  6819 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:37.582273  6819 raft_consensus.cc:697] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:37.583122  6819 consensus_queue.cc:237] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.586062  6979 raft_consensus.cc:3055] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:37.586761  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:37.580615  6599 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:37.590374  6973 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:37.590474  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:37.591585  6993 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.514603  6930 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.520798  6811 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:37.592823  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:37.593196  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:37.593482  1542 raft_consensus.cc:2368] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15.
I20260709 13:02:37.573753  6974 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.579380  1511 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:37.520820  6489 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.570526  6745 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:37.520615  6437 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:37.600642  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.570680  6903 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:37.580101  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.608980  6962 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.615183  1691 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:02:37.609537  6537 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:37.609350  6489 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.616039  6537 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.616410  6537 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:37.586475  6979 raft_consensus.cc:740] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:37.617564  6489 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.618208  6979 consensus_queue.cc:260] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.609320  6745 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.605655  6599 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.625115  6697 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:37.626341  6856 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.626669  6817 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:37.604286  6993 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.628021  6993 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.623299  6537 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.630003  6993 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.630286  6537 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.603664  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:37.606966  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.593956  6894 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:37.580976  6381 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:37.633919  6381 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.636044  6381 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.592137  6824 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:37.636530  6824 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:37.636956  6824 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:37.643668  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.645989  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.646229  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 1236) took 1264 ms. Trace:
I20260709 13:02:37.646600  1544 rpcz_store.cc:276] 0709 13:02:36.381960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.382155 (+   195us) service_pool.cc:224] Handling call
0709 13:02:36.408886 (+ 26731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.802757 (+393871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.646009 (+843252us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54000c3354. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:37.646177 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903885056}
W20260709 13:02:37.647094  6990 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.382s	user 0.002s	sys 0.000s
I20260709 13:02:37.648046  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.650381  1619 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 16.
I20260709 13:02:37.671623  1616 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
W20260709 13:02:37.671964  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 68368.8us
I20260709 13:02:37.575309  6859 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.673477  1661 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:37.674796  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.649371  6979 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:37.678959  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.679741  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.680155  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:37.684980  1693 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:37.680414  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:37.686700  1548 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:37.686861  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:37.687367  1539 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:37.681998  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:37.649791  6483 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.687752  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:37.684373  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:37.687436  1545 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.688567  1548 raft_consensus.cc:2393] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:37.688570  1694 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:37.689635  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:37.690558  1543 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:37.690851  1688 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:02:37.691670  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.692440  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.694536  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.695391  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:37.696048  1689 raft_consensus.cc:2393] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:37.674358  6817 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:37.697882  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.698434  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:37.690567  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:37.700750  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:37.699303  1689 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:37.681984  1690 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:37.688349  1616 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:37.671120  6851 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.720937  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:37.679102  6894 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.722908  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.719837  1690 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:37.688338  6483 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.735160  6483 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.726598  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:37.736059  6977 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.843s	user 0.003s	sys 0.000s
I20260709 13:02:37.736480  1539 raft_consensus.cc:2393] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:37.737222  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:37.738159  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:37.739064  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:37.699878  6599 consensus_queue.cc:1059] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:02:37.739992  6599 raft_consensus.cc:3055] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:37.740321  6599 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:37.740949  6984 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.741693  6950 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.741554  6599 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.742508  6599 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:37.718658  6745 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.743920  6981 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.744690  6745 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:37.732988  6851 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.742908  6489 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:37.745590  6489 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.673946  6963 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:02:37.747522  6489 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.749045  6975 raft_consensus.cc:3055] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:37.749428  6975 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:37.750415  1539 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:37.751240  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:37.750130  6975 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.753103  6975 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:37.753768  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.754735  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:37.755512  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.758951  1622 raft_consensus.cc:2410] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:37.759687  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.759940  6859 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.760689  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.761529  6824 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.764951  6849 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:37.765434  6849 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.768582  2234 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:37.752243  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:37.769675  1539 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 7.
W20260709 13:02:37.770159  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.772751  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:37.742177  6950 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.777035  1616 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:37.779345  1545 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:37.779131  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.782645  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:37.785410  1693 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 16.
I20260709 13:02:37.785843  1616 raft_consensus.cc:2393] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:37.789179  1694 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:37.767228  6849 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:37.696893  6819 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:37.792774  1692 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:37.796450  1689 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:37.797137  1539 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:37.797431  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 2139) took 1342 ms. Trace:
I20260709 13:02:37.797960  1615 rpcz_store.cc:276] 0709 13:02:36.483530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.601459 (+117929us) service_pool.cc:224] Handling call
0709 13:02:36.606355 (+  4896us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:36.609966 (+  3611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.609999 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:36.630704 (+ 20705us) log.cc:844] Serialized 52 byte log entry
0709 13:02:36.757999 (+127295us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:37.630181 (+872182us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b180017de20. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c679cbc0a 00007f5c7110b219 00007f5c67a53a40 00007f5c67a4e4e4 00007f5c67a4e455 00007f5c6e5363c7 00007f5c6ab489a7 00007f5c6ab580bf 00007f5c6ab58038
0709 13:02:37.791568 (+161387us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.792042 (+   474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.792121 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:37.792161 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:37.797181 (+  5020us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.797359 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53783,"prepare.queue_time_us":876068,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":5150,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":18250,"spinlock_wait_cycles":12459904,"thread_start_us":234119,"threads_started":2,"wal-append.queue_time_us":105172}
I20260709 13:02:37.802951  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:37.810074  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.815091  6894 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:37.773384  6824 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.810137  6819 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.823797  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:37.824455  1539 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 7.
I20260709 13:02:37.826128  6819 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:37.791790  6723 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:37.828260  6723 raft_consensus.cc:697] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:37.828450  2232 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:37.829141  6723 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.829749  6852 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:37.830322  6852 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.830775  6852 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.787658  6967 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:37.845366  1615 raft_consensus.cc:1275] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:37.807878  6983 consensus_queue.cc:1059] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
W20260709 13:02:37.845279  6924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.000s	sys 0.034s
I20260709 13:02:37.890194  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:37.895720  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.896204  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.897046  1663 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:37.897185  6751 consensus_queue.cc:1059] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:37.898267  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:37.898378  6751 raft_consensus.cc:3055] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:37.898841  6751 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:02:37.883167  6924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.000s	sys 0.035s
I20260709 13:02:37.896009  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:37.837455  6967 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.900112  7012 consensus_queue.cc:1048] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:02:37.905128  6894 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:37.907387  6910 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.907886  6967 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:37.883754  6966 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.910303  6966 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.912354  6966 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.905119  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:37.913066  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:37.913748  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:37.914283  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:37.914867  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:37.915112  6950 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:37.919478  1541 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.919872  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:37.921767  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:37.922830  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:37.905161  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.924278  1615 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:37.905238  6964 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:37.905855  6819 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:37.926169  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:37.929306  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:37.931888  1540 raft_consensus.cc:2393] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 18: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:37.925026  1514 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:37.921643  6599 consensus_queue.cc:1059] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:02:37.935127  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:37.936576  1540 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:37.927222  6950 consensus_queue.cc:1059] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:02:37.935096  1541 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:37.938655  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:37.939647  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:37.940601  1514 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:37.950608  1540 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:37.956604  1514 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:37.958436  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:37.953339  1663 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:37.951660  6745 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:37.935381  6851 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:37.964349  1514 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:37.948690  6849 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.905068  6751 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:37.951812  6981 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:37.971328  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:37.971951  1618 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:37.972549  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:37.972806  7010 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:37.973719  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:37.974133  7013 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:37.974702  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.975246  1621 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:37.976003  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.976492  1621 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:37.977173  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:37.978052  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:37.979375  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.978551  1621 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:37.961985  6997 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:37.980500  1618 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:37.964637  6950 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:37.981263  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:37.965742  6599 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:37.988412  6599 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.988798  6599 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:37.982025  6981 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.992141  6981 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:37.982942  1615 raft_consensus.cc:2410] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:02:37.980760  6824 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:38.000204  6824 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:37.989055  6852 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.002375  6824 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:38.002889  6852 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:37.987461  6751 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:37.968103  6968 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:02:38.011998  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:38.086238  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 121734us
I20260709 13:02:37.969485  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:38.098452  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 2214) took 1043 ms. Trace:
I20260709 13:02:38.099375  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:38.087715  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:38.101097  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:38.102145  1543 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.089661  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:38.105458  1544 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:38.113106  1547 raft_consensus.cc:1240] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:38.113811  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.115289  1541 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:02:38.094512  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3014) took 1173 ms. Trace:
I20260709 13:02:38.117322  1546 rpcz_store.cc:276] 0709 13:02:36.920905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.944698 (+ 23793us) service_pool.cc:224] Handling call
0709 13:02:36.944922 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.060109 (+115187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.093587 (+1033478us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540023fad4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:38.094233 (+   646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263244160}
I20260709 13:02:38.108671  1514 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:38.099000  1542 rpcz_store.cc:276] 0709 13:02:37.055163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.370972 (+315809us) service_pool.cc:224] Handling call
0709 13:02:38.097872 (+726900us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b540027bfd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:38.098216 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509056256}
W20260709 13:02:38.122301  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.115891  1539 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:38.125038  1586 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:38.126377  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.144133  1616 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:38.145792  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.127002   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:38.127699  1514 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:38.128916  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 2152) took 1070 ms. Trace:
I20260709 13:02:38.152277  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:38.157143  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:38.150013  1614 rpcz_store.cc:276] 0709 13:02:37.058711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.591353 (+532642us) service_pool.cc:224] Handling call
0709 13:02:37.591690 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.619057 (+ 27367us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:37.636899 (+ 17842us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.692578 (+ 55679us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.693001 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.694446 (+  1445us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:37.694649 (+   203us) log.cc:844] Serialized 14 byte log entry
0709 13:02:37.694824 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.128229 (+433405us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b54001f86d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:38.128284 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.128444 (+   160us) raft_consensus.cc:1685] finished
0709 13:02:38.128460 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.128712 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17508,"prepare.queue_time_us":20515,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":434,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":6988,"spinlock_wait_cycles":67444736,"thread_start_us":55325,"threads_started":1,"wal-append.queue_time_us":114620}
I20260709 13:02:38.132556  1615 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:38.137251  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 2200) took 1403 ms. Trace:
I20260709 13:02:38.140570  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 2151) took 1082 ms. Trace:
I20260709 13:02:38.143030  1619 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:38.154933  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:38.180393  6573 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:38.180927  6674 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:38.181895  6674 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.184685  6856 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:38.184949  6581 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.185333  6824 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.185676  6856 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.163057  1617 rpcz_store.cc:276] 0709 13:02:36.733832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.736548 (+  2716us) service_pool.cc:224] Handling call
0709 13:02:38.135900 (+1399352us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b5800085298. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19e9c 00007f5c67a19a5b 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb17fc0 00007f5c6fb02929 00007f5c6fb023d2 00007f5c69079bd4
0709 13:02:38.136253 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.136681 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.136711 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:38.136789 (+    78us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:38.136828 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.136892 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.137024 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12808064}
I20260709 13:02:38.190878  6756 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:38.194190  6819 raft_consensus.cc:3055] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:38.198647  6537 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.198237  6437 consensus_queue.cc:1059] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:38.199077  6864 raft_consensus.cc:3055] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:38.200017  1620 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:38.163362  1623 rpcz_store.cc:276] 0709 13:02:37.058119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.084962 (+ 26843us) service_pool.cc:224] Handling call
0709 13:02:38.140123 (+1055161us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54000fb9d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:38.140371 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990387072}
W20260709 13:02:38.195173  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.201140  6855 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.202426  1543 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:02:38.209908  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:38.210690  1688 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:38.212030  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:38.212790  1697 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:38.216025  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:38.216864  1692 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:38.218078  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:38.220036  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:38.219038  2271 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:38.223440  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:38.224579  1694 raft_consensus.cc:2393] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:38.225679  6751 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.226998  6852 raft_consensus.cc:3055] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:38.227571  1693 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:38.228947  6852 raft_consensus.cc:740] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:38.230044  6858 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:38.231086  6962 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:38.230871  6858 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.233276  6851 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:38.233551  2234 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:38.233850  6856 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.203548  6819 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:38.234632  6950 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:38.234315  6910 consensus_queue.cc:1059] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:38.236047  6819 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.237468  1513 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:38.238752  6819 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.238837  6489 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:38.239816  6489 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:38.240276  6489 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.241629  6854 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.230612  6852 consensus_queue.cc:260] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.244788  6966 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:38.233803  6851 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:38.206664  6864 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:38.252372  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:38.254086  6817 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:38.251993  6851 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.250710  6966 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:38.257552  6854 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:38.263216  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:38.268657  6897 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:38.269201  6966 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.271643  6910 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.273188  6910 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:38.278805  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.265446  6968 raft_consensus.cc:3055] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:38.275216  6866 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:38.285693  1692 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:38.286235  6723 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:02:38.258884  6817 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.292287  6674 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.280185  6968 raft_consensus.cc:740] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:38.307904  6910 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.307675  6968 consensus_queue.cc:260] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.295878  6864 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.310075  6968 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:38.296756  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:38.297394  6969 raft_consensus.cc:3055] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:02:38.299976  7025 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:02:38.300352  6987 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 1.033s	user 0.000s	sys 0.015s
I20260709 13:02:38.300215  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:38.300611  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 2128) took 1847 ms. Trace:
I20260709 13:02:38.300760  1689 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:38.302337  6858 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:38.302575  6988 log.cc:927] Time spent T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 1.031s	user 0.000s	sys 0.002s
I20260709 13:02:38.305568  6817 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:38.294183  6967 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:38.314967  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.318526  6969 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:38.325918  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 954) took 1703 ms. Trace:
W20260709 13:02:38.325218  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 170478us
I20260709 13:02:38.320391  1620 rpcz_store.cc:276] 0709 13:02:36.452843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.591830 (+138987us) service_pool.cc:224] Handling call
0709 13:02:36.592168 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.223518 (+1631350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.300342 (+ 76824us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54000d3ed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:38.300551 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3639722752}
I20260709 13:02:38.313900  6723 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.326362  1696 rpcz_store.cc:276] 0709 13:02:36.620960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.622261 (+  1301us) service_pool.cc:224] Handling call
0709 13:02:36.622601 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:36.855854 (+233253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:36.855885 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:36.877892 (+ 22007us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.060549 (+182657us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:37.060582 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.060641 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.234877 (+1174236us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:38.323328 (+ 88451us) raft_consensus.cc:1685] finished
0709 13:02:38.323354 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.324355 (+  1001us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47342,"raft.queue_time_us":115138,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":15639,"spinlock_wait_cycles":96020224,"thread_start_us":338492,"threads_started":2,"wal-append.queue_time_us":296438}
W20260709 13:02:38.330013  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.315080  2232 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:38.331988  1697 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
W20260709 13:02:38.333387  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 67224us
W20260709 13:02:38.334069  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 209305us
I20260709 13:02:38.338711  6835 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:38.343950  1619 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:38.344818  6835 raft_consensus.cc:697] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:38.344925  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:38.346040  6835 consensus_queue.cc:237] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.348286  6899 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:38.348564  6907 raft_consensus.cc:3055] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:38.349005  6907 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:38.350270  6907 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.352566  6864 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:38.356377  6969 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.359710  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:38.359841  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:38.360823  1544 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:02:38.361013  6723 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.361917  6852 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:38.365406  1539 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:38.362068  1620 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:38.367575  1688 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 18.
I20260709 13:02:38.368965  6969 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:38.369510  7001 log.cc:927] Time spent T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 13:02:38.369257  6599 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.372377  6599 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:38.372509  7026 log.cc:927] Time spent T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:02:38.373078  1586 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:38.374578  6959 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.375438  6959 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.377362  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:38.378384  6967 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:38.378763  6967 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.378906  6959 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.381371  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:38.383734  6723 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.381013  6674 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:38.379436  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:38.384169  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:38.384792  2272 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
W20260709 13:02:38.380018  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.392037  2232 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:38.395206  6842 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:38.395768  6842 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.396278  6842 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:38.375558  1586 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:38.400300  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:38.401106  6967 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.401993  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:38.404999  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 50414.4us
I20260709 13:02:38.404398  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:38.428297  2266 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:38.442595  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 67161.2us
I20260709 13:02:38.442500  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:38.436921  1514 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:38.450548  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.452881  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:38.453395  1623 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:02:38.456751  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.458061  1663 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:38.458211  6599 consensus_queue.cc:1059] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:38.427258  6957 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:02:38.460141  1586 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:38.460397  6964 raft_consensus.cc:3055] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:38.460777  6964 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:38.461747  1586 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:38.461915  6964 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.463560  6964 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:38.459528  6599 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:38.443975  6674 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:38.474984  1547 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:38.466012  1587 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:38.476719  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 70289us
I20260709 13:02:38.477347  2232 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:38.479640  6897 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:38.481997  2263 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:38.476943  6854 consensus_queue.cc:1059] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:02:38.485216  6756 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:38.485299  6855 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:38.485903  6756 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.486368  6756 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.489025  1514 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:38.490083  6745 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:38.490494  6745 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:38.490844  6745 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:38.491696  6907 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:38.492033  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:38.484063  1663 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:38.500319  1620 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 15: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:38.507658  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:38.508785  6861 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:38.509500  6856 raft_consensus.cc:3055] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:38.509676  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:38.509999  6856 raft_consensus.cc:740] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:38.512254  1661 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:38.522204  7024 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:02:38.522746  6856 consensus_queue.cc:260] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.524314  6856 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:38.524355  6674 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.500589  6723 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:38.525141  1662 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:38.544003  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:38.552903  1662 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:38.554275  1662 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:38.554841  6599 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:38.555248  6599 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:38.555670  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 108906us
I20260709 13:02:38.557590  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:38.557632  6851 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.535128  6817 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.554358  6437 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:38.559386  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:38.539945  6723 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.499394  6967 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.570011  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:38.568392  1513 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:38.555995  6894 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:38.577490  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 45500.2us
I20260709 13:02:38.564829  6855 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:38.579056  1622 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:38.549089  6897 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:38.579082  6819 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:38.588963  6819 raft_consensus.cc:697] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:38.589826  6855 raft_consensus.cc:697] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:38.590234  6819 consensus_queue.cc:237] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.591064  6855 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.571786  6723 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.584755  6817 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:02:38.585898  6899 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:38.586015  6975 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:38.586488  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 102501us
W20260709 13:02:38.592456  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 59164.1us
I20260709 13:02:38.555709  6599 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:38.596078  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 178251us
I20260709 13:02:38.596585  6751 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:38.571233  6674 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.601147  6851 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.610289  6894 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:38.611030  6967 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:38.612674  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.602185  6897 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.597985  6573 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.604482  6745 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.608151  1663 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:38.607442  6751 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:38.616979  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 57854.5us
I20260709 13:02:38.603314  6537 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.605674  6899 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.619386  6573 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.613495  6975 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.620682  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 2213) took 1007 ms. Trace:
I20260709 13:02:38.628973  1622 rpcz_store.cc:276] 0709 13:02:37.613083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.760478 (+147395us) service_pool.cc:224] Handling call
0709 13:02:38.620421 (+859943us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54000410d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:38.620621 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1855266560}
I20260709 13:02:38.631850  1548 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:38.616938  6751 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:38.651829  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:38.655138  1615 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:02:38.629045  6899 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:38.657917  7003 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.067s	user 0.004s	sys 0.000s
I20260709 13:02:38.658118  6817 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:38.658913  6817 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.661096  6817 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:38.666102  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.655490  1615 pending_rounds.cc:85] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 7
W20260709 13:02:38.668915  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 63275.9us
I20260709 13:02:38.672228  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:38.673122  1540 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:38.673863  1514 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:38.674283  1543 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:38.675065  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:38.676108  1514 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:38.676580  6849 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:38.677067  6849 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:38.677475  6849 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:38.669099  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:38.680080  6917 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:38.664726  6489 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.653066  6962 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:38.666723  1615 pending_rounds.cc:107] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 12.8
W20260709 13:02:38.681718  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.690145  1615 raft_consensus.cc:2889] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:38.693230  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:38.687397  6381 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:38.691164  6851 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.704388  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:38.705313  1696 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:38.705672  6745 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.708081  1586 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:38.667610  6756 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:38.711902  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.720331  2266 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:38.668756  6854 consensus_queue.cc:1059] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:02:38.727440  1587 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:38.726979  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:38.740756  6599 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.741293  6723 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.726328  6855 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:38.745151  2271 raft_consensus.cc:2368] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
I20260709 13:02:38.745381  6756 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.726871  6381 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:38.751405  6381 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.755508  2263 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:38.756491  6489 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:38.756834  1622 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:38.757959  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:38.758219  6897 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.758631  1693 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:02:38.760910  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:38.761178  6894 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.761543  1694 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 8.
I20260709 13:02:38.761927  6894 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:38.762375  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:38.763079  1694 raft_consensus.cc:2393] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:38.763978  1689 raft_consensus.cc:1240] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:38.773305  1663 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:38.774101  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 53397us
I20260709 13:02:38.779886  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:38.781335  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:38.782143  1692 raft_consensus.cc:2393] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 8: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:38.782595  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:38.790849  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:38.790724  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:38.759512  6573 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.751500  6907 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:38.793599  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:38.773267  6861 raft_consensus.cc:3055] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:38.796453  1544 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.797109  1662 leader_election.cc:400] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
I20260709 13:02:38.797444  1662 leader_election.cc:403] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:38.793704  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:38.773666  6599 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:38.799597  1693 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:38.800594  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:38.801493  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 125502us
I20260709 13:02:38.783943  6674 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:38.788142  6723 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.811195  1689 raft_consensus.cc:2410] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:02:38.813009  1617 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:38.799175  6861 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:38.817365  1693 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:02:38.787662  6854 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:02:38.812433  6962 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:38.817422  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:38.829509  7033 log.cc:927] Time spent T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.231s	user 0.000s	sys 0.002s
I20260709 13:02:38.831490  6723 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:02:38.836866  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.799582  6849 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.843842  6849 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.846903  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:38.818010  1693 pending_rounds.cc:85] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 10
I20260709 13:02:38.847774  1693 pending_rounds.cc:107] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:02:38.848150  1693 raft_consensus.cc:2889] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:38.823956  7039 log.cc:927] Time spent T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:02:38.817867  1511 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:38.850631  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 157764us
I20260709 13:02:38.824447  1695 raft_consensus.cc:1240] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:38.851955  6537 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:38.852577  1511 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:38.853892  6537 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:38.854902  6897 consensus_queue.cc:1059] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:38.824254  6907 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.847157  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:38.816443  6573 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:38.823576  6861 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.806813  6967 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.862920  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:38.880828  1586 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:38.855372  1511 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:38.873109  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 79536.9us
I20260709 13:02:38.874694  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:38.855873  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:38.885510  2263 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:38.903494  6674 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:38.903963  6674 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:38.903229  1513 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:38.904834  1691 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:38.882512  1662 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:38.906008  1544 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:38.914719  2232 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:38.870244  6861 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:38.904341  6674 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.857790  6907 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:38.905632  6842 consensus_meta.cc:287] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
W20260709 13:02:38.932539  1661 leader_election.cc:336] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.886s (SENT)
I20260709 13:02:38.867583  6975 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:38.855809  6897 raft_consensus.cc:3055] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:02:38.933652  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 78372.5us
I20260709 13:02:38.873381  6751 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.935551  2265 raft_consensus.cc:1240] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:38.936820  6751 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:38.927764  6969 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:38.939079  6969 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:02:38.939724  7037 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
I20260709 13:02:38.940551  1661 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:38.940256  6969 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.941660  6907 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:38.943751  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:38.944628  6723 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:38.945827  1511 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:02:38.948189  7040 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:02:38.933629  6537 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:38.952144  6745 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:38.952755  6745 raft_consensus.cc:697] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:38.954013  6745 consensus_queue.cc:237] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.955852  6537 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:38.957269  6537 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.961383  1511 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:38.961620  1587 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:38.962466  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.881925  6899 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.974537  1514 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:38.975890  2231 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:38.980639  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:02:38.982403  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 50926.8us
I20260709 13:02:38.983587  6907 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:38.984186  6907 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.986145  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:38.986347  6907 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:38.986953  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 104545us
I20260709 13:02:38.987370  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:38.962924  6897 raft_consensus.cc:740] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:38.987604  6751 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:38.990588  6851 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:38.992151  6897 consensus_queue.cc:260] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:38.993610  6897 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:38.997463  6852 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:38.997701  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:38.998471  1697 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:38.999074  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:38.999800  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:39.000103  1695 raft_consensus.cc:2393] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:38.970155  6573 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:02:38.972879  6723 raft_consensus.cc:697] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:39.011982  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:39.012943  1690 raft_consensus.cc:2393] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 15: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:39.012492  6723 consensus_queue.cc:237] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:38.963449  6842 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:39.019654  6842 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:39.022147  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:39.022884  1543 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:39.023324  2271 raft_consensus.cc:2368] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9.
I20260709 13:02:38.980806  6856 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:39.043882  1547 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:39.046005  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:39.046902  1545 raft_consensus.cc:2393] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 8: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:39.048233  1546 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:02:39.049151  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:39.049477  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:39.049940  1539 raft_consensus.cc:2368] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
I20260709 13:02:39.050040  1541 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:39.054486  1548 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:39.055632  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:39.056828  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:39.058218  1548 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:39.059394  1548 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:39.062589  2272 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
W20260709 13:02:39.070739  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.060316  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:39.071624  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:39.074312  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:39.074947  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.078378  1547 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:39.079178  1513 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:39.080924  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 105106us
I20260709 13:02:39.083389  2231 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:39.084517  1661 leader_election.cc:400] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
I20260709 13:02:39.084637  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:39.087714  6979 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:39.088349  6899 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:39.089560  6962 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:39.082054  6489 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:39.090833  6489 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.092895  6489 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:39.095564  6963 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:02:39.096385  6963 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:39.096740  6963 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:39.097617  6963 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.098817  6963 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:39.099557  2231 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:39.099756  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 73566.5us
I20260709 13:02:39.100199  6849 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:39.100795  6849 raft_consensus.cc:697] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:39.101722  6849 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:39.103729  6855 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:39.105523  1587 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:39.132436  6756 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:39.133132  6756 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.129220  6962 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:02:39.079002  6861 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:39.135463  6856 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:39.136050  6856 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:39.136937  6856 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.137475  6674 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.139925  1662 leader_election.cc:400] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9.
I20260709 13:02:39.140343  1662 leader_election.cc:403] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:39.141925  6979 consensus_queue.cc:1059] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:39.143102  6979 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:39.146407  6963 raft_consensus.cc:3055] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:39.146828  6963 raft_consensus.cc:740] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:39.151726  1548 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:39.153965  2272 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:39.156085  6861 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:39.160306  6867 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:39.160482  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:39.162153  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:39.163677  1690 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:39.163765  1541 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:39.180574  6962 consensus_queue.cc:1059] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:02:39.141938  6674 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:39.187906  6756 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:39.189885  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 84600.2us
I20260709 13:02:39.190622  1587 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:39.191385  6756 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:39.197924  1543 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:39.129886  6842 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:39.147887  6963 consensus_queue.cc:260] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:39.200531  2232 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:39.084419  6907 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:02:39.197090  6967 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10.
I20260709 13:02:39.228250  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:39.231771  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:39.234567  1542 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:39.230813  1539 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:39.239369  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:39.240341  1543 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:39.237102  6573 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:39.251549  6573 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.252198  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:39.253499  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:39.253895  6573 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:39.254508  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:39.233795  6861 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.255833  6861 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.257829  6861 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:39.259059  6979 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 8. Current term is 9.
I20260709 13:02:39.193711  6894 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:02:39.255335  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:39.224433  6917 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:39.264199  1620 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:39.241196  6963 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:39.277870  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:39.278131  1688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.008s	sys 0.019s
I20260709 13:02:39.274905  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:39.280906  1688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.009s	sys 0.019s
I20260709 13:02:39.296099  1587 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:39.312276  1540 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:39.326073  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:39.418468  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:39.314641  6819 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:39.314208  6917 raft_consensus.cc:697] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:39.281133  6979 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.143s
W20260709 13:02:39.560807  1694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.011s	sys 0.041s
I20260709 13:02:39.552150  1542 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
W20260709 13:02:39.548249  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.549774  1587 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:39.333772  6861 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.380770  6573 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:39.558701  1691 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:39.279165  6897 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.561257  1694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.011s	sys 0.041s
W20260709 13:02:39.570932  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 239236us
I20260709 13:02:39.575189  1514 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:39.577277  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:39.561182  6751 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.020s	sys 0.017s
W20260709 13:02:39.578327  6537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.009s	sys 0.016s
I20260709 13:02:39.588001  1514 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:39.596918  1514 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:39.567935  6894 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.610718  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 430205us
I20260709 13:02:39.613866  1661 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:39.585598  6537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.009s	sys 0.016s
I20260709 13:02:39.576148  6756 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:39.578795  6751 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.020s	sys 0.017s
I20260709 13:02:39.580122  6861 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.583178  6854 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:02:39.632369  1661 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:39.613471  6745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.015s	sys 0.020s
I20260709 13:02:39.704290  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:39.714318  1615 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:39.619576  6899 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:39.693886  6751 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 18 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:39.726042  6855 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:39.726207  6975 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:39.726603  6855 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.726500  6751 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.712730  6917 consensus_queue.cc:237] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:39.728349  6975 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.728964  6856 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:39.728915  6975 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.729717  6856 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.732046  6975 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:39.732350  6819 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:39.732817  6819 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:39.735457  6924 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:39.735280  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.722934  6599 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:39.745400  6599 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:39.745980  6599 raft_consensus.cc:697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:39.713507  6745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.016s	sys 0.025s
I20260709 13:02:39.750123  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:39.756419  1622 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:39.732259  6856 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:39.714501  7057 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:39.737185  6489 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:39.623761  6897 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.623690  6756 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:39.754954  6849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.002s	sys 0.039s
I20260709 13:02:39.782059  6756 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:39.834671  7069 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.834247  7068 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.746974  6599 consensus_queue.cc:237] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.640769  6894 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:39.829290  6979 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:39.799551  1545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.013s	sys 0.063s
W20260709 13:02:39.872646  1545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.017s	sys 0.063s
W20260709 13:02:39.785590  6849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.002s	sys 0.040s
I20260709 13:02:39.844116  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3328) took 1035 ms. Trace:
I20260709 13:02:39.875267  1696 rpcz_store.cc:276] 0709 13:02:38.808748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.808950 (+   202us) service_pool.cc:224] Handling call
0709 13:02:38.847745 (+ 38795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.848178 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.848205 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.848649 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:02:39.266705 (+418056us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:39.266744 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.266807 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:39.843871 (+577064us) raft_consensus.cc:1685] finished
0709 13:02:39.843899 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.844049 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3919,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":84,"thread_start_us":417645,"threads_started":1,"wal-append.queue_time_us":928499}
W20260709 13:02:39.881341  2233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.019s	sys 0.032s
W20260709 13:02:39.882481  2233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.019s	sys 0.032s
W20260709 13:02:39.986553  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 389710us
I20260709 13:02:39.871168  7069 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.973270  6975 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:39.996850  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 373551us
W20260709 13:02:39.995779  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.973737  6573 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:39.882500  6979 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:40.003144  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 426032us
I20260709 13:02:39.877985  7068 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:39.987644  6537 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.013991  6963 consensus_meta.cc:287] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.000s
I20260709 13:02:40.016573  2272 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:40.026361  6963 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.015040  7052 log.cc:927] Time spent T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 13:02:40.024278  7049 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:02:40.002772  6975 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.026914  6963 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:40.037567  7050 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:02:40.016304  6573 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.033399  6861 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.057195  7080 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.016839  6537 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.056414  7067 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.064373  7057 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.071071  7071 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:02:40.084725  7057 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:40.088251  7061 log.cc:927] Time spent T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:02:40.089835  7063 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:02:40.090469  6819 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.060053  6897 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.069003  6861 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.092015  7060 log.cc:927] Time spent T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:02:40.092356  6861 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.093374  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3332) took 1082 ms. Trace:
I20260709 13:02:40.092607  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 2247) took 1044 ms. Trace:
I20260709 13:02:40.094439  6861 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:40.095547  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 63129.2us
W20260709 13:02:40.069387  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 71083.5us
I20260709 13:02:40.064574  7079 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.094660  1545 rpcz_store.cc:276] 0709 13:02:39.048172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.049561 (+  1389us) service_pool.cc:224] Handling call
0709 13:02:39.049943 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:39.050399 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.050427 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:39.051148 (+   721us) log.cc:844] Serialized 52 byte log entry
0709 13:02:39.873138 (+821990us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:39.873194 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.873284 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:40.092306 (+219022us) raft_consensus.cc:1685] finished
0709 13:02:40.092334 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.092536 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":92,"thread_start_us":821509,"threads_started":1,"wal-append.queue_time_us":932444}
I20260709 13:02:40.093853  1694 rpcz_store.cc:276] 0709 13:02:39.011471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.012039 (+   568us) service_pool.cc:224] Handling call
0709 13:02:39.012400 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:39.012810 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.012839 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:39.013306 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:02:39.568671 (+555365us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:39.568732 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.568829 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:40.093125 (+524296us) raft_consensus.cc:1685] finished
0709 13:02:40.093152 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.093305 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11748,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":9232,"thread_start_us":554858,"threads_started":1,"wal-append.queue_time_us":962367}
I20260709 13:02:40.102183  6894 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.102613  7057 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.102648  2272 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:40.106709  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 101236us
I20260709 13:02:40.114969  7057 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:40.115487  7057 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.115821  1543 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:40.116652  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:40.117583  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:40.117691  6894 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:40.118207  6894 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.119477  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:40.118489  1543 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:40.108664  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:40.123636  1696 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:40.126998  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:40.127602  1689 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:40.128847  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:40.129216  1546 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:40.129427  1697 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:40.131143  1542 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:02:40.135854  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:40.136489  1696 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:40.136865  1690 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:40.139039  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:40.139649  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:40.141191  7058 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:40.145954  6855 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.147529  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:40.150841  7069 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:40.152269  7065 log.cc:927] Time spent T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:02:40.153999  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 43769.3us
I20260709 13:02:40.101382  6861 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:40.153524  1694 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:40.147588  1697 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:40.103973  6745 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:40.070842  6489 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:02:40.103251  7068 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:40.166996  2268 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:40.169279  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:40.173058  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.171819  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 54792.9us
I20260709 13:02:40.179950  1586 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:40.064379  7080 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.126609  7057 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.091897  7067 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.182781  1586 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:40.183162  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 74520.7us
I20260709 13:02:40.193397  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:40.170642  6962 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:40.194080  1697 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:40.113442  7079 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.182156  6855 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:40.205718  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.202021  1692 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:40.183558  6979 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.168062  6861 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.172645  6756 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.193858  6599 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.202612  7057 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.205592  6855 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.184883  6745 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.189381  6917 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:40.229430  1539 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:40.215533  6975 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.236282  7079 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.230283  6963 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:40.237587  7084 log.cc:927] Time spent T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:02:40.226379  6599 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.240612  6599 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:40.227874  7057 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.243577  7057 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.244505  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:02:40.245425  1616 raft_consensus.cc:606] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:40.245823  1616 raft_consensus.cc:614] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:40.250515  7096 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:40.251161  7096 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:40.251576  7096 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:40.252086  6861 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.200978  6723 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:02:40.235111  6537 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.244724  7067 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:40.203696  6962 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.268247  6894 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:40.269263  7078 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:02:40.270623  7080 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:40.281179  6745 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.230338  6855 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:40.296108  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 124571us
W20260709 13:02:40.299729  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 118677us
W20260709 13:02:40.300263  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 112978us
I20260709 13:02:40.312094  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:40.312695  1546 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:40.313320  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:40.293449  6723 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.314513  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:02:40.315078  1616 raft_consensus.cc:606] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:40.315400  1616 raft_consensus.cc:614] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:40.319578  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:40.320827  1540 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:40.322695  1514 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:40.300633  6975 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:40.324854  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:40.325613  1539 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:40.325167  1586 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:40.327634  1663 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:40.328436  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:40.328796  1586 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:40.331173  1546 raft_consensus.cc:2410] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:40.348594  7082 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:40.349376  7082 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:40.349825  7082 raft_consensus.cc:697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:40.353451  6861 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:40.354025  6861 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.355161  6962 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:40.328544  6537 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:40.356104  7093 log.cc:927] Time spent T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:02:40.356777  7091 log.cc:927] Time spent T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:02:40.362845  1663 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:40.350697  7082 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.372556  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:40.373750  1540 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:02:40.375656  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 148695us
W20260709 13:02:40.378326  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 49581us
I20260709 13:02:40.374643  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:40.325519  6975 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.377647  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:40.383608  6975 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:40.392082  1545 raft_consensus.cc:2393] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 15: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:40.356129  6537 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:40.409137  6537 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:40.371902  7067 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:40.321369  6723 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.377323  6963 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:40.452178  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:02:40.473731  1616 raft_consensus.cc:606] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:40.475667  1616 raft_consensus.cc:614] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:40.472786  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 67108.5us
I20260709 13:02:40.448486  7067 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:40.508296  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:40.372983  6962 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:02:40.453495  6894 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:40.410635  7109 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.524610  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:40.491727  6599 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:40.562371  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.507031  7079 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:40.506889  6969 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:40.508885  7069 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.521818  7067 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:40.535594  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:40.593580  2265 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 9.
I20260709 13:02:40.575564  6756 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.574909  6751 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:02:40.617528  7105 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:02:40.620690  7114 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.621472  7114 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.623997  7115 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.624647  7115 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.626938  6856 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:40.627601  6856 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.632983  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.633672  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.634346  1614 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:40.634425  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.635586  7077 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:40.636312  7077 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.635632  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.638722  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.639695  1621 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:40.633912  1623 raft_consensus.cc:2410] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:02:40.642362  6856 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.642441  7114 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.643316  7090 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:40.644074  7090 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.591506  6969 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.648200  6969 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.647195  7090 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.651703  7087 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:40.605880  7088 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:40.652278  7087 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.652936  7088 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.607040  7109 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.655372  7087 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.652261  7114 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:40.576085  6599 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.656173  7114 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.657249  1616 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:02:40.657989  6599 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.658738  7114 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.702559  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.709147  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.709949  1623 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 16: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:40.710418  7088 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.709875  6723 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.606482  6861 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.719847  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:40.722509  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 418822us
I20260709 13:02:40.720662  1621 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:40.727007  1690 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:40.594726  7079 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.730367  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.706260  6969 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.726531  1691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58526 (request call id 976) took 1776 ms (client timeout 1518 ms). Trace:
W20260709 13:02:40.737174  1691 rpcz_store.cc:269] 0709 13:02:38.943322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.943487 (+   165us) service_pool.cc:224] Handling call
0709 13:02:40.719727 (+1776240us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400147b54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:40.719851 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762473856}
I20260709 13:02:40.615089  6751 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.738929  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.606611  7069 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.739526  1620 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:40.740762  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.741163  7069 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:40.741503  1620 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:40.716109  7088 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.742412  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:02:40.745561  1622 raft_consensus.cc:606] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:40.746011  1622 raft_consensus.cc:614] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:40.739526  1615 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:40.713653  7090 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:40.754932  7090 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.756961  7090 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.757426  7090 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:40.758455  7112 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:40.758972  7112 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.759989  7088 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.761917  7112 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.764017  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:40.752074  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.754185  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.770215  1541 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:40.807962  1621 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:40.757855  7090 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.830543  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.833060  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:40.737277  6964 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.745299  6856 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.836625  1662 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:40.837585  1623 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:40.745513  7082 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:40.843921  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:40.843053  2231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.518s (SENT) [suppressed 19 similar messages]
I20260709 13:02:40.759269  6855 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.735512  7075 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 13:02:40.745405  6969 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.842463  7069 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:40.850613  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 2173) took 1601 ms. Trace:
I20260709 13:02:40.849838  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.859179  1623 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:40.858009  1618 rpcz_store.cc:276] 0709 13:02:39.248894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.705963 (+1457069us) service_pool.cc:224] Handling call
0709 13:02:40.706365 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.706625 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:40.706993 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 13:02:40.850316 (+143323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:40.850363 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:40.850409 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.850466 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.850561 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":129,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":2575,"thread_start_us":142975,"threads_started":1}
I20260709 13:02:40.876475  1616 raft_consensus.cc:2393] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 16: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:40.880514  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.851558  7109 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.840845  6964 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.864059  7069 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.886749  1621 raft_consensus.cc:2393] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:40.849833  7082 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:40.894332  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.865777  7077 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.848657  6856 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.906272  1623 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
W20260709 13:02:40.912159  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 69030.4us
I20260709 13:02:40.898016  7069 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:40.906927  6975 consensus_meta.cc:287] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.003s
I20260709 13:02:40.923821  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.924466  1621 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:40.906706  7124 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:40.887307  7110 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:02:40.929154  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.933506  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:40.922371  7086 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.940902  6856 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.945171  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:40.946643  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:40.947813  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:40.948836  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:40.959349  6697 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:40.959844  6697 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:40.960773  6697 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:40.962091  7119 log.cc:927] Time spent T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:02:40.968046  6855 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.969241  7090 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:40.959352  2268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "953db44baef24f55a28e65ff051866d1"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:40.974265  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.974503  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.975072  1621 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:40.975713  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:40.926056  6975 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.983465  6964 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.977921  6907 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.996918  6907 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:40.997258  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:40.999694  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:40.979216  7079 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:41.000291  2265 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:40.978747  6962 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.999063  6907 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:40.929332  7124 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.007444  7124 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.012236  6819 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:40.999480  6967 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:40.956432  7086 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.002444  7121 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.019546  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:02:41.025611  7096 consensus_meta.cc:287] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.000s
I20260709 13:02:41.026139  7096 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.028362  6975 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.028728  7082 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:41.003916  6962 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.055591  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1199) took 2221 ms. Trace:
I20260709 13:02:41.066094  7088 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.068478  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:41.065023  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:41.062546  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.058368  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:41.069792  1539 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:41.063797  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.070721  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.064194  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.063500  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.071633  1548 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
W20260709 13:02:41.072111  7055 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 1.097s	user 0.019s	sys 0.010s
W20260709 13:02:41.018512  6537 consensus_meta.cc:287] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.000s
I20260709 13:02:41.072165  1542 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:41.072773  6537 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.073755  1540 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:41.074774  6537 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.030215  6967 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:41.076078  6967 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.077015  6967 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:41.068367  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:41.078418  1694 raft_consensus.cc:2410] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:41.002480  7129 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.078905  7080 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.079793  7115 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.079981  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.080283  7129 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.080847  1540 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:41.082191  6962 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:41.079591  7080 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.083096  7085 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:41.084229  7083 log.cc:927] Time spent T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.963s	user 0.004s	sys 0.028s
I20260709 13:02:41.083811  7085 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.084993  7080 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:41.086334  7085 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:41.086956  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:41.087824  2269 raft_consensus.cc:2410] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:02:41.087845  2263 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:41.037930  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:41.068925  1619 rpcz_store.cc:276] 0709 13:02:38.834150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.834290 (+   140us) service_pool.cc:224] Handling call
0709 13:02:38.834627 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.834977 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.835003 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.835470 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:02:39.226174 (+390704us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:39.226221 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.226300 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.054762 (+1828462us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b24002aace8. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c678d79c4 00007f5c678d5acb 00007f5c67a90dc9 00007f5c67a90a55 00007f5c67a8ffb0 00007f5c6a706488 00007f5c6a706be8 00007f5c6a6de398 00007f5c6a6d976a 00007f5c6a6d8bb6
0709 13:02:41.055267 (+   505us) raft_consensus.cc:1685] finished
0709 13:02:41.055287 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.055514 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1094,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"spinlock_wait_cycles":34624896,"thread_start_us":390303,"threads_started":1,"wal-append.queue_time_us":783221}
I20260709 13:02:41.089262  1695 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:41.093676  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:41.095711  7056 log.cc:927] Time spent T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 1.272s	user 0.016s	sys 0.005s
I20260709 13:02:41.097012  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54496 (request call id 1036) took 2237 ms. Trace:
I20260709 13:02:41.097376  2266 rpcz_store.cc:276] 0709 13:02:38.869831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.870869 (+  1038us) service_pool.cc:224] Handling call
0709 13:02:38.871268 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.871745 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.871790 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.872411 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:02:39.317422 (+445011us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:39.317476 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.318260 (+   784us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.094929 (+1776669us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:41.096744 (+  1815us) raft_consensus.cc:1685] finished
0709 13:02:41.096764 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.096942 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":406,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":35712384,"thread_start_us":444547,"threads_started":1,"wal-append.queue_time_us":848357}
I20260709 13:02:41.045617  6573 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:41.103554  1662 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:41.103658  1663 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:41.112881  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61451.4us
I20260709 13:02:41.100847  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:41.114050  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:41.114857  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:41.118494  1663 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:41.118705  1514 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:41.119899  1514 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:41.119561  1663 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:41.015581  6969 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:41.165591  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 45744.8us
W20260709 13:02:41.112840  7125 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:02:41.051432  6964 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.167188  1514 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:41.188165  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:41.066218  7086 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:41.196597  1514 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:41.156603  6907 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:41.155958  6819 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:41.158259  7085 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:41.155839  6381 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:41.141108  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.164005  7088 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:41.227984  6573 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:41.231127  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:41.231479  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:41.200245  7124 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:41.234193  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54488 (request call id 843) took 1488 ms. Trace:
I20260709 13:02:41.200062  6964 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.227387  7079 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:41.121831  6537 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:41.156816  6894 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:41.239542  2268 raft_consensus.cc:606] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:41.162459  7129 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.245062  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:41.168911  7080 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:41.047195  7096 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.197048  6969 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:41.255959  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:41.198949  6849 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:41.168062  6962 consensus_queue.cc:1059] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:02:41.229876  6907 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.250361  2268 raft_consensus.cc:614] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:41.244256  2271 rpcz_store.cc:276] 0709 13:02:39.746099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.746236 (+   137us) service_pool.cc:224] Handling call
0709 13:02:39.746544 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:39.746746 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:40.185213 (+438467us) log.cc:844] Serialized 14 byte log entry
0709 13:02:41.233693 (+1048480us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b1800472d20. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c6a6e64bc 00007f5c67a3448b 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a4e455 00007f5c6ab36060 00007f5c6ab48716 00007f5c6ab59287
0709 13:02:41.233803 (+   110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:41.233855 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:41.233910 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.233988 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.234104 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3057,"prepare.queue_time_us":473197,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":45021,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":33442048,"thread_start_us":577657,"threads_started":3,"wal-append.queue_time_us":144029}
I20260709 13:02:41.122941  6897 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 13:02:41.254837  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.255123  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.276814  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:41.242944  7088 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.277047  1541 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:41.256659  1614 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:41.257375  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.241346  6381 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:41.262207  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.253567  7080 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.256347  6969 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.299160  6969 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:41.244674  7124 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:41.303632  7124 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.304180  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 2177) took 2054 ms. Trace:
I20260709 13:02:41.304569  1617 rpcz_store.cc:276] 0709 13:02:39.250158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.568716 (+318558us) service_pool.cc:224] Handling call
0709 13:02:39.569038 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:39.606792 (+ 37754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.606829 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:39.637388 (+ 30559us) log.cc:844] Serialized 26 byte log entry
0709 13:02:40.016684 (+379296us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:40.016742 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.303807 (+1287065us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b540016e754. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:41.303856 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:41.303902 (+    46us) raft_consensus.cc:1685] finished
0709 13:02:41.303915 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:41.304123 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17546,"raft.queue_time_us":22533,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7208,"spinlock_wait_cycles":45370752,"thread_start_us":264426,"threads_started":1,"wal-append.queue_time_us":347392,"wal-append.run_cpu_time_us":2671,"wal-append.run_wall_time_us":1164705}
I20260709 13:02:41.306844  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:41.247160  7079 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.307440  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:41.307617  7079 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:41.308198  7090 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:41.308722  7090 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.310707  7090 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:41.247340  6573 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.313093  6964 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:41.314656  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:41.315191  1541 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:41.264324  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 186488us
I20260709 13:02:41.274206  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 19 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:41.316350  1615 raft_consensus.cc:2410] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 19 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:41.267343  7103 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.277729  1619 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:41.319546  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:41.034854  7121 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.288497  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:41.323951  1544 raft_consensus.cc:2393] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:41.288535  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:41.298261  7069 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.261515  6849 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:41.327612  6849 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:41.327864  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.329018  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.329571  1542 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:41.330462  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.331185  1542 raft_consensus.cc:2410] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:02:41.317708  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.250264  6894 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.314218  7080 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:41.065613  7067 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.268636  1587 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:41.319546  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.275913  6907 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:41.341581  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 73183.8us
I20260709 13:02:41.332191  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 19 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.281458  7088 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.342332  1587 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:41.279896  7059 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.343252  7059 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.281363  6381 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:41.271982  7082 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:02:41.276943  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.335367  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:41.341660  6975 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:41.325104  6962 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:41.339383  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 179395us
I20260709 13:02:41.365937  1663 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:41.367246  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:41.349570  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:41.339843  1586 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:41.354611  1541 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:41.355839  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:41.347576  6975 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.358489  6849 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.355866  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.378460  1544 raft_consensus.cc:1813] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Handling vote request from an unknown peer 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:41.379048  1544 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 9: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:41.389314  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:41.325510  7103 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.390027  2271 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:41.320896  6897 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:02:41.412500  1541 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:41.363981  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:41.413853  1614 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:41.414465  6854 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:41.414885  6854 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:41.415271  6854 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:41.363865  2265 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:41.391651  7103 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.392258  1513 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:41.419204  1513 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:41.335711  6964 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:41.419961  6964 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.420562  1513 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:41.420744  7067 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:41.349382  7115 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:41.377990  1586 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:41.422024  6964 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:41.332707  7127 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
W20260709 13:02:41.422291  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 44381.1us
I20260709 13:02:41.423549  7127 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:41.377866  6962 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.424160  7127 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:41.424868  7127 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:41.425215  7127 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:41.425570  7127 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.425999  6962 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:41.395562  6573 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.426934  6573 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:41.337149  6894 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:41.394528  7069 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:41.408757  1545 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:41.428531  6819 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:41.429104  6819 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.429561  6819 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:41.410765  6849 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:41.422152  7136 log.cc:927] Time spent T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:02:41.430646  7139 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:41.395246  7059 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.406806  7088 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.404693  7121 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.394497  6751 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.377177  6975 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:41.435592  2234 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:41.458250  1661 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:41.466321  6975 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.440637  7139 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:41.470757  1540 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:41.493587  6817 raft_consensus.cc:3055] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:41.500072  6817 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:41.512094  6817 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.512282  6381 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.457316  6964 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 13:02:41.517060  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.495575  7069 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:41.473469  7139 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:41.469002  7067 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:02:41.496304  7110 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:41.467780  6907 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.528272  1539 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:41.522507  7110 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:41.542033  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 191312us
I20260709 13:02:41.544447  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:41.561046  1621 raft_consensus.cc:2368] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16.
I20260709 13:02:41.546064  7085 raft_consensus.cc:3055] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:41.546566  7080 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.574604  6854 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.551529  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.555094  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.582576  1541 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:41.532287  6817 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:41.569260  7085 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:41.583904  2232 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:41.570144  7110 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:41.591269  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 224078us
I20260709 13:02:41.584275  1587 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:41.595108  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:41.598680  7096 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:41.599046  7096 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.599436  7096 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:41.602263  7080 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:41.609182  6381 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.612761  6907 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:41.617129  7085 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.618475  7085 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:41.620899  6975 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.622776  6856 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:41.623203  6856 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:41.623739  7088 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.624418  7088 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:41.593432  7121 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:41.624923  7088 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.623744  6856 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:41.593786  6962 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:41.630179  6962 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.631613  7088 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.633404  7110 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.633881  6745 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:41.634406  6745 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.636745  6854 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.637630  1587 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:41.638561  1587 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:41.639219   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:41.641058   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:41.623204  6819 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.625388  7121 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.651839  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:41.645717  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 50651us
I20260709 13:02:41.632452  6962 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:41.661533  1617 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:41.662213  1662 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:41.647068  1587 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:41.663813  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:41.665844  1587 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:41.665657  7139 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.682708  7098 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:41.683765  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:41.683979  7139 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:41.670125  7143 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:41.693538  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.661293  6854 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:41.664839  7121 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:41.664772  7086 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:41.664988  7115 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:41.666929  6855 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:41.705628  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:41.708055  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:41.670125  6573 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:41.717057  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 222073us
I20260709 13:02:41.695956  7082 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:41.719401  1661 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:41.665119  7124 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.700340  6962 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:41.705433  6599 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:41.737679  7067 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:41.708853  7139 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:41.739588  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:41.739743  1661 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:41.712203  7115 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:41.717197  7080 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:41.745440  1695 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:41.747879  1693 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:41.751092  1546 raft_consensus.cc:1240] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:41.721642  7110 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.752357  1696 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:41.753145  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:41.768362  1693 raft_consensus.cc:2368] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:41.752873  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:41.766489  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 98943.8us
I20260709 13:02:41.728600  6855 raft_consensus.cc:697] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:41.730341  7143 raft_consensus.cc:697] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:41.777603  1621 pending_rounds.cc:85] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 8
I20260709 13:02:41.779337  1621 pending_rounds.cc:107] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:02:41.779697  1621 raft_consensus.cc:2889] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:41.777451  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:41.712855  7079 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.779860  1661 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:41.734795  7085 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:41.809329  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:41.741019  7088 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.806728  1623 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:02:41.743080  6819 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:41.734418  7145 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:41.827173  7145 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.829273  7145 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:41.830981  6381 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:41.831527  6381 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.750291  7115 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:41.716602  7086 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:41.818593  7140 log.cc:927] Time spent T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:41.824092  7143 consensus_queue.cc:237] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.825496  7149 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:41.813859  6855 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.839696  1617 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:02:41.841481  1693 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:41.811462  6969 consensus_meta.cc:287] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 13:02:41.843218  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:41.849308  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:41.743132  6962 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.850839  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:41.885361  1621 raft_consensus.cc:2368] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 13. Current term is 14.
I20260709 13:02:41.885289  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:41.782676  6963 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:41.850303  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:41.882494  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:41.886482  1693 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:41.888434  2234 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:41.842514  6819 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:41.777984  7080 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.897881  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:41.833586  7067 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:41.767853  6599 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.897979  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:41.845057  7085 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.781488  7139 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.879392  7149 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.914096  1693 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:41.914717  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:41.914903  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:41.887991  7059 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:41.843430  7088 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.901654  6957 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:41.935915  1540 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:41.948052  1693 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:02:41.850293  7127 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:41.895876  6573 raft_consensus.cc:697] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:41.901643  6745 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:41.942344  1690 raft_consensus.cc:2368] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:41.885435  6969 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:41.963739  1544 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:02:41.978085  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.946475  6894 consensus_meta.cc:287] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
W20260709 13:02:41.981689  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 138268us
I20260709 13:02:41.934648  7149 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:41.971154  1540 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:41.973618  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:41.988250  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:41.989122  1691 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:41.990114  1539 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:41.993050  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:41.993294  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:41.993979  1690 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:41.973989  6957 raft_consensus.cc:697] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 15 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:41.998963  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:41.995242  1548 raft_consensus.cc:2368] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:41.978690  6697 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:41.999598  1691 raft_consensus.cc:2376] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e37b8013aec24431a6672a857806329e in term 10. Re-sending same reply.
I20260709 13:02:41.951385  7059 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:42.009426  1690 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:42.015666  7085 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:41.965057  7160 consensus_queue.cc:1059] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:02:42.015873  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.017467  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:42.020249  7146 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:02:42.020505  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:42.020985  7152 log.cc:927] Time spent T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:02:41.999795  7155 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.030288  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.049746  1694 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 14.
I20260709 13:02:42.049607  7155 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.050796  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.032361  1697 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:42.052954  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.054139  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.052026  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.056192  1694 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:42.057288  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.057499  7059 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:42.058028  1694 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:42.007354  6381 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:42.037992  7150 log.cc:927] Time spent T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:02:42.039143  7165 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:42.038511  7163 raft_consensus.cc:3055] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:42.098474  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:42.099349  1541 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:42.044551  6856 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.047019  1514 leader_election.cc:400] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16.
I20260709 13:02:42.047674  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.048573  6745 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.024785  7124 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:41.983174  6894 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:42.051983  7155 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.059924  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:42.063802  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:42.069558  6969 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.071070  7139 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:42.072556  7088 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.078383  7157 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:42.083307  7079 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.087386  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.128255  1694 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:42.129061  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.129534  1694 raft_consensus.cc:2393] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:42.026701  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.088399  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.088562  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.089141  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.098627  7163 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:42.094707  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:42.095788  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.137159  1697 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:42.095765  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.098106  1617 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:42.103946  1514 leader_election.cc:403] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:02:42.104807  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.106576  6957 consensus_queue.cc:237] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:42.107369  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.108492  6962 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:42.109068  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.079167  6723 consensus_queue.cc:1059] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:02:42.122040  1541 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:42.130990  1616 raft_consensus.cc:2410] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:02:42.089752  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:42.159871  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:42.160449  1614 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:42.132642  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.164639  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.140671  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.141693  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.166469  1617 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:42.142386  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.143047  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.166900  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.167706  1694 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:02:42.168356  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 65028us
I20260709 13:02:42.145602  7127 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:42.146401  7155 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:42.102043  7165 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.182138  7165 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.182624  7088 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:42.148231  7079 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16.
I20260709 13:02:42.148435  1688 raft_consensus.cc:2393] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 15: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:02:42.148074  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 101298us
I20260709 13:02:42.187214  1620 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:42.131477  7157 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.173352  1511 leader_election.cc:400] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:42.187911  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:42.188131  1511 leader_election.cc:403] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:42.173969  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.177867  7163 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.179528  7155 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.148061  6599 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:42.183216  7086 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:42.188483  1619 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:42.189872  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 82459.1us
I20260709 13:02:42.196938  1514 leader_election.cc:400] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 13. Current term is 14.
I20260709 13:02:42.188985  1694 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:42.215138  1514 leader_election.cc:403] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:02:42.202121  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.202661  1511 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:42.101954  7121 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:42.217192  7057 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:42.214716  1587 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:42.124409  6573 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.118201  6745 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.230075  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.240829  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:42.215890  7096 consensus_meta.cc:287] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.616s	user 0.006s	sys 0.005s
I20260709 13:02:42.238690  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:42.237314  7166 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:42.250432  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.249560  1614 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:42.251201  1697 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:42.251760  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.212903  7059 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:42.252403  1694 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:42.236205  7057 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.259321  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.213038  7124 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:02:42.264588  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.274941  1694 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:42.277932  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:42.280380  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.281216  1694 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:42.270529  1696 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:42.283385  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.285000  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.219872  6849 consensus_queue.cc:1059] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 13:02:42.286692  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.288357  1663 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:42.252511  7163 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:42.250626  6854 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:42.223237  7127 consensus_queue.cc:1059] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:02:42.304906  1663 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:42.311865  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 95065.6us
W20260709 13:02:42.319563  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 122711us
I20260709 13:02:42.325309  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:42.266466  7057 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:42.333309  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:42.336381  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.295964  6897 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 13. Current term is 14.
I20260709 13:02:42.330376  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.340870  1688 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:42.330536  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:42.331503  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.306329  6854 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.251372  7096 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:42.337605  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 78256.8us
I20260709 13:02:42.315258  7086 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:42.312796  1511 leader_election.cc:400] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:42.353842  1511 leader_election.cc:403] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:42.355402  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.356025  1688 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:42.298113  7079 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:02:42.290644  7165 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:02:42.362368  7168 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:42.291966  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.372139  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.375483  1689 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
W20260709 13:02:42.326445  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 104730us
I20260709 13:02:42.334421  6907 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:42.373660  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:42.392477  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.347198  6854 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:42.381989  1622 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:42.353426  7086 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.335052  7149 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.485863  1688 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
W20260709 13:02:42.600059  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 295218us
I20260709 13:02:42.623190  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:42.423059  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 43619us
I20260709 13:02:42.479598  1697 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:42.487761  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:42.625283  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.433409  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.480217  1619 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
W20260709 13:02:42.418817  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 174213us
I20260709 13:02:42.439284  1694 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
W20260709 13:02:42.599743  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 287104us
W20260709 13:02:42.505635  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.501802  7076 raft_consensus.cc:3055] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:42.652303  7076 raft_consensus.cc:740] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:42.432818  7096 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.433246  6897 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:42.653837  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:42.434130  7178 raft_consensus.cc:3055] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:42.641638  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.641268  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.647724  1511 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:02:42.601372  6963 consensus_meta.cc:287] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.708s	user 0.012s	sys 0.005s
W20260709 13:02:42.652411  7172 log.cc:927] Time spent T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 13:02:42.654696  2268 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:42.512596  6697 consensus_meta.cc:287] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.004s
I20260709 13:02:42.673171  1690 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 16: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:42.628278  1689 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:42.658341  1688 raft_consensus.cc:2368] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 13. Current term is 14.
I20260709 13:02:42.675141  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.675374  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:42.562903  7115 consensus_meta.cc:287] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.003s
W20260709 13:02:42.493484  7167 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.346s	user 0.000s	sys 0.002s
I20260709 13:02:42.676192  7115 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.678558  7115 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.644790  7086 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.674373  1663 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:42.675869  1689 raft_consensus.cc:2368] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15.
I20260709 13:02:42.681345  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.681980  1689 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:42.682647  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.644753  7057 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:42.683907  6855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.000s	sys 0.002s
W20260709 13:02:42.684245  6855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.000s	sys 0.002s
I20260709 13:02:42.685041  7057 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:42.484611  7082 consensus_meta.cc:287] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.755s	user 0.007s	sys 0.002s
I20260709 13:02:42.686647  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.658596  1697 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 18.
I20260709 13:02:42.673527  1586 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:42.687750  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.405273  6856 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.625128  7121 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.689172  1586 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:42.531092  6894 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:42.690078  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:42.690675  1688 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:42.691202  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:42.644079  7155 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.686348  6963 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:42.691753  7057 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:42.688607  2268 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:42.582971  7059 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:42.507196  7080 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:42.657541  7178 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:42.655100  6751 raft_consensus.cc:3055] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:42.702725  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.489601  7157 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.654815  6745 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.706306  1513 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:42.761394  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:42.787434  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 81181.7us
I20260709 13:02:42.707453  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.698853  1586 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:42.383296  7168 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.694754  7115 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:42.757495  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 67482.3us
I20260709 13:02:42.703146  6599 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.705372  7096 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:42.757529  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 66385.7us
W20260709 13:02:42.804908  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 134276us
I20260709 13:02:42.793660  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.788439  1691 raft_consensus.cc:2368] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16.
W20260709 13:02:42.808930  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 110211us
I20260709 13:02:42.845774  1586 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:42.809929  1511 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:42.692569  7082 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:42.714803  7166 raft_consensus.cc:697] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:42.771874  7127 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:42.822274  1661 leader_election.cc:400] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:42.853428  1661 leader_election.cc:403] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:42.805413  7059 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:42.826606  1514 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:42.821758  6745 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:42.828074  7186 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:02:42.833695  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.834497  7168 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.834956  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:42.835776  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 2176) took 1091 ms. Trace:
I20260709 13:02:42.839310  7157 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:42.841912  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.842264  7086 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.771934  6751 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:42.705199  7057 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:42.877312  7057 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.846794  1689 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:42.878358  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.878912  1689 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:42.879817  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:42.701671  6697 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:02:42.881204  6751 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:42.773658  6894 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.756582  6856 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:42.820192  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:42.827859  7175 log.cc:927] Time spent T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.353s	user 0.000s	sys 0.000s
I20260709 13:02:42.859187  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:42.805804  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 131503us
I20260709 13:02:42.865860  1623 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:42.866039  1586 leader_election.cc:400] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15.
I20260709 13:02:42.891264  1586 leader_election.cc:403] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:02:42.821357  7115 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:42.821492  7096 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:42.870069  1692 rpcz_store.cc:276] 0709 13:02:41.744013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.744140 (+   127us) service_pool.cc:224] Handling call
0709 13:02:42.835608 (+1091468us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b5400147654. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:42.835728 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1103754112}
I20260709 13:02:42.904248  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:42.895701  1694 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:42.787480  7185 consensus_queue.cc:1059] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 13:02:42.856600  7154 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:42.897727  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.843739  6599 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.907456  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.868435  7163 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.864713  7192 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:42.898113  1586 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:42.918134  1696 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:42.909026  1663 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:42.883595  6745 raft_consensus.cc:697] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:42.932204  1692 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:42.937633  1692 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:42.930670  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.933797  1586 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:42.938621  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:42.901953  7168 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15.
I20260709 13:02:42.900559  7059 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.900511  7115 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:42.906934  7096 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:42.943224  1586 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:42.962673  7155 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:42.963083  7155 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:42.963462  7155 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.965417  7178 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.966809  7178 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:42.934867  7088 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:42.938541  7163 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:42.970114  6969 raft_consensus.cc:3055] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:42.970593  6969 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:42.971438  7088 raft_consensus.cc:697] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:42.971771  6969 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.972354  7088 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.973495  6969 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:42.901327  6856 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.943836  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:42.951802  7082 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:42.940872  7143 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:42.705403   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:42.984803  1619 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:42.993048  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 166507us
I20260709 13:02:42.993012  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.998471  1693 raft_consensus.cc:2368] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15.
I20260709 13:02:42.999603  1514 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:42.981021  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:42.996461  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 186601us
I20260709 13:02:43.001314  1511 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:42.996860  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:42.937799  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:43.004021  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 66302us
I20260709 13:02:43.004700  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:43.008023  1511 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:43.009888  1586 leader_election.cc:400] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15.
I20260709 13:02:43.010298  1586 leader_election.cc:403] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:43.009753  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:43.011164  1693 raft_consensus.cc:2368] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15.
I20260709 13:02:43.013131  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:43.014249  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:43.017655  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:43.018944  1614 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:43.020138  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:43.020047  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:43.021467  1693 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:42.944423  7154 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:43.031946  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:43.032603  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:43.016515  6855 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15.
I20260709 13:02:42.975389  6599 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:43.033568  1614 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:43.014802  6963 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:42.983161  6856 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:42.985026  7082 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:42.988255  7143 raft_consensus.cc:697] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:42.978046  7086 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:42.915742  6697 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:02:43.043094  1691 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:43.075906  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:42.975755  7149 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:43.037830  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:43.044391  1619 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:43.025035  7059 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:43.048336  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:43.085000  1539 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:43.052551  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:43.046265  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:43.053287  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:43.057586  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:43.087809  1541 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:43.087925  1543 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:43.088632  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:43.059505  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:43.043556  7154 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.981168  6854 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.016628  7182 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:43.030763  7188 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:42.978775  7155 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.076874  1692 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:43.030833  7194 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:42.982120  7096 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:42.978274  7115 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.012537  7168 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:02:42.928803  7166 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.061290  1540 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:43.101945  7154 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:43.101240  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:43.131912  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:43.089558  1546 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:43.105049  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 100413us
I20260709 13:02:43.106046  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:42.983665  6745 consensus_queue.cc:237] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.107278  1623 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:43.103454  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:43.078532  6969 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:43.107755  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 72834.4us
I20260709 13:02:43.113550  7057 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.084697  7059 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:43.089428  6963 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:43.173522  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:43.124607  1539 raft_consensus.cc:2468] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:43.109368  7188 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:43.189489  1620 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:43.193259  1586 leader_election.cc:400] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15.
I20260709 13:02:43.087308  1544 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:43.135587  1542 raft_consensus.cc:2393] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:43.141779  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:43.103154  7182 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:43.194396  1586 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:43.175303  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:43.127583  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:43.177739  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:43.185043  7096 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:43.124919  7194 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.185937  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:43.207254  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:43.191120  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:43.194550  1693 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:43.175364  2232 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:43.197841  7204 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.202620  1586 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:43.196383  1691 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:43.205996  1546 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:43.174839  7059 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.187580  7082 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.215556  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:43.216516  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:43.217025  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:43.222129  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:43.192957  7188 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:43.224293  1539 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:43.224982  1542 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:43.226428  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3348) took 1161 ms. Trace:
I20260709 13:02:43.228791  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:43.229574  1691 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:43.231818  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:43.233464  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:43.235565  1542 raft_consensus.cc:1240] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:43.210834  7194 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:43.237180  1542 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:43.230914  7193 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:43.241777  7190 log.cc:927] Time spent T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.456s	user 0.003s	sys 0.000s
I20260709 13:02:43.243321  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 2189) took 1221 ms. Trace:
I20260709 13:02:43.243384  1689 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:43.243840  1690 rpcz_store.cc:276] 0709 13:02:42.022016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.026512 (+  4496us) service_pool.cc:224] Handling call
0709 13:02:43.243119 (+1216607us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54001603d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:43.243265 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248975104}
I20260709 13:02:43.245189  1690 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:43.206805  6975 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:43.243381  1621 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:43.227001  1697 rpcz_store.cc:276] 0709 13:02:42.064731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.832159 (+767428us) service_pool.cc:224] Handling call
0709 13:02:42.832377 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.832543 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:43.079172 (+246629us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.226034 (+146862us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.226096 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:43.226152 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.226234 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.226362 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12195,"prepare.queue_time_us":335231,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2972,"thread_start_us":379530,"threads_started":2}
I20260709 13:02:43.252105  1586 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:43.201921  7182 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:43.173264  6969 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.260430  1693 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:43.223472  7204 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.266441  7204 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:43.260128  6975 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:43.268652  6917 consensus_queue.cc:1059] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:43.269992  6917 raft_consensus.cc:3055] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:43.270397  6917 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:43.226374  7180 raft_consensus.cc:2804] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:43.282725  1548 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:43.283882  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:43.288139  1691 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:43.300364  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:43.300981  1618 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:43.304863  1547 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:43.195978  7143 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.272635  7168 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:43.319753  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:43.281294  7203 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:43.304477  7180 raft_consensus.cc:697] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:43.280475  7129 consensus_queue.cc:1059] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 13:02:43.331369  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 79331.5us
I20260709 13:02:43.332183  1586 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:43.333732  1586 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:43.329097  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:43.335955  1661 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:43.334749  1586 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:43.334693  1587 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:43.339574  1548 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:43.341795  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:43.343075  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:43.344143  1661 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:43.280138  6917 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.347506  1661 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:43.350531  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:43.340277  6975 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:43.362175  7192 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:43.412528  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 69556.7us
I20260709 13:02:43.363545  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 2267) took 1520 ms. Trace:
I20260709 13:02:43.413601  1622 rpcz_store.cc:276] 0709 13:02:41.842845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.842986 (+   141us) service_pool.cc:224] Handling call
0709 13:02:43.363264 (+1520278us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54003ccdd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:43.363463 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152777088}
I20260709 13:02:43.348232  7082 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:43.373361  1547 raft_consensus.cc:1240] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:43.361236  7057 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:43.346710  6854 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:43.346432  7204 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:43.345279  6894 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:43.419209  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:43.424134  1587 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:43.351542  7155 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:43.441392  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:43.468530  1690 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
W20260709 13:02:43.475833  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.364061  1661 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:43.483521  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 59453.1us
I20260709 13:02:43.419857  6855 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:43.411345  7129 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:43.481493  7200 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:02:43.480369  7202 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:43.482394  7206 log.cc:927] Time spent T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
W20260709 13:02:43.480515  7212 log.cc:927] Time spent T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:02:43.411062  7115 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:43.383283  6975 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:02:43.498870  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.419893  7082 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:02:43.508817  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.505235  1618 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:43.584542  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 2212) took 1491 ms. Trace:
I20260709 13:02:43.584880  1618 rpcz_store.cc:276] 0709 13:02:42.093281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.159554 (+ 66273us) service_pool.cc:224] Handling call
0709 13:02:43.300205 (+1140651us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b5800085298. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:02:43.584485 (+284280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9390464}
I20260709 13:02:43.521936  1690 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:43.467703  6917 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.426692  7168 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:43.521446  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 157558us
I20260709 13:02:43.589028  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:43.525903  1587 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:43.535768  7187 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:43.549882  7209 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:02:43.502483  6854 consensus_queue.cc:1059] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 13:02:43.571764  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 230357us
I20260709 13:02:43.600565  1511 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:43.486690  6969 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:43.542307  6894 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:43.524606  6855 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:43.603103  6855 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:43.423738  7180 consensus_queue.cc:237] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.604213  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:43.583868  6975 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:43.586862  7082 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:43.606231  1661 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:43.594205  7187 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:43.564355  7129 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.611047  1511 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:43.612403  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 86752.3us
I20260709 13:02:43.615252  1663 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:43.615360  1511 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:43.616914  1514 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:43.617336  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:43.617980  1663 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:43.620064  1546 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:43.616659  1511 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:43.606871  7057 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:43.621129  1663 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:43.606691  6894 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:43.587178  7194 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.610592  7124 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:43.613369  6573 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:43.613539  7187 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:43.626730  1663 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:43.598057  7202 consensus_queue.cc:1059] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:02:43.628873  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 202471us
I20260709 13:02:43.621567  6381 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:43.621830  7197 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:43.624109  7115 raft_consensus.cc:3055] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:43.620194  7192 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:43.622118  7149 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:43.621635  7086 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:43.624287  7088 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:43.627465  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:43.647064  7154 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.624413  7057 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:43.627125  6819 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:43.645452  1692 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:43.643657  6745 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:43.750432  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.833192  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 212740us
I20260709 13:02:43.842424  1586 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:43.840178  1514 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:43.812225  7143 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.876478  7187 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.754766  7192 raft_consensus.cc:697] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:43.893098  7192 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.641933  6573 raft_consensus.cc:697] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:43.896279  6573 consensus_queue.cc:237] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.641932  7115 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:43.899883  6969 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.641948  7197 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:43.900540  7197 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:43.900426  6969 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:43.902390  7195 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.955s	user 0.002s	sys 0.000s
I20260709 13:02:43.902566  6969 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:43.903385  7181 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:43.903915  7181 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.904181  7143 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.906071  7181 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:43.888700  7154 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:43.908010  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:43.654804  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:43.908562  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3349) took 1843 ms. Trace:
I20260709 13:02:43.908991  1689 rpcz_store.cc:276] 0709 13:02:42.065030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.880489 (+815459us) service_pool.cc:224] Handling call
0709 13:02:43.243229 (+362740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.243959 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.908376 (+664417us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54001603d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:43.908505 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833571584}
I20260709 13:02:43.635795  1663 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:43.634388  7215 consensus_queue.cc:1059] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 13:02:43.808780  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 192166us
I20260709 13:02:43.769394  7086 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.910774  7076 consensus_queue.cc:260] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.911288  7086 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.912220  7076 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.913257  6894 raft_consensus.cc:3055] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:43.913877  6894 raft_consensus.cc:740] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:43.915804  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:43.916041  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3358) took 1788 ms. Trace:
I20260709 13:02:43.916435  2263 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:43.916989  7219 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:43.917590  7219 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.918424  1513 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:43.920349  7185 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:43.920732  7185 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:43.921073  7185 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:43.924141  7194 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:43.815730  7057 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:43.924633  1696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39244 (request call id 2200) took 1761 ms (client timeout 2168 ms). Trace:
W20260709 13:02:43.925093  1696 rpcz_store.cc:269] 0709 13:02:42.162710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.291743 (+129033us) service_pool.cc:224] Handling call
0709 13:02:43.924443 (+1632700us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b54003c23d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:43.924572 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1226694912}
W20260709 13:02:43.927237  7213 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.516s	user 0.000s	sys 0.001s
I20260709 13:02:43.883123  6751 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:43.864323  7223 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:43.865128  7124 consensus_queue.cc:1059] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.067s
W20260709 13:02:43.880272  7221 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:02:43.932632  7124 raft_consensus.cc:3055] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:43.914767  6894 consensus_queue.cc:260] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.933032  7124 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:43.922822  6975 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.933902  7124 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.935076  7124 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:43.872079  7129 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:43.936599  2231 leader_election.cc:336] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Timed out: RequestConsensusVote RPC to 127.0.107.131:43987 timed out after 1.518s (SENT)
W20260709 13:02:43.937655  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.939520  7215 consensus_queue.cc:1059] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:43.939872  7205 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:43.940373  7205 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.942149  7215 raft_consensus.cc:3055] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:43.942559  7215 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:43.943571  6819 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:43.943907  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 308183us
I20260709 13:02:43.944116  6819 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.945047  7163 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:43.945437  1663 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:43.946292  6819 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:43.946839  6819 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:43.946944  1663 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:43.860980  7188 consensus_meta.cc:287] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.000s
I20260709 13:02:43.950265  7188 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.951392  1545 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:43.952661  7188 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:43.861295  7168 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:43.823927  6745 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.953428  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:43.953806  6745 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:43.954423  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:43.863405  7088 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:43.955540  7088 raft_consensus.cc:697] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:43.955657  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:43.892064  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33892 (request call id 1264) took 1235 ms. Trace:
I20260709 13:02:43.956605  1623 rpcz_store.cc:276] 0709 13:02:42.656817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.026228 (+369411us) service_pool.cc:224] Handling call
0709 13:02:43.033867 (+  7639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.135583 (+101716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.891813 (+756230us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b540016ec54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:43.892005 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167856896}
I20260709 13:02:43.956713  7088 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:43.899371  7191 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.948s	user 0.003s	sys 0.000s
W20260709 13:02:43.798481  6897 consensus_meta.cc:287] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 1.145s	user 0.008s	sys 0.004s
W20260709 13:02:43.958060  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.958343  6897 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:43.958940  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:43.913337  7086 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:43.860139  7182 consensus_meta.cc:287] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.000s
I20260709 13:02:43.960201  7182 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.961576  1688 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:43.961305  7115 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.817899  1615 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:02:43.962491  7182 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:43.962625  7115 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:43.948155  1511 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:43.963526  1618 raft_consensus.cc:2410] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:02:43.963819  6897 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:43.916481  1694 rpcz_store.cc:276] 0709 13:02:42.127302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.905906 (+778604us) service_pool.cc:224] Handling call
0709 13:02:42.906180 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.937141 (+ 30961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.937170 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:42.937213 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:42.937249 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.915809 (+978560us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b54000974d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:43.915857 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.915983 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70765952}
W20260709 13:02:43.964416  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 116879us
I20260709 13:02:43.964222  6897 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.965229  6897 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:43.948767  1662 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:43.949401  6697 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:43.966925  6697 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.969136  6697 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:43.969630  6697 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:43.850947  7222 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:43.969817  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:43.970269  7222 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:43.945593  7163 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:43.964185  1511 leader_election.cc:400] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 13. Current term is 14.
I20260709 13:02:43.972608  6975 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:43.972863  7222 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:02:43.972929  6849 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:43.957407  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:43.973989  1511 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:43.974498  1691 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:43.974803  6849 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:43.975327  6849 raft_consensus.cc:697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:43.976213  6849 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.953516  7168 raft_consensus.cc:697] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:43.978547  7168 consensus_queue.cc:237] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:43.984526  1663 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:43.985294  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:43.985882  7086 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:43.986575  7086 consensus_queue.cc:1059] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:43.987382  7086 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:43.987762  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:43.987994  7086 raft_consensus.cc:3055] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:43.988428  7086 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:43.989238  7086 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:43.990020  7059 consensus_meta.cc:287] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.759s	user 0.006s	sys 0.004s
I20260709 13:02:43.990641  1541 raft_consensus.cc:2410] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:02:43.990447  7086 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:43.996373  1540 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:43.641898  6907 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:44.003098  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:44.004920  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:44.005021  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:43.933741  6894 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:43.755476  7178 consensus_meta.cc:287] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.788s	user 0.012s	sys 0.000s
I20260709 13:02:43.929905  7185 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.000890  1691 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 19.
I20260709 13:02:44.015614  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:44.000946  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:43.943136  7205 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:44.058019  1586 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:43.907210  7143 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:43.886796  7201 log.cc:927] Time spent T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.689s	user 0.001s	sys 0.004s
I20260709 13:02:44.045248  1615 raft_consensus.cc:1240] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:44.046414  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 108303us
I20260709 13:02:43.955475  7219 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:44.047546  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:44.047603  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:44.057330  1545 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:43.990407  7059 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.057278  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:44.061179  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 204506us
I20260709 13:02:44.094012  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:44.094986  1691 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 16: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:44.096131  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:44.097452  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:44.098816  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:44.073917  1543 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:44.039206  1688 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:44.086858  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:44.087702  1694 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:44.102099  1586 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:44.105152  1548 raft_consensus.cc:2393] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 14: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:44.105294  1691 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 18. Current term is 19. Ops: [16.8-18.9]
W20260709 13:02:44.112190  6917 consensus_meta.cc:287] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.000s
I20260709 13:02:44.114537  6897 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.115505  7219 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:44.116209  7219 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:44.116550  7185 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:44.117020  7057 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.117139  7219 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.119009  7057 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.104216  7203 consensus_queue.cc:1059] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:02:44.120947  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 1007) took 1266 ms. Trace:
I20260709 13:02:44.121340  7203 raft_consensus.cc:3055] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:44.043421  6751 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:02:44.121822  7203 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:44.087821  7166 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:44.122565  7185 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:44.122957  7166 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 19 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:44.123118  7185 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:44.124090  7166 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.124558  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:44.126250  7104 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:44.126842  7104 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.128314  2268 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:44.129158  7104 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.132436  1544 raft_consensus.cc:1240] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:44.037416  7163 consensus_queue.cc:1059] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:02:44.133615  7059 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.134092  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:44.134236  7163 raft_consensus.cc:3055] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:44.134647  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:44.134836  7163 raft_consensus.cc:740] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:44.135123  7115 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:44.135859  2271 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:44.135687  7115 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.121423  1695 rpcz_store.cc:276] 0709 13:02:42.854470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.978688 (+124218us) service_pool.cc:224] Handling call
0709 13:02:42.978987 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.979309 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.979335 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.979824 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:02:43.084792 (+104968us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:43.206994 (+122202us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.223167 (+ 16173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.223265 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.886073 (+662808us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:44.120682 (+234609us) raft_consensus.cc:1685] finished
0709 13:02:44.120774 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:44.120893 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8899,"prepare.queue_time_us":126552,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":19639,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":9389,"spinlock_wait_cycles":13683584,"thread_start_us":197926,"threads_started":2,"wal-append.queue_time_us":190165}
I20260709 13:02:44.136739  7187 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.137662  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:44.138254  7115 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:44.139067  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:44.135701  7163 consensus_queue.cc:260] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.112246  7082 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.140951  6917 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:44.142804  7082 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.140648  7163 raft_consensus.cc:3060] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:44.144325  6968 consensus_queue.cc:1059] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:44.144826  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:44.145490  6968 raft_consensus.cc:3055] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:44.145859  6968 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:44.146661  6968 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.147620  6968 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:44.151525  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:44.153000  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:44.116554  6897 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.153611  1695 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:44.154476  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:44.155301  2271 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:44.158962  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:44.162395  1513 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:44.164860  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:44.165135  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:44.166042  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:44.162431  2266 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:44.107065  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:44.175933  1688 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:44.177970  1689 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:43.943336  7215 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.185484  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:44.181583  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:44.188761  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 45065.3us
I20260709 13:02:44.200783  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:44.190435  2231 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:44.204900  1541 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:44.046125  6855 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.206022  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:44.206626  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:44.209936  2263 raft_consensus.cc:1240] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:44.206197  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:44.211877  1541 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:44.211961  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:44.213003  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:44.182394  7204 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.006s	sys 0.031s
I20260709 13:02:44.122804  7203 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.077715  6907 consensus_queue.cc:1059] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 13:02:44.255339  1688 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:44.207033  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:44.262166  1547 raft_consensus.cc:2368] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12.
I20260709 13:02:44.232744  2232 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:44.200017  7115 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:44.187103  6897 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:44.266656  1619 raft_consensus.cc:1240] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:44.211577  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 86082.8us
W20260709 13:02:44.217108  7204 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.007s	sys 0.032s
I20260709 13:02:44.271978  1545 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:44.211651  7129 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:44.284624  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 51978.4us
I20260709 13:02:44.163717  6745 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:44.294276  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.217684  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:44.213611  6573 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:44.215360  7218 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:44.309993  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 97569.4us
I20260709 13:02:44.276896  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:44.281592  1540 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:44.315714  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:44.265539  7149 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:44.275177  7115 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:44.319345  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:44.314231  1547 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:44.319841  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:44.322798  2232 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:44.277842  6907 consensus_queue.cc:1243] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:02:44.323066  1541 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:44.283598  7204 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:44.288453  7203 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:44.313288  6723 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:44.326887  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:44.328703  1545 raft_consensus.cc:2368] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16.
I20260709 13:02:44.287684  6897 raft_consensus.cc:697] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:44.331179  2268 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:44.283958  7129 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:44.339323  7129 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:44.341338  7204 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.344362  1690 raft_consensus.cc:3055] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:44.344733  1690 raft_consensus.cc:740] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:44.345525  1690 consensus_queue.cc:260] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.346642  1690 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:44.319936  7086 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:44.347332  7086 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.347685  6897 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.326709  7149 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.327484  7115 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:44.333107  7197 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.350482  7104 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:44.336100  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:44.372130  1541 raft_consensus.cc:2393] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:44.354370  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:44.323107  7218 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:44.359197  1540 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:44.361099  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:44.361833  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:44.362864  1661 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:44.364809  1587 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:44.367517  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:44.411262  1697 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:44.368108  7229 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:44.379297  7149 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:44.381526  7197 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.383324  7086 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:44.384428  7236 log.cc:927] Time spent T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:44.351375  7129 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.386612  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:44.392352  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:44.393358  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35704 (request call id 2285) took 1313 ms. Trace:
I20260709 13:02:44.394327  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:44.397542  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:44.397629  7215 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:44.398445  1618 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:44.335216  6723 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:44.466109  6723 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.467980  6855 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.468711  6855 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.469202  6855 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.401027  1588 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:44.430392  7229 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:44.471927  7229 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:44.472018  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 71063.2us
I20260709 13:02:44.473489  7219 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:44.413300  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 48562.7us
I20260709 13:02:44.476039  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:44.477349  1587 leader_election.cc:400] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12.
I20260709 13:02:44.478101  7082 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:44.416644  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 49958.8us
I20260709 13:02:44.479579  7185 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.318461  6573 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.480590  7185 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:44.481178  1511 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:44.482288  1511 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:44.482436  6573 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:44.483951  7178 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:44.484261  7057 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:44.456892  7129 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.487833  7178 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.452690  1543 rpcz_store.cc:276] 0709 13:02:43.079998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.103223 (+ 23225us) service_pool.cc:224] Handling call
0709 13:02:44.393172 (+1289949us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54000aa0d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:44.393277 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2130681728}
I20260709 13:02:44.488385  7178 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.490624  7178 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.478889  7082 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:44.491540  7082 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:44.491927  7082 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:44.493003  7082 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.493434  7129 consensus_queue.cc:1059] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:44.484884  1588 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:44.403852  7115 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.495600  6573 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:44.496284  1617 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:44.496923  7115 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:44.427050  7076 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.500257  7076 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.502228  7076 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.496991  6745 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.502548  6723 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:44.504317  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.504914  1697 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:44.494450  7129 raft_consensus.cc:3055] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:44.505580  7129 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:44.426676  7187 consensus_queue.cc:1059] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:02:44.506989  7187 raft_consensus.cc:3055] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:44.506788  7129 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:44.505225  7241 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:02:44.504393  1511 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:44.418190  7154 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:44.507386  7187 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:44.508823  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:44.508772  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:44.530257  7187 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.531104  2265 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:44.531563  7187 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:44.512252  7180 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:02:44.532994  7180 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:44.533145  1588 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:44.533371  7180 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:44.514376  6745 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:44.534253  6745 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.534359  7180 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.536989  7203 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:44.537115  6745 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:44.537416  7203 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:44.515677  7088 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:44.514632  1587 leader_election.cc:400] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16.
I20260709 13:02:44.539525  1587 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:44.537829  7203 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:44.543751  6855 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.504484  7218 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.510980  1690 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:02:44.547616  7192 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:02:44.516304  1511 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:44.551398  7088 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:44.552587  1511 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:44.521808  1441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52838 (request call id 255) took 34108 ms (client timeout 15000 ms). Trace:
I20260709 13:02:44.522296  2271 raft_consensus.cc:1240] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:44.555948  7088 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:44.557372  1511 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:44.558590  7154 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:44.559161  6573 consensus_queue.cc:1059] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:44.522109  1446 catalog_manager.cc:5697] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 9 to 11, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 11 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.560509  6573 raft_consensus.cc:3055] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:44.560982  6573 raft_consensus.cc:740] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:44.561017  1446 catalog_manager.cc:5697] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.562129  6573 consensus_queue.cc:260] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.563974  6573 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.563726  1446 catalog_manager.cc:5697] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.524156  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:44.565984  1511 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:44.566946  6751 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:44.567051  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3092) took 1505 ms. Trace:
I20260709 13:02:44.567492  6751 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:44.567528  1544 rpcz_store.cc:276] 0709 13:02:43.061910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.197442 (+135532us) service_pool.cc:224] Handling call
0709 13:02:43.197844 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.132880 (+935036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.566827 (+433947us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b54003b4554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:44.566993 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2148903168}
I20260709 13:02:44.568753  7082 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:44.568558  6751 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:44.564381  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.524446  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.565205  1446 catalog_manager.cc:5697] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 10 to 12, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 12 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:44.574826  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:44.574889  1446 catalog_manager.cc:5697] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 11 to 15, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 15 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:44.574635  1614 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:44.576253  1619 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:44.576165  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:44.576916  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:44.579887  1620 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:44.581817  1615 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:44.581822  1446 catalog_manager.cc:5697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.585788  1513 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:44.590200  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:44.591662  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:44.592077  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:44.594986  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:44.565217  7088 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:44.588375  1514 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:44.598207  1539 raft_consensus.cc:1240] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:44.528775  7057 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:44.509523  7129 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:44.599005  1618 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 19 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:02:44.601977  2272 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:44.523761  6723 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:02:44.612926  1544 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:44.605762  1446 catalog_manager.cc:5697] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 7 to 14, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 14 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:44.646085  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.602787  7197 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:44.659824  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 46023.2us
W20260709 13:02:44.655969  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 341296us
I20260709 13:02:44.678478  1540 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:44.597997  7124 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:02:44.606330  6897 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:44.607043  6855 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:44.676098  1446 catalog_manager.cc:5697] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.615851  7166 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:44.661355  7228 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:44.696120  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:44.683766  7197 raft_consensus.cc:697] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:44.658591  7154 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:02:44.687356  6897 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.705524  1446 catalog_manager.cc:5697] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 10 to 12, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 12 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:44.764663  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.668442  7178 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:02:44.684069  7215 consensus_queue.cc:1059] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 13:02:44.553742  1441 rpcz_store.cc:269] 0709 13:02:10.413310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.414180 (+   870us) service_pool.cc:224] Handling call
0709 13:02:44.521605 (+34107425us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:37.365170 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:37.390043 (+ 24873us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:37.390082 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:02:37.390102 (+    20us) tablet.cc:662] Decoding operations
0709 13:02:37.391817 (+  1715us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:37.391867 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:37.391891 (+    24us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:02:37.393460 (+  1569us) tablet.cc:701] Row locks acquired
0709 13:02:37.393479 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:02:37.393618 (+   139us) write_op.cc:270] Start()
0709 13:02:37.393723 (+   105us) write_op.cc:276] Timestamp: P: 1783602157393572 usec, L: 0
0709 13:02:37.393745 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:02:37.394502 (+   757us) log.cc:844] Serialized 8676 byte log entry
0709 13:02:38.240211 (+845709us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b1800392020. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a513f3 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:02:38.367321 (+127110us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:38.583074 (+215753us) op_driver.cc:464] REPLICATION: finished
0709 13:02:38.680636 (+ 97562us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c67a340ac 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6e574ef0
0709 13:02:39.041905 (+361269us) write_op.cc:301] APPLY: starting
0709 13:02:39.042029 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:39.244291 (+202262us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:39.244347 (+    56us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:40.277571 (+1033224us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b5c0007658c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70d30331 00007f5c70d30221 00007f5c70d2af6c 00007f5c6e48b30b 00007f5c6e48afd3 00007f5c6e589e34 00007f5c6e57597c 00007f5c6e579d61 00007f5c6e579d19 00007f5c6e579ca9 00007f5c6e579c71
0709 13:02:41.059834 (+782263us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:41.277269 (+217435us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:02:41.288831 (+ 11562us) write_op.cc:312] APPLY: finished
0709 13:02:41.289473 (+   642us) log.cc:844] Serialized 196 byte log entry
0709 13:02:41.660593 (+371120us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:41.736972 (+ 76379us) write_op.cc:454] Released schema lock
0709 13:02:41.750361 (+ 13389us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:41.887852 (+137491us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:41.893550 (+  5698us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14433,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":432855,"apply.run_cpu_time_us":89472,"apply.run_wall_time_us":2800530,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96175,"num_ops":22,"prepare.queue_time_us":326775,"prepare.run_cpu_time_us":13967,"prepare.run_wall_time_us":181760,"raft.queue_time_us":82926,"raft.run_cpu_time_us":31395,"raft.run_wall_time_us":445841,"replication_time_us":1138295,"spinlock_wait_cycles":35864832,"thread_start_us":939313,"threads_started":5,"wal-append.queue_time_us":597315,"wal-append.run_cpu_time_us":37636,"wal-append.run_wall_time_us":2490093}]]}
I20260709 13:02:44.684108  7168 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:44.789018  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 466258us
I20260709 13:02:44.692817  7103 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:02:44.791837  1547 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:44.793006  2272 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:44.794857  1446 catalog_manager.cc:5697] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.775864  7188 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:02:44.775453  7218 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:44.788216  7088 raft_consensus.cc:697] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:44.701103  7166 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.705298  7228 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:44.777657  7157 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:02:44.795254  6897 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:44.820266  1446 catalog_manager.cc:5697] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.824326  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:44.835187  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:44.836694  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:44.850411  7228 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:44.852396  7180 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:44.805364  7168 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:44.884399  7247 log.cc:927] Time spent T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:02:44.836444  6855 raft_consensus.cc:3055] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:44.856129  6573 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:44.907985  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.932943   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:44.825150  7203 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.993671  1446 catalog_manager.cc:5697] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 4 to 8, term changed from 5 to 8, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 8 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.820710  7218 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.022888  1446 catalog_manager.cc:5697] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 8 to 10, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 10 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:44.839872  7124 consensus_queue.cc:1059] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.159s
I20260709 13:02:44.976984  7237 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.963884  6855 raft_consensus.cc:740] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:45.066845  7237 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:44.992079  7256 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:02:45.061561  7255 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:02:45.062089  7197 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.066308  7258 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.055048  1446 catalog_manager.cc:5697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.093808  1617 raft_consensus.cc:2468] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:45.067842  6855 consensus_queue.cc:260] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.023633  7154 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.094868  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 490982us
I20260709 13:02:45.118709  7204 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.094358  7229 consensus_meta.cc:287] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.002s
W20260709 13:02:45.120203  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 155304us
I20260709 13:02:45.121690  1446 catalog_manager.cc:5697] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.090085  7057 raft_consensus.cc:3055] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:44.999506  6573 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.139062  1545 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:45.137810  2232 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:45.123313  7166 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:45.146350  1446 catalog_manager.cc:5697] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.148563  1446 catalog_manager.cc:5697] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 10 to 13, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 13 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.141664  7124 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:45.150379  7124 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.024037  7088 consensus_queue.cc:237] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.135789  6855 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:45.131526  7057 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:45.094794  7256 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.138989  6751 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.128822  7154 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.141927  7260 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.133327  7204 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.134876  7229 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.152328  7124 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:45.124068  7258 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.167117  6723 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:45.184016  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.186592  7237 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:45.187552  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 46954.5us
I20260709 13:02:45.194729  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.195231  1619 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:45.197211  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:45.199991  2234 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:45.201365  6894 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:45.202666  7246 log.cc:927] Time spent T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.421s	user 0.004s	sys 0.006s
I20260709 13:02:45.201936  6894 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.219586  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:45.220111  1694 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:45.220389  7250 log.cc:927] Time spent T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
I20260709 13:02:45.220847  6894 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:45.202211  6599 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.221549  6599 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.222607  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 2225) took 1044 ms. Trace:
I20260709 13:02:45.203346  7202 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:45.223564  6599 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:45.202369  6697 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:45.187233  7057 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.224249  6697 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:45.224920  7253 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 13:02:45.194100  7252 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:02:45.226329  6697 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:45.177105  7260 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.204986  7193 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:45.228484  1694 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:45.228363  7193 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.230446  7193 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:45.205622  7163 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.231108  7163 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.232282  1692 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:45.233029  7163 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:45.233884  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.222975  1691 rpcz_store.cc:276] 0709 13:02:44.178095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.181166 (+  3071us) service_pool.cc:224] Handling call
0709 13:02:44.181554 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:44.199695 (+ 18141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.199745 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:44.200541 (+   796us) log.cc:844] Serialized 52 byte log entry
0709 13:02:44.726162 (+525621us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:44.779141 (+ 52979us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.184475 (+405334us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b18000c6580. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a51522 00007f5c67a537c1 00007f5c67a53779 00007f5c67a53709 00007f5c67a536d1 00007f5c67a529cd 000000000038f354 000000000038f199 00007f5c67a3483a
0709 13:02:45.204531 (+ 20056us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.204735 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.204809 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.222415 (+ 17606us) raft_consensus.cc:1685] finished
0709 13:02:45.222435 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.222556 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":424938,"prepare.queue_time_us":31114,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":436853,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":5509,"spinlock_wait_cycles":12771200,"thread_start_us":450155,"threads_started":1,"wal-append.queue_time_us":581156}
I20260709 13:02:45.219147  7059 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:45.235620  7163 consensus_queue.cc:1059] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:45.236196  7059 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.237078  6697 raft_consensus.cc:3055] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:45.237429  6697 raft_consensus.cc:740] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:45.237883  7185 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.757s	user 0.006s	sys 0.003s
W20260709 13:02:45.192157  7187 consensus_meta.cc:287] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.000s
I20260709 13:02:45.238343  7163 consensus_queue.cc:1059] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:45.248920  7256 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:45.239341  6697 consensus_queue.cc:260] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.249792  7168 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:45.212040  7254 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:02:45.206054  1662 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:45.203183  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 840369us
W20260709 13:02:45.252148  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 46156.3us
I20260709 13:02:45.253039  1662 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:45.253551  7218 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:45.173676  6751 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.254087  1662 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:45.212509  7204 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:45.255533  6751 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:45.217417  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:45.256525  1696 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:45.256759  7260 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:45.216802  1690 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:45.245712  6573 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:45.246423  7154 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:45.258162  7193 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:45.258833  7143 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:45.218940  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.259841  1540 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:45.247453  7229 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:45.252094  7203 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:45.253446  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:45.262317  1661 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:45.247067  7057 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.263078  7149 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:45.215776  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:45.247678  7258 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:45.240772  7248 log.cc:927] Time spent T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:02:45.275833  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:45.277256  1661 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:45.277910  6894 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:45.278676  6894 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:45.279388  6894 raft_consensus.cc:697] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:45.280344  6894 consensus_queue.cc:237] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.283520  6819 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:45.286800  6897 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:45.288630  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.295778  1544 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:45.304608  7059 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:45.263593  7143 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:45.308805  6897 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:45.290772  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 53944.3us
I20260709 13:02:45.311688  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.312311  1693 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:45.249840  6697 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.315841  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.315891  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.316491  1693 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:45.316576  1545 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:45.317744  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.318063  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.318332  1693 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:45.318431  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:45.318634  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.319013  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.319257  1695 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:45.319689  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.320037  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:45.318658  1688 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 8.
I20260709 13:02:45.310024  1694 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:45.320273  1545 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:45.320758  1693 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:02:45.316802  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.321995  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.326501  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.326912  1544 raft_consensus.cc:2368] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14.
I20260709 13:02:45.328408  1621 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:02:45.328716  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:45.328936  1621 pending_rounds.cc:85] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 7
I20260709 13:02:45.329300  1621 pending_rounds.cc:107] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:02:45.326555  1619 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:02:45.329859  1619 pending_rounds.cc:85] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 8
I20260709 13:02:45.330106  1619 pending_rounds.cc:107] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:02:45.330325  1619 raft_consensus.cc:2889] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:45.329605  1621 raft_consensus.cc:2889] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:45.294356  1697 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:45.333350  1618 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:45.333468  1695 raft_consensus.cc:1275] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:02:45.348134  1695 pending_rounds.cc:85] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 10
I20260709 13:02:45.348583  1695 pending_rounds.cc:107] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:02:45.348990  1695 raft_consensus.cc:2889] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:45.349989  1511 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:45.332216  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.351768  1540 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 8.
I20260709 13:02:45.331772  1539 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:45.356328  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:45.357064  1697 raft_consensus.cc:2393] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:45.358220  1511 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:45.242964  7129 consensus_meta.cc:287] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.000s
I20260709 13:02:45.361241  7202 raft_consensus.cc:3055] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:45.361631  7202 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:45.361824  1692 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:45.362985  1692 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:45.364738  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.366154  1511 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:45.367084  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:45.370520  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.371228  1690 raft_consensus.cc:2393] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 10: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:45.371567  1615 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:45.387398  1511 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:45.381851  1693 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:45.349098  6599 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.386411  6907 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:45.350637  7149 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:45.389904  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 101088us
I20260709 13:02:45.402496  1514 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:45.404103  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 204166us
I20260709 13:02:45.398293  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.377882  7178 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:45.413776  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:45.414440  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.418102  1689 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 15: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:45.385660  6897 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:45.414461  1615 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 13: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:45.419967  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:45.389583  7143 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.400367  6751 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:45.370718  7187 consensus_queue.cc:1059] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:02:45.398313  7256 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:45.422433  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:45.386472  7260 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:02:45.433128  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.433702  1695 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:45.434089  2234 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:45.400558  7203 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:02:45.443985  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:45.411137  6745 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:02:45.430389  7124 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:45.414711  7197 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:02:45.425125  7266 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:45.414417  6599 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:45.449924  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.432682  6751 raft_consensus.cc:697] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:45.415668  7149 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.431552  6968 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:02:45.444553  7256 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:45.430932  7059 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:02:45.443706  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:45.453578  1695 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:45.472339  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:45.472683  1689 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:45.413805  6907 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.444169  7218 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.428802  7143 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.452006  7266 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.489500  2266 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:45.419665  7202 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.496100  1695 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:45.502763  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 103397us
I20260709 13:02:45.503525  1511 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:45.454355  7185 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:02:45.488313  2268 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:45.498240  1545 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:45.489825  7203 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.507742  6897 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:45.499744  7218 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.516448  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.516979  7218 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:45.507014  7225 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:45.517568  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.511476  7168 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:45.518571  7168 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.519850  6751 consensus_queue.cc:237] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.520598  7168 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:45.518157  1690 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:45.523026  7202 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:45.524094  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:45.524592  6907 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:45.524765  1690 raft_consensus.cc:2393] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 15: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:45.525520  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.526242  1690 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:45.526283  7143 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:45.527038  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.495189  7180 raft_consensus.cc:2804] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:45.527776  7180 raft_consensus.cc:697] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:45.491214  7188 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:45.528610  1692 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:02:45.528926  7188 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.529497  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.530659  1692 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:45.530880  7188 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:45.532951  7256 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.534145  7204 raft_consensus.cc:3055] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:45.534515  7204 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:45.502873  7266 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:45.535254  7204 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.536273  7204 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:45.541074  1690 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:45.543848  7163 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.544318  7124 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:45.545764  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3107) took 1274 ms. Trace:
I20260709 13:02:45.546150  1547 rpcz_store.cc:276] 0709 13:02:44.271386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.332015 (+ 60629us) service_pool.cc:224] Handling call
0709 13:02:44.332295 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.802806 (+470511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.545512 (+742706us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54000c4754. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:45.545706 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053249920}
I20260709 13:02:45.547363  1511 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:45.548369  1511 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:45.549005  6897 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:45.550307  6897 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:45.551087  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:45.554682  1692 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:45.514577  2232 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:45.562071  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.564697  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.565513  1693 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
W20260709 13:02:45.568068  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 53566.3us
I20260709 13:02:45.573392  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:45.575860  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:45.578918  7265 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:45.579049  7143 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:45.579665  7260 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:45.579579  7143 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.580065  7260 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.580436  7260 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.581702  7143 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:45.584338  7218 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:45.588449  7149 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:45.590540  6599 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:45.632738  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 54015.6us
I20260709 13:02:45.627969  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.633522  1511 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:45.628325  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.627853  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.550647  6897 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:45.632304  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.633651  1619 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:45.634279  1618 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:45.599998  1588 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:45.641423  7168 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:45.544358  7163 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.650250  7281 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:45.651501  1661 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:45.652864  7143 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:45.653326  7143 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.653708  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:45.653743  7143 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.654640  6907 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:45.655622  6907 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:45.656111  6907 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.662513  7281 raft_consensus.cc:697] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:45.664209  1661 leader_election.cc:400] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14.
I20260709 13:02:45.664664  1661 leader_election.cc:403] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:45.665320  7086 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14.
I20260709 13:02:45.664237  7281 consensus_queue.cc:237] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.666564  7218 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.667798  7218 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.670222  7218 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:45.679766  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:45.680966  7086 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:45.681514  7086 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:45.681990  7086 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:45.684480  7192 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:45.699471  7271 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:45.700104  7271 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.702759  1692 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:02:45.702987  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 130981us
I20260709 13:02:45.704744  1586 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:45.705932  1539 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
I20260709 13:02:45.706358  1539 pending_rounds.cc:85] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 8
I20260709 13:02:45.706614  1539 pending_rounds.cc:107] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 13:02:45.706892  1539 raft_consensus.cc:2889] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:45.707683  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.708408  1547 raft_consensus.cc:2393] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:45.708257  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.708822  1539 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:45.709266  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:45.710198  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.710362  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.710609  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.711097  1541 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:45.711999  1548 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:45.713129  1544 raft_consensus.cc:1240] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:45.704357  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61123.8us
I20260709 13:02:45.713891  1689 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:02:45.718676  1540 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:45.719048  1539 raft_consensus.cc:2393] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:45.719206  1617 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:45.638080  7178 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:45.631357  6599 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.721683  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.730248  1546 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:45.724351  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.731148  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.731323  1617 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:45.724628  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.643635  6897 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.637427  7265 raft_consensus.cc:697] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:45.728973  1539 raft_consensus.cc:1240] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:45.732197  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.639678  7088 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:45.733253  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.737412  1539 raft_consensus.cc:1240] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:02:45.737449  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.599232  7154 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 13:02:45.567284  7203 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.726672  1663 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:45.745530  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.753327  1546 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 9.
I20260709 13:02:45.642148  7124 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:02:45.713793  7281 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:45.718154  7218 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:45.773984  1663 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:45.745992  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.720834  6917 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.528622  7180 consensus_queue.cc:237] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.746716  7143 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:45.730726  7178 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:45.777180  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.755108  7182 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:45.789449  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.856933  1619 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 15: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:45.790129  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.790833  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.773528  7218 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.858297  7218 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.858438  7086 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.792404  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:45.733793  6907 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.860989  1622 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:45.818382  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.864459  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:45.819044  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 68470.6us
W20260709 13:02:45.819132  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 67148.2us
I20260709 13:02:45.757213  7193 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.834285  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.836148  7288 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:45.839811  7149 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:45.840420  7271 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:45.756151  7088 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.780915  7187 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:45.859797  1616 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:45.793256  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.861572  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:45.794691  7168 raft_consensus.cc:697] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:45.866902  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.868171  1540 raft_consensus.cc:2393] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:45.742153  6599 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.854491  7178 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:45.856500  7182 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:45.893636  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 186773us
W20260709 13:02:45.895512  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.874569  7288 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.776028  7281 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.868402  7197 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:45.843389  6917 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.924202  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:45.925055  1539 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 15: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:45.926020  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:45.927237  2231 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:45.927836  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:45.927723  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.929111  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:45.929733  2271 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:45.885310  7187 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:45.935734  1586 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:45.936890  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:45.942451  2265 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 15: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
W20260709 13:02:45.942538  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 168654us
I20260709 13:02:45.943962  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:45.918097  7182 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:45.966596  2266 raft_consensus.cc:2393] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:45.878317  7193 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:45.966451  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 66724.5us
I20260709 13:02:45.971992  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:45.973788  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:45.926802  6751 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:45.921794  7288 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.938017  7124 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.987957  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 121562us
W20260709 13:02:45.988118  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 52853.8us
I20260709 13:02:45.990222  1690 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:45.881577  7265 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.966678  7143 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:45.994402  1586 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:45.966809  7294 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:45.932633  7197 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.984684  7204 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:45.987502  7104 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:45.987645  6751 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:45.990017  7124 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:46.028113  7285 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:02:45.990794  7115 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:46.028721  6697 consensus_meta.cc:287] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.679s	user 0.009s	sys 0.003s
I20260709 13:02:46.029472  7086 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:46.030218  6917 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:45.988951  7284 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.072625  7284 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:46.076236  7272 log.cc:927] Time spent T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:02:46.077962  7288 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:46.079244  7295 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:02:46.065289  7273 log.cc:927] Time spent T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:02:46.082372  7088 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:46.083343  7203 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.083899  7203 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:46.084234  7203 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.084533  7203 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:46.034741  1616 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:45.944535  7290 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:02:45.969849  7287 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:02:45.994093  7163 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:45.998428  7294 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.071094  6907 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:46.091459  7283 log.cc:927] Time spent T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: Append to log took a long time: real 0.199s	user 0.002s	sys 0.000s
I20260709 13:02:46.059095  7289 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.032595  7197 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:46.164862  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 172391us
I20260709 13:02:46.168352  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:46.176000  1697 raft_consensus.cc:2468] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:46.031353  7260 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.055989  7204 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:46.067081  7115 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.125439  7288 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:46.141983  7163 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:46.000480  7257 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.127s
I20260709 13:02:46.147720  7289 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:46.130359  7266 consensus_meta.cc:287] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.000s
W20260709 13:02:46.129072  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 201946us
I20260709 13:02:46.180794  7290 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.129294  7154 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:02:46.132705  7294 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:46.211139  2231 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:46.001492  7168 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:46.139196  7178 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:46.234689  1545 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:02:46.189808  7202 consensus_meta.cc:287] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.006s
I20260709 13:02:46.192278  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:46.240365  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 246833us
I20260709 13:02:46.241454  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:46.187676  7204 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:46.188160  7115 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:46.188270  7197 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:46.185372  7187 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.237124  7266 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:46.299255  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 88232us
I20260709 13:02:46.323203  1546 raft_consensus.cc:1240] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:46.179307  7182 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:46.325059  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 79982.1us
I20260709 13:02:46.324131  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:46.332049  2263 raft_consensus.cc:2368] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13.
I20260709 13:02:46.210848  7163 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:46.240109  7290 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:46.337894  7290 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:46.340132  7182 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:46.345424  7270 log.cc:927] Time spent T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.518s	user 0.000s	sys 0.001s
W20260709 13:02:46.348737  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 375526us
I20260709 13:02:46.349433  7218 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.352489  6599 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:46.354542  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 1350) took 1534 ms. Trace:
W20260709 13:02:46.356055  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.359016  7193 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:46.360832  1614 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:02:46.354928  1543 rpcz_store.cc:276] 0709 13:02:44.822786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.822904 (+   118us) service_pool.cc:224] Handling call
0709 13:02:45.812422 (+989518us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b5800093398. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb17fc0 00007f5c6fb02929 00007f5c6fb023d2 00007f5c69079bd4
0709 13:02:45.812600 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.920373 (+107773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.920402 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.920443 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:45.920471 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.354319 (+433848us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000c2454. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:46.354367 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.354483 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249965696}
I20260709 13:02:46.366816  1587 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:46.367215  1511 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:46.370594  7304 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:46.371093  7304 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:46.371960  7304 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.372465  7289 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:46.373116  7256 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:46.373274  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 378911us
I20260709 13:02:46.369550  7225 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.374325  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:46.374437  7225 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.376695  7225 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.333897  7187 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:46.377190  7225 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:46.379689  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 1020) took 1057 ms. Trace:
I20260709 13:02:46.380138  1688 rpcz_store.cc:276] 0709 13:02:45.322397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.322552 (+   155us) service_pool.cc:224] Handling call
0709 13:02:45.332262 (+  9710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.332644 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.332686 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.333257 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.088722 (+755465us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b18001ee8c0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de0d1 00007f5c6aaf9a0f
0709 13:02:46.177893 (+ 89171us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:46.177937 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.178008 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.374059 (+196051us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:46.379476 (+  5417us) raft_consensus.cc:1685] finished
0709 13:02:46.379497 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.379632 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25272,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":13700,"spinlock_wait_cycles":9875712,"thread_start_us":88995,"threads_started":1,"wal-append.queue_time_us":878780}
I20260709 13:02:46.381405  7203 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.384789  7163 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:46.323002  7197 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.387006  7197 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.387369  7115 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.387799  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:46.388360  2269 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:46.389106  7124 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.389297  7115 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.389925  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:46.392163  7178 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:46.393092  1588 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:46.394321  7257 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:46.395004  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:46.394677  7257 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.356014  7218 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.401566  1587 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:46.402956  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 78912.5us
I20260709 13:02:46.397360  7311 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:46.415576  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:02:46.398772  7313 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.065s	user 0.000s	sys 0.003s
I20260709 13:02:46.405889  7257 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:46.419534  7115 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:02:46.447964  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 1022) took 1125 ms. Trace:
W20260709 13:02:46.453365  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 50666.5us
I20260709 13:02:46.490167  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:46.421531  7203 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:46.454789  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 47114.6us
W20260709 13:02:46.493450  6897 consensus_meta.cc:287] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.739s	user 0.012s	sys 0.004s
I20260709 13:02:46.493687  1619 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:46.493835  6897 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.495460  1662 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:46.398999  7307 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:46.497586  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:46.455685  6751 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:46.497891  7307 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:46.458662  6968 consensus_queue.cc:1059] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:46.499042  6968 raft_consensus.cc:3055] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:46.498893  7307 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:46.419670  6573 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.369974  7182 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:02:46.500082  6573 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:46.500773  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 3411) took 1141 ms. Trace:
I20260709 13:02:46.479295  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54496 (request call id 1069) took 1053 ms. Trace:
I20260709 13:02:46.501104  1697 rpcz_store.cc:276] 0709 13:02:45.366549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.366800 (+   251us) service_pool.cc:224] Handling call
0709 13:02:46.500622 (+1133822us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b5400148554. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:46.500724 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658863872}
I20260709 13:02:46.501979  6573 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:46.502105  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.442292  7218 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:46.481739  7294 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.506685  7294 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:46.483063  7281 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:46.483556  7260 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.439842  6975 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:46.488138  7266 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:46.498148  1616 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.508934  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:46.499537  6968 raft_consensus.cc:740] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:46.472592  7284 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.501479  2263 rpcz_store.cc:276] 0709 13:02:45.425579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.425704 (+   125us) service_pool.cc:224] Handling call
0709 13:02:46.479027 (+1053323us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54006261d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:46.479191 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035699968}
I20260709 13:02:46.504277  7218 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.524847  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:46.444072  7178 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.419258  7265 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.542352  1692 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:46.417541  7290 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:46.512159  1662 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:46.512447  1539 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.489848  1696 rpcz_store.cc:276] 0709 13:02:45.322921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.323034 (+   113us) service_pool.cc:224] Handling call
0709 13:02:45.323277 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.389388 (+ 66111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.389427 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.389467 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:45.389498 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.447717 (+1058219us) spinlock_profiling.cc:243] Waited 65.9 ms on lock 0x7b5400147b54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:46.447767 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.447898 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151631104}
I20260709 13:02:46.478801  7204 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:46.522032  1616 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:46.507630  6975 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.494762  6723 consensus_queue.cc:1048] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:46.527702  1697 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:02:46.528867  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:46.529605  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:46.555059  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:46.529980  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:46.555913  2263 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:02:46.533260  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:46.533586  1688 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.556694  2271 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:46.536216  1691 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:46.500039  7192 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:46.547647  1588 leader_election.cc:400] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13.
I20260709 13:02:46.534025  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.558488  2268 raft_consensus.cc:2393] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 15: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:46.557277  1588 leader_election.cc:403] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:46.558199  1662 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:46.564213  1539 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:46.564718  2271 raft_consensus.cc:2468] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:02:46.540582  7080 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.549348  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:46.541078  7205 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.567282  1616 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:46.549342  6975 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:46.567600  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:46.573169  1688 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:46.517386  7154 consensus_queue.cc:1059] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:02:46.524333  7304 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:46.565734  2232 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:46.519215  6917 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:02:46.587584  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:46.549875  6894 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.576604  7294 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:46.585662  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:46.585956  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:46.586064  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.577824  1662 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:46.587984  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:46.589674  1547 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:46.559209  7265 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.590941  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:46.587064  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:46.596112  1543 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:46.557219  6897 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.606352  2272 raft_consensus.cc:1240] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:46.606928  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 165839us
I20260709 13:02:46.608433  1587 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:46.609091  6573 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:46.609472  1587 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:46.589717  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:46.546821  7178 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.595799  1586 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:46.566741  7256 raft_consensus.cc:697] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:46.593679  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.593446  7261 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:46.581207  7080 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.604980  7187 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:02:46.605187  6849 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:46.631510  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:46.597287  7294 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:46.605823  7258 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.605651  7188 consensus_queue.cc:1059] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:46.579150  7290 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13.
I20260709 13:02:46.575093  7289 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:46.637054  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:46.611393  6573 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:46.637786  6573 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:46.638160  6573 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:46.613710  1546 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:46.601372  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:46.581856  7260 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:46.593366  7192 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:46.604189  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:46.618045  1695 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:46.625658  1663 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:46.616856  7300 raft_consensus.cc:2804] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:46.611516  7265 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:46.662672  1692 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:46.676916  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:46.677266  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:46.678884  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:46.627805  1545 raft_consensus.cc:2410] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:02:46.649597  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:46.626225  6855 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.665030  1663 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:46.687201  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 55808.3us
I20260709 13:02:46.583587  7205 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.694418  1663 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:46.632855  7261 raft_consensus.cc:697] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:46.639115  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:46.597358  6968 consensus_queue.cc:260] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:46.660355  7289 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.666608  7204 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:46.666553  7256 consensus_queue.cc:237] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.668428  7304 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.669020  7244 raft_consensus.cc:3055] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:46.706993  7260 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.748819  7244 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:46.749845  7244 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:46.750823  7260 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.669454  7163 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.751173  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:46.752038  1689 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:46.751672  7163 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.752964  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.753576  1689 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 19.
I20260709 13:02:46.753690  7163 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:46.671663  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:46.754427  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:46.755573  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:46.687234  7182 consensus_queue.cc:1059] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:02:46.756459  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.756592  7182 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.757076  7182 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.757429  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.757974  1689 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:46.758736  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.759008  7182 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.693321  7059 raft_consensus.cc:2764] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:46.725208  7202 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:46.761153  7178 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.703016  6855 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.764009  6855 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.661173  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:46.682420  1617 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:02:46.739768  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 173129us
I20260709 13:02:46.639484  7258 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:46.769352  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.672642  1696 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:46.634415  7294 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:46.639382  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:46.696794  7188 raft_consensus.cc:3055] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:02:46.697515  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 96244.6us
I20260709 13:02:46.831895  6573 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.835628  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:46.836234  1545 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:46.697966  6897 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.698657  7311 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:46.686657  7300 raft_consensus.cc:697] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:46.700153  7218 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.700531  7265 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:46.703202  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.871718  1688 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:46.622816  7115 raft_consensus.cc:2804] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:46.706036  1616 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:46.731055  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:46.740370  1692 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:02:46.747759  7261 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:46.748383  7080 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:46.889998  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:46.890618  1616 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:02:46.831246  7182 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:46.831324  7188 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:46.766285  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.767011  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:46.687949  1514 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:46.688357  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:46.769426  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:46.854482  7192 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:46.767318  1586 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:46.725577  6894 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:46.827880  1621 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:46.830303  1697 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:46.837764  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:46.838860  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:46.901487  1546 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:02:46.901978  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:46.902357  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:46.902990  1546 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:46.903927  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:46.841064  1542 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:02:46.904856  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 137627us
I20260709 13:02:46.905732  1511 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:46.906068  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:46.842051  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:46.907357  1548 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:46.842427  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:46.843039  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:46.851887  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 65587.9us
I20260709 13:02:46.844266  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:46.910727  1547 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:46.859570  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:46.861321  1620 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:02:46.841606  7163 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:02:46.866988  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.827569  7203 raft_consensus.cc:3055] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:46.876569  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.924798  1688 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:46.879310  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.925920  1692 raft_consensus.cc:2393] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 15: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:46.926093  1511 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:46.809455  7204 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.831001  6599 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:46.886715  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:46.891587  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:46.933111  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:46.928186  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:46.934350  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:46.759316  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.893267  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:46.751279  7244 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:46.895798  1623 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 16: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
W20260709 13:02:46.976169  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.904732  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 216838us
I20260709 13:02:46.988931  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:46.989452  1691 raft_consensus.cc:2410] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:46.915831  1696 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:46.927490  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:46.928290  1511 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:46.990998  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 62789.4us
I20260709 13:02:46.859519  7103 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:02:46.867806  7257 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:46.992550  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:46.934470  1615 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 15: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:46.897238  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:46.991163  1548 raft_consensus.cc:2410] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:46.900337  7080 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:47.002118  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:46.994087  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:47.005208  1623 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:46.997725  1511 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:46.892717  7115 raft_consensus.cc:697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:47.008544  1623 raft_consensus.cc:1240] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:02:46.890219  7178 consensus_queue.cc:1059] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:02:47.017206  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:47.018265  1618 raft_consensus.cc:2393] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:47.011482  1615 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:02:47.012239  7256 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:47.018978  1615 pending_rounds.cc:85] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 8
I20260709 13:02:47.022987  1615 pending_rounds.cc:107] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:02:47.023293  1615 raft_consensus.cc:2889] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:47.019431  1695 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:46.929869  6897 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.923768  6855 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:47.009665  1511 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:46.898264  7182 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:46.931280  7218 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.894081  7260 consensus_queue.cc:1059] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:02:46.931133  7185 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.932905  7203 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:47.030522  1622 raft_consensus.cc:2368] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:47.002125  7282 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:46.904343  7088 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:02:47.001978  7286 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:47.009291  7319 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.903486  7192 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:47.037698  6855 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:46.988623  7204 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.029547  7059 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:47.067188  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 229482us
I20260709 13:02:47.009632  7124 consensus_queue.cc:1059] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:02:47.049991  7333 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:47.089496  7256 raft_consensus.cc:697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:47.005451  6599 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:47.016705  7080 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:47.105957  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:47.084244  7286 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:47.127130  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.015594  7188 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:47.154878  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 49019.1us
I20260709 13:02:47.090801  7205 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:47.161907  1617 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:47.100823  6855 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:47.155498  7295 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:47.108321  7336 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:47.085036  7218 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.106843  7289 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:47.178013  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.181509  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 171929us
I20260709 13:02:47.163573  7286 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:47.038013  7300 consensus_queue.cc:237] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:47.155741  7163 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:47.185495  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 179650us
I20260709 13:02:47.156103  7185 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:47.155817  7203 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.172035  7258 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.196400  7185 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:47.092856  7319 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:47.193599  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.181146  7205 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:47.187660  7188 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:47.225864  7182 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:47.226341  7325 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:02:47.227639  7329 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:02:47.228060  7335 log.cc:927] Time spent T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:02:47.155262  7115 consensus_queue.cc:237] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:47.228507  7327 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 13:02:47.230058  7332 log.cc:927] Time spent T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:47.227825  7088 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:47.234241  1547 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
W20260709 13:02:47.241955  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.208877  7168 raft_consensus.cc:3055] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:47.204147  7185 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:47.155674  7333 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:47.265254  7256 consensus_queue.cc:237] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.272127  7340 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:47.272457  6599 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:47.272871  7340 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:47.187867  7336 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.276623  7336 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:47.282213  1621 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:47.253175  7168 raft_consensus.cc:740] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:47.231091  7205 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:47.270149  7257 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:47.270007  7289 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:47.302265  7193 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:47.303951  7307 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:02:47.451931  7303 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:02:47.500681  7359 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.501081  7356 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:47.511976  7359 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.512148  7356 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.503698  7192 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:47.504558  7080 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:47.519390  7204 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:47.520491  7330 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:02:47.529471  7345 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:47.550146  7345 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:47.551724  6855 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.552453  7345 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:47.529955  7244 consensus_meta.cc:287] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
W20260709 13:02:47.557077  7202 consensus_meta.cc:287] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.797s	user 0.003s	sys 0.007s
I20260709 13:02:47.557322  7352 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:47.543669  7354 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.558079  7352 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.558331  7354 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.487336  7319 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.523177  7307 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.565625  7307 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.548915  7205 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:47.552358  7333 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:47.556859  6855 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.557525  7202 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:47.495162  7260 raft_consensus.cc:3055] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:47.575587  7260 raft_consensus.cc:740] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:47.576681  7260 consensus_queue.cc:260] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.577956  7260 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:47.531118  7338 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.339s	user 0.000s	sys 0.000s
I20260709 13:02:47.534082  7197 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.580284  7197 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:47.581225  6968 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.588665  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:47.546418  6975 consensus_meta.cc:287] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.953s	user 0.009s	sys 0.000s
I20260709 13:02:47.490250  7289 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:47.561820  7218 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.573432  7354 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.574079  7168 consensus_queue.cc:260] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.583053  7197 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:47.526037  7356 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.614496  7059 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:47.615167  7059 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:47.616355  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.600457  6975 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.618556  1619 raft_consensus.cc:1240] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:02:47.619271  6975 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.622619  7185 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:47.621757  7294 consensus_meta.cc:287] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.766s	user 0.008s	sys 0.002s
I20260709 13:02:47.627295  6745 raft_consensus.cc:3055] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:47.627727  7294 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:47.628911  1689 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:47.627727  6745 raft_consensus.cc:740] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:47.631876  6745 consensus_queue.cc:260] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:47.633143  6745 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:47.634609  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.631032  6573 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.640270  2267 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:47.641593  7168 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.642194  7057 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:47.652874  7289 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:47.655010  6573 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.655755  6573 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:47.663307  1514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.629s (SENT) [suppressed 14 similar messages]
W20260709 13:02:47.665777  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.668501  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.673594  6573 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.678936  7286 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.685395  7286 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.696502  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3444) took 1105 ms. Trace:
I20260709 13:02:47.697026  1688 rpcz_store.cc:276] 0709 13:02:46.591254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.940081 (+348827us) service_pool.cc:224] Handling call
0709 13:02:46.989281 (+ 49200us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:47.079395 (+ 90114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.079466 (+    71us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:47.088883 (+  9417us) log.cc:844] Serialized 52 byte log entry
0709 13:02:47.629173 (+540290us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b1800400540. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c6a6e64bc 00007f5c67a3448b 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de0d1
0709 13:02:47.662682 (+ 33509us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:47.695723 (+ 33041us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.696002 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.696096 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:47.696150 (+    54us) raft_consensus.cc:1685] finished
0709 13:02:47.696242 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.696425 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":201489,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":14653,"spinlock_wait_cycles":4920576,"thread_start_us":192602,"threads_started":2,"wal-append.queue_time_us":439861}
I20260709 13:02:47.716925  7185 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.729795  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 2249) took 1081 ms. Trace:
I20260709 13:02:47.730370  1619 rpcz_store.cc:276] 0709 13:02:46.648212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.648316 (+   104us) service_pool.cc:224] Handling call
0709 13:02:46.648631 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:47.619055 (+970424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.729472 (+110417us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b540016e254. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:47.729718 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2229823872}
I20260709 13:02:47.732259  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 2253) took 1053 ms. Trace:
I20260709 13:02:47.732682  1622 rpcz_store.cc:276] 0709 13:02:46.678451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.678597 (+   146us) service_pool.cc:224] Handling call
0709 13:02:47.732047 (+1053450us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400067a54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:47.732196 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792564992}
W20260709 13:02:47.734215  1661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.006s	sys 0.013s
W20260709 13:02:47.734632  1661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.006s	sys 0.013s
W20260709 13:02:47.734997  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 577878us
I20260709 13:02:47.737622  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34192 (request call id 2323) took 1008 ms. Trace:
I20260709 13:02:47.741163  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:47.762403  1622 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
W20260709 13:02:47.743558  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.003s	sys 0.015s
W20260709 13:02:47.763206  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.004s	sys 0.016s
I20260709 13:02:47.615440  7352 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.740952  1587 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:47.766880  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:47.740411  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:47.735651  7182 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.772974  7193 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
W20260709 13:02:47.779336  7331 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:02:47.783846  7203 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:47.785913  7188 consensus_meta.cc:287] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.000s
I20260709 13:02:47.773582  6975 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:47.762048  1617 rpcz_store.cc:276] 0709 13:02:46.729436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.994463 (+265027us) service_pool.cc:224] Handling call
0709 13:02:47.737414 (+742951us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400066154. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:47.737552 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365814528}
W20260709 13:02:47.745641  1623 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.000s	sys 0.020s
W20260709 13:02:47.795064  1696 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.000s	sys 0.032s
W20260709 13:02:47.797514  1696 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.000s	sys 0.032s
W20260709 13:02:47.759673  1663 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.002s	sys 0.018s
W20260709 13:02:47.798308  1663 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.002s	sys 0.019s
W20260709 13:02:47.796747  1623 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.000s	sys 0.021s
I20260709 13:02:47.799278  6573 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:47.800796  1543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.005s	sys 0.016s
I20260709 13:02:47.769842  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:47.776824  1587 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:47.802313  1661 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:47.802352  1587 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:47.760924  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.011s	sys 0.010s
W20260709 13:02:47.803541  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.011s	sys 0.010s
W20260709 13:02:47.801175  1543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.005s	sys 0.017s
I20260709 13:02:47.806732  1661 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:47.807464  1663 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:47.814551  1587 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:47.788069  7256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.010s
I20260709 13:02:47.818394  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:47.819998  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:47.821117  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.815376  7193 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:47.815569  7187 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:47.822741  7187 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.823149  7187 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:47.795460  6975 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.826156  6975 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:47.818081  7154 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:47.827816  7294 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:47.832751  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:47.836858  1663 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:47.867944  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:47.869601  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.870440  6573 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:47.870625  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 2252) took 1193 ms. Trace:
I20260709 13:02:47.871162  1620 rpcz_store.cc:276] 0709 13:02:46.676817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.677054 (+   237us) service_pool.cc:224] Handling call
0709 13:02:47.870418 (+1193364us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54001f86d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:47.870558 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421348608}
I20260709 13:02:47.869656  1587 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:47.873005  1616 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:47.877699  7352 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.878335  7352 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.889575  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:47.890129  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:47.890410  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:47.819450  7256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.006s	sys 0.010s
W20260709 13:02:47.894616  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 87971.1us
I20260709 13:02:47.776531  7182 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:47.898725  7352 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:47.909150  1545 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:47.910069  1544 raft_consensus.cc:3060] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:47.920166  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 50580.1us
I20260709 13:02:47.923966  1661 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:47.825363  7346 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:47.922688  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 85929.6us
I20260709 13:02:47.930177  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:47.893416  7289 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:47.964900  1663 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:47.966914  1615 raft_consensus.cc:1240] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:02:47.967828  1619 raft_consensus.cc:2410] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:02:47.930781  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:47.976516  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:47.891646  7193 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:47.941785  1620 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:47.982502  1620 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:47.931228  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:47.977655  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.008s	sys 0.021s
W20260709 13:02:47.983348  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.009s	sys 0.021s
I20260709 13:02:47.966343  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:47.992576  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 68707.4us
I20260709 13:02:47.993556  2231 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:47.979358  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:47.890476  7343 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:47.962136  7154 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.009927  1615 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:47.928244  7333 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:47.961452  7308 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:47.987143  7115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.161s	sys 0.295s
I20260709 13:02:48.018939  6894 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.020396  7346 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:48.032017  7308 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.032321  6894 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:48.032421  7346 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.022608  7168 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:48.028133  7218 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.028813  7182 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:48.029819  7154 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.029995  7059 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:48.034142  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:48.068977  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:48.034756  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:48.070066  1545 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.070154  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:48.035229  1617 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:02:48.070847  1617 pending_rounds.cc:85] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 8
I20260709 13:02:48.071192  1617 pending_rounds.cc:107] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:02:48.071450  1617 raft_consensus.cc:2889] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:47.920064  7307 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:48.038887  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:48.039460  1618 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:48.040319  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:47.928369  7205 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:48.041630  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:48.096385  1620 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:48.044231  6975 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:48.044561  7321 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.005s	sys 0.015s
I20260709 13:02:47.987604  7202 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:48.013834  7294 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:48.032035  7115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.161s	sys 0.295s
I20260709 13:02:48.037599  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:48.082329  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:48.111812  1618 raft_consensus.cc:2368] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:48.097951  1544 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:48.069229  7359 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:48.113225  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:48.114609  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:48.016088  7333 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:48.039855  7287 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:48.116891  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.044989  6894 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:48.105075  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:48.109774  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:48.120090  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:48.082005  7328 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:02:48.129592  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.139982  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:48.097013  7163 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:48.044078  7168 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.103648  7205 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:48.116410  7321 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.005s	sys 0.016s
I20260709 13:02:48.147190  6975 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:48.068420  7218 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.121635  7333 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:48.174185  7218 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:48.153790  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:48.138715  6917 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:02:48.116218  7311 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:48.178494  7311 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.051676  7193 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.181037  7311 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:48.181524  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:48.182900  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:48.184006  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:48.185016  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:48.185508  1541 raft_consensus.cc:1813] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Handling vote request from an unknown peer 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:48.185964  1541 raft_consensus.cc:2368] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11.
I20260709 13:02:48.186805  1541 raft_consensus.cc:3060] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:48.189456  7187 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:48.191700  1544 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:48.192514  7308 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:48.110424  7294 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:48.162533  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.165733  1623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 2331) took 1408 ms. Trace:
W20260709 13:02:48.201818  6697 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.029s	sys 0.096s
I20260709 13:02:48.172143  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3146) took 1321 ms. Trace:
I20260709 13:02:48.121088  7302 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.182s
I20260709 13:02:48.157518  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:48.160311  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:48.096485  7307 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.201869  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39238 (request call id 3445) took 1527 ms. Trace:
I20260709 13:02:48.206933  1543 rpcz_store.cc:276] 0709 13:02:46.850865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.908955 (+ 58090us) service_pool.cc:224] Handling call
0709 13:02:46.909389 (+   434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:46.928624 (+ 19235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.928671 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:46.946843 (+ 18172us) log.cc:844] Serialized 52 byte log entry
0709 13:02:47.805540 (+858697us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:47.833455 (+ 27915us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.834066 (+   611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.834161 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:48.171884 (+337723us) raft_consensus.cc:1685] finished
0709 13:02:48.171910 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.172072 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18717,"prepare.queue_time_us":66647,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":19236,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":56256,"spinlock_wait_cycles":48755968,"thread_start_us":768033,"threads_started":1,"wal-append.queue_time_us":1147347}
I20260709 13:02:48.171681  7353 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.215031  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:48.205060  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.010s	sys 0.038s
I20260709 13:02:48.203492  1623 rpcz_store.cc:276] 0709 13:02:46.757215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.013986 (+256771us) service_pool.cc:224] Handling call
0709 13:02:47.014335 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:47.020065 (+  5730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.020095 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:47.020649 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:02:47.799090 (+778441us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:47.799134 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.799826 (+   692us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:48.023044 (+223218us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b4800150258. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6fa67aa1 00007f5c6fa5eb37 00007f5c6fa5e9ca 00007f5c6fb5626f 00007f5c6fb55f37 00007f5c6fb6a55c 00007f5c6fb6a508 00007f5c6fb6a488 00007f5c6fb6a443 00007f5c6fb696ec 00007f5c6ea93a96
0709 13:02:48.165372 (+142328us) raft_consensus.cc:1685] finished
0709 13:02:48.165401 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.165655 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5163,"raft.queue_time_us":13159,"raft.run_cpu_time_us":18412,"raft.run_wall_time_us":995329,"spinlock_wait_cycles":6017280,"thread_start_us":778132,"threads_started":1,"wal-append.queue_time_us":1142752}
I20260709 13:02:48.198387  1587 leader_election.cc:400] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11.
I20260709 13:02:48.216310  1587 leader_election.cc:403] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:48.119493  7124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.020s	sys 0.024s
I20260709 13:02:48.214673  1543 raft_consensus.cc:1240] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:02:48.214969  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:48.218688  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:48.219350  1693 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
W20260709 13:02:48.217239  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.044s	user 0.010s	sys 0.039s
I20260709 13:02:48.209652  1615 raft_consensus.cc:2468] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:48.160408  7205 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:48.152609  7154 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:48.215564  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:48.220028  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 1.04688e+06us
I20260709 13:02:48.213572  1696 rpcz_store.cc:276] 0709 13:02:46.674861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.003914 (+329053us) service_pool.cc:224] Handling call
0709 13:02:47.004247 (+   333us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:47.113609 (+109362us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:47.172311 (+ 58702us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.798108 (+625797us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:47.890081 (+ 91973us) log.cc:844] Serialized 78 byte log entry
0709 13:02:47.890238 (+   157us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:47.892734 (+  2496us) log.cc:844] Serialized 14 byte log entry
0709 13:02:47.892950 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.893025 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:48.201616 (+308591us) raft_consensus.cc:1685] finished
0709 13:02:48.201637 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.201801 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43526,"prepare.queue_time_us":61194,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":3582,"raft.queue_time_us":196617,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":38059,"spinlock_wait_cycles":78042368,"thread_start_us":670661,"threads_started":2,"wal-append.queue_time_us":997655}
I20260709 13:02:48.205399  7294 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:48.225154  1542 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:48.227841  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:48.206928  6697 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.029s	sys 0.096s
I20260709 13:02:48.144500  7287 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.193327  7163 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:48.206924  6894 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.260551  1622 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:48.265427  1543 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:48.269308  1544 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:02:48.271087  2271 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:02:48.211299  7328 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:48.277531  1619 raft_consensus.cc:1275] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:02:48.221832  7124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.020s	sys 0.028s
I20260709 13:02:48.284195  1662 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:48.285406  1692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.016s	sys 0.034s
W20260709 13:02:48.286456  1692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.016s	sys 0.034s
I20260709 13:02:48.261464  7187 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:48.285162  2232 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:48.224031  7311 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.298571  1545 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:48.216251  7202 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:48.298691  1514 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.012s	sys 0.005s
I20260709 13:02:48.303171  1587 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:02:48.317253  1514 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.012s	sys 0.005s
W20260709 13:02:48.317664  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 654355us
W20260709 13:02:48.304085  1540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.004s	sys 0.011s
I20260709 13:02:48.309918  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:48.310272  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:48.311542  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:48.314076  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:48.322989  1688 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
W20260709 13:02:48.282002  7300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.028s	sys 0.020s
I20260709 13:02:48.314860  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:48.314987  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:48.296672  7261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.012s	sys 0.007s
W20260709 13:02:48.324148  1540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.004s	sys 0.011s
I20260709 13:02:48.361232  1697 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:48.376473  7168 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:48.375885  7328 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:48.295984  6894 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.389526  6917 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:48.389991  6917 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.390343  6917 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:48.391490  1695 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:02:48.343585  7300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.028s	sys 0.020s
I20260709 13:02:48.374696  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3143) took 1529 ms. Trace:
W20260709 13:02:48.399865  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 96795.5us
I20260709 13:02:48.401984  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:48.410171  1619 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 16: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:48.297657  7369 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:48.370915  7261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.012s	sys 0.008s
I20260709 13:02:48.260792  7353 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.434299  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:48.486804  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:48.488714  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:48.489368  1696 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:48.489526  1619 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:48.297788  7218 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.099s
W20260709 13:02:48.434554  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.496709  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:48.397943  1540 rpcz_store.cc:276] 0709 13:02:46.844975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.845088 (+   113us) service_pool.cc:224] Handling call
0709 13:02:46.845334 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.845513 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:47.271018 (+425505us) log.cc:844] Serialized 14 byte log entry
0709 13:02:48.374218 (+1103200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:48.374305 (+    87us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:48.374377 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.374474 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:48.374626 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31455,"prepare.queue_time_us":353589,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":7870,"raft.queue_time_us":15674,"thread_start_us":1430893,"threads_started":2}
I20260709 13:02:48.480034  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:48.616382  1619 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:48.360371  7372 consensus_queue.cc:1059] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 13:02:48.627454  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:48.651911  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.433952  7182 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:02:48.415107  2267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.006s	sys 0.011s
I20260709 13:02:48.358307  7202 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.701960  1697 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:48.433743  7308 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:48.484598  7265 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.713366  1541 consensus_meta.cc:287] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.526s	user 0.006s	sys 0.007s
W20260709 13:02:48.713915  2267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.008s	sys 0.012s
I20260709 13:02:48.434895  7059 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 20 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:48.693519  7281 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:48.485737  7088 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:48.709204  7203 consensus_meta.cc:287] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.925s	user 0.006s	sys 0.015s
W20260709 13:02:48.737538  1691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.280s	user 0.007s	sys 0.020s
I20260709 13:02:48.620949  7300 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:48.709522  7346 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:48.782408  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:48.812220  2271 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:02:48.710526  7372 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:48.710736  6697 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:48.718269  7373 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:48.717526  7182 raft_consensus.cc:697] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:48.819782  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:48.721468  7359 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:48.823042  1662 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:48.599678  7369 raft_consensus.cc:697] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:48.786628  1691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.329s	user 0.007s	sys 0.020s
I20260709 13:02:48.783165  6894 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:48.811503  7178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.731s	user 0.011s	sys 0.030s
I20260709 13:02:48.781723  7361 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:48.794183  7168 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.793591  7163 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:48.725461  7308 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.832860  7307 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:48.808280  7088 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:48.900449  7333 consensus_meta.cc:287] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.727s	user 0.009s	sys 0.012s
I20260709 13:02:48.793238  7281 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:48.778422  7265 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.821722  7300 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.899720  7287 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:48.853163  6697 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:48.853675  7372 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:48.900162  6894 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:48.901279  7178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.826s	user 0.011s	sys 0.031s
I20260709 13:02:48.877861  7359 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:48.905254  7168 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:48.862377  7373 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:48.934089  7365 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.560s	user 0.000s	sys 0.001s
W20260709 13:02:48.944406  6573 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.020s	sys 0.016s
I20260709 13:02:48.926541  6894 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:48.933931  6897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.048s	sys 0.072s
W20260709 13:02:48.960916  6573 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.021s	sys 0.017s
I20260709 13:02:48.916148  7333 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:48.957118  6855 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.032s	sys 0.085s
W20260709 13:02:48.964254  6897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.049s	sys 0.073s
I20260709 13:02:49.149992  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54504 (request call id 815) took 1505 ms. Trace:
I20260709 13:02:48.496083  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:49.153126  6745 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:49.153515  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 657355us
I20260709 13:02:49.154958  1514 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:49.157992  6697 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:49.157905  1514 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:49.158798  6697 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:49.100068  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:48.964686  6894 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:49.154500  6745 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.160158  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 3158) took 1123 ms. Trace:
I20260709 13:02:49.160645  1539 rpcz_store.cc:276] 0709 13:02:48.037153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.037366 (+   213us) service_pool.cc:224] Handling call
0709 13:02:49.099594 (+1062228us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5800093398. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:02:49.160028 (+ 60434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4951808}
W20260709 13:02:48.980041  6855 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.032s	sys 0.085s
W20260709 13:02:49.101574  1547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.006s	sys 0.017s
W20260709 13:02:49.165236  1547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.007s	sys 0.017s
I20260709 13:02:49.164906  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:49.102348  1586 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.012s	sys 0.007s
I20260709 13:02:49.103029  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:49.166695  1586 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.201s	user 0.012s	sys 0.007s
I20260709 13:02:49.167193  1546 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:49.168081  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 3157) took 1131 ms. Trace:
I20260709 13:02:49.168577  1546 rpcz_store.cc:276] 0709 13:02:48.036880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.037105 (+   225us) service_pool.cc:224] Handling call
0709 13:02:49.102505 (+1065400us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b5800093398. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:02:49.167999 (+ 65494us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5368576}
W20260709 13:02:49.106393  1621 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.091s	user 0.013s	sys 0.108s
W20260709 13:02:49.170089  1621 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.013s	sys 0.108s
W20260709 13:02:49.109754  1614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.337s	user 0.004s	sys 0.027s
W20260709 13:02:49.172322  1614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.399s	user 0.004s	sys 0.028s
I20260709 13:02:49.172230  7059 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.934278  7182 consensus_queue.cc:237] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.173439  7059 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.175298  7185 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:49.167309  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 1.23392e+06us
I20260709 13:02:49.176299  7185 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.177296  7088 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.178969  7178 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:49.178354  7088 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:49.004473  7202 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.034864  7265 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:49.112645  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 2334) took 1184 ms. Trace:
W20260709 13:02:49.030244  7205 consensus_meta.cc:287] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.767s	user 0.005s	sys 0.007s
I20260709 13:02:49.111615  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 2321) took 2397 ms. Trace:
I20260709 13:02:49.120538  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:49.122684  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:49.124452  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39238 (request call id 3438) took 2534 ms (client timeout 2711 ms). Trace:
W20260709 13:02:49.119604  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 1.14502e+06us
I20260709 13:02:49.126523  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 2264) took 2290 ms. Trace:
I20260709 13:02:49.127445  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 2255) took 2535 ms. Trace:
I20260709 13:02:49.127605  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:50792
I20260709 13:02:49.129065  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 2263) took 1105 ms. Trace:
I20260709 13:02:49.010252  7281 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:49.041328  7294 consensus_meta.cc:287] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.753s	user 0.012s	sys 0.000s
I20260709 13:02:49.009198  7300 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.008191  7308 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:49.040288  7311 consensus_meta.cc:287] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.000s
I20260709 13:02:49.114790  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34180 (request call id 2262) took 1091 ms. Trace:
I20260709 13:02:49.013329  7333 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:48.960812  7353 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:49.033387  7359 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:49.332676  2232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.012s	sys 0.016s
I20260709 13:02:48.980149  7369 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:49.333250  2232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.012s	sys 0.016s
W20260709 13:02:49.333810  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 1.04864e+06us
W20260709 13:02:49.335471  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.014s	sys 0.026s
W20260709 13:02:49.335858  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.014s	sys 0.026s
I20260709 13:02:49.011611  7372 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.037902  7373 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:48.997767  7380 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:02:49.193852  6745 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.235116  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:49.339468  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.016s	sys 0.017s
W20260709 13:02:49.339960  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.016s	sys 0.017s
I20260709 13:02:49.184715  1617 rpcz_store.cc:276] 0709 13:02:47.928489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.928634 (+   145us) service_pool.cc:224] Handling call
0709 13:02:48.034817 (+106183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.071931 (+ 37114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.112119 (+1040188us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b54002643d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:49.112421 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166171520}
I20260709 13:02:49.200517  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35712 (request call id 3155) took 1164 ms. Trace:
I20260709 13:02:49.343019  1548 rpcz_store.cc:276] 0709 13:02:48.036351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.037574 (+  1223us) service_pool.cc:224] Handling call
0709 13:02:49.120140 (+1082566us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b5800093398. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67a19b71 00007f5c67a19a22 00007f5c70932c09 00007f5c6fa8cee0 00007f5c6fb560ab 00007f5c6fb56131 00007f5c6fb040a0 00007f5c6fb03984 00007f5c6907e6d4 00007f5c6907e662
0709 13:02:49.200425 (+ 80285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4605696}
W20260709 13:02:49.343459  7193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.097s	user 0.007s	sys 0.028s
I20260709 13:02:49.185708  1616 rpcz_store.cc:276] 0709 13:02:46.714102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.003578 (+289476us) service_pool.cc:224] Handling call
0709 13:02:47.872613 (+869035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.873451 (+   838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.111025 (+1237574us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b54001f86d0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3d8ad 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:49.111326 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997986048}
W20260709 13:02:49.229190  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 62155.1us
I20260709 13:02:49.187526  1615 rpcz_store.cc:276] 0709 13:02:48.023909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.035064 (+ 11155us) service_pool.cc:224] Handling call
0709 13:02:49.128637 (+1093573us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54000fbed4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:49.128864 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291224960}
I20260709 13:02:49.245720  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:49.345036  1545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.001s	sys 0.009s
I20260709 13:02:49.179368  7185 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:49.345602  1545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.001s	sys 0.009s
W20260709 13:02:49.346113  7321 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.057s	user 0.015s	sys 0.024s
I20260709 13:02:49.247054  7294 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:49.346642  7321 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.015s	sys 0.025s
I20260709 13:02:49.346578  7185 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:49.348058  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:49.348680  7294 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:49.346535  1514 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:49.349040  1544 raft_consensus.cc:2393] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 15: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:49.247745  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:49.186771  1689 rpcz_store.cc:269] 0709 13:02:46.590049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.758528 (+168479us) service_pool.cc:224] Handling call
0709 13:02:49.123992 (+2365464us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54001293d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:49.124189 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1999995776}
I20260709 13:02:49.179993  7178 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:49.175344  7187 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.351838  7311 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11.
I20260709 13:02:49.351693  7187 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.353042  7059 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.354635  7187 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:49.239929  1693 raft_consensus.cc:606] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:49.355443  1693 raft_consensus.cc:614] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:49.185708  6697 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.357889  6697 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:49.289428  7326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.098s	user 0.011s	sys 0.024s
W20260709 13:02:49.358649  7326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.012s	sys 0.024s
I20260709 13:02:49.150684  2267 rpcz_store.cc:276] 0709 13:02:47.644843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.656529 (+ 11686us) service_pool.cc:224] Handling call
0709 13:02:47.656846 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:47.657159 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.657201 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:47.657687 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:02:48.734798 (+1077111us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:48.734841 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.734965 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.149338 (+414373us) raft_consensus.cc:1685] finished
0709 13:02:49.149378 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.149717 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"thread_start_us":1076701,"threads_started":1,"wal-append.queue_time_us":1322691}
I20260709 13:02:49.350881  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:49.186949  1691 rpcz_store.cc:276] 0709 13:02:46.835957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.004940 (+168983us) service_pool.cc:224] Handling call
0709 13:02:47.005216 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:47.271355 (+266139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.279631 (+  8276us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:47.282751 (+  3120us) log.cc:844] Serialized 26 byte log entry
0709 13:02:48.863505 (+1580754us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:48.863548 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.863616 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.125865 (+262249us) raft_consensus.cc:1685] finished
0709 13:02:49.125902 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.126264 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28666,"raft.queue_time_us":195375,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":15882,"thread_start_us":1666644,"threads_started":2,"wal-append.queue_time_us":1602806}
I20260709 13:02:49.187135  1692 rpcz_store.cc:276] 0709 13:02:46.591973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.003850 (+411877us) service_pool.cc:224] Handling call
0709 13:02:47.008977 (+  5127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:47.692696 (+683719us) spinlock_profiling.cc:243] Waited 8.74 ms on lock 0x7b180023d0a0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c6a6e64bc 00007f5c67a3448b 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a4e455 00007f5c6ab36060 00007f5c6ab36bfb 00007f5c6ab4164b
0709 13:02:47.692877 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.692917 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:47.693507 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:02:48.286916 (+593409us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:48.286971 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.287051 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:48.959545 (+672494us) raft_consensus.cc:1685] finished
0709 13:02:48.959574 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.127151 (+167577us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28879,"raft.queue_time_us":212832,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":16672,"spinlock_wait_cycles":20097920,"thread_start_us":797492,"threads_started":2,"wal-append.queue_time_us":1263861}
I20260709 13:02:49.301184  1622 rpcz_store.cc:276] 0709 13:02:48.023618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.037289 (+ 13671us) service_pool.cc:224] Handling call
0709 13:02:49.114284 (+1076995us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540016ec54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab422fa 00007f5c6fb03b17 00007f5c6907e6d4 00007f5c6907e662 00007f5c6907e591 00007f5c6907e50c 00007f5c6907d7c2 00007f5c68e7948c 00007f5c68e788c6 00007f5c68e7826f
0709 13:02:49.114493 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339839232}
I20260709 13:02:49.290349  7202 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:02:49.313441  7328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.013s	sys 0.019s
W20260709 13:02:49.332337  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:49.367457  7328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.014s	sys 0.019s
I20260709 13:02:49.367064  7202 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.325824  7205 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.371766  7202 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:49.368956  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:49.329423  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:49.372862  2267 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
W20260709 13:02:49.343890  7193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.007s	sys 0.028s
I20260709 13:02:49.124984  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:49.330142  1663 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:49.374614  7193 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:49.375799  7193 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:49.376430  7193 raft_consensus.cc:697] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:49.377986  1586 connection.cc:256] RPC call timeout handler was delayed by -1.1295470320000618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
I20260709 13:02:49.373672  7205 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:49.394443  1586 connection.cc:256] RPC call timeout handler was delayed by -1.0638470320000692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 13:02:49.394899  1586 connection.cc:256] RPC call timeout handler was delayed by -1.0103233520000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:02:49.395392  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 107604us
I20260709 13:02:49.371745  1514 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:49.391166  1513 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:49.405862  1663 leader_election.cc:400] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
W20260709 13:02:49.407459  1690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.008s	sys 0.001s
I20260709 13:02:49.377960  7193 consensus_queue.cc:237] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:49.411466  1542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.000s	sys 0.010s
I20260709 13:02:49.398597  7185 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:49.407948  1690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.009s	sys 0.001s
W20260709 13:02:49.412045  1542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.000s	sys 0.011s
W20260709 13:02:49.412101  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 287513us
I20260709 13:02:49.398221  7088 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:49.426657  7088 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:49.427747  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 521618us
I20260709 13:02:49.428463  7383 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:49.429730  7088 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.429409  7383 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.430420  7088 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:49.435287  2271 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:49.436393  2263 raft_consensus.cc:1240] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:49.436595  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:49.437546  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35704 (request call id 2343) took 1317 ms. Trace:
I20260709 13:02:49.438063  1542 rpcz_store.cc:276] 0709 13:02:48.119934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.271790 (+151856us) service_pool.cc:224] Handling call
0709 13:02:48.272158 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:48.274167 (+  2009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:48.274207 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:48.281238 (+  7031us) log.cc:844] Serialized 26 byte log entry
0709 13:02:49.431901 (+1150663us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:49.431991 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.432123 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.437308 (+  5185us) raft_consensus.cc:1685] finished
0709 13:02:49.437334 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.437471 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17347,"raft.queue_time_us":1595,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":10070,"thread_start_us":1149989,"threads_started":1,"wal-append.queue_time_us":1150967}
I20260709 13:02:49.439821  7237 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.440624  7237 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.437469  2272 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:49.443280  7237 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:49.469094  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:49.472157  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:49.472641  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:49.431288  7088 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.467037  7328 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:49.491734  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 2343) took 1558 ms. Trace:
I20260709 13:02:49.443403  6894 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.488633  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:49.503353  2266 raft_consensus.cc:1813] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Handling vote request from an unknown peer 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:49.503494  7124 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:49.503590  7287 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:49.504765  6917 consensus_meta.cc:287] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 1.114s	user 0.027s	sys 0.009s
I20260709 13:02:49.507071  2266 raft_consensus.cc:2368] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11.
I20260709 13:02:49.509305  7375 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.509946  7352 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:49.637602  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.658452  2272 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:02:49.677100  1586 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:49.685951  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:49.511195  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:49.598047  1661 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:49.557217  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:49.687634  1663 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:49.492779  7328 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:02:49.670063  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 600627us
W20260709 13:02:49.693876  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 322267us
I20260709 13:02:49.641206  6573 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:49.496069  1621 rpcz_store.cc:276] 0709 13:02:47.932860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.984158 (+ 51298us) service_pool.cc:224] Handling call
0709 13:02:47.984480 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.984720 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:49.170787 (+1186067us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.382207 (+211420us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.394772 (+ 12565us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.412426 (+ 17654us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:49.464265 (+ 51839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.470440 (+  6175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.491662 (+ 21222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17241,"prepare.queue_time_us":1337534,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":84,"raft.queue_time_us":10533,"raft.run_cpu_time_us":594,"raft.run_wall_time_us":58866,"spinlock_wait_cycles":22254336,"thread_start_us":1271836,"threads_started":2,"wal-append.queue_time_us":302394}
I20260709 13:02:49.700580  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:49.702178  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:49.702636  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:49.702939  1544 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:49.555920  6894 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.549036  7343 consensus_queue.cc:1059] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.156s
I20260709 13:02:49.705691  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:49.706104  7343 raft_consensus.cc:3055] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:49.706593  1540 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:49.706789  7343 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:49.511586  6855 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.707912  6855 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.708257  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:49.678910  7124 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.658950  7402 raft_consensus.cc:493] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:49.641762  7346 raft_consensus.cc:3055] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:49.588356  7411 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.688118  7383 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.547739  6897 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.720779  2231 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:49.719692  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3153) took 1684 ms. Trace:
I20260709 13:02:49.691644  6917 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.737179  6897 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.738600  6917 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:49.739156  1541 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:49.739725  7163 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:49.739802  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 62902.4us
I20260709 13:02:49.716794  7124 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.743062  6894 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:49.743641  6894 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:49.744115  6894 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.750128  7311 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:49.750370  7372 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.753873  7372 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.754629  1514 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:49.756649  7188 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:49.757071  7188 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.757520  7188 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.757628  1544 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:49.760212  1548 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 19. Current term is 20. Ops: []
W20260709 13:02:49.761479  7407 log.cc:927] Time spent T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.332s	user 0.000s	sys 0.002s
I20260709 13:02:49.762470  7372 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:49.751502  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 154723us
I20260709 13:02:49.774821  7163 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.775599  7163 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.777387  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:49.777876  7163 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:49.778159  1542 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:49.751211  6855 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.720053  7346 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:49.779910  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:49.780233  1663 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:49.780732  7346 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.781956  1663 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:49.782030  7346 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:49.735993  1547 rpcz_store.cc:276] 0709 13:02:48.035797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.035928 (+   131us) service_pool.cc:224] Handling call
0709 13:02:48.036194 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:48.036392 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:48.074157 (+ 37765us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.488373 (+1414216us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.506575 (+ 18202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:49.652841 (+146266us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:49.679000 (+ 26159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.694998 (+ 15998us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.719640 (+ 24642us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7201,"prepare.queue_time_us":257509,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":128,"raft.queue_time_us":28717,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":43732,"thread_start_us":1306835,"threads_started":3,"wal-append.queue_time_us":1249757}
I20260709 13:02:49.752197  7187 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.751632  7375 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.751192  7311 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.788043  7187 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.789595  7375 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:49.790046  7187 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:49.790239  7311 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:49.751842  7343 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.791112  6573 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.793102  6573 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.793052  1586 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:49.793928  7328 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.790289  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58526 (request call id 1029) took 1477 ms. Trace:
I20260709 13:02:49.795040  1688 rpcz_store.cc:276] 0709 13:02:48.312580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.323770 (+ 11190us) service_pool.cc:224] Handling call
0709 13:02:48.360708 (+ 36938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:48.361160 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:48.361193 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:48.366020 (+  4827us) log.cc:844] Serialized 26 byte log entry
0709 13:02:49.127566 (+761546us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b18001da9a0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de0d1 00007f5c6aaf9a0f
0709 13:02:49.394274 (+266708us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:49.669633 (+275359us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.678161 (+  8528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.678234 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.760694 (+ 82460us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:49.764586 (+  3892us) raft_consensus.cc:1685] finished
0709 13:02:49.764613 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.790116 (+ 25503us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":216468,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":13108,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":30520,"spinlock_wait_cycles":54109184,"thread_start_us":350258,"threads_started":2,"wal-append.queue_time_us":1062245}
I20260709 13:02:49.750057  7088 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.799722  7193 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:49.800137  7193 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:49.800484  7193 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:49.801545  7287 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.802002  7311 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:49.803987  7287 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.804972  6855 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:49.806185  1588 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:49.808362  6855 consensus_queue.cc:1059] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:49.809151  7369 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:49.809870  6855 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:49.810870  6855 raft_consensus.cc:697] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:49.811162  7369 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:49.811936  7369 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.812858  1539 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:49.813885  1514 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:49.814914  7178 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:49.800871  7124 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.816416  1586 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:49.817250  7178 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:49.817669  7178 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.817996  7124 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.812250  7311 raft_consensus.cc:3055] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:49.814278  7369 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:49.795111  7328 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:49.818266  7088 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:02:49.818076  7260 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:49.824492  7260 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:49.825465  7260 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.826701  7260 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:49.819139  7229 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:49.828837  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:49.829207  7229 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:49.830085  7229 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:49.820413  7377 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.957s	user 0.002s	sys 0.013s
I20260709 13:02:49.751295  7168 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:49.836195  7282 raft_consensus.cc:3055] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:49.836596  7282 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:49.837783  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:49.842463  1539 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:49.846035  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:49.846119  1663 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:49.846696  2269 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:49.847303  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 63969.9us
I20260709 13:02:49.848862  1663 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
W20260709 13:02:49.849956  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 252135us
I20260709 13:02:49.851126  1661 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:49.722283  7321 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:49.807401  1588 leader_election.cc:400] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11.
W20260709 13:02:49.852517  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 45381.8us
I20260709 13:02:49.852757  7361 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:49.853431  7361 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.857501  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:49.858597  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:49.859297  1623 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 14.
I20260709 13:02:49.860270  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:49.865330  7185 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:49.866072  7185 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:49.867132  7402 raft_consensus.cc:515] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.869881  7402 leader_election.cc:290] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:49.865515  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:49.821906  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:49.881393  2269 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:49.884202  7405 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:49.885056  7405 consensus_queue.cc:1059] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:49.822443  7188 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.886271  7405 raft_consensus.cc:3055] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:49.886667  7405 raft_consensus.cc:740] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:49.889672  1541 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:49.890295  1539 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 16.
I20260709 13:02:49.890516  1547 raft_consensus.cc:2393] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 10: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:49.823014  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 1392) took 1646 ms. Trace:
I20260709 13:02:49.888603  1513 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:49.886104  7289 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:49.900799  6745 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:49.901350  6745 raft_consensus.cc:697] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:49.818063  7178 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:49.823374  7059 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:49.818817  7311 raft_consensus.cc:740] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:49.910574  6745 consensus_queue.cc:237] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.723501  7352 consensus_queue.cc:1059] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.189s
I20260709 13:02:49.912137  7185 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.906558  7088 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.916039  7088 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.918380  7088 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:49.918466  2232 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:49.891790  1545 rpcz_store.cc:276] 0709 13:02:48.176642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.301889 (+125247us) service_pool.cc:224] Handling call
0709 13:02:48.302284 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:48.363048 (+ 60764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:48.363095 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:48.363643 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:02:49.822333 (+1458690us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b1800440e00. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c6a6e64bc 00007f5c67a3448b 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de0d1
0709 13:02:49.822567 (+   234us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:49.822600 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.822710 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.822754 (+    44us) raft_consensus.cc:1685] finished
0709 13:02:49.822764 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:49.822960 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120681,"raft.queue_time_us":71254,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":18089,"spinlock_wait_cycles":75469056,"thread_start_us":859509,"threads_started":1,"wal-append.queue_time_us":942742}
I20260709 13:02:49.920949  7193 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:49.921936  7287 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:49.915012  7185 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:49.903496  7188 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:49.953922  6968 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:49.954399  7237 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:49.964855  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 116165us
W20260709 13:02:49.969717  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 118636us
I20260709 13:02:49.820765  6855 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.957970  7202 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:49.911156  7311 consensus_queue.cc:260] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.900599  7411 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:49.970676  6968 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:49.958422  6894 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:49.990944  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 313225us
W20260709 13:02:50.063198  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.108989  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 292709us
W20260709 13:02:50.110405  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.982014  6897 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:50.107900  1663 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:49.956670  7405 consensus_queue.cc:260] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:50.130376  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.132058  7411 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:50.133386  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:50.134132  2269 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:50.138672  6894 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:50.146270  1513 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:50.148178  7188 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:50.148867  7188 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.149405  7188 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.149972  7229 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:50.152355  7182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.085s	sys 0.147s
I20260709 13:02:50.155704  7202 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:50.125905  7185 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:50.164141  7182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.085s	sys 0.148s
I20260709 13:02:50.128600  7193 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:50.165452  7202 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:50.180804  7309 consensus_queue.cc:1048] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:02:50.190590  7282 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:50.192621  7282 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:50.193819  7260 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:50.194931  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.194496  7260 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:50.197744  7260 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:50.199508  7387 log.cc:927] Time spent T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.901s	user 0.002s	sys 0.002s
I20260709 13:02:50.200119  7343 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.200903  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 2260) took 2460 ms. Trace:
I20260709 13:02:50.201280  1614 rpcz_store.cc:276] 0709 13:02:47.740674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.740789 (+   115us) service_pool.cc:224] Handling call
0709 13:02:47.741154 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:47.742847 (+  1693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.742876 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:47.757474 (+ 14598us) log.cc:844] Serialized 26 byte log entry
0709 13:02:49.173270 (+1415796us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:49.173385 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.173518 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:49.907087 (+733569us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:50.200544 (+293457us) raft_consensus.cc:1685] finished
0709 13:02:50.200568 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.200822 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1314,"raft.queue_time_us":1537,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"spinlock_wait_cycles":41676288,"thread_start_us":1399871,"threads_started":1,"wal-append.queue_time_us":1485442}
I20260709 13:02:50.203475  6968 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:50.208340  1586 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:50.209761  7328 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:50.210300  7328 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:50.210831  7328 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:50.211876  7419 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
W20260709 13:02:50.213106  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 113795us
I20260709 13:02:50.214102  1663 leader_election.cc:400] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:50.182832  7202 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.226976  6918 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:02:50.229663  7405 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.175904  7185 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:50.232636  7185 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:50.246896  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 61351.5us
I20260709 13:02:50.183588  7311 raft_consensus.cc:3060] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:50.259876  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 278165us
I20260709 13:02:50.265110  1586 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:50.268113  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.269388  1586 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:50.269767  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:50.275406  7182 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:50.277990  7182 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:50.278522  7182 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.278923  7182 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:50.284639  7361 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:50.285100  7188 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:50.298985  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.300101  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.300231  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:50.263624  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.037s	sys 0.112s
W20260709 13:02:50.326723  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.038s	sys 0.112s
I20260709 13:02:50.303404  7188 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:50.271123  1586 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:50.327652  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 577237us
W20260709 13:02:50.325829  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 60633.3us
I20260709 13:02:50.331331  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:50.332010  2267 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.339643  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:50.339836  7178 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:50.340936  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:50.342499  1691 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:50.364137  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:50.363837  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.362228  1689 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:50.365998  1695 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:50.376565  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:50.380529  2234 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:50.388320  1691 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:50.362699  7361 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:50.389683  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.399665  2269 raft_consensus.cc:1275] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:50.399832  1692 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:50.369707  7178 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:50.370090  7402 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:50.404287  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:50.406106  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:50.406757  1689 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:50.402724  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:50.408423  2266 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:50.409257  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:50.409358  7425 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.409957  7425 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:50.410427  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:50.411134  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:50.411752  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:50.412066  7425 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:50.405789  7309 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:50.412518  1697 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:50.413731  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:50.414291  1545 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.415709  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:50.411089  1546 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:50.411803  1539 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:02:50.412693  1548 raft_consensus.cc:2393] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:50.421218  1695 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:50.421561  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:50.423030  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:50.423506  1540 raft_consensus.cc:2368] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16.
I20260709 13:02:50.423763  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:50.424134  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.424846  1695 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 17: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:50.424677  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:50.413734  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:50.427239  1697 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:50.510104  1446 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33072 (request call id 137) took 14602 ms (client timeout 15000 ms). Trace:
I20260709 13:02:50.444849  2267 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:50.536798  1621 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:50.494381  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.496747  2266 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 18.
I20260709 13:02:50.431519  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:50.541134  1691 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:50.467716  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:50.541882  2269 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:50.431120  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:50.544451  1542 raft_consensus.cc:2368] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
W20260709 13:02:50.446885  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 175901us
I20260709 13:02:50.549166  2268 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:02:50.548305  1692 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:50.436874  1545 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:50.531009  1689 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:50.412703  7309 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.555110  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.562821  7402 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:50.563287  7402 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:50.563808  7402 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.559638  1588 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:50.561492  2263 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:50.561591  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:50.567010  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:50.568847  1513 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:50.570482  1695 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:50.574659  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:50.559267  7309 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:50.584513  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 153475us
I20260709 13:02:50.582882  2272 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:50.587855  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:50.588192  1689 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:50.596442  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.592303  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.573990  7187 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:50.599856  1662 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:50.602726  1695 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:50.583850  7178 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:50.612815  1691 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:50.612087  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:50.616285  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:50.617861  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 61936.4us
W20260709 13:02:50.621032  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.623700  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.625038  1692 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:50.626305  1689 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 9.
I20260709 13:02:50.601629  7193 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:50.608490  7187 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.630204  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:50.631093  1586 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:50.633688  1695 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.633934  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:50.636169  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.638814  6745 consensus_queue.cc:1059] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:50.641630  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:50.642253  6745 raft_consensus.cc:3055] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:50.642715  6745 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:50.640095  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:50.644282  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.599567  7202 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:50.648330  1692 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:50.647310  1546 raft_consensus.cc:2393] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 17: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:50.623252  7343 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:50.601903  7405 consensus_queue.cc:1048] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:02:50.652513  6745 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:50.653995  6745 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.655608  7163 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.656134  7163 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:50.658149  7163 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:50.658692  7163 consensus_queue.cc:1059] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:50.659509  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.660118  1696 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:50.661270  1696 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:02:50.623754  7178 raft_consensus.cc:697] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:50.644093  7187 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:50.684137  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.685786  7372 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:50.686249  7178 consensus_queue.cc:237] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:50.687587  6894 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:50.688210  6894 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:50.683339  1693 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:50.690250  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:50.536974  1446 rpcz_store.cc:269] 0709 13:02:35.907803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.922378 (+ 14575us) service_pool.cc:224] Handling call
0709 13:02:50.509906 (+14587528us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:45.469478 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:45.512397 (+ 42919us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:45.512448 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:02:45.512468 (+    20us) tablet.cc:662] Decoding operations
0709 13:02:45.591881 (+ 79413us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:45.592028 (+   147us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:45.592069 (+    41us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:02:45.593812 (+  1743us) tablet.cc:701] Row locks acquired
0709 13:02:45.593872 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:02:45.594094 (+   222us) write_op.cc:270] Start()
0709 13:02:45.594276 (+   182us) write_op.cc:276] Timestamp: P: 1783602165594015 usec, L: 0
0709 13:02:45.594308 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:02:45.595209 (+   901us) log.cc:844] Serialized 6661 byte log entry
0709 13:02:46.633486 (+1038277us) op_driver.cc:464] REPLICATION: finished
0709 13:02:47.010445 (+376959us) write_op.cc:301] APPLY: starting
0709 13:02:47.022190 (+ 11745us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:47.780311 (+758121us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:47.781015 (+   704us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:48.187128 (+406113us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:48.187718 (+   590us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:02:48.187784 (+    66us) write_op.cc:312] APPLY: finished
0709 13:02:48.188285 (+   501us) log.cc:844] Serialized 156 byte log entry
0709 13:02:49.359427 (+1171142us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:49.360453 (+  1026us) write_op.cc:454] Released schema lock
0709 13:02:49.360668 (+   215us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:49.361444 (+   776us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:49.361489 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":392122,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":300629,"apply.run_cpu_time_us":65797,"apply.run_wall_time_us":2372414,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75255,"num_ops":17,"prepare.queue_time_us":106995,"prepare.run_cpu_time_us":8905,"prepare.run_wall_time_us":251483,"raft.queue_time_us":436094,"raft.run_cpu_time_us":88435,"raft.run_wall_time_us":258406,"replication_time_us":1021266,"thread_start_us":1927251,"threads_started":5,"wal-append.queue_time_us":1446901,"wal-append.run_cpu_time_us":37974,"wal-append.run_wall_time_us":2682964}]]}
I20260709 13:02:50.693280  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:50.694010  1691 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:02:50.697168  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 66154.4us
I20260709 13:02:50.691454  1692 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:50.666241  1444 catalog_manager.cc:5697] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 11 to 12, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 12 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:50.701908  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.702713  1695 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
W20260709 13:02:50.703334  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 79224.6us
I20260709 13:02:50.704394  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
W20260709 13:02:50.711946  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.668738  7193 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:50.716626  1586 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:50.696604  6855 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:50.722734  1689 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:50.718037  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:50.701627  7372 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:02:50.725135  1695 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.731673  1587 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:50.738873  7321 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:50.739434  7321 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:50.739884  7321 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:50.747406  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.748230  1692 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:50.755887  1444 catalog_manager.cc:5697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 10 to 11, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 11 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.730015  7405 raft_consensus.cc:3055] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:50.814563  1693 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:50.788213  7343 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:50.803103  7405 raft_consensus.cc:740] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:50.829375  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 185556us
I20260709 13:02:50.829845  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.832149  1692 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
W20260709 13:02:50.836135  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 104572us
I20260709 13:02:50.823746  7168 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:50.845413  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.845968  1693 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:50.870296  1587 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:50.873334  1691 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
W20260709 13:02:50.868252  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 155448us
I20260709 13:02:50.879617  1695 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:50.844597  7168 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.852429  7202 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:50.887209  7185 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:50.892859  7425 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:50.915077  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:50.894871  7168 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.931267  1695 raft_consensus.cc:2393] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 10: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:50.894634  7442 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.897879  6894 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:50.954569  7432 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:02:50.930176  7425 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:50.989289  7425 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:50.932176  7185 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:50.994201  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 100026us
W20260709 13:02:50.964089  7441 log.cc:927] Time spent T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:02:50.999590  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 91942.6us
W20260709 13:02:50.974016  7182 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.002s
I20260709 13:02:50.892323  7405 consensus_queue.cc:260] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:50.981140  7343 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:50.983255  7193 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:50.985323  6855 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:02:50.987092  7328 consensus_meta.cc:287] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.762s	user 0.009s	sys 0.002s
I20260709 13:02:50.988485  7311 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:50.987120  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:50.950309  1444 catalog_manager.cc:5697] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 8 to 11, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 11 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:51.033125  1444 catalog_manager.cc:5697] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 8 to 9, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 9 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.034107  7187 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:51.015786  1697 consensus_meta.cc:287] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.588s	user 0.006s	sys 0.004s
I20260709 13:02:51.035528  2272 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:51.035645  1697 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 20.
I20260709 13:02:51.020995  6745 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:51.036695  6745 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.037849  7185 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:51.038450  6745 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:51.015470  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 69805.7us
I20260709 13:02:51.025223  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.039635  1695 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:51.039677  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.015658  7182 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.040565  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.042616  7182 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:51.026566  1587 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:51.024940  6855 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:51.029865  7328 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.042774  1695 raft_consensus.cc:3055] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:02:51.043686  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.059952  1695 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:51.068248  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:51.068830  1696 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:51.057240  7405 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:51.054490  7287 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:50.993964  7442 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:51.081512  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.089030  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.081930  1444 catalog_manager.cc:5697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 11 to 12, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 12 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.096989  7442 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:51.104444  7328 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:51.081678  7282 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.106303  7282 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.108958  7282 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:51.110836  6855 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.112100  6855 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:51.118135  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.118698  1689 raft_consensus.cc:1813] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Handling vote request from an unknown peer 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:51.118327  1444 catalog_manager.cc:5697] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:02:51.119097  1689 raft_consensus.cc:2368] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 12.
I20260709 13:02:51.121547  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:51.122732  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.123801  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.086741  1695 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.132234  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:51.132586  2272 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:51.132745  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.132966  1547 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 15: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:51.132908  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.133414  1693 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:51.134759  1542 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:51.135473  7282 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.134788  7178 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:51.136088  7282 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.138126  7282 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:51.085681  7402 consensus_meta.cc:287] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.000s
I20260709 13:02:51.139709  7402 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:51.146310  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 147333us
W20260709 13:02:51.148496  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 142597us
I20260709 13:02:51.059916  7309 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.145879  2231 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:51.155326  1661 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:51.157470  1542 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:51.155048  1444 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 9 to 10, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 10 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.162096  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:50792
I20260709 13:02:51.162652  1693 raft_consensus.cc:606] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:51.164027  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 138466us
I20260709 13:02:51.165777  1695 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:51.166003  1663 connection.cc:256] RPC call timeout handler was delayed by -1.4827215729999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 13:02:51.166385  1663 connection.cc:256] RPC call timeout handler was delayed by -1.1551215730000308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
I20260709 13:02:51.167287  2271 raft_consensus.cc:2368] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15.
I20260709 13:02:51.169188  2231 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:51.169515  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:51.167364  7442 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:51.164515  7182 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:51.172116  7455 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:02:51.191540  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:51.191545  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.210521  1696 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:51.188105  1661 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:51.184818  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:51.212601  1694 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:51.212846  1617 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:51.216377  1444 catalog_manager.cc:5697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 8 to 9, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 9 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.222306  1661 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:51.226097  6745 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:51.227242  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 58100.3us
I20260709 13:02:51.228291  2231 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:51.202626  7438 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.303s	user 0.000s	sys 0.003s
I20260709 13:02:51.187974  7447 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.184962  7309 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:51.192551  7402 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:51.238492  1661 leader_election.cc:400] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16.
I20260709 13:02:51.235215  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:51.243781  1661 leader_election.cc:403] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:02:51.234419  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 53717.8us
I20260709 13:02:51.221254  7237 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:51.234853  7343 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:51.248260  7163 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:51.231952  7182 raft_consensus.cc:697] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:51.230010  7185 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:02:51.225940  7321 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.254002  7353 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:51.273815  7353 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:51.274288  7353 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.275943  7459 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.276556  7459 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.278867  7459 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:51.254204  1586 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:51.239482  7369 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:51.256665  1661 leader_election.cc:400] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
I20260709 13:02:51.279913  1661 leader_election.cc:403] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:51.279513  7188 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:51.281128  1661 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:51.283598  7289 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
I20260709 13:02:51.284521  7289 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:51.285118  7289 raft_consensus.cc:697] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:51.286085  7289 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.248847  7262 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:51.288071  7163 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.182536  7425 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.290607  7402 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.291081  7425 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:51.291141  7402 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.291965  1623 raft_consensus.cc:1240] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:51.293543  7402 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:51.176270  7168 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.199481  7178 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:02:51.295306  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.296020  1691 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:51.178669  7442 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.299156  7442 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:51.269827  7182 consensus_queue.cc:237] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.270365  7185 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:51.271203  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:51.254871  7187 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:51.308396  2271 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:51.272065  1621 raft_consensus.cc:1240] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:51.273319  7321 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:51.306743  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.307017  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.310738  2231 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:51.312414  7163 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:51.312848  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.313503  1694 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:51.313971  2231 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:51.314512  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:51.314990  1617 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:02:51.315723  7262 consensus_queue.cc:1059] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:51.316788  7262 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:51.318262  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.318441  7262 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.318902  1692 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:02:51.320073  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:02:51.324244  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 57319.7us
I20260709 13:02:51.328289  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:51.327157  2234 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:51.255362  7343 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:51.319094  7262 raft_consensus.cc:3055] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:51.345798  1662 leader_election.cc:400] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15.
I20260709 13:02:51.346143  1662 leader_election.cc:403] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:51.328895  1691 raft_consensus.cc:2376] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17. Re-sending same reply.
I20260709 13:02:51.264017  6894 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16.
I20260709 13:02:51.347380  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:51.351688  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.351948  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.352566  1691 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:51.352619  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.349030  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.353559  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:51.353696  1622 raft_consensus.cc:2393] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 17: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:51.354126  1691 raft_consensus.cc:2376] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 20. Re-sending same reply.
W20260709 13:02:51.345621  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 140263us
I20260709 13:02:51.301631  7369 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:51.357363  1694 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:51.362214  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:51.362803  1691 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:51.349501  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 115113us
I20260709 13:02:51.359967  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.363656  1689 raft_consensus.cc:2393] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:51.364246  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:51.368255  1539 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:51.371273  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.371956  1693 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
W20260709 13:02:51.378715  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 51629us
I20260709 13:02:51.350931  7343 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:51.311789  7442 consensus_queue.cc:1059] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:02:51.378115  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 45527.7us
I20260709 13:02:51.349131  7262 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:02:51.368367  7461 log.cc:927] Time spent T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.003s
I20260709 13:02:51.382474  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:51.383844  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:51.369186  7369 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:51.385462  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.388682  1623 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:51.359571  7453 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:51.381351  7229 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:51.374277  7447 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:02:51.392632  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 144140us
I20260709 13:02:51.394979  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.391613  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.392817  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.398062  1692 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 17: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:51.395536  1693 raft_consensus.cc:2376] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12. Re-sending same reply.
I20260709 13:02:51.403858  1622 raft_consensus.cc:2410] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:02:51.391144  6894 raft_consensus.cc:3055] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:51.412060  1691 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:02:51.413815  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:51.415091  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.416249  1691 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:02:51.417721  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:51.418093  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.421408  2272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:51.423316  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.423745  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:51.411765  6894 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:51.424599  1622 raft_consensus.cc:2368] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16.
I20260709 13:02:51.424741  7468 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:51.425001  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.425307  6894 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.426410  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.426762  6894 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:51.400151  7469 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:51.429477  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:51.409613  7229 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 15 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:51.438777  1693 raft_consensus.cc:2376] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17. Re-sending same reply.
I20260709 13:02:51.428865  1621 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:51.445492  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:51.446838  1693 raft_consensus.cc:2376] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16. Re-sending same reply.
I20260709 13:02:51.448247  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.449312  1693 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 10.
I20260709 13:02:51.455943  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:51.456692  1693 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:51.458737  1693 raft_consensus.cc:1275] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:02:51.459152  1693 pending_rounds.cc:85] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 12
I20260709 13:02:51.459510  1693 pending_rounds.cc:107] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:02:51.459844  1693 raft_consensus.cc:2889] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:51.427119  7282 consensus_queue.cc:1059] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:02:51.463891  1693 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:02:51.425156  7468 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:51.464823  7229 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.478222  7353 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.479038  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.444849  7469 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:51.486135  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:51.487464  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.488276  1621 raft_consensus.cc:2393] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 16: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:51.485354  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.495913  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:51.499258  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.499869  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.499958  1618 raft_consensus.cc:2410] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:02:51.494354  1623 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:51.487277  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:51.506101  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 110862us
I20260709 13:02:51.509132  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.510058  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:51.510593  1615 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.511559  6918 consensus_queue.cc:1059] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:02:51.513916  1622 raft_consensus.cc:1240] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:51.514408  6918 raft_consensus.cc:3055] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:51.514796  6918 raft_consensus.cc:740] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:51.515825  7353 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:51.515621  6918 consensus_queue.cc:260] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.517055  6918 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.422984  7262 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.524719  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:51.532035  1693 pending_rounds.cc:85] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 13
I20260709 13:02:51.532491  1693 pending_rounds.cc:107] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:02:51.532807  1693 raft_consensus.cc:2889] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:51.535439  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.487668  7468 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:51.536305  1623 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:02:51.497391  7469 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.547989  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:51.550601  1614 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:51.547024  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.553046  1619 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:51.557283  1697 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:51.560668  2271 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:51.561116  2272 raft_consensus.cc:606] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:51.561607  2272 raft_consensus.cc:614] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:51.562150  1615 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:51.557605  7262 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:51.578531  1621 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:51.586903  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:51.595127  7463 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 13:02:51.610271  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 60839us
I20260709 13:02:51.620669  1614 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:02:51.613660  1615 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:51.594651  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 73807.8us
W20260709 13:02:51.633011  1514 leader_election.cc:336] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Timed out: RequestConsensusVote RPC to 127.0.107.130:46095 timed out after 1.629s (SENT)
I20260709 13:02:51.634243  1586 leader_election.cc:400] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 12.
I20260709 13:02:51.634708  1514 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:51.634967  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:51.621426  7470 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:02:51.643966  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:51.644690  1688 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.631760  7289 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:51.650655  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 268215us
I20260709 13:02:51.653239  1586 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:51.653997  7447 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15.
I20260709 13:02:51.654175  1586 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:51.651965  1511 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:51.656782  2268 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:51.658844  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:51.662552  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:51.668294  1691 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:02:51.659520  7182 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:51.671801  7182 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.672256  7182 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:51.675112  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:51.676267  7478 log.cc:927] Time spent T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:51.671710  7168 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:51.678596  7369 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.664323  7467 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:51.679596  7467 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:51.680054  7467 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:51.682866  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.679173  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:51.685326  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:51.655544  7178 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:51.657858  7187 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:51.689531  1614 raft_consensus.cc:2368] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
I20260709 13:02:51.690500  1615 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:51.699625  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.655653  7289 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.799889  7289 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:51.805384  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 109373us
I20260709 13:02:51.805258  7343 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.812399  6745 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.812783  7369 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:51.812948  6745 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.814890  6745 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:51.818584  7477 raft_consensus.cc:3055] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:51.819048  7477 raft_consensus.cc:740] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:51.820873  7459 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:51.687680  7188 raft_consensus.cc:2764] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:02:51.822249  7468 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.661952  7282 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:51.823160  7282 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.823577  7282 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:51.828203  1588 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:51.832000  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 199087us
I20260709 13:02:51.836627  2272 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:51.839884  7182 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.842512  7459 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:51.842581  7182 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:51.846050  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.846421  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.847400  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.848124  1623 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:51.848690  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.848982  7469 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.845712  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.850441  1614 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:51.851533  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.851684  7369 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:51.852531  1615 raft_consensus.cc:2368] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15.
I20260709 13:02:51.852417  7369 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:51.854017  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:51.854840  1689 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.857267  7442 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:51.857877  7459 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:51.860028  1696 raft_consensus.cc:2410] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:51.867828  1511 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:51.871076  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c033fce18c634feb995adf2f2422308c"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:50792
I20260709 13:02:51.871840  1693 raft_consensus.cc:606] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:51.872270  1693 raft_consensus.cc:614] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:51.873946  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:02:51.874166  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 76302.8us
I20260709 13:02:51.857993  7442 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.876040  1617 raft_consensus.cc:2393] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 16: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:51.700096  7187 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.876556  1586 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:51.902562  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:51.903364  2271 raft_consensus.cc:2393] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 13: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:02:51.898774  2272 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:51.901875  1586 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:51.906729  6745 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:51.907145  6745 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.893857  1511 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:51.897152  1688 raft_consensus.cc:2468] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:51.907506  6745 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:51.908577  1511 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:51.909060  1695 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:51.875504  1689 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:51.901952  7187 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:51.913218  7311 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:51.913867  7311 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.914350  7311 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:51.875003  7469 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:51.907490  1586 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:51.820431  7487 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 13:02:51.700433  7405 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.211s
I20260709 13:02:51.923862  1542 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:51.927349  1539 raft_consensus.cc:1240] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:51.925441  2272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:51.928022  2272 raft_consensus.cc:606] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:51.797394  7453 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.119s
I20260709 13:02:51.877431  7185 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:51.892062  7369 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:51.930972  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.935387  7477 consensus_queue.cc:260] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:51.899088  7343 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:51.918874  7321 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:51.939954  1617 raft_consensus.cc:2393] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:51.926494  7168 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:51.931983  7287 consensus_queue.cc:1048] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:02:51.908123  7459 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:52.006994  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:52.070225  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.963239  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:52.063736  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 145760us
I20260709 13:02:51.937474  7490 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:51.966252  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.936757  7188 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:51.937953  7469 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:52.084853  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:52.009490  6894 consensus_meta.cc:287] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.003s
I20260709 13:02:52.058228  7453 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:52.092741  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:51.963656  7168 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.093272  6745 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.065090  7468 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:52.097604  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 189074us
I20260709 13:02:52.101734  1620 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:52.084172  7188 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:52.083303  7469 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.945884  7185 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:52.102330  7168 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:52.011691  7493 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:02:52.092984  7453 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:02:52.124028  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.129837  6745 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:52.132834  1511 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:52.111593  7188 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.113178  7469 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:52.138110  1620 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:02:52.138255  6745 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:52.110615  7498 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:52.141891  6745 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:52.150727  6745 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:52.153415  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 232196us
W20260709 13:02:52.156068  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:52.157895  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 52928.1us
I20260709 13:02:52.117901  7468 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:02:52.092012  7490 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:52.169844  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:52.158741  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 95561.8us
I20260709 13:02:52.173432  1620 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:52.174069  7442 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:52.176061  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.176802  1620 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:52.177482  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.153833  7321 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:52.179580  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.179737  1620 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:52.180583  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.181272  1616 raft_consensus.cc:2393] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:52.181555  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.181957  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.182076  1620 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:52.182833  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.183286  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.184226  7185 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:52.184383  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.184607  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.185118  1622 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:52.185603  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.185818  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.186146  1623 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:52.186314  1622 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:52.182916  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.187968  1616 raft_consensus.cc:2393] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 11: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:52.188169  7321 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.188741  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.189761  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.190384  1616 raft_consensus.cc:2393] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:52.190662  1511 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:52.187084  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.186944  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.192513  7493 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:52.193041  7493 raft_consensus.cc:697] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:52.193233  1623 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:02:52.193950  7493 consensus_queue.cc:237] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.199556  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:52.202874  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:52.203715  2263 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:52.187187  1620 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:52.214871  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.215497  1623 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:52.215696  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.216264  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.216972  1623 raft_consensus.cc:2393] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 16: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:52.217192  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet 953db44baef24f55a28e65ff051866d1 with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:46330
I20260709 13:02:52.217814  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.218186  7490 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:52.218786  7490 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:52.155946  7311 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.225497  1663 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:52.225996  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.226866  1620 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:52.227217  1623 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 18: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:52.227116  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.228322  1614 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:52.233765  6745 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:52.172806  7453 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.236047  7453 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:52.215020  7187 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.241669  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:52.244057  6745 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:52.154415  7498 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.226065  7193 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:52.232178  6894 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:52.252079  1511 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:52.252974  7289 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:52.254624  7289 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.255028  7289 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:52.255927  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.255996  7499 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:02:52.256603  1618 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.228963  7501 consensus_queue.cc:1059] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 13:02:52.270458  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 62014us
W20260709 13:02:52.270865  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 74723.2us
W20260709 13:02:52.270030  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 112650us
I20260709 13:02:52.273254  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:52.273553  1511 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:52.274554  1514 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:52.273250  1618 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:52.277612  1513 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:52.269274  7467 consensus_meta.cc:287] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.002s
I20260709 13:02:52.282286  7282 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.251638  7193 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.291254  1663 leader_election.cc:400] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16.
I20260709 13:02:52.292160  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:52.290138  7498 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:52.317209  6745 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:52.317762  6745 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:52.318200  6745 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:52.291841  7459 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.319291  1663 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:52.290974  7511 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:52.324324  1514 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:02:52.328487  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 50949us
W20260709 13:02:52.331650  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.312529  7507 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:52.325194  7498 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:52.337303  6745 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:52.302362  7467 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:52.326659  7511 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:02:52.340476  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 67009.5us
I20260709 13:02:52.341264  1663 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:52.343775  7343 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:52.343257  6745 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:52.348443  1511 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:52.338780  7163 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:52.352020  1540 raft_consensus.cc:1240] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:52.355043  1663 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:52.326771  7459 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.340853  7511 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:52.359745  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:52.361977  6745 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:52.362426  6745 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.362776  6745 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:52.347975  7311 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:52.358048  7187 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:52.348387  7507 consensus_queue.cc:1059] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:02:52.366441  7188 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.368024  7507 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.368537  7507 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:52.369148  7188 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:52.369488  1622 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:52.354595  7163 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:52.370592  1663 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:52.347189  7469 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.372133  7467 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:52.373894  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:52.370147  7188 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:52.373085  7282 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:52.371400  7459 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:52.390915  2231 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:52.385421  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61186.3us
I20260709 13:02:52.389936   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:52.358269  6918 consensus_queue.cc:1059] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:02:52.358397  7400 consensus_queue.cc:1059] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:02:52.364784  7343 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:52.402972  1663 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:52.410220  1514 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:52.419459  1514 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:52.420543  7188 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.421125  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:52.381623  7163 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:52.380833  7510 tablet_replica.cc:333] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:02:52.412043  6894 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:52.425338  1514 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:52.435322  1514 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:52.436348  6745 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.446329  6918 raft_consensus.cc:2804] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:52.447085  6918 raft_consensus.cc:697] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:52.448436  6918 consensus_queue.cc:237] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:52.456399  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 47368.8us
I20260709 13:02:52.415784  7343 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:52.417940  7282 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.363356  7518 consensus_queue.cc:1059] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:02:52.422088  7517 raft_consensus.cc:3055] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:02:52.458122  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 55213.1us
I20260709 13:02:52.463541  6745 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:52.463774  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 115401us
I20260709 13:02:52.401928  7289 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.437593  7188 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:52.441704  7467 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:52.470307  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:52.472185  1514 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:52.470717  1511 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:52.517401  6745 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:52.517360  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 45266.1us
I20260709 13:02:52.519536  1514 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:52.460462  6894 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:52.489152   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:52.529142  6745 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:52.529273  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 168692us
I20260709 13:02:52.459462  7343 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:52.532258  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 250046us
W20260709 13:02:52.494386  7506 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:02:52.494359  7495 log.cc:927] Time spent T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.317s	user 0.000s	sys 0.002s
I20260709 13:02:52.537451  1586 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:52.537308  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 66730.7us
I20260709 13:02:52.534096  2272 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:52.470654  1663 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:52.469121  7519 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:52.537936  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 125635us
I20260709 13:02:52.538952  1511 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:52.541085  1513 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:52.469964  7507 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:52.525063  7489 raft_consensus.cc:3055] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:52.488780  7469 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:52.516031  7467 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.467195  7517 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:02:52.546280  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 75707us
I20260709 13:02:52.546343  7522 raft_consensus.cc:2764] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:02:52.465111  7168 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.569024  7168 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:52.570521  1619 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 17: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:52.490990  7282 consensus_queue.cc:1059] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:02:52.571938  7469 raft_consensus.cc:3055] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:52.571980  7459 consensus_queue.cc:1059] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:52.558022  1663 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:52.574344  1663 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:52.575161  7447 raft_consensus.cc:2764] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:02:52.575992  7508 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:02:52.575913  7447 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:52.563476  7493 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:52.577700  7493 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.577945  7447 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:52.578140  7493 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:52.578652  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:52.562706  1693 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:52.563370  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:52.580011  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:52.525763  7524 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.564128  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:52.564805  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:52.585197  1695 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
W20260709 13:02:52.572474  7486 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:52.581243  1690 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:52.542703  7289 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:52.589026  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 50147.6us
I20260709 13:02:52.589720  1511 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:52.545245  7489 raft_consensus.cc:740] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:52.583389  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:52.586382  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 128399us
I20260709 13:02:52.586341  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:52.593540  1689 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 15: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:52.557869  7467 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:52.556052  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:52.592061  1690 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:52.566291  7507 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:52.581511  1663 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:52.572489  7469 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:52.672315  7469 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.673945  7469 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:52.554978  7498 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 20 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:52.677276  7505 raft_consensus.cc:3055] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:52.677723  7505 raft_consensus.cc:740] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:52.677052  7498 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.678573  7505 consensus_queue.cc:260] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:52.674117  7168 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.682032  7168 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:52.684348  7193 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:52.659286  7477 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.688884  7168 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:52.579309  7447 raft_consensus.cc:697] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:52.657876  7163 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.651222  7511 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:52.664119  1587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.129:46597 timed out after 1.511s (SENT) [suppressed 28 similar messages]
I20260709 13:02:52.664268  7517 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.666332  7535 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:52.690052  1539 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:52.690696  2263 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
W20260709 13:02:52.691233  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 109827us
I20260709 13:02:52.706418  1663 leader_election.cc:400] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
I20260709 13:02:52.706696  1663 leader_election.cc:403] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:02:52.644675  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 49321.3us
W20260709 13:02:52.645138  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 51794.2us
I20260709 13:02:52.627279  7489 consensus_queue.cc:260] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:52.708449  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 118787us
I20260709 13:02:52.712999  1511 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:52.713511  7535 raft_consensus.cc:697] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:52.713858  7400 consensus_queue.cc:1059] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:52.714596  7510 raft_consensus.cc:2243] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:52.714924  7400 raft_consensus.cc:3055] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:52.714488  7535 consensus_queue.cc:237] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.715327  7400 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:52.715720  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:52.715938  1663 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:52.710268  7507 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:52.717247  1663 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:52.717783  7519 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:52.718088  7507 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.689965  6918 consensus_queue.cc:1059] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:02:52.719008  7289 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
I20260709 13:02:52.719550  6918 raft_consensus.cc:3055] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:52.719949  6918 raft_consensus.cc:740] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:52.720189  6894 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:52.713029  7517 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:52.709128  1513 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:52.718510  1663 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:52.719766  7289 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:52.703446  7193 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:52.726733  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 170811us
I20260709 13:02:52.729220  2263 raft_consensus.cc:1240] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:52.729449  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.720960  7511 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:52.730441  6745 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:52.731019  6745 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:52.731369  6745 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:52.736737  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.715327  7510 raft_consensus.cc:2272] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:52.709028  7530 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:52.724179  7505 raft_consensus.cc:3060] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.747186  1619 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:02:52.783455  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:52.790170  1691 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:52.791316  1539 raft_consensus.cc:1240] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:52.739569  7442 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.747709  7499 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.739938  7289 raft_consensus.cc:697] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:52.749325  7178 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:52.747529  7468 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:52.804304  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:52.810674  1542 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:52.811146  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:52.809628  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:52.716377  7400 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:52.812641  1546 raft_consensus.cc:2393] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 17: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:52.813619  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:52.813609  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 149523us
W20260709 13:02:52.814429  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 87401.8us
I20260709 13:02:52.821197  1542 raft_consensus.cc:2410] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:02:52.819083  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:52.821892  1694 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:52.815457  1617 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:02:52.821197  1663 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:52.824748  1663 leader_election.cc:400] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) with higher term. Message: Invalid argument: T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15.
I20260709 13:02:52.823673  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:52.829174  1691 raft_consensus.cc:2468] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 18.
I20260709 13:02:52.829571  6745 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.830976  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.825915  1543 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:02:52.831708  1616 raft_consensus.cc:2393] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:52.829074  1663 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:52.831810  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:52.830549  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.832496  1691 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 20.
I20260709 13:02:52.832913  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.802302  7530 raft_consensus.cc:697] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:52.834404  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:52.807688  7178 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.834890  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.836287  1545 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:52.839272  1619 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:52.837873  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.838583  1623 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:52.841351  7178 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.843083  7532 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:52.843639  7532 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.845824  7532 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:52.848706  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:52.835202  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.849640  1615 raft_consensus.cc:2393] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 14: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:52.849803  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.849191  1691 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:52.825189  7468 raft_consensus.cc:697] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:52.849923  1616 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:52.804883  7533 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:02:52.833927  7193 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:52.863615  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:52.866780  1688 raft_consensus.cc:1813] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Handling vote request from an unknown peer 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:52.867336  1688 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:52.847523  6894 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:52.874099  1615 pending_rounds.cc:85] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 12
I20260709 13:02:52.874430  1615 pending_rounds.cc:107] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:02:52.874912  1615 raft_consensus.cc:2889] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:52.875288  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:52.877051  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.808157  7499 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:52.865070  7536 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:02:52.870204  7527 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.881273  1688 raft_consensus.cc:1240] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:02:52.883860  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:52.884757  1693 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:02:52.835987  7467 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.888239  1691 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:02:52.885960  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.889041  1623 raft_consensus.cc:2393] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 15: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:52.866654  7193 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.870987  6894 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.850651  7442 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:02:52.897398  1618 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:02:52.897780  1618 pending_rounds.cc:85] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 13
I20260709 13:02:52.898041  1618 pending_rounds.cc:107] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:02:52.879096  6745 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:52.898274  1618 raft_consensus.cc:2889] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:52.820699  7447 consensus_queue.cc:237] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.894131  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:52.894917  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:52.900612  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:52.904434  7103 consensus_queue.cc:1059] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
W20260709 13:02:52.907668  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.907871  7361 raft_consensus.cc:3055] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:52.908273  7361 raft_consensus.cc:740] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:52.894029  7527 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:52.914165  7527 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:52.891800  7163 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:52.919855  7532 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:52.920665  7532 consensus_queue.cc:1243] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer 27308aae2ef347ccba1b27e7f6f04334 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:52.877614  7289 consensus_queue.cc:237] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.921154  7532 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:52.921528  7532 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:52.924371  1586 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:52.924589  7343 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.925632  1586 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:52.902869  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:52.927680  1617 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:52.933645  1693 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:02:52.933863  7532 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.933761  7321 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:52.934944  7343 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:52.935148  7532 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:52.938125  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:52.939214  7182 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:52.940061  7168 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:52.940178  7468 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:52.941876  7168 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.909420  7361 consensus_queue.cc:260] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:52.944414  7361 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.946205  1586 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:52.947499  7453 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:52.947599  7499 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:52.903463  7530 consensus_queue.cc:237] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.877871  7490 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:52.887053  7522 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.949605  7453 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:52.949596  7522 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:52.950763  1586 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:52.953092  1695 raft_consensus.cc:1240] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:52.953764  1694 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:52.960412  1619 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:52.896458  7193 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:52.899478  6894 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:52.964463  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:52.989501  1616 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:52.972293  7527 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:52.968046  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:53.004545  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:53.004382  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:53.006150  1694 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 17: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:53.008008  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:53.013028  1586 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:53.016960  1586 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:53.002838  7499 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:53.017808  7499 raft_consensus.cc:2804] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:53.018031  1586 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:02:53.018668  1586 raft_consensus.cc:2686] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:53.012545  7493 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.021551  7493 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:53.012555  7453 consensus_queue.cc:1059] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:02:53.012852  1621 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:53.019250  1586 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:53.056463  2234 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:02:53.054253  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 51021.4us
I20260709 13:02:53.063448  1623 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:53.074730  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:53.075949  1690 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 16: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:53.079394  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:53.082356  2263 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:53.047349  7459 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:53.096190  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:53.096784  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:53.099545  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 80358.9us
W20260709 13:02:53.107973  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.111891  2263 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:53.114643  1513 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:53.119976  1586 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:53.122228  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.092811  7458 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:53.133553  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:53.132048  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:53.135275  1690 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:53.132570  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.101670  7459 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.138650  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:53.127518  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 126315us
I20260709 13:02:53.127072  7468 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:53.150496  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:53.151306  1696 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:53.128222  7499 raft_consensus.cc:697] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:53.153367  7499 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:53.153935  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.154621  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.156677  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.157254  7468 raft_consensus.cc:697] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:53.157428  1546 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:53.158279  7468 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:53.158906  7545 log.cc:927] Time spent T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:02:53.159823  7541 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:02:53.159987  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:53.136922  7453 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:53.160681  1693 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:53.168402  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:53.176270  7467 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:53.183911  7543 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:02:53.146421  7459 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:53.190851  7558 raft_consensus.cc:2804] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:53.193490  7453 raft_consensus.cc:697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:53.194862  7453 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:53.134007  7458 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.224893  1548 raft_consensus.cc:1240] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:53.225149  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.227092  1540 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:53.229162  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.229895  1546 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:02:53.228087  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 82254.9us
W20260709 13:02:53.230875  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.252717  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:53.231119  7458 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.267477  1696 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:53.235064  7343 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:53.270714  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:53.285580  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.271029  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:53.271684  7522 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:53.244561  6968 consensus_queue.cc:1059] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:02:53.272460  1693 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:53.272609  7343 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.242667  7558 raft_consensus.cc:697] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:53.298667  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.303712  1540 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 17: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:53.270861  7510 ts_tablet_manager.cc:1916] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:53.312330  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.302768  7522 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:53.364784  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 108678us
I20260709 13:02:53.330646  7555 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:53.372800  7522 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.364269  7557 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:53.417455  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.442112  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.444911  1544 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:53.466405  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.467384  1540 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:53.466411  1546 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
W20260709 13:02:53.457773  7517 consensus_meta.cc:287] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.733s	user 0.012s	sys 0.000s
I20260709 13:02:53.469317  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.475126  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.477032  7343 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:53.470018  1544 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:53.471585  1541 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:53.459229  7532 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.524s	user 0.013s	sys 0.000s
I20260709 13:02:53.479444  1543 raft_consensus.cc:2410] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:02:53.459404  7361 consensus_meta.cc:287] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.003s
W20260709 13:02:53.460325  7178 consensus_meta.cc:287] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.618s	user 0.005s	sys 0.009s
I20260709 13:02:53.489279  7178 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:53.491652  1542 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:53.484447  7193 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:53.495630  1696 raft_consensus.cc:2368] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15.
I20260709 13:02:53.460578  6894 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:53.500046  6894 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:53.500505  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.473650  1547 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:53.501639  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70c773fba6b40bfad053ffbcc4b9d86" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.502044  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.502688  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.502918  1547 raft_consensus.cc:2368] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
I20260709 13:02:53.503388  1544 raft_consensus.cc:2368] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:53.504886  7178 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:53.505070  7525 raft_consensus.cc:993] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:02:53.511868  7525 raft_consensus.cc:1081] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:02:53.503950  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.505992  1692 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:02:53.504025  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.512796  1542 raft_consensus.cc:3060] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:53.513906  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:53.514381  7568 log.cc:927] Time spent T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:53.514503  1540 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:53.504305  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.503741  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.449045  7530 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:53.516414  1541 raft_consensus.cc:2393] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 17: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:53.516616  7530 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.517223  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.515347  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.518507  1541 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:53.508653  1539 raft_consensus.cc:2410] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:02:53.509032  7569 log.cc:927] Time spent T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:02:53.509634  7564 log.cc:927] Time spent T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:02:53.510208  7522 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:53.443125  7557 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.520505  1616 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:02:53.510353  7570 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:02:53.515926  1546 raft_consensus.cc:2410] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:02:53.508772  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.449636  7558 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:53.458441  7505 consensus_meta.cc:287] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.676s	user 0.016s	sys 0.003s
W20260709 13:02:53.533474  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.557605  1548 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:53.558709  1696 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:53.563508  1690 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:53.571229  7567 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.574204  1620 raft_consensus.cc:1275] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:53.578778  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.581260  1547 raft_consensus.cc:2368] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:53.526528  7400 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:53.591804  7459 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:53.572134  7567 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:53.602110  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.605845  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.596737  1548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:53718
W20260709 13:02:53.637279  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.603508  7459 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 21 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:53.625581  2268 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:02:53.654946  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:53.658111  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.662586  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.663520  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:53.664152  1690 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 17: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:53.666260  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:53.668401  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.669188  1540 raft_consensus.cc:2410] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:02:53.669943  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.670553  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:53.670859  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.671693  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.672112  1696 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:53.672691  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.673059  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:53.673252  1546 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:53.673992  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.663479  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.676836  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.674029  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:53.677898  1695 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:02:53.676853  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.678429  1690 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:53.677351  1540 raft_consensus.cc:2368] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:53.691927  1542 raft_consensus.cc:2468] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
W20260709 13:02:53.694867  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.695801  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:53.695900  1511 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:53.696998  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:53.697508  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.681672  7567 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:53.684722  1541 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:53.678388  7530 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:53.687558  7557 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:53.687837  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:53.690230  7193 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:53.698186  1542 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:02:53.700683  1511 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:53.703573  1543 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:53.706051  2232 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:53.712231  1548 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:53.712471  1511 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:53.713486  1548 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:53.713904  1661 leader_election.cc:400] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:53.714298  1661 leader_election.cc:403] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:02:53.725075  1661 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:53.698904  7178 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:53.729708  1511 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:53.707442  7483 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:53.704888  7518 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:53.738381  1695 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:53.738690  1511 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:53.746544  1511 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:53.723026  7467 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:53.748972  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.717403  7369 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:02:53.730454  7193 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:53.731931  7507 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:53.769824  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.769326  1548 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.787475  1697 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 16. Current term is 17. Ops: []
W20260709 13:02:53.793395  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 47274.6us
I20260709 13:02:53.723448  7361 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:02:53.741670  7483 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.794751  1511 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:53.748167  7185 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:53.797254  1511 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:53.799731  7518 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.800128  7483 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:53.787622  7458 consensus_meta.cc:287] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.001s
I20260709 13:02:53.795077  7530 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:53.735188  7405 consensus_queue.cc:1059] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:02:53.751335  7289 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:53.817595  6918 consensus_queue.cc:260] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.820010  7467 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:53.821275  1514 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:53.826320  1511 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:53.827530  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 102572us
I20260709 13:02:53.839382  1661 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:53.825537  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 117147us
I20260709 13:02:53.795054  7178 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.843634  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:53.845279  1587 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:53.826253  7471 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:53.850244  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:53.823225  7517 consensus_queue.cc:1059] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:02:53.852651  2271 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:53.835922  7405 consensus_queue.cc:1243] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:53.856459  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:53.843572  7518 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:53.863444  7178 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:53.865514  7289 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:53.865609  7178 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:53.870575  1511 leader_election.cc:400] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15.
I20260709 13:02:53.870957  1511 leader_election.cc:403] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:02:53.847644  7560 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:53.874605  1695 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:53.832136  7458 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.847455  7469 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:53.869771  7467 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.891125  7467 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:53.891629  7489 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:53.893250  7467 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:53.893427  7163 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:53.880164  7518 raft_consensus.cc:697] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:53.894016  7163 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.895001  7518 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:53.896158  7163 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:53.897862  7507 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:53.898033  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:53.898442  7458 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:53.898977  2271 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:53.874331  7182 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:53.888408  7505 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.900957  7505 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.902463  7289 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:53.903082  2269 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:53.903434  7289 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:53.876991  7560 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.906138  7529 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.906605  7529 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.889750  7471 consensus_queue.cc:1059] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:53.890441  7469 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:53.910434  7469 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:53.904325  7289 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.912031  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 2321) took 1031 ms. Trace:
I20260709 13:02:53.912448  1692 rpcz_store.cc:276] 0709 13:02:52.881037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.881148 (+   111us) service_pool.cc:224] Handling call
0709 13:02:52.881430 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.512761 (+631331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.911803 (+399042us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54000e88d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:53.911973 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435480320}
I20260709 13:02:53.918839  7467 raft_consensus.cc:3055] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:53.919910  7229 consensus_queue.cc:1048] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:53.920827  2263 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:53.922345  7483 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:53.924790  7483 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:53.926424  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 55988.6us
I20260709 13:02:53.928952  1511 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:53.933830  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:53.934592  1693 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:53.935297  7517 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:53.944061  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 98891.4us
I20260709 13:02:53.945470  1587 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:53.947149  1693 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 21.
I20260709 13:02:53.951848  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:53.952840  1620 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.957284  1587 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:53.879065  1695 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:53.968601  1695 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:02:53.959465  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:53.969388  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:53.973338  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 133242us
I20260709 13:02:53.974103  1514 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:53.940052  7289 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:53.926167  7467 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:53.978672  1587 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:53.963310  7535 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:53.964238  7532 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:53.963124  7459 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:53.988572  7467 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.003103  7467 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:54.004052  7560 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:54.004906  7593 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:53.965931  7468 consensus_queue.cc:1059] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:02:53.981132  7505 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:53.996312  7289 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.975317  7559 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:53.998526  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:54.021463  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:54.013209  1587 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:54.007622  7289 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.033241  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:53.997085  7555 consensus_queue.cc:1059] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 13:02:54.034710  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 60700.3us
W20260709 13:02:54.042150  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.042932  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.007894  7591 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:02:54.030830  7459 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:54.051301  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 54684.2us
I20260709 13:02:54.018318  7182 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
W20260709 13:02:54.053790  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 74353.8us
I20260709 13:02:54.036736  7469 raft_consensus.cc:3055] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:54.019999  7532 consensus_queue.cc:1059] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:02:54.063968  1548 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:54.068594  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 85557.4us
I20260709 13:02:54.057462  1661 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:54.074446  7469 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:54.075588  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:54.075457  7469 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.076840  7469 raft_consensus.cc:3060] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:54.079977  7588 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:54.080879  7588 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:54.061266  7289 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:54.072057  2272 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:02:54.033456  7592 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:54.085934  1662 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:54.076763  1661 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:54.033381  7468 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:02:54.094901  1692 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:54.095996  1694 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 20. Current term is 21. Ops: []
W20260709 13:02:54.096310  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 45497.4us
I20260709 13:02:54.112100  1587 leader_election.cc:304] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:54.112510  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:54.097898  1695 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:54.118184  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:54.097899  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:54.100374  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 43684.5us
I20260709 13:02:54.033110  7559 consensus_queue.cc:1059] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:02:54.127596  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 59201us
I20260709 13:02:54.128566  1662 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:54.123669  1661 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:54.115067  1587 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:54.120532  1586 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:54.136575  1661 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:54.150013  1661 leader_election.cc:400] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:54.150946  7602 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:54.130923  7593 raft_consensus.cc:2749] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:54.152933  7559 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:54.131618  7405 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:54.155465  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:54.156060  7193 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:54.156308  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 2322) took 1274 ms. Trace:
I20260709 13:02:54.160322  7178 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:54.161283  7603 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.161564  7529 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:54.145390  7343 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:54.146569  6894 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:54.113529  7182 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:02:54.164614  6918 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.137398  7588 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:54.126384  7289 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:54.105082  7321 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:02:54.173498  1661 leader_election.cc:403] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:54.221834  1693 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:54.222362  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 72550.8us
W20260709 13:02:54.173834  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 53377.6us
I20260709 13:02:54.057260  7557 consensus_queue.cc:1059] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
W20260709 13:02:54.175789  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 60821us
I20260709 13:02:54.186000  1697 rpcz_store.cc:276] 0709 13:02:52.881803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.881915 (+   112us) service_pool.cc:224] Handling call
0709 13:02:52.882517 (+   602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.794057 (+911540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.156054 (+361997us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54001b8d54. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:54.156239 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2080509824}
I20260709 13:02:54.189771  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:53.572388   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:54.191283  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:54.192430  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:54.227169  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:54.147697  7592 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:54.216467  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:54.217046  1544 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:02:54.220641  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:54.230224  1543 raft_consensus.cc:2368] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
I20260709 13:02:54.220858  1541 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:02:54.219017  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 45547.9us
I20260709 13:02:54.221078  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:54.231861  1545 raft_consensus.cc:2393] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:54.185429  7168 raft_consensus.cc:3055] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:54.223277  1661 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:54.220649  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:54.238446  1691 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:54.204694  7343 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:54.235009  1548 raft_consensus.cc:2393] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 14: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:54.227138  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:54.239979  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:54.244102  2272 raft_consensus.cc:3055] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:54.245474  2272 raft_consensus.cc:740] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:54.219266  7588 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:54.254932  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:54.255228  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:54.255661  1619 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:02:54.256072  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:54.256860  1614 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:54.258263  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:54.260449  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:54.254032  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:54.267299  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:54.269145  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:54.229622  7369 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 16. Current term is 17.
I20260709 13:02:54.214509  7510 ts_tablet_manager.cc:1929] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 13:02:54.236349  7168 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:54.262784  7522 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:54.299897  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:54.280553  1617 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:54.264344  2272 consensus_queue.cc:260] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:54.273518  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:54.304752  1619 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:02:54.294760  1622 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:54.243664  7405 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:54.305588  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 80116.1us
I20260709 13:02:54.305989  7405 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.250182  7343 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:54.297155  1548 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:02:54.298295  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.299434  1620 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:54.304862  2272 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:54.294384  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:54.244962  7289 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.213251  7603 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.262856  7588 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:54.241084  7467 consensus_queue.cc:1059] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:02:54.240815  6894 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:02:54.320155  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:54.321692  1614 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:54.302007  7608 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:54.325935  1691 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:54.263043  7559 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:02:54.244102  7599 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:02:54.308526  7522 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:54.308465  7582 raft_consensus.cc:3055] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:54.336817  7582 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:54.337839  7522 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:54.337769  7582 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.338918  7582 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:54.318703  7182 raft_consensus.cc:2764] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:02:54.340232  7603 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:54.322273  7510 log.cc:1199] T 953db44baef24f55a28e65ff051866d1 P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/953db44baef24f55a28e65ff051866d1
I20260709 13:02:54.317421  7405 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:54.353766  1614 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:54.357568  2272 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:54.360443  7510 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46330 (request call id 0) took 2143 ms. Trace:
I20260709 13:02:54.360963  7510 rpcz_store.cc:276] 0709 13:02:52.216642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.216881 (+   239us) service_pool.cc:224] Handling call
0709 13:02:52.348086 (+131205us) ts_tablet_manager.cc:1151] Deleting tablet 953db44baef24f55a28e65ff051866d1
0709 13:02:52.358062 (+  9976us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:53.902026 (+1543964us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:54.189008 (+286982us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:54.360347 (+171339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":250706,"tablet-delete.queue_time_us":119260,"thread_start_us":83577,"threads_started":1}
I20260709 13:02:54.331276  7608 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:54.368558  1615 raft_consensus.cc:1240] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:54.308583  7607 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:02:54.332870  7321 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:02:54.377503  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:54.378433  1615 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:54.329670  7289 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.363317  6894 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.375968  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:54.390642  1617 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
W20260709 13:02:54.382212  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 75682.7us
I20260709 13:02:54.396832  1586 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:02:54.398196  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 182591us
I20260709 13:02:54.402580  1661 leader_election.cc:400] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
I20260709 13:02:54.406076  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:54.406864  1548 raft_consensus.cc:2393] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:54.420842  1690 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:54.423641  1615 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:54.391672  7614 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:54.355182  7592 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.396492  7616 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:02:54.433964  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.399068  7517 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15.
I20260709 13:02:54.432619  1540 raft_consensus.cc:1240] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:02:54.438409  1615 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:54.453833  1514 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:54.460899  1514 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:54.430967  7469 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.469295  1514 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:54.395263  6894 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.476634  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:54.477376  1617 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:54.485565  1542 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:54.491279  1514 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:54.369951  7168 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:02:54.426393  7193 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:02:54.470870  7518 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:54.479099  7599 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:54.508831  1663 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:54.511595  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 87397us
I20260709 13:02:54.471468  7618 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:54.439949  7614 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:54.529336  1514 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:54.476114  7469 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.508155  7602 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 21 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:54.537240  7289 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:54.537070  7602 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.538962  7289 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:54.539727  7611 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:02:54.539875  7621 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:02:54.540709  7497 raft_consensus.cc:3055] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:54.541208  7497 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:54.542204  7497 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.545493  7607 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:54.546008  7607 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.546407  7607 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:54.548629  6894 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:54.550858  7178 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:54.551347  7178 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:54.551800  7178 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:54.558344  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.561120  7612 log.cc:927] Time spent T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:02:54.513919  7610 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:54.468015  7616 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:54.584301  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 88469.1us
I20260709 13:02:54.591809  1587 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:54.593269  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 71415.8us
I20260709 13:02:54.559192  7497 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:54.467875  7608 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:54.588876  7593 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:54.604112  7613 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:54.601047  1514 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:54.597333  7559 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:54.613359  1621 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:54.606168  7610 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:02:54.610010  7467 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:54.623867  7599 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:02:54.633425  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:54.639513  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.627355  7616 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:54.602392  7618 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:02:54.655963  7599 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:54.656658  7599 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.659329  7599 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:54.639492  7467 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.658875  7607 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.688206  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:54.692574  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:54.699470  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:54.701052  1540 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:54.608261  7593 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:54.630110  7405 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.690851  7467 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:54.708803  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 200031us
I20260709 13:02:54.709852  1663 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:54.712164  1614 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 21 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:54.718379  1663 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:54.727084  7614 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:54.728379  7593 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:54.734627  1663 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:54.720650  7633 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:54.736160  1663 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:54.738539  7193 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:54.730320  7469 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:54.744486  7607 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:54.737322  7631 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:54.751551  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.749099  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:54.752197  1618 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:54.739140  7193 raft_consensus.cc:697] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:54.750924  1540 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:02:54.755203  2232 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:54.756060  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:54.756449  6918 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:54.757041  1547 raft_consensus.cc:2410] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:54.753455  7178 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.758081  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:54.759683  1547 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:54.760185  1588 consensus_peers.cc:597] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8820554e3d9a4662b150408d84019889. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.760701  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 363450us
I20260709 13:02:54.721616  7163 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:02:54.769093  1547 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 16.
I20260709 13:02:54.770165  1616 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:54.771981  7582 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.771951  7193 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.772791  7582 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.774339  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:54.770455  2232 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:54.774945  1617 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:54.776646  6968 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:54.777217  6968 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:54.778112  6968 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:54.775051  7582 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:54.780715  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.748690  7639 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:02:54.782370  7606 log.cc:927] Time spent T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.602s	user 0.000s	sys 0.002s
I20260709 13:02:54.771852  7588 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:54.736183  7645 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:54.783970  7645 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.784389  7645 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:54.793022  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:54.793645  1689 raft_consensus.cc:1240] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:02:54.793741  1540 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:54.796074  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:54.765153  7343 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:54.797269  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:54.797791  1617 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 18.
I20260709 13:02:54.797897  1618 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:02:54.799474  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:54.801926  1691 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:54.757041  6918 raft_consensus.cc:697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:54.804216  6918 consensus_queue.cc:237] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:54.796566  7588 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:54.785388  7593 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:54.812759  7593 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.814155  7467 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.814776  7593 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:54.806061  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:54.815809  1692 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:54.820497  7507 raft_consensus.cc:3055] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:54.806453  1587 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:54.807567  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:54.800854  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:54.812203  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:54.768354  7178 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:54.823282  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:54.823673  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:54.823879  1540 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 14.
I20260709 13:02:54.825208  1690 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:54.833135  7602 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:54.833763  7602 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:54.834300  7602 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:54.836057  1689 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:54.839704  7405 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:54.847770  1690 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:54.848503  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:54.849511  1694 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:02:54.853829  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:54.854749  1618 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:54.867053  1546 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 18.
I20260709 13:02:54.869735  7168 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:54.869834  7343 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:54.854008  7622 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:54.875545  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:54.828866  7507 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:54.880089  7616 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:54.881151  7605 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.697s	user 0.000s	sys 0.001s
I20260709 13:02:54.881793  7616 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:54.889289  7608 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:54.897049  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:54.897765  1696 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:54.899860  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:54.900934  1690 raft_consensus.cc:2393] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:54.867655  1618 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:54.918458  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:54.919559  1540 raft_consensus.cc:2393] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:54.923707  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:54.924489  1547 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:54.907922  7616 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:54.938278  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:54.939546  1540 raft_consensus.cc:2410] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:02:54.947187  1589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.929553  7616 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:54.949755  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:54.949939  1547 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:54.954401  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:54.955163  1540 raft_consensus.cc:2410] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:54.954696  7602 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:54.959322  7602 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:54.952476  7616 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:54.967269  7646 log.cc:927] Time spent T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:02:54.974227  1544 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
W20260709 13:02:54.974670  7650 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:54.974709  1544 pending_rounds.cc:85] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 8
I20260709 13:02:54.975857  1544 pending_rounds.cc:107] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:02:54.976032  1662 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:54.976155  1544 raft_consensus.cc:2889] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:54.984937  7505 raft_consensus.cc:3055] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:54.985409  7505 raft_consensus.cc:740] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:54.986626  7530 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.986311  7505 consensus_queue.cc:260] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.987914  2232 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:54.988519  7442 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:54.987145  7530 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.989107  7645 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:54.991302  7530 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:54.992015  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:54.999076  1548 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 13:02:55.014616  1548 pending_rounds.cc:85] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 7
I20260709 13:02:55.014886  1548 pending_rounds.cc:107] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:02:54.998212  7645 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:55.015288  1548 raft_consensus.cc:2889] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:55.016961  1548 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:55.018190  1548 raft_consensus.cc:1240] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:55.023984  1540 raft_consensus.cc:1240] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:55.024370  1513 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:55.024001  1547 raft_consensus.cc:1240] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:54.995080  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:55.038866  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:55.036168  2271 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
W20260709 13:02:55.004438  7594 log.cc:927] Time spent T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.873s	user 0.004s	sys 0.000s
I20260709 13:02:55.044328  7607 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:55.054154  7607 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:54.991750  6968 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:54.994642  7505 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.098400  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:55.012454  7567 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.114491  1694 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:02:55.114708  7616 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.114952  7567 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.115701  1542 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:55.117137  7567 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:55.117660  1542 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:02:55.055246  7607 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.118791  1542 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:02:55.099152  6968 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.121050  6968 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:55.123540  7636 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:55.124202  7532 raft_consensus.cc:3055] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:55.124063  7636 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.124576  7532 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:55.125401  7532 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.126305  7532 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:55.128481  7636 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:54.504184  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet 953db44baef24f55a28e65ff051866d1 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
W20260709 13:02:55.131815  1433 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 668662us
I20260709 13:02:55.132835  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:55.139966  1662 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:55.141978  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:55.133927  7618 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:55.142581  1544 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 10.
I20260709 13:02:55.145658  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:55.147782  1694 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 9.
I20260709 13:02:55.151297  2232 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:55.156509  2269 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:55.159299  1544 raft_consensus.cc:1240] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:02:55.159664  1545 raft_consensus.cc:1240] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:55.158236  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:55.161455  2268 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:02:55.167917  1662 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:55.146054  7193 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:55.146138  7533 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:55.176669  1662 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:55.168355  7229 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:55.173175  7535 raft_consensus.cc:3055] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:55.173077  7442 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:55.173467  7193 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:55.180757  7229 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.180588  7645 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:55.207278  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.183033  7535 raft_consensus.cc:740] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:55.178143  7533 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.185257  7193 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.188459  7442 raft_consensus.cc:697] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:55.236990  7442 consensus_queue.cc:237] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.237691  1618 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:55.202193  7229 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.243814  7602 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.259136  7602 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.201503  7645 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:55.260036  7663 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:02:55.248924  7321 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.279902  7321 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.282384  7321 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:55.264008  7645 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.295913  1514 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:55.298053  1514 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:55.309337  7591 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:55.311074  1514 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:55.323323  7615 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:55.331261  7591 raft_consensus.cc:697] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 18 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:55.309332  7185 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:02:55.331501  7468 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:55.370430  6968 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.373226  2263 raft_consensus.cc:2368] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15.
I20260709 13:02:55.374069  7507 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.375701  6968 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:55.376775  7636 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:55.377359  7636 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.379485  1662 leader_election.cc:400] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15.
I20260709 13:02:55.379904  1662 leader_election.cc:403] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:02:55.308568  7535 consensus_queue.cc:260] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.391911  7343 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:55.394490  7591 consensus_queue.cc:237] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.396340  7533 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:55.401660  7616 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:55.375223  7507 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:55.411760  7602 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:55.380975  7468 raft_consensus.cc:697] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:55.415102  7468 consensus_queue.cc:237] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.391115  7532 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.418653  7532 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.421015  7532 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:55.406755  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 2359) took 1207 ms. Trace:
I20260709 13:02:55.427573  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:55.429018  1697 raft_consensus.cc:1240] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:02:55.427085  1695 rpcz_store.cc:276] 0709 13:02:54.199605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.199761 (+   156us) service_pool.cc:224] Handling call
0709 13:02:54.200132 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.242508 (+ 42376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.242556 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.250826 (+  8270us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.494695 (+243869us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:54.592059 (+ 97364us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.592840 (+   781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.406339 (+813499us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b54001289d4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:55.406388 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.406446 (+    58us) raft_consensus.cc:1685] finished
0709 13:02:55.406544 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.406693 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11542,"prepare.queue_time_us":26136,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":14371,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":15838,"spinlock_wait_cycles":69878144,"thread_start_us":261661,"threads_started":2,"wal-append.queue_time_us":318856}
I20260709 13:02:55.429665  7321 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:55.430537  7602 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:55.429939  7618 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:55.437904  7343 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15.
I20260709 13:02:55.442821  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:55.440450  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:55.445713  1623 raft_consensus.cc:1240] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 17. Current term is 18. Ops: [16.10-17.11]
I20260709 13:02:55.446568  1618 raft_consensus.cc:1240] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:02:55.447988  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:55.448838  1614 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:55.441305  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:55.445501  1615 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:02:55.454200  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:55.454928  1688 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:55.461376  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.466835  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:55.442392  7163 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.469784  7163 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.474138  7163 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:55.474736  7163 consensus_queue.cc:1059] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:55.483875  1693 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:55.484655  1614 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:55.495898  7505 consensus_queue.cc:1059] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:55.503926  1587 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:55.504189  1688 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:55.507954  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:55.510289  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:55.511185  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:55.513504  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:55.517117  1539 raft_consensus.cc:2393] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 14: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:55.500087  7343 raft_consensus.cc:3055] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:55.539575  7343 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:55.540422  7343 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.541159  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:55.505609  7616 consensus_queue.cc:1059] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:02:55.519172  7442 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:55.515128  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:55.535882  7636 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:55.536327  1541 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 10. (term mismatch)
I20260709 13:02:55.552834  1541 pending_rounds.cc:85] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 9
I20260709 13:02:55.553140  1541 pending_rounds.cc:107] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 13:02:55.553406  1541 raft_consensus.cc:2889] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:55.538116  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:55.538292  7193 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.504585  7497 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.538955  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:55.557838  1539 raft_consensus.cc:2393] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 10: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:55.506971  7507 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.558768  7507 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.561265  7507 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:55.513801  7505 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:55.562817  7505 raft_consensus.cc:697] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:55.562697  7497 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.564898  7497 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:55.543977  7442 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:55.573843  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 263028us
I20260709 13:02:55.565877  1542 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
W20260709 13:02:55.584100  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 69665.3us
W20260709 13:02:55.589663  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.544382  7321 raft_consensus.cc:493] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:55.596181  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.596722  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 305369us
I20260709 13:02:55.589270  7615 raft_consensus.cc:697] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:55.603489  1511 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:55.572621  7645 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.565274  7505 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.589597  7229 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.617496  7507 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:55.618764  7603 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:55.621212  1661 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:55.627789  1661 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:55.596915  7321 raft_consensus.cc:515] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.640811  7442 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:55.640970  7229 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:55.641515  7442 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:55.628362  7636 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:55.627959  7558 raft_consensus.cc:3055] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:55.655818  7558 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:55.656682  7558 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.658030  7558 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:55.655843  7622 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.660326  7622 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:02:55.662457  7622 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:55.642894  7442 consensus_queue.cc:1059] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:55.648654  7193 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:55.643911  7636 raft_consensus.cc:697] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
W20260709 13:02:55.667264  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.669363  7591 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:55.670118  7591 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.670324  7321 leader_election.cc:290] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:55.670640  7591 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:55.665132  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 191833us
W20260709 13:02:55.651212  7661 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.536s	user 0.003s	sys 0.005s
I20260709 13:02:55.676507  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:55.678105  1663 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:55.730986  7645 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:55.737106  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:55.737597  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:55.738054  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:55.738643  1614 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:02:55.739495  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:55.740790  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:55.741362  1543 raft_consensus.cc:3060] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:55.741590  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:55.742166  1617 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
W20260709 13:02:55.745066  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 135949us
I20260709 13:02:55.745672  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:55.746991  1546 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:55.747329  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:55.717181  7193 consensus_queue.cc:1059] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:02:55.746112  1511 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:55.752177  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:55.754711  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:55.755398  2268 raft_consensus.cc:2368] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:55.756842  7193 raft_consensus.cc:3055] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:55.757232  7193 raft_consensus.cc:740] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:55.757476  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:55.758162  1691 raft_consensus.cc:2393] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:55.758001  7193 consensus_queue.cc:260] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.759164  7193 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:55.760005  1539 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:55.760365  7676 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:55.760736  7676 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.761046  7676 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:55.763495  7677 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.764017  7677 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.766016  7677 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:55.769505  7591 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:55.770578  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:55.748688  7684 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:55.771225  2263 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:55.772789  1513 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:55.773705  1662 leader_election.cc:400] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:55.774039  1662 leader_election.cc:403] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:55.703722  7615 consensus_queue.cc:237] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.778034  7163 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.733115  7636 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.778119  1548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3226) took 1301 ms. Trace:
I20260709 13:02:55.791471  1548 rpcz_store.cc:276] 0709 13:02:54.477892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.035278 (+557386us) service_pool.cc:224] Handling call
0709 13:02:55.035752 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.045500 (+  9748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.045533 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.411071 (+365538us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b2c000e1a38. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:02:55.411485 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.698815 (+287330us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:55.717810 (+ 18995us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.777753 (+ 59943us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b54000d96a0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6aab9733 00007f5c6ab3edbf 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c
0709 13:02:55.777808 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.777888 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.777929 (+    41us) raft_consensus.cc:1685] finished
0709 13:02:55.777941 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.778063 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9315,"prepare.queue_time_us":19044,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1352,"raft.queue_time_us":10847,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6246,"spinlock_wait_cycles":27098112,"thread_start_us":286918,"threads_started":1,"wal-append.queue_time_us":290354}
I20260709 13:02:55.772930  7684 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:55.779091  7662 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.667s	user 0.003s	sys 0.000s
I20260709 13:02:55.795869  7684 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:55.741823  7602 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:55.782734  2271 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:55.796981  7602 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.797783  1662 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:55.802433  7467 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:55.799074  7602 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:55.772491  7229 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:55.808959  7163 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:55.809258  7558 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:55.812072  7193 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.814914  1623 raft_consensus.cc:1240] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:55.835932  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 63219us
I20260709 13:02:55.812071  1440 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.840651  7526 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:55.842144  7483 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:55.833493  7229 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.845125  7229 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:55.845558  7163 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:55.832916  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:55.834544  1619 raft_consensus.cc:1240] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:55.851862  1544 raft_consensus.cc:3060] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.777503  1543 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:02:55.847298  7163 raft_consensus.cc:697] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:55.855188  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:55.836805  7558 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.861526  7684 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.864871  1619 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:02:55.867928  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:55.881779  1619 pending_rounds.cc:85] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 13
I20260709 13:02:55.882125  1619 pending_rounds.cc:107] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:02:55.882376  1619 raft_consensus.cc:2889] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:55.876344  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 130333us
I20260709 13:02:55.900559  1511 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:55.878811  1544 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
W20260709 13:02:55.880752  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 165420us
I20260709 13:02:55.902828  1663 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:55.879279  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 248226us
I20260709 13:02:55.851261  7468 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:55.905463  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:55.906951  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:55.910517  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:55.918375  1622 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:55.874539  7675 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.921130  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:55.952634  7535 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.953033  7558 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:55.881191  7672 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:55.955060  7163 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.956971  7587 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:55.957456  7587 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:55.960216  7684 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:55.961587  7675 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.969973  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:55.878450  7321 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:02:55.969446  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 68945.9us
I20260709 13:02:55.974486  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:55.899112  7635 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:55.987730  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:55.911136  7468 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.989377  7587 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:55.990638  1622 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:55.900121  7193 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:55.997610  7321 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:55.998493  7681 log.cc:927] Time spent T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:02:55.924576  7631 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:55.968391  7645 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:55.996376  7468 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:55.913959  7497 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:02:55.973439  7558 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:56.012329  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 214623us
I20260709 13:02:56.014271  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:56.015786  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:56.017941  1691 raft_consensus.cc:2468] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 11.
I20260709 13:02:56.017690  1689 raft_consensus.cc:2468] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:02:56.023217  1586 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:56.029922  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 47559.7us
W20260709 13:02:56.031709  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 191683us
I20260709 13:02:56.034592  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:56.016662  7607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.002s	sys 0.011s
I20260709 13:02:56.039361  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:56.011086  7645 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:56.012802  7688 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:56.066141  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:02:56.069904  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.074043  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:56.074846  1694 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:56.075930  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:56.077769  1691 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:56.082588  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:56.083335  1689 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:56.038496  7168 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:56.041589  7636 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:56.026049  7558 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:56.040820  7607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.002s	sys 0.011s
I20260709 13:02:56.006697  7635 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:56.105772  7635 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:56.096884  1693 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:02:56.044173  7645 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:56.116999  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:56.117779  1694 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:02:56.118722  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:56.119688  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:56.119885  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:56.120390  1543 raft_consensus.cc:2393] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:56.121240  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:56.121474  1548 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:56.121948  1541 raft_consensus.cc:2368] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
I20260709 13:02:56.122730  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:56.123224  1542 raft_consensus.cc:2376] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15. Re-sending same reply.
I20260709 13:02:56.123675  7672 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.124204  7672 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:56.125078  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:56.125320  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:56.125650  1697 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:56.126158  7672 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:56.126283  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:56.126642  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5c9f43dc704dd09f6c603fa4ea346c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:56.127647  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:56.128018  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:56.128536  1694 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:56.130484  7193 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:56.118741  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:56.132133  1692 raft_consensus.cc:2393] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 18: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:56.132479  7193 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:56.132791  1587 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:56.133042  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:56.123715  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:56.102253  7558 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:56.102632  7343 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:56.103706  7688 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:56.060913  7615 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:56.090616  7689 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.097316  7321 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.134909  1661 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:56.203446  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:56.153735  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:56.206877  2271 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:56.160643  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:56.094707  7691 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:56.091204  7675 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:56.141068  7630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.028s	user 0.009s	sys 0.050s
I20260709 13:02:56.190768  1544 pending_rounds.cc:85] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 11
I20260709 13:02:56.197199  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:56.080561  7533 consensus_queue.cc:1059] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 13:02:56.217478  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:56.218053  1546 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
W20260709 13:02:56.089602  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 336388us
I20260709 13:02:56.093130  7507 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:02:56.211342  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:56.231375  1542 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:56.152868  7635 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:02:56.245711  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:56.134693  7636 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:56.212682  7630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.009s	sys 0.050s
I20260709 13:02:56.248056  1614 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 11.
I20260709 13:02:56.212218  1543 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:56.212771  1544 pending_rounds.cc:107] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:02:56.263855  1544 raft_consensus.cc:2889] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:56.188009  7688 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:56.215268  1513 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:56.219477  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:56.220549  1692 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:02:56.223244  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 88424.1us
W20260709 13:02:56.319204  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 99826.5us
I20260709 13:02:56.319214  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 3227) took 1841 ms. Trace:
I20260709 13:02:56.223069  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:56.320272  1661 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:56.320405  1540 rpcz_store.cc:276] 0709 13:02:54.478197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.046723 (+568526us) service_pool.cc:224] Handling call
0709 13:02:55.047322 (+   599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.047587 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:55.095148 (+ 47561us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.964058 (+868910us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b18003a7320. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a33e07 00007f5c7088eab9 00007f5c67a5069b 00007f5c67a4e93f 00007f5c67a50c02 00007f5c6a6d820b 00007f5c6a6ddd23 00007f5c6a6de23a 00007f5c6ab48a2a
0709 13:02:56.318894 (+354836us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:56.318945 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:56.318986 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.319059 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.319162 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88643,"prepare.queue_time_us":47334,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":1413,"spinlock_wait_cycles":8974592,"thread_start_us":265912,"threads_started":1}
W20260709 13:02:56.323354  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 190628us
I20260709 13:02:56.214593  7321 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:56.284569  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 235434us
I20260709 13:02:56.331816  2272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54504 (request call id 874) took 1322 ms. Trace:
I20260709 13:02:56.332671  7467 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:56.333124  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 117993us
W20260709 13:02:56.334923  7703 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:02:56.336447  7497 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.337257  7507 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:56.347694  1511 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:56.470331  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.344831  2272 rpcz_store.cc:276] 0709 13:02:55.009473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.043163 (+ 33690us) service_pool.cc:224] Handling call
0709 13:02:55.096872 (+ 53709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.097220 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.097256 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.760102 (+662846us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b2c000bc158. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:02:55.760510 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.976918 (+216408us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:55.977059 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.977353 (+   294us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.331485 (+354132us) raft_consensus.cc:1685] finished
0709 13:02:56.331514 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.331754 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3148,"spinlock_wait_cycles":3891968,"thread_start_us":215507,"threads_started":1,"wal-append.queue_time_us":447589}
I20260709 13:02:56.229691  7631 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:56.352260  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 292606us
I20260709 13:02:56.348726  2231 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:56.324059  7558 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:02:56.407665  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 83818.2us
I20260709 13:02:56.322280  7684 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:56.344717  7321 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:56.498196  7321 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:56.498956  7309 raft_consensus.cc:3055] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:56.499446  7309 raft_consensus.cc:740] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:56.500298  7309 consensus_queue.cc:260] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:56.501605  7309 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:56.420735  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 295639us
W20260709 13:02:56.421339  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 383988us
I20260709 13:02:56.503988  1586 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:56.504446  2232 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:56.504709  7684 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.505676  7533 raft_consensus.cc:2804] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:56.506201  7533 raft_consensus.cc:697] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 15 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:56.506841  7684 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:56.507292  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 158760us
I20260709 13:02:56.510846  7400 raft_consensus.cc:2804] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:56.511288  7400 raft_consensus.cc:697] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:56.512092  7400 consensus_queue.cc:237] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:56.512669  7321 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.514570  7321 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.516395  6968 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:56.516878  6968 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:56.518828  6968 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:56.519997  7702 log.cc:927] Time spent T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:02:56.520334  7701 consensus_queue.cc:1059] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:56.521569  7483 raft_consensus.cc:3055] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:56.521914  7483 raft_consensus.cc:740] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:56.522655  7483 consensus_queue.cc:260] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:56.520345  2234 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:56.526315  7505 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:56.526719  7505 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:56.527083  7505 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:56.530481  7688 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.531747  1689 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:02:56.532102  1689 pending_rounds.cc:85] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 10
I20260709 13:02:56.222007  7691 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:56.532528  1689 pending_rounds.cc:107] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:02:56.532801  1689 raft_consensus.cc:2889] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:56.532975  7701 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:56.399677  7615 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.493584  1661 leader_election.cc:400] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 10 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 10. Current term is 11.
W20260709 13:02:56.542902  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 57320.8us
I20260709 13:02:56.544025  1661 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:56.470376  7507 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.544735  7507 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:56.478360  7497 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.497216  7558 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.531973  1588 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:56.206105  7689 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.536895  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:56.391913  7587 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
I20260709 13:02:56.534184  7616 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:56.541958  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:02:56.588845  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 241226us
I20260709 13:02:56.546128  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:56.572300  1661 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:56.591835  1661 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:56.471246  7603 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:56.493733  7676 consensus_meta.cc:287] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.732s	user 0.012s	sys 0.000s
W20260709 13:02:56.579821  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 47934.5us
I20260709 13:02:56.532809  7489 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:56.620157  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:56.617285  7178 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:56.661791  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:56.661942  7178 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.662418  7178 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:56.663331  7705 log.cc:927] Time spent T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.255s	user 0.000s	sys 0.000s
I20260709 13:02:56.617295  7616 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:56.665643  7468 consensus_meta.cc:287] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.650s	user 0.006s	sys 0.002s
I20260709 13:02:56.665997  7616 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.666069  7468 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:56.668851  7558 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.669977  7467 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:56.670310  1541 raft_consensus.cc:1240] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:56.670490  7467 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.572635  7557 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.671619  7557 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:56.673436  7557 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:56.673520  7721 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:56.675045  7689 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:56.675400  7468 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:56.677263  7688 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.677635  7616 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.678444  7483 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:56.678130  7616 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.680680  7616 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.507062  7533 consensus_queue.cc:237] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:56.668922  7708 log.cc:927] Time spent T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:02:56.571696  7714 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 13:02:56.615240  7321 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:56.616051  7631 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:56.672504  7467 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.678068  7497 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.571157  7645 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:56.659039  7695 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:56.732846  1696 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:56.700148  7691 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:56.717867  7168 consensus_meta.cc:287] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.620s	user 0.006s	sys 0.002s
I20260709 13:02:56.738776  7168 raft_consensus.cc:2749] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:56.718587  7505 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.572854  7615 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.737170  7531 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:56.648941  7672 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 13:02:56.742995  7704 log.cc:927] Time spent T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:02:56.625700  7603 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.626057  7676 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:56.752131  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 426414us
I20260709 13:02:56.743633  7532 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:56.744812  7591 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.758553  7532 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.758694  7591 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.743517  7505 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:56.821344  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 53307.4us
I20260709 13:02:56.827399  1514 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:56.829267  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:56.830125  1614 raft_consensus.cc:2410] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:02:56.839103  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:56.840997  1614 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:56.842947  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:56.842941  1623 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:56.843140  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:56.843935  1614 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:56.845100  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:56.846009  1616 raft_consensus.cc:2410] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:02:56.847487  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:56.848676  1616 raft_consensus.cc:2410] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
W20260709 13:02:56.831933  7696 log.cc:927] Time spent T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.486s	user 0.000s	sys 0.001s
I20260709 13:02:56.750089  7531 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:56.837414  7468 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:56.868209  7468 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.868705  7468 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:56.874976  7591 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.875649  7591 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:56.877018  7591 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:56.878578  7676 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.880405  7532 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.882050  7615 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:56.885480  7710 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:02:56.890815  7645 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:56.892983  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34192 (request call id 2429) took 1154 ms. Trace:
I20260709 13:02:56.893452  1618 rpcz_store.cc:276] 0709 13:02:55.738289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.738408 (+   119us) service_pool.cc:224] Handling call
0709 13:02:55.738679 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.742918 (+  4239us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:55.973585 (+230667us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.318847 (+345262us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:56.320050 (+  1203us) log.cc:844] Serialized 26 byte log entry
0709 13:02:56.320169 (+   119us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:56.320199 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.320257 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.884850 (+564593us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:56.892634 (+  7784us) raft_consensus.cc:1685] finished
0709 13:02:56.892758 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.892912 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3894,"prepare.queue_time_us":24789,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":29453,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3110,"spinlock_wait_cycles":10268416,"thread_start_us":524648,"threads_started":2,"wal-append.queue_time_us":627846}
I20260709 13:02:56.897464  7507 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:56.901345  7675 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:56.903458  7603 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.905982  7507 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:56.907358  7645 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:56.923760  7645 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.926028  7645 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:56.926146  7715 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.214s	user 0.003s	sys 0.000s
I20260709 13:02:56.908097  7691 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:56.926853  7691 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.928839  7691 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:56.910763  7636 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:56.903098  7531 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.920390  7684 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:56.929840  7684 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.931937  7684 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:56.933429  7178 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:56.935849  7178 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:56.942734  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
W20260709 13:02:56.943727  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 354200us
W20260709 13:02:56.942723  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 363249us
I20260709 13:02:56.946756  1511 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:56.951234  1621 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:56.944809  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:56.945729  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:56.952098  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:56.952704  1614 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:56.952976  1618 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:02:56.953724  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:56.960031  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 337642us
I20260709 13:02:56.961823  1623 raft_consensus.cc:1240] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:56.963127  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:56.963855  1620 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:56.969276  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 377519us
I20260709 13:02:56.987540  1514 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:56.961539  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:57.001080  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:57.007251  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:57.009367  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:57.017513  2269 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:57.019101  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:57.019624  2269 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:57.009790  2271 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:57.007616  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:56.859256   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:57.027931  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:57.032595  2272 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
W20260709 13:02:57.036715  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 57729.1us
I20260709 13:02:57.037613  2234 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:57.040829  1620 raft_consensus.cc:2410] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:02:57.045020  1662 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:56.986805  7163 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:56.987018  7505 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.999135  7684 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:56.999607  7674 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:57.058806  2269 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:57.009720  7622 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:57.054518  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:02:57.051314  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 43972.5us
I20260709 13:02:57.053675  7467 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:02:57.111647  1513 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:57.111891  1587 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:57.066082  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:57.059846  7688 consensus_queue.cc:1059] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:02:57.070510  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:57.025852  7185 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:02:57.047456  7723 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:57.007094  7739 consensus_queue.cc:1059] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:02:57.043834  7636 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:02:57.109187  2267 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:57.052654  7675 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.053969  7713 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:57.054453  7687 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:57.052516  7615 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:57.112143  1693 raft_consensus.cc:1240] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:02:57.176173  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.176949  1689 raft_consensus.cc:2410] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:02:57.177151  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.177735  1693 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:02:57.112954  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.114955  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:57.100296  7691 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:57.135751  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:57.135885  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:57.133765  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: e37b8013aec24431a6672a857806329e
I20260709 13:02:57.139425  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.187566  1620 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:57.188051  1688 raft_consensus.cc:2410] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:02:57.188374  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:57.144259  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210a36eb12cf4ba2a2c5d8ffd07e37e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.137501  7700 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:57.149874  1690 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:02:57.189739  1690 pending_rounds.cc:85] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 7
I20260709 13:02:57.053382  7729 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:02:57.170233  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:57.107568  7505 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.135067  7722 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:57.140043  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:57.189118  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 55434.2us
I20260709 13:02:57.169235  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:57.195386  1695 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.195909  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:57.199528  2267 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:57.190796  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:57.200583  1697 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.201146  1513 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:57.184340  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.202231  1692 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 18.
I20260709 13:02:57.110669  7684 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.189988  1690 pending_rounds.cc:107] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:02:57.203203  1690 raft_consensus.cc:2889] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:57.115592  7622 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:57.186340  7615 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.234730  1586 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:57.187798  7688 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.190297  7691 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:57.240046  1623 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 18.
I20260709 13:02:57.248987  1586 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:57.249433  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.251011  2267 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:57.242534  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:57.242785  7618 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:57.243206  7645 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:57.243680  7631 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:57.253234  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 52202.5us
I20260709 13:02:57.254498  1586 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:57.246294  7684 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:57.255564  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.210781  7321 raft_consensus.cc:2764] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:02:57.170508  7675 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.178066  7468 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.256141  1695 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:57.260818  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:57.267875  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.268050  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.266122  1697 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:57.271595  2269 raft_consensus.cc:1240] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:57.241510  7615 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.269104  1693 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 10.
I20260709 13:02:57.251130  7691 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:57.250604  7700 raft_consensus.cc:697] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:57.176085  7687 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.253866  7722 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:57.143040  7723 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:57.277631  2267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:57.239749  7489 consensus_queue.cc:1059] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:02:57.260500  7178 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:57.289371  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:57.251317  7688 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.285876  2267 raft_consensus.cc:606] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:57.287353  1621 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:57.277194  7739 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:57.300305  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:57.300861  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:57.296326  1541 raft_consensus.cc:2368] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 16. Current term is 17.
I20260709 13:02:57.278656  7618 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:57.309624  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:57.310606  1544 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:57.311005  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:57.264147  7645 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.311504  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
W20260709 13:02:57.285302  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 87013.1us
I20260709 13:02:57.299144  2267 raft_consensus.cc:614] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:57.298878  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:57.312685  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:02:57.313050  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:57.301487  1546 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 11.
I20260709 13:02:57.302548  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:57.314154  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:57.314306  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:57.314812  1546 raft_consensus.cc:2393] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:57.314828  1543 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 18.
I20260709 13:02:57.315522  1514 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:57.315860  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:57.316726  1541 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 18: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:57.317868  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:57.320973  1543 raft_consensus.cc:2393] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 17: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:57.324019  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:57.288043  7636 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:57.327661  1663 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:57.316768  7178 raft_consensus.cc:697] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:02:57.330520  7748 log.cc:927] Time spent T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:57.330081  7178 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:57.332415  7695 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:57.332854  7695 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:57.333032  7716 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:57.333297  7695 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.316529  7618 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:57.335760  7618 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:57.267104  7631 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.338059  7622 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:57.288334  7722 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:57.340870  7722 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:57.299991  7739 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:57.325557  1541 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:57.323256  7518 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:57.376516  1511 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:57.346982  7725 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:57.386376  7755 log.cc:927] Time spent T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:57.372241  7193 consensus_queue.cc:1059] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 13:02:57.399250  7746 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:02:57.400827  2267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:57.401456  7745 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:57.396754  7518 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:57.403944  7518 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.404927  7618 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.401475  2267 raft_consensus.cc:606] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:57.406823  2267 raft_consensus.cc:614] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:57.364382  7636 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:57.398777  7739 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:57.420487  7751 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:57.421058  7675 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:57.421739  7687 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:57.387360  7467 consensus_queue.cc:1059] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:02:57.422715  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:57.427598  1615 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:57.428447  1511 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:57.428530  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:57.426040  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.424402  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.431893  1697 raft_consensus.cc:1275] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:57.435632  1514 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:02:57.446746  2267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:57.448442  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:57.422891  7467 raft_consensus.cc:3055] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:57.424201  7739 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.387997  7721 consensus_queue.cc:1059] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:02:57.437352  7602 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:57.438643  7616 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:57.476707  1615 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:57.456561  7467 raft_consensus.cc:740] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:02:57.486726  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 232326us
I20260709 13:02:57.487926  1586 leader_election.cc:304] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:57.451707  7691 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:57.472489  7505 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:57.493530  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:57.495404  2269 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 18.
I20260709 13:02:57.497781  1662 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:57.488624  7468 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:57.507292  7631 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:57.510550  7749 log.cc:927] Time spent T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:02:57.492136  7636 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:57.512382  7730 log.cc:927] Time spent T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 13:02:57.514544  7750 log.cc:927] Time spent T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:02:57.498363  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:57.523620  7467 consensus_queue.cc:260] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.526161  7615 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.498557  7723 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:57.505834  7764 raft_consensus.cc:2749] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:57.531631  7688 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:57.535821  7618 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:57.542634  7741 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.298s	user 0.000s	sys 0.005s
W20260709 13:02:57.544222  7747 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.292s	user 0.003s	sys 0.001s
I20260709 13:02:57.546571  7691 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:57.492879  7645 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:57.477641  7616 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:57.547768  7759 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:57.547945  7602 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:57.395895  7700 consensus_queue.cc:237] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:57.597144  7767 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:57.612229  7767 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:57.564194  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 2392) took 1339 ms. Trace:
I20260709 13:02:57.556107  7695 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:57.614085  1444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52808 (request call id 202) took 39337 ms (client timeout 15000 ms). Trace:
I20260709 13:02:57.578367  7723 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:57.620841  7742 log.cc:927] Time spent T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.279s	user 0.002s	sys 0.000s
I20260709 13:02:57.584607  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:57.584801  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:02:57.623778  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 59056.5us
I20260709 13:02:57.624081  1622 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 18: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:57.586125  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:57.614432  1691 rpcz_store.cc:276] 0709 13:02:56.224710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.224887 (+   177us) service_pool.cc:224] Handling call
0709 13:02:56.225165 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.385171 (+160006us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:56.615917 (+230746us) log.cc:844] Serialized 14 byte log entry
0709 13:02:57.067741 (+451824us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:57.067785 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:57.067825 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.503706 (+435881us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b18003c2a40. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a1f2a6 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419
0709 13:02:57.563976 (+ 60270us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400127ad4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:57.564030 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.564141 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":326796,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":73,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":39896,"spinlock_wait_cycles":375617792,"thread_start_us":681880,"threads_started":2,"wal-append.queue_time_us":659308}
W20260709 13:02:57.576709  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 78422.4us
I20260709 13:02:57.617347  1440 catalog_manager.cc:5697] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:57.618322  7615 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:57.620405  7616 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:57.628758  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:57.630995  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:57.639438  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:57.614617  7467 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.628063  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:57.641476  2268 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 18.
I20260709 13:02:57.611611  7602 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.628646  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:57.620846  7695 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:57.614315  7767 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:57.659083  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:57.645869  2267 raft_consensus.cc:606] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:57.671516  1588 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:57.674697  7674 raft_consensus.cc:3055] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:57.675123  7674 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:57.675990  7674 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.677275  7674 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.679811  7193 raft_consensus.cc:3055] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:02:57.700588  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 55499.8us
I20260709 13:02:57.678738  7400 raft_consensus.cc:3055] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:57.680639  7616 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:57.679713  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 269320us
I20260709 13:02:57.631479  1440 catalog_manager.cc:5697] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 9 to 11, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 11 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:02:57.616102  1444 rpcz_store.cc:269] 0709 13:02:18.276709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.277049 (+   340us) service_pool.cc:224] Handling call
0709 13:02:57.613973 (+39336924us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:51.483768 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:51.484397 (+   629us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:51.484441 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:02:51.484458 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:51.485363 (+   905us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:51.485448 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:51.485475 (+    27us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:02:51.486244 (+   769us) tablet.cc:701] Row locks acquired
0709 13:02:51.486291 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:02:51.486461 (+   170us) write_op.cc:270] Start()
0709 13:02:51.486601 (+   140us) write_op.cc:276] Timestamp: P: 1783602171486394 usec, L: 0
0709 13:02:51.486643 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:02:51.612780 (+126137us) log.cc:844] Serialized 3258 byte log entry
0709 13:02:52.281619 (+668839us) op_driver.cc:464] REPLICATION: finished
0709 13:02:52.358921 (+ 77302us) write_op.cc:301] APPLY: starting
0709 13:02:52.363792 (+  4871us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:52.666005 (+302213us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:52.666128 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:52.714194 (+ 48066us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:52.714538 (+   344us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:02:52.714582 (+    44us) write_op.cc:312] APPLY: finished
0709 13:02:52.714924 (+   342us) log.cc:844] Serialized 81 byte log entry
0709 13:02:52.715089 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:52.715215 (+   126us) write_op.cc:454] Released schema lock
0709 13:02:52.715259 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:52.740593 (+ 25334us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:52.748534 (+  7941us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":148673,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":51101,"apply.run_cpu_time_us":13071,"apply.run_wall_time_us":374046,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37599,"num_ops":8,"prepare.queue_time_us":174020,"prepare.run_cpu_time_us":71580,"prepare.run_wall_time_us":477844,"raft.queue_time_us":230712,"raft.run_cpu_time_us":9517,"raft.run_wall_time_us":69769,"replication_time_us":781379,"thread_start_us":605010,"threads_started":4,"wal-append.queue_time_us":398447,"wal-append.run_cpu_time_us":21931,"wal-append.run_wall_time_us":1706139}]]}
I20260709 13:02:57.743492  2231 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:57.738469  7764 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:57.752570  7764 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:57.755669  7764 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:57.759645  7483 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:57.774173  7752 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.564s	user 0.000s	sys 0.003s
I20260709 13:02:57.775455  1440 catalog_manager.cc:5697] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 12 to 13, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 13 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:57.777420  7725 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:57.778112  7725 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:57.780258  7734 consensus_queue.cc:1059] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:02:57.780589  1663 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:57.700592  7193 raft_consensus.cc:740] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:57.781714  7193 consensus_queue.cc:260] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:57.783392  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75442f7324f24d4494f1ba99a64ed4ac" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.784497  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.707741  7400 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:57.785291  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.788218  1691 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:02:57.785919  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:57.785951  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:57.787571  1697 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:57.707906  7683 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:57.786587  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:57.738749  7719 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.791227  2231 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:57.792668  1586 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:57.782874  7193 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:57.854864  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 63740.2us
W20260709 13:02:57.857908  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 65297.4us
I20260709 13:02:57.778476  1440 catalog_manager.cc:5697] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 11 to 12, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 12 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:57.861095  1689 raft_consensus.cc:1240] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:57.787115  7691 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:57.874343  1690 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:57.861778  7698 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:57.868924  7716 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:57.873103  7533 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:57.868806  7721 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:57.906322  7400 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:57.908942  7784 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.126s
I20260709 13:02:57.868202  7683 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.881767  7691 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:57.884478  7698 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:57.868407  7719 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.881592  7713 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:02:57.910243  7400 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:57.924456  7698 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.904016  7721 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.927843  7537 consensus_queue.cc:1048] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:02:57.920727  1440 catalog_manager.cc:5697] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 11 to 15, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 15 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:57.937227  7721 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:57.913039  1616 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
I20260709 13:02:57.937973  1440 catalog_manager.cc:5697] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:57.953176  7775 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:02:57.952848  1440 catalog_manager.cc:5697] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 12 to 14, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 14 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:57.963081  7602 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:57.964538  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 528959us
I20260709 13:02:57.964812  7687 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:57.965272  7602 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:57.965507  7687 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:57.965939  7687 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:02:57.966284  7744 log.cc:927] Time spent T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.721s	user 0.003s	sys 0.000s
I20260709 13:02:57.971654  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53718 (request call id 1479) took 1436 ms. Trace:
I20260709 13:02:57.972465  7636 raft_consensus.cc:3055] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:57.972935  7636 raft_consensus.cc:740] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:57.973917  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 2344) took 1009 ms. Trace:
I20260709 13:02:57.973763  7636 consensus_queue.cc:260] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:57.974864  7636 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:57.975802  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.976080  7739 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:57.976380  7776 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
W20260709 13:02:57.978003  7779 log.cc:927] Time spent T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:02:57.978960  7780 log.cc:927] Time spent T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:02:57.915259  7531 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.980247  7531 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:57.981163  7468 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:57.981647  7468 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:57.982322  7531 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:57.974377  1617 rpcz_store.cc:276] 0709 13:02:56.963953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.192395 (+228442us) service_pool.cc:224] Handling call
0709 13:02:57.192724 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.258760 (+ 66036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.258789 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:57.258827 (+    38us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:57.258862 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.973660 (+714798us) spinlock_profiling.cc:243] Waited 65.8 ms on lock 0x7b54000fcdd4. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab3ee01 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2 00007f5c68e7948c 00007f5c68e788c6
0709 13:02:57.973718 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.973854 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151418112}
I20260709 13:02:57.966302  7687 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:57.984412  7725 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:02:57.913932  7731 consensus_queue.cc:1175] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" responder_term: 16 status { last_received { term: 15 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:02:57.986851  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 558439us
I20260709 13:02:57.965960  1615 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:57.988127  1511 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:57.972095  1539 rpcz_store.cc:276] 0709 13:02:56.535479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.535896 (+   417us) service_pool.cc:224] Handling call
0709 13:02:56.572242 (+ 36346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:56.572567 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:56.572598 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:56.581064 (+  8466us) log.cc:844] Serialized 26 byte log entry
0709 13:02:57.139119 (+558055us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:57.139161 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.139220 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:57.965759 (+826539us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:57.971189 (+  5430us) raft_consensus.cc:1685] finished
0709 13:02:57.971217 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.971575 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":863,"raft.queue_time_us":465,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":19537,"spinlock_wait_cycles":42267392,"thread_start_us":415099,"threads_started":1,"wal-append.queue_time_us":560872}
I20260709 13:02:57.919324  7691 raft_consensus.cc:3060] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:57.976533  7739 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:58.000191  1648 heartbeater.cc:646] Failed to heartbeat to 127.0.107.190:37205 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.190:37205 timed out after 15.000s (SENT)
I20260709 13:02:58.001417  7739 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:58.002609  1547 raft_consensus.cc:1275] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:58.003336  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:58.003235  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.005405  2267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:58.005937  2267 raft_consensus.cc:606] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:02:58.022852  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.024643  1511 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:57.997148  7468 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:58.026602  1511 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.037688  7739 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:58.038306  7518 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:58.043318  1511 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:58.044965  7732 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:58.045058  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:58.045388  7683 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:58.045812  1616 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
W20260709 13:02:58.049528  7758 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.663s	user 0.006s	sys 0.000s
I20260709 13:02:58.052613  2234 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:58.056378  1511 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:02:58.057382  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.959685  1440 catalog_manager.cc:5697] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 10 to 11, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 11 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.061542  7467 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:58.072487  1661 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:02:58.076881  1661 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:58.041975  7497 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:58.081050  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:58.095440  1661 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:58.096370  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 220172us
I20260709 13:02:58.097052  1586 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:58.061708  7674 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:58.123080  1586 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:58.134681  1586 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:58.135627  7754 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:58.125586  1661 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:58.137952  1586 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:58.145663  1586 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:58.092630  7714 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:58.062237  7732 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:02:58.092917  7695 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:58.084707  7683 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:58.140467  7758 log.cc:927] Time spent T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:58.126336  7782 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:58.126951  7723 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:58.144354  7754 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:58.167642  7754 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.168190  7754 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.158962  7783 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
W20260709 13:02:58.159965  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.077867  7531 consensus_queue.cc:1048] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:02:58.160418  7781 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:58.172338  7781 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.174507  7781 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:58.176123  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.176333  7723 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.177019  7723 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.137923  7721 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:58.131007  7168 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:58.179462  7168 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.179853  7168 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.180649  7723 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:58.190341  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:58.114594  7719 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:58.133641  7674 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:58.189986  7744 log.cc:927] Time spent T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:02:58.154145  7716 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:58.150962  7784 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:58.149718  7616 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:58.155323  7714 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.122009  7497 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.217685  7732 raft_consensus.cc:493] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:58.218181  7732 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:58.218968  7497 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:58.158573  7683 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:58.206620  7674 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.221232  7683 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.243075  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:58.243728  1697 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.216027  7698 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.246627  7698 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:58.247634  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.247982  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.250742  7674 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.252609  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.253624  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:58.254554  7687 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.247159  7698 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:58.259194  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.266868  1688 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:58.273213  1691 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:58.240327  1690 raft_consensus.cc:1240] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:02:58.228132  7732 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:58.219847  7714 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.280717  1697 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
W20260709 13:02:58.274960  7763 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:58.270825  7716 raft_consensus.cc:697] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:58.276286  7698 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.287391  7777 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.018s
W20260709 13:02:58.225940  7608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.001s	sys 0.016s
I20260709 13:02:58.277122  7168 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.321040  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.292161  7754 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:58.349494  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.338515  7608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.001s	sys 0.016s
I20260709 13:02:58.306221  7691 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:58.346163  1662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.000s	sys 0.022s
W20260709 13:02:58.369817  1662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.000s	sys 0.023s
I20260709 13:02:58.329418  1688 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:58.229663  1440 catalog_manager.cc:5697] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.376076  1663 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
W20260709 13:02:58.381327  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 883535us
I20260709 13:02:58.388590  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:58.389962  2267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:02:58.394258  2267 raft_consensus.cc:606] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.394644  2267 raft_consensus.cc:614] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:58.382308  1587 leader_election.cc:400] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 16. Current term is 17.
I20260709 13:02:58.397821  1587 leader_election.cc:403] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:02:58.407024  1587 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.403849  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39244 (request call id 2410) took 1196 ms. Trace:
I20260709 13:02:58.388655  7734 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:58.413827  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:58.380208  7683 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.416108  2268 raft_consensus.cc:1240] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:02:58.408452  7618 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 16. Current term is 17.
I20260709 13:02:58.423708  1692 rpcz_store.cc:276] 0709 13:02:57.207520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.216965 (+  9445us) service_pool.cc:224] Handling call
0709 13:02:57.217298 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:57.217657 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:57.251884 (+ 34227us) log.cc:844] Serialized 14 byte log entry
0709 13:02:57.873425 (+621541us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:57.907292 (+ 33867us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b4800012cd8. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6fa67aa1 00007f5c6fa5eb37 00007f5c6fa5e9ca 00007f5c6fb5626f 00007f5c6fb55f37 00007f5c6fb6a55c 00007f5c6fb6a508 00007f5c6fb6a488 00007f5c6fb6a443 00007f5c6fb696ec 00007f5c6ea93a96
0709 13:02:58.183849 (+276557us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b2c000d1b28. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c69437a11 00007f5c69447372 00007f5c6ab79a01 00007f5c6ab3e43a 00007f5c6ab3d83e 00007f5c6fb02419 00007f5c69079bd4 00007f5c69079b62 00007f5c69079a91 00007f5c69079a0c 00007f5c69078cc2
0709 13:02:58.184191 (+   342us) log.cc:844] Serialized 26 byte log entry
0709 13:02:58.184331 (+   140us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:58.184535 (+   204us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.184694 (+   159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.184765 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.403619 (+218854us) raft_consensus.cc:1685] finished
0709 13:02:58.403646 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.403786 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":259202,"prepare.queue_time_us":41999,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":3250,"raft.queue_time_us":285194,"raft.run_cpu_time_us":1121,"raft.run_wall_time_us":181941,"spinlock_wait_cycles":8982656,"thread_start_us":372368,"threads_started":2,"wal-append.queue_time_us":224378}
W20260709 13:02:58.411509  7764 consensus_meta.cc:287] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.003s
I20260709 13:02:58.412853  7687 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:58.435635  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.437642  7767 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:58.410053  7723 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:02:58.445755   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:58.430836  7533 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:58.447856   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:58.391064  7716 consensus_queue.cc:237] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.421769  7674 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:58.452973  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.453846  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:58.454592  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.461676  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:58.439160  7505 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:58.465191  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.465739  1540 raft_consensus.cc:2393] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:58.435938  7467 raft_consensus.cc:697] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:58.466264  1587 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.469548  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.470250  1540 raft_consensus.cc:2393] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:58.470613  1692 raft_consensus.cc:2393] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 12: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:58.471380  1697 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:02:58.466522  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.440877  7507 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:58.490036  7507 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.492856  7507 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:58.473574  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.474367  1543 raft_consensus.cc:1240] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:58.493745  1547 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 18.
I20260709 13:02:58.494251  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:58.494619  7505 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:58.494995  1543 raft_consensus.cc:2393] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 18: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:58.475921  1544 raft_consensus.cc:1240] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:58.472756  1545 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:02:58.496078  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.496217  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.496809  1544 raft_consensus.cc:2368] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
I20260709 13:02:58.495146  7505 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.497303  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.497561  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.498349  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.498591  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.499449  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:58.498968  7505 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:58.505924  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
W20260709 13:02:58.512033  7796 log.cc:927] Time spent T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:02:58.477787  7168 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:58.451388  7533 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:58.479010  7467 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.449394  7767 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.481441  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.458977  1440 catalog_manager.cc:5697] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.442768  7734 raft_consensus.cc:697] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:58.484841  7321 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:58.485502  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.488623  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.494838  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:58.515249  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:58.515900  2272 raft_consensus.cc:2468] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 18.
I20260709 13:02:58.473752  7787 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:58.498353  7691 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:58.544668  1542 raft_consensus.cc:2393] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 18: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:58.520730  7723 consensus_queue.cc:1059] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:58.446286  7618 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:58.546581  7754 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:58.547107  7767 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:58.548089  7618 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.550151  7618 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:58.550722  7788 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:02:58.524565  1511 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.552525  7683 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 19 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:58.554253  7787 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.556825  7787 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:58.525096  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:58.525755  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 328643us
I20260709 13:02:58.438247  7764 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:58.517900  1690 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:58.540202  1662 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:58.541265  1547 raft_consensus.cc:2393] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 11: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:58.519452  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:58.560132  2267 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:58.561502  2263 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:58.563437  7754 raft_consensus.cc:3055] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:58.563825  7754 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:58.536337  7698 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:58.564932  7698 raft_consensus.cc:2804] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:58.564558  7754 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.565395  7698 raft_consensus.cc:697] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:58.565737  7754 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.566242  7698 consensus_queue.cc:237] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:58.567900  7793 log.cc:927] Time spent T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:02:58.568540  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.569242  7764 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:58.569455  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.569610  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.570179  1696 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 17: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:58.570215  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.570945  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:58.571548  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:58.572096  1691 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.572131  7734 consensus_queue.cc:237] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.572806  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:58.575656  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:58.576759  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 61587.7us
I20260709 13:02:58.577201  7616 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:58.578990  1587 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:58.580461  7802 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.580193  1587 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:58.581830  7764 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:58.582588  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:02:58.583076  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 58572.7us
I20260709 13:02:58.583992  7798 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:58.564580  1440 catalog_manager.cc:5697] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.585556  1440 catalog_manager.cc:5697] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 9 to 12, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 12 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:02:58.589047  1691 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 19.
W20260709 13:02:58.592092  7789 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.115s	user 0.002s	sys 0.001s
I20260709 13:02:58.590167  1511 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:58.592067  7801 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:58.594257  7807 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:58.594076  7533 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:58.595989  1587 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
W20260709 13:02:58.602263  7794 log.cc:927] Time spent T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:02:58.617517  1586 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
W20260709 13:02:58.626243  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.618209  1511 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:58.615394  7701 raft_consensus.cc:993] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:02:58.640234  1511 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:02:58.641631  1511 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:58.633229  7700 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:58.656668  7700 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:58.657223  7700 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.654069  6968 raft_consensus.cc:1081] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:02:58.577195  7714 raft_consensus.cc:515] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:58.663407  1587 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.663700  1586 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:58.645311  7507 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:58.668041  7799 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:58.668321  7787 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.686954  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:58.668778  7754 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:58.645167  7795 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:58.702746  2272 raft_consensus.cc:2368] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:58.705132  1690 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:02:58.705574  1690 pending_rounds.cc:85] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 9
I20260709 13:02:58.705825  1690 pending_rounds.cc:107] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:02:58.706100  1690 raft_consensus.cc:2889] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.681391  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.685967  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:58.686615  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:58.708416  1615 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:02:58.709587  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:58.710888  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:58.687801  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:58.689821  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:58.690912  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:58.712770  1620 raft_consensus.cc:2393] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 12: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:58.691999  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:58.697130  1622 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:58.715536  1689 raft_consensus.cc:1240] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:58.716071  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:58.718176  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:58.718390  1548 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:58.718953  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:58.726158  1539 raft_consensus.cc:2393] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 19: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:02:58.726487  1619 raft_consensus.cc:2410] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:02:58.729079  1621 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:58.739956  1691 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:02:58.740341  1691 pending_rounds.cc:85] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 10
I20260709 13:02:58.740541  1691 pending_rounds.cc:107] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:02:58.740762  1691 raft_consensus.cc:2889] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.742158  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:58.700699  7616 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.700780  7533 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:58.745355  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:58.682279  7801 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:02:58.700881  7764 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:58.717430  7799 raft_consensus.cc:697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:58.760667  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:58.762393  1615 raft_consensus.cc:2393] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 18: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:58.733723  7607 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:02:58.765029  1615 raft_consensus.cc:1240] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:58.765591  7799 consensus_queue.cc:237] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.767004  7714 leader_election.cc:290] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:58.780737  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:58.783142  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.756699  7764 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:58.790518  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:58.792022  1615 raft_consensus.cc:2410] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:02:58.813791  1661 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:58.814654  1692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:58526
I20260709 13:02:58.815229  1692 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:58.815639  1692 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.807610  7700 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.825399  1661 leader_election.cc:400] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
I20260709 13:02:58.830921  1661 leader_election.cc:403] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:58.787021  7608 consensus_queue.cc:1059] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:02:58.843787  1661 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:58.863557  1661 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:58.864017  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:58.864871  1615 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.797217  7734 consensus_queue.cc:1059] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
W20260709 13:02:58.877378  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 150102us
I20260709 13:02:58.867372  1661 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:58.873219  7811 log.cc:927] Time spent T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:02:58.875636  7729 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:58.875928  7815 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:58.831970  7725 raft_consensus.cc:2749] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:58.892940  1661 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:58.892273  1692 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:58.861159  7163 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597) with higher term. Message: Invalid argument: T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12.
W20260709 13:02:58.908267  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 132066us
I20260709 13:02:58.908526  1622 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:58.880455  7795 raft_consensus.cc:697] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:58.910915  7795 consensus_queue.cc:237] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.891765  7784 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:58.912506  7784 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.913126  7784 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.913256  1692 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:58.913583  7784 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.889748  7467 consensus_queue.cc:1059] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:02:58.922825  7636 raft_consensus.cc:3055] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:58.923286  7636 raft_consensus.cc:740] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:58.924134  7636 consensus_queue.cc:260] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:58.925511  7636 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.929162  7616 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:58.929440  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 108878us
I20260709 13:02:58.930260  1513 leader_election.cc:400] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
I20260709 13:02:58.930533  1513 leader_election.cc:403] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:58.931182  7178 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:58.931291  7798 raft_consensus.cc:3060] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.931690  7178 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.933650  7178 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:58.935551  7802 raft_consensus.cc:3055] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:58.935942  7802 raft_consensus.cc:740] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:58.936724  7802 consensus_queue.cc:260] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.938357  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.939811  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:58.940490  1539 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:58.941424  7807 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:02:58.941509  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.941995  7807 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:58.942750  1514 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.943248  7507 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:58.943579  7687 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:58.944046  1548 raft_consensus.cc:1240] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:02:58.944504  7807 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:58.944566  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:02:58.945178  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.945819  7739 raft_consensus.cc:3055] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:58.946187  7739 raft_consensus.cc:740] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:02:58.946457  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.945765  7674 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:58.947118  7739 consensus_queue.cc:260] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:58.947914  1544 raft_consensus.cc:1240] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:58.943861  7507 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:58.948511  7739 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:58.948628  7507 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:58.945215  1545 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.950989  7802 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:58.955260  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.955518  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.956168  1587 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.956576  1514 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.957738  1587 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.940514  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:02:58.959213  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:58.959703  1616 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 12.
I20260709 13:02:58.960523  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:58.961117  1622 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:58.958771  1541 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:02:58.965211  1587 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.877888  7791 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:58.956488  7809 log.cc:927] Time spent T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 13:02:58.979039  1539 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 19.
I20260709 13:02:58.976804  1615 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:58.984820  1587 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.980288  1545 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 12.
I20260709 13:02:58.981184  7767 consensus_queue.cc:1059] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:58.982300  7805 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:58.986661  2234 leader_election.cc:304] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:58.992369  1539 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:58.992980  1514 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:58.956668  7807 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:58.978371  7732 raft_consensus.cc:2749] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.877328  7764 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:59.010128  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af6b960277d47bd994134d20b77c59a" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
W20260709 13:02:59.034029  7817 log.cc:927] Time spent T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:59.035763  7784 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:59.006129  7716 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:59.003984  7687 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:59.041729  7716 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:59.044158  1622 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:59.044775  7602 raft_consensus.cc:3055] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:59.045184  7602 raft_consensus.cc:740] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:59.004381  7616 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:59.004864  7777 raft_consensus.cc:2804] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:59.046211  7602 consensus_queue.cc:260] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:59.064458  7716 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:59.064940  7602 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.051178  7616 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:59.069710  7616 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:59.070065  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:59.070785  2268 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:02:59.072213  7700 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:59.067185  1622 raft_consensus.cc:1240] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:59.074437  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:59.072125  1588 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:59.100000  7723 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:59.099347  7505 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:59.135002  7798 raft_consensus.cc:2749] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517) with higher term. Message: Invalid argument: T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb for earlier term 12. Current term is 13.
W20260709 13:02:59.155743  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 54330.7us
I20260709 13:02:59.151280  7723 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
W20260709 13:02:59.172611  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 165219us
I20260709 13:02:59.173573  1587 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:59.175707  1693 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:59.176560  1663 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:59.154063  7777 raft_consensus.cc:697] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:59.180824  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:59.183306  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:59.186913  1615 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:02:59.187290  1615 pending_rounds.cc:85] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 8
I20260709 13:02:59.170125  7723 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:59.180994  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:59.191108  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:59.191749  1545 raft_consensus.cc:2468] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:02:59.154263  7735 consensus_queue.cc:1059] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:02:59.197093  1514 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:02:59.187548  1615 pending_rounds.cc:107] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 15.9
I20260709 13:02:59.199976  1615 raft_consensus.cc:2917] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Aborting config change with OpId 15.9: Aborted: Op aborted by new leader
I20260709 13:02:59.202734  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debbced49eac4fa895623a8e492b9ce3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:02:59.203264  1615 raft_consensus.cc:2889] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:59.186304  7786 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:59.157699  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 264836us
I20260709 13:02:59.216792  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:40538 (request call id 0) took 6244 ms. Trace:
I20260709 13:02:59.217310  1615 rpcz_store.cc:276] 0709 13:02:52.964876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.081969 (+117093us) service_pool.cc:224] Handling call
0709 13:02:53.498840 (+416871us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b54002c2f20. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6aabb520 00007f5c6ab44b42 00007f5c6ab43800 00007f5c6fb04d29 00007f5c690831d4 00007f5c69083162 00007f5c69083091 00007f5c6908300c 00007f5c690822c2 00007f5c68e7948c
0709 13:02:54.066188 (+567348us) spinlock_profiling.cc:243] Waited 43.9 ms on lock 0x7b4c000262c0. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c68e0aa20 00007f5c68e1ba29 00007f5c68de1644 00007f5c68e08f2d 00007f5c68e08b93 00007f5c6aa971af 00007f5c6aa96f3e 00007f5c6ab1c888 00007f5c6ab3975c 00007f5c6ab3a76a 00007f5c6ab3991b
0709 13:02:54.067559 (+  1371us) log.cc:844] Serialized 506 byte log entry
0709 13:02:54.694713 (+627154us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b1800076500. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c6aaa7571 00007f5c6ab7ad01 00007f5c6aab7691 00007f5c6aa97eaa 00007f5c6aa9ed53 00007f5c6aa9ecd9 00007f5c6aa9ec69 00007f5c6aa9ec31 00007f5c6aa9ddfd 000000000038f354 000000000038f199
0709 13:02:54.880384 (+185671us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:59.203886 (+4323502us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12015,"raft.queue_time_us":21611,"raft.run_cpu_time_us":3785,"raft.run_wall_time_us":575582,"spinlock_wait_cycles":205822848,"thread_start_us":116128,"threads_started":2,"wal-append.queue_time_us":115631,"wal-append.run_cpu_time_us":4352,"wal-append.run_wall_time_us":1715134}
I20260709 13:02:59.220896  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:02:59.195099  7725 raft_consensus.cc:2804] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:59.235582  7777 consensus_queue.cc:237] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:59.201632  7467 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.189044  7716 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:02:59.252658  1661 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:59.255364  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 62677us
I20260709 13:02:59.216269  7674 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.264670  1661 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:59.256120  7193 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.244148  7719 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:59.256901  7725 raft_consensus.cc:697] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:59.222692  7787 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:59.271332  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.272401  2272 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:59.204203  7607 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:02:59.222998  7801 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:59.315358  2268 raft_consensus.cc:3055] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:59.259119  7716 consensus_queue.cc:1243] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer 44c8c572048a40b1a5e71865068ed1bb log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:02:59.320327  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 55766.3us
I20260709 13:02:59.265113  7163 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:59.338454  2268 raft_consensus.cc:740] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:02:59.351045  2268 consensus_queue.cc:260] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:59.354491  7826 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:02:59.354521  2268 raft_consensus.cc:3060] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.362483  2268 raft_consensus.cc:2468] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:02:59.332293  7729 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:59.347703  7698 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:02:59.373445  7616 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:59.374246  7831 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:02:59.313726  7674 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:59.377964  7674 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:59.378309  7725 consensus_queue.cc:237] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:59.373193  7731 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:02:59.380342  7507 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:59.382364  7507 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:59.382408  7729 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:59.259234  7467 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:59.379426  7832 log.cc:927] Time spent T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:02:59.392709  7616 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:02:59.444337  1494 auto_rebalancer.cc:629] Failed to schedule move for tablet 8820554e3d9a4662b150408d84019889: Aborted: Op aborted by new leader
I20260709 13:02:59.529798  7467 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:59.453490   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:59.474263  1617 raft_consensus.cc:2410] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:02:59.345113  1661 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:02:59.553696  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 208536us
I20260709 13:02:59.492473  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:59.560287  1694 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 18.
I20260709 13:02:59.494153  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:02:59.502764  1616 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 13.
I20260709 13:02:59.523733  7321 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:59.353279  7791 consensus_queue.cc:1059] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:02:59.405640  7786 raft_consensus.cc:697] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:02:59.565769  7786 consensus_queue.cc:237] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:59.568284  7729 raft_consensus.cc:2749] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:59.603681  7791 raft_consensus.cc:3055] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:59.604339  7791 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:59.606166  7791 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:59.644999  7835 log.cc:927] Time spent T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.329s	user 0.001s	sys 0.002s
W20260709 13:02:59.648061  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.650424  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.643062  7833 log.cc:927] Time spent T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.408s	user 0.003s	sys 0.000s
I20260709 13:02:59.691439  7791 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.699882  1620 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:59.708693  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 451512us
I20260709 13:02:59.714706  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:59.715639  1690 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
W20260709 13:02:59.723726  7838 log.cc:927] Time spent T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.405s	user 0.003s	sys 0.000s
I20260709 13:02:59.724781  7636 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:02:59.725870  7636 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:02:59.732333  7802 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.781s	user 0.012s	sys 0.007s
I20260709 13:02:59.703166  1695 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:59.767395  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34180 (request call id 2357) took 1056 ms. Trace:
I20260709 13:02:59.767920  1621 rpcz_store.cc:276] 0709 13:02:58.693845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.729946 (+ 36101us) service_pool.cc:224] Handling call
0709 13:02:58.730282 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:58.737526 (+  7244us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:59.003742 (+266216us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.212493 (+208751us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:59.213093 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.213250 (+   157us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:59.213296 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.213422 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:59.722574 (+509152us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b4400022b4c. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c678d9db1 00007f5c67977c85 00007f5c679786a2 00007f5c6a6ea1db 00007f5c6a6e5aaf 00007f5c6a6d986e 00007f5c6a6d8bb6 00007f5c6a6d87d8 00007f5c6a6e2221 00007f5c6a6e21d9 00007f5c6a6e2169
0709 13:02:59.736875 (+ 14301us) raft_consensus.cc:1685] finished
0709 13:02:59.739312 (+  2437us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.750607 (+ 11295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25078,"prepare.queue_time_us":29854,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":71466,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":26370,"spinlock_wait_cycles":21139840,"thread_start_us":444115,"threads_started":2,"wal-append.queue_time_us":239918}
W20260709 13:02:59.776681  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 69824.8us
I20260709 13:02:59.778340  7787 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:02:59.778947  7787 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:59.819375  7852 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:59.820223  7852 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:02:59.828392  1494 auto_rebalancer.cc:629] Failed to schedule move for tablet 18e6dd43c01541d3abf870473a28780a: Illegal state: Replica 27308aae2ef347ccba1b27e7f6f04334 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
W20260709 13:02:59.844326  7854 log.cc:927] Time spent T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.163s	user 0.002s	sys 0.000s
I20260709 13:02:59.844781  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:59.845629  2263 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:02:59.836117  7852 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:59.847261  1513 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:59.849694  7846 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.850334  7846 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:59.860999  7636 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:02:59.879768  7723 consensus_meta.cc:287] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.009s
I20260709 13:02:59.882237  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:59.882459  7723 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:59.883164  1620 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 18.
I20260709 13:02:59.885005  7723 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:59.887111  7846 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:02:59.897591  7839 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.901829  1663 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:02:59.903079  7636 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:59.903190  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 45401us
I20260709 13:02:59.905375  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:02:59.911533  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:02:59.898430  7839 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:59.889775  7830 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.914220  7830 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:59.916872  7830 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:59.918901  1619 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:59.922024  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:59.922734  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:59.923235  1619 raft_consensus.cc:2393] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 17: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:02:59.923833  1511 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:59.924650  1617 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:59.923846  1691 raft_consensus.cc:2393] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:02:59.925700  7805 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:59.926151  7805 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.926195  1511 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:02:59.926626  7805 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:59.928283  1616 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 18.
I20260709 13:02:59.934280  7795 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:59.928380  7801 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:59.949440  1621 raft_consensus.cc:1275] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:59.953401  7828 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.954296  7828 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:59.955068  7729 consensus_queue.cc:1059] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:59.956000  7729 consensus_queue.cc:1243] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer 27308aae2ef347ccba1b27e7f6f04334 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:59.957474  7828 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:02:59.958199  7725 raft_consensus.cc:3055] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:59.958683  7725 raft_consensus.cc:740] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:02:59.960067  7725 consensus_queue.cc:260] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:02:59.961510  7725 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.941313  7801 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting leader election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:59.963198  7801 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:59.963449  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:59.964286  2267 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:02:59.967212  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:59.967571  7807 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:02:59.969071  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:59.971194  1662 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:02:59.972882  2266 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:59.974599  7636 raft_consensus.cc:493] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:02:59.975211  7636 raft_consensus.cc:515] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:02:59.976029  7163 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:59.976418  7163 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.976737  7163 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:59.977399  7636 leader_election.cc:290] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:59.977942  7636 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:59.973805  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:02:59.980947  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:02:59.981292  7839 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:02:59.982447  1616 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:02:59.984339  1688 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:59.941444  7795 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.999555  7795 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.004642  7739 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:00.005561  7739 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.023064  1617 raft_consensus.cc:1275] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:03:00.034094  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.027655  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:00.033154  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:00.042407  1543 pending_rounds.cc:85] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 8
I20260709 13:03:00.042661  1694 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:00.042809  1543 pending_rounds.cc:107] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:03:00.043166  1543 raft_consensus.cc:2889] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:00.043380  1688 raft_consensus.cc:2393] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 17: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:03:00.031715  1514 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:00.047596  1620 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:00.044590  7729 raft_consensus.cc:493] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:03:00.017920  7163 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:00.050834  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 139072us
I20260709 13:03:00.057129  1690 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:00.060362  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:00.031224  7830 consensus_queue.cc:1048] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:03:00.068213  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:00.070679  1694 raft_consensus.cc:2368] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 16. Current term is 17.
I20260709 13:03:00.053756  7729 raft_consensus.cc:515] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:00.067692  7537 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:03:00.073379  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:00.083648  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:03:00.091032  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.092077  1541 raft_consensus.cc:1275] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:00.097652  7526 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:00.098392  7526 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:00.099742  1546 raft_consensus.cc:1240] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:00.100718  1542 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:00.101331  1544 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:03:00.101526  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.103322  7526 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:00.084537  7739 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:00.107373  1539 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:03:00.123294  7526 consensus_queue.cc:1048] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:03:00.124169  7795 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.125695  7729 leader_election.cc:290] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:00.126566  7795 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:00.111754  7778 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:00.127151  7798 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:00.127266  7778 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:00.129913  7778 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:00.131629  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.132613  1548 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:03:00.134006  2232 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:00.136160  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.137192  1540 raft_consensus.cc:2410] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:00.139400  7778 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:00.139933  7778 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:00.143260  7778 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:00.144560  7163 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:00.149569  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:00.152007  1514 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:00.160382  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:00.164826  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:00.165339  1616 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:00.088861  7807 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:03:00.160068  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:00.122916  7636 raft_consensus.cc:493] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:03:00.172796  1621 raft_consensus.cc:2393] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 19: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:03:00.180805  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:00.181756  1693 raft_consensus.cc:2393] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 15: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:03:00.183135  7700 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:00.177388  7787 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.185016  7691 consensus_queue.cc:1048] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:03:00.185765  1614 raft_consensus.cc:1240] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:00.187911  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.195919  1586 leader_election.cc:400] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 16. Current term is 17.
I20260709 13:03:00.196343  1586 leader_election.cc:403] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:03:00.198559  7719 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:00.183683  7700 raft_consensus.cc:697] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:00.205190  7723 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:00.205541  1586 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:03:00.176659  7636 raft_consensus.cc:515] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:00.221673  1616 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:03:00.227222  1693 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
W20260709 13:03:00.229000  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 106990us
I20260709 13:03:00.227675  1693 pending_rounds.cc:85] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting all ops after (but not including) 7
I20260709 13:03:00.230953  1693 pending_rounds.cc:107] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:03:00.231009  7616 raft_consensus.cc:2749] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987) with higher term. Message: Invalid argument: T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 for earlier term 16. Current term is 17.
I20260709 13:03:00.231289  1693 raft_consensus.cc:2889] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:00.238715  7843 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:00.239528  7843 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.241644  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33125bfca16d4902a09564d1eef1a47f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.242085  7843 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:00.243306  7787 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:00.251091  7846 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:00.235157  7321 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.260486  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.260835  2272 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:03:00.244782  7805 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.260219  1663 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:00.219007  7700 consensus_queue.cc:237] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.266878  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:00.232782  7839 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:00.263801  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:00.278366  1587 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:00.279076  1661 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:03:00.287676  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 58041.2us
I20260709 13:03:00.264178  7843 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:03:00.275880  7795 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.297515  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:00.302862  1689 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.297753  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:00.286336  7786 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:00.267693  7321 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.306356  1541 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 16: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:03:00.300184  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.308677  7321 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:00.290482  1587 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:00.310997  7846 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:00.282292  7729 consensus_queue.cc:1059] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:03:00.311532  7846 raft_consensus.cc:697] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:00.311934  7729 raft_consensus.cc:3055] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:00.312355  7729 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:00.312543  7846 consensus_queue.cc:237] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.313172  7805 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:00.313683  1543 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:00.313306  7729 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.314630  7795 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.315634  7791 raft_consensus.cc:493] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:03:00.316111  7801 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:00.316246  7791 raft_consensus.cc:515] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:00.316834  7795 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:00.317196  7855 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:03:00.318360  7791 leader_election.cc:290] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:00.289005  7691 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:00.320341  7801 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:03:00.322104  7870 log.cc:927] Time spent T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.270s	user 0.003s	sys 0.000s
I20260709 13:03:00.326304  7827 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:00.326879  7827 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:00.327924  7827 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:00.331847  7828 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:00.332393  7828 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.334339  7828 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:00.310748  7778 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:00.339670  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 60662us
I20260709 13:03:00.342454  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:03:00.343128  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 47266.9us
I20260709 13:03:00.344568  1514 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:00.314647  7729 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:00.352191  7636 leader_election.cc:290] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:00.359730  1661 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:00.365285  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:00.369093  1661 leader_election.cc:304] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:03:00.370162  7828 raft_consensus.cc:2749] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:00.371845  1661 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:00.373811  1586 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:00.374941  7608 raft_consensus.cc:2749] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:00.375676  1586 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:00.376104  7828 raft_consensus.cc:2749] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:00.377475  7608 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:00.378686  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:00.379585  1695 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 19.
I20260709 13:03:00.379769  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:00.340492  1689 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 19.
I20260709 13:03:00.380507  1691 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 19.
W20260709 13:03:00.404779  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 121685us
I20260709 13:03:00.405215  1511 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:00.407279  7807 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:00.407860  7807 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 19 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:00.408939  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.408857  7807 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.409636  1543 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 19.
W20260709 13:03:00.415030  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.421814  1587 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:03:00.403311  1494 auto_rebalancer.cc:629] Failed to schedule move for tablet 1352a2bbd594477385f629ba7222a83f: Illegal state: Replica c20847a6dcea4c2a9cbaf35a2171e33d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:00.438752  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:00.381271  7791 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:00.440724  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:00.446161  1695 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 18.
I20260709 13:03:00.450170  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a432d1e3024e13a2d20229db9a8d85" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:00.381597  7723 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
W20260709 13:03:00.476183  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 77869.4us
I20260709 13:03:00.474058  1511 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:00.486313  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.500543  7799 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:00.503737  7321 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:00.504220  7321 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.472409  7636 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.509079  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:00.511839  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:00.506588  7321 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:00.564284  1696 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.571326  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162dcbb665f341d1ab765403c5c3a480" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:03:00.569154  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 120990us
W20260709 13:03:00.572292  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 150614us
I20260709 13:03:00.575078  1661 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:00.561928  7799 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:00.581877  2272 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 17.
I20260709 13:03:00.579399  7799 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.580344  7163 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:00.569537  7636 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:00.601909  7799 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.614046  7890 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.614625  7890 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:00.616842  7890 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:03:00.618010  7876 log.cc:927] Time spent T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:03:00.622828  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:00.608891  7778 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:00.611758  7851 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:03:00.610455  7801 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.625862  7636 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:00.626267  7801 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.603554  7178 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.180s
I20260709 13:03:00.611958  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a63558e47a84017a3a62f52bb8cb3eb" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.628325  7801 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:00.669502  2231 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:00.671438  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:00.673715  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:00.672235  2267 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:03:00.674319  1616 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:03:00.683266  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 166569us
I20260709 13:03:00.684152  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:00.687877  7735 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:00.688153  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:00.688319  7735 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:00.688697  7735 raft_consensus.cc:3060] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.689762  7827 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:00.690439  7827 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.688706  1618 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:00.692885  7827 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:00.696307  7608 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:00.696859  7608 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.698969  7608 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:00.700213  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:00.701118  1694 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:03:00.702829  1586 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:00.703807  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:00.709790  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:00.710022  1615 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 18.
I20260709 13:03:00.710572  1623 raft_consensus.cc:2393] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 44c8c572048a40b1a5e71865068ed1bb in current term 17: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:03:00.714284  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:00.717748  1694 raft_consensus.cc:2393] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 15: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:03:00.717919  1696 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 19.
I20260709 13:03:00.722344  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.723178  1545 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:03:00.724851  7801 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.725387  7801 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.727718  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:00.728382  2263 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 15.
I20260709 13:03:00.719637  7890 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:00.729405  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.733565  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:00.734218  2266 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:00.723001  1511 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:00.727718  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:00.729559  7890 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:00.720293  1662 leader_election.cc:304] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:03:00.760810  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.752059  1514 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:00.752024  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:00.762096  1539 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
W20260709 13:03:00.762503  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 44066.8us
I20260709 13:03:00.763460  1662 leader_election.cc:304] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:03:00.767796  1662 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:00.769168  1545 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:03:00.795917  1618 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 19.
I20260709 13:03:00.761444  7851 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:00.767379  7890 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:00.772490  7691 raft_consensus.cc:2749] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:00.772943  7852 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:00.776340  7163 raft_consensus.cc:2749] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:00.773386  7801 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:00.804586  1616 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 19.
I20260709 13:03:00.785488  7636 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:00.809177  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:00.822580  1588 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:00.807247  7851 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 19 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:00.824875  7851 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.807600  7636 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.827556  7636 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:00.831996  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 117049us
I20260709 13:03:00.820138  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:00.835480  1615 raft_consensus.cc:2393] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 13: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:03:00.847785  2266 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:03:00.867069  7505 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:00.867555  7505 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.867901  7505 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:00.860150  7843 raft_consensus.cc:493] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.881652  1689 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:00.895300  7843 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:00.943559  2263 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:03:00.908702  7791 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:00.965530  1513 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:03:00.962735  7887 log.cc:927] Time spent T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.186s	user 0.004s	sys 0.000s
I20260709 13:03:00.974715  7725 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:03:00.888571  7321 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:00.986758  7890 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:03:00.989007  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.984922  7791 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:00.992151  7908 log.cc:927] Time spent T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:03:00.900287  7735 raft_consensus.cc:515] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:01.020433  1545 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:00.995452  7178 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:01.027400  1614 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:03:01.043936  7636 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:01.046294  7636 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:01.049280  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:01.049896  2272 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:01.056459  7735 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:01.058986  7505 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:01.061275  1697 raft_consensus.cc:1240] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Rejecting Update request from peer e37b8013aec24431a6672a857806329e for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:01.062065  7505 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:01.067620  2272 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:03:01.068684  1662 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:01.039367  7178 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:01.076620  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:01.128131  2272 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:01.128312  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:01.130131  7890 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:01.130307  1621 raft_consensus.cc:2393] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 19: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:03:01.136343  7791 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:01.140836  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:01.147805  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:01.151088  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:01.151942  7178 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:01.127082  7636 raft_consensus.cc:2804] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:01.198447  1694 raft_consensus.cc:2468] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 19.
I20260709 13:03:01.202287  7636 raft_consensus.cc:697] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:01.209671  7636 consensus_queue.cc:237] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:01.218726  1619 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:03:01.220458  1617 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:01.197540  7843 leader_election.cc:290] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:03:01.227339  7799 consensus_meta.cc:287] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Time spent flushing consensus metadata: real 0.549s	user 0.006s	sys 0.006s
I20260709 13:03:01.233933  7799 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:01.235975  7799 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:01.243002  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:01.244205  2231 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:01.244588  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:01.245332  1696 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 14.
I20260709 13:03:01.245591  7843 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:01.246841  7735 raft_consensus.cc:2804] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:01.247335  7735 raft_consensus.cc:697] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 19 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:01.248229  7735 consensus_queue.cc:237] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:01.243753  1661 leader_election.cc:304] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:03:01.254557  1661 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:01.203465  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:01.264343  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:01.256979  7691 raft_consensus.cc:2749] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:01.287710  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3006951ad004b6b87217fff5303a9ab" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:01.259117  7791 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.288758  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:01.295495  1614 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:01.297757  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:01.301371  1615 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:01.313102  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bd2e8876bc642db9518e484c47f1ac3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:01.315900  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:01.316319  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:01.317041  1539 raft_consensus.cc:2393] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 14: Already voted for candidate 44c8c572048a40b1a5e71865068ed1bb in this term.
I20260709 13:03:01.316474  1541 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:01.320912  7893 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:01.314798  1514 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:03:01.310992  2272 raft_consensus.cc:2468] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 18.
I20260709 13:03:01.343612  1689 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:01.344515  1545 raft_consensus.cc:2468] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:03:01.348412  2232 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:01.355870  7321 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:01.356762  7777 raft_consensus.cc:2764] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:03:01.356703  1541 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 20.
I20260709 13:03:01.362152  1511 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:01.365532  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:01.366118  1692 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:01.384554  7497 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:01.385195  7497 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.385574  7497 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:01.387540  7725 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:01.395582  1587 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:03:01.397403  1694 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:03:01.415570  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236ab34afb704d93bb2705d3aadbe163" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:01.406764  1588 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:03:01.430774  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61005.6us
I20260709 13:03:01.434576  1588 leader_election.cc:304] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:03:01.414333  7890 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:01.436244  1586 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:01.397714  7888 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:03:01.439721  7616 raft_consensus.cc:2804] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:01.443216  7893 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:03:01.447129  7879 raft_consensus.cc:2749] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:01.443662  7846 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:01.510576  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:01.510555  1661 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:03:01.511454  1694 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:01.516953  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 71410.7us
W20260709 13:03:01.530148  7926 log.cc:927] Time spent T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:03:01.534917  1692 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 19.
I20260709 13:03:01.526342  7723 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:03:01.571326  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 119209us
I20260709 13:03:01.574374  1694 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 20.
I20260709 13:03:01.560940  7890 raft_consensus.cc:697] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:01.524266  7846 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:03:01.582825  7928 log.cc:927] Time spent T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:03:01.602190  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 165986us
I20260709 13:03:01.574882  7607 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.603453  1614 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:01.590660  7723 raft_consensus.cc:697] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:03:01.604310  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 104025us
I20260709 13:03:01.595957  7944 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:01.608871  1511 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:01.614348  1689 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:01.616290  7607 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:01.617535  7607 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 19 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
W20260709 13:03:01.619380  7930 log.cc:927] Time spent T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:03:01.619735  7890 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:01.619354  7607 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:01.624882  7846 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:01.624797  7723 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:01.596467  7805 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:03:01.638024  1615 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 19.
I20260709 13:03:01.613359  7795 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:03:01.677647  2266 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:01.666441  7931 log.cc:927] Time spent T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:03:01.672447  7791 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.660840  7616 raft_consensus.cc:697] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
W20260709 13:03:01.711696  1494 auto_rebalancer.cc:629] Failed to schedule move for tablet 4a5fdc87ebdd414ab8baa34e162bc8c4: Illegal state: Replica 44c8c572048a40b1a5e71865068ed1bb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:01.700582  7795 consensus_queue.cc:1059] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
W20260709 13:03:01.772205  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 59460.2us
I20260709 13:03:01.768236  7497 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:03:01.803244  7953 log.cc:927] Time spent T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:03:01.758595  7616 consensus_queue.cc:237] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:01.820843  7497 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:01.834388  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:01.855768  7954 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:03:01.865573  1695 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:01.873096  1622 raft_consensus.cc:1275] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:03:01.875109  7777 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:01.902359  7723 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.903154  7723 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:01.923063  7526 consensus_queue.cc:1048] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:03:01.928165  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 138108us
I20260709 13:03:01.930853  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:01.998793  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:01.999851  1542 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:03:02.001811  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:03:02.008214  7940 raft_consensus.cc:3055] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:02.006067  7723 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:02.008682  7321 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:02.009112  7321 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.009469  7321 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:02.008695  7940 raft_consensus.cc:740] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:02.012465  7940 consensus_queue.cc:260] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:02.020300  7932 log.cc:927] Time spent T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.479s	user 0.005s	sys 0.000s
I20260709 13:03:02.020341  7321 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:02.022961  7321 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:02.026403  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 78409.5us
I20260709 13:03:02.028666  7828 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.029157  7828 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:02.033182  1691 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:02.037137  1547 raft_consensus.cc:3060] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:02.038105  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:02.038647  1692 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.039353  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:02.039963  1542 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:02.049220  2272 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:02.060621  7828 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:02.076781  1542 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:03:02.075152  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:02.080494  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:02.081775  1688 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:03:02.081173  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:02.082648  1696 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:02.085002  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "44c8c572048a40b1a5e71865068ed1bb" is_pre_election: true
I20260709 13:03:02.085728  1542 raft_consensus.cc:2393] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 17: Already voted for candidate 27308aae2ef347ccba1b27e7f6f04334 in this term.
I20260709 13:03:02.085974  1587 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:03:02.090941  1547 raft_consensus.cc:1275] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:02.092577  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:03:02.097838  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 47528.2us
I20260709 13:03:02.103498  7950 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:02.115895  1586 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:02.117060  7843 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:02.107070  7828 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:03:02.135519  1696 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
W20260709 13:03:02.155666  7931 log.cc:927] Time spent T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:02.156203  7940 raft_consensus.cc:3060] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:02.161026  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 157893us
I20260709 13:03:02.164740  1618 raft_consensus.cc:1240] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Rejecting Update request from peer 44c8c572048a40b1a5e71865068ed1bb for earlier term 17. Current term is 18. Ops: []
W20260709 13:03:02.165875  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 80686us
I20260709 13:03:02.112773  1692 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
W20260709 13:03:02.166749  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 61628.7us
I20260709 13:03:02.210418  7805 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:02.171991  7950 raft_consensus.cc:697] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:02.212570  7950 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:02.230664  1692 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:02.233187  1511 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334
W20260709 13:03:02.238142  7976 log.cc:927] Time spent T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:03:02.258250  1692 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:02.264230  7954 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:02.281121  7954 raft_consensus.cc:697] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:02.282106  7954 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:02.264045  7830 consensus_queue.cc:1048] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:03:02.262984  7505 consensus_queue.cc:1059] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:03:02.297185  7505 raft_consensus.cc:3055] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:02.297569  7505 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:02.298369  7505 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:02.288305  7497 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:03:02.299405  7505 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.332309  1619 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:03:02.382237  1543 raft_consensus.cc:1240] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Rejecting Update request from peer 27308aae2ef347ccba1b27e7f6f04334 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:02.267702   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:02.413652  2272 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:03:02.414791  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 87233.1us
I20260709 13:03:02.417922  7851 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:02.423547  1541 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:02.424821  1548 raft_consensus.cc:1275] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:03:02.425166  1548 pending_rounds.cc:85] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Aborting all ops after (but not including) 14
I20260709 13:03:02.425387  1548 pending_rounds.cc:107] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:03:02.425601  1548 raft_consensus.cc:2889] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:02.447021  1663 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:02.447942  1696 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:02.448212  7830 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:02.449569  7879 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:02.451067  7879 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:02.461575  2272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:03:02.462312  2272 raft_consensus.cc:606] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:02.475132  2272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:03:02.476132  2272 raft_consensus.cc:606] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 15 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:02.480775  1445 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 10 to 11, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 11 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:02.483343  1445 catalog_manager.cc:5697] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 9 to 10, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 10 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:02.492026  2267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77eb0c0355254cf592e70feb5035e50f"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:03:02.493216  2267 raft_consensus.cc:606] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:02.493623  2267 raft_consensus.cc:614] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:02.488457  7890 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:03:02.521061  2266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:03:02.522713  2266 raft_consensus.cc:606] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:02.523217  2266 raft_consensus.cc:614] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:02.504501  7723 consensus_queue.cc:1048] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:03:02.530202  2266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "effd69042c284e8386aafb50372a93b6"
dest_uuid: "e37b8013aec24431a6672a857806329e"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:53842
I20260709 13:03:02.531143  2266 raft_consensus.cc:606] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:02.544123   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:03:02.558826  1440 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33072 (request call id 138) took 12270 ms (client timeout 15000 ms). Trace:
I20260709 13:03:02.560616  1445 catalog_manager.cc:5697] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.562179   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:02.588944  1445 catalog_manager.cc:5697] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 9 to 11, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 11 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:02.559305  1440 rpcz_store.cc:269] 0709 13:02:50.287945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.288256 (+   311us) service_pool.cc:224] Handling call
0709 13:03:02.558628 (+12270372us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:59.077421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:59.077983 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:59.078019 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:02:59.078039 (+    20us) tablet.cc:662] Decoding operations
0709 13:02:59.079199 (+  1160us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:59.079295 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:59.079323 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:02:59.356195 (+276872us) tablet.cc:701] Row locks acquired
0709 13:02:59.356225 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:02:59.356435 (+   210us) write_op.cc:270] Start()
0709 13:02:59.356584 (+   149us) write_op.cc:276] Timestamp: P: 1783602179356373 usec, L: 0
0709 13:02:59.356613 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:02:59.357487 (+   874us) log.cc:844] Serialized 5129 byte log entry
0709 13:02:59.882940 (+525453us) op_driver.cc:464] REPLICATION: finished
0709 13:03:00.072995 (+190055us) write_op.cc:301] APPLY: starting
0709 13:03:00.077237 (+  4242us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:00.624899 (+547662us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:00.625031 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:00.726146 (+101115us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:00.726513 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:03:00.726575 (+    62us) write_op.cc:312] APPLY: finished
0709 13:03:00.727033 (+   458us) log.cc:844] Serialized 121 byte log entry
0709 13:03:00.733152 (+  6119us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:00.733484 (+   332us) write_op.cc:454] Released schema lock
0709 13:03:00.733545 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:00.734431 (+   886us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:00.734464 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1732063,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":183522,"apply.run_cpu_time_us":24020,"apply.run_wall_time_us":661482,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58519,"num_ops":13,"prepare.queue_time_us":352169,"prepare.run_cpu_time_us":15148,"prepare.run_wall_time_us":334599,"raft.queue_time_us":191993,"raft.run_cpu_time_us":78318,"raft.run_wall_time_us":140234,"replication_time_us":526004,"thread_start_us":480294,"threads_started":4,"wal-append.queue_time_us":58253,"wal-append.run_cpu_time_us":53126,"wal-append.run_wall_time_us":2312353}]]}
I20260709 13:03:02.608045  1445 catalog_manager.cc:5697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 12 to 13, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 13 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:02.610551  1445 catalog_manager.cc:5697] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 7 to 9, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 9 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.629405  1445 catalog_manager.cc:5697] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 7 to 10, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 10 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.636497  1688 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:02.644827  7890 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:02.645035  1445 catalog_manager.cc:5697] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:02.657747  1445 catalog_manager.cc:5697] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 7 to 10, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 10 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:02.661558  1543 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:02.673758  7719 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:02.676777  1445 catalog_manager.cc:5697] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:02.687773  7972 raft_consensus.cc:993] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: : Instructing follower 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:02.690937  1689 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:03:02.698197  7920 raft_consensus.cc:1081] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Signalling peer 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:02.700497  7805 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:02.700691  1620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "effd69042c284e8386aafb50372a93b6"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:33892
I20260709 13:03:02.701421  1620 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:02.701773  1620 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.699813  1445 catalog_manager.cc:5697] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 7 to 8, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 8 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:02.709595  1445 catalog_manager.cc:5697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 6 to 10, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 10 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.744931  1614 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:03:02.745384  1614 pending_rounds.cc:85] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Aborting all ops after (but not including) 6
I20260709 13:03:02.745592  1614 pending_rounds.cc:107] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:03:02.745803  1614 raft_consensus.cc:2889] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:02.752077  7467 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:02.752774  1620 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:02.756495  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:02.757040  2266 raft_consensus.cc:3055] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:02.757302  2266 raft_consensus.cc:740] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:02.757980  2266 consensus_queue.cc:260] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:02.758962  2266 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.767143  7920 raft_consensus.cc:993] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:02.767691  7920 raft_consensus.cc:1081] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 15 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:02.769526  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:58526
I20260709 13:03:02.770206  1696 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:02.770627  1696 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:02.783143  2266 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:03:02.784976  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:02.785892  1620 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:02.786325  1543 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.787438  1696 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:02.800343  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:02.800900  1623 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:02.804190  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58998217db5f42c08255f6a6a86b3dae" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:02.802848  1588 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:02.804962  1696 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:02.806854  2266 raft_consensus.cc:3055] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:02.808266  7890 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:02.808804  7890 raft_consensus.cc:697] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:02.809675  7890 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:02.808102  2266 raft_consensus.cc:740] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:02.822261  2266 consensus_queue.cc:260] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:02.826457  7948 raft_consensus.cc:993] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: : Instructing follower 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:02.827023  7948 raft_consensus.cc:1081] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Signalling peer 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:02.837088  1620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:33892
I20260709 13:03:02.838060  1620 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:02.838603  1620 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.847662  1543 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 14.
I20260709 13:03:02.849761  2266 raft_consensus.cc:3060] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:02.853875  1623 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:03:02.855638  1663 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:02.861398  2266 raft_consensus.cc:2468] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:03:02.869119  7725 raft_consensus.cc:2804] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:02.869728  7725 raft_consensus.cc:697] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:02.870595  7725 consensus_queue.cc:237] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:02.918154  1620 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:02.926978  1620 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:02.928344  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:02.929690  1540 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.928201  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5886b3175b9d44069e5ba1077b09a28f" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:02.931237  2266 raft_consensus.cc:3055] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:02.931507  2266 raft_consensus.cc:740] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
W20260709 13:03:02.942407  1494 auto_rebalancer.cc:629] Failed to schedule move for tablet 10a17adb150f4450b68adcffc1c3d655: Illegal state: Replica 44c8c572048a40b1a5e71865068ed1bb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:02.948751  1623 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:02.954420  1540 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:03:02.960040  1587 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
W20260709 13:03:02.960700  1588 consensus_peers.cc:597] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a83a11e6c2348918b88fe74b7ee7361. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:02.960870  7723 raft_consensus.cc:2804] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:02.961458  7723 raft_consensus.cc:697] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:02.962324  7723 consensus_queue.cc:237] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:02.963711  1689 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:02.965097  7890 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:02.968466  2266 consensus_queue.cc:260] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:02.973266  7719 raft_consensus.cc:2955] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 LEADER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:02.981606  2266 raft_consensus.cc:3060] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.982120  1696 raft_consensus.cc:2955] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:02.993731  2266 raft_consensus.cc:2468] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:03:03.021917  1545 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:03.034794  7505 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:03:03.065088  1545 raft_consensus.cc:2955] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
W20260709 13:03:03.072876  1494 auto_rebalancer.cc:629] Failed to schedule move for tablet cecec9af1f82495390a4640f3927241f: Illegal state: Replica c20847a6dcea4c2a9cbaf35a2171e33d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
W20260709 13:03:03.084486  1494 auto_rebalancer.cc:629] Failed to schedule move for tablet 42d9e3317d944e97b0f09db457e476f3: Illegal state: Replica 27308aae2ef347ccba1b27e7f6f04334 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:03.278725  1439 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 13 to 14, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 14 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:03.280745  1439 catalog_manager.cc:5697] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 13 to 18, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 18 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:03.295995  1439 catalog_manager.cc:5697] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:03.302951  1439 catalog_manager.cc:5697] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 15 to 19, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 19 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:03.307144  1439 catalog_manager.cc:5697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 13 to 17, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 17 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:03.326088  1439 catalog_manager.cc:5697] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 12 to 16, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 16 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:03:03.338826  1445 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52824 (request call id 230) took 39758 ms (client timeout 15000 ms). Trace:
I20260709 13:03:03.338662  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet 953db44baef24f55a28e65ff051866d1 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:46330
I20260709 13:03:03.358379  2272 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:03.360350  1540 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:03:03.342423  1445 rpcz_store.cc:269] 0709 13:02:23.580499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.584225 (+  3726us) service_pool.cc:224] Handling call
0709 13:03:03.338742 (+39754517us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:02.962603 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:02.965849 (+  3246us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:02.965908 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:03:02.965928 (+    20us) tablet.cc:662] Decoding operations
0709 13:03:02.973301 (+  7373us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:02.973394 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:02.973426 (+    32us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:03:02.974600 (+  1174us) tablet.cc:701] Row locks acquired
0709 13:03:02.974646 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:03:02.974806 (+   160us) write_op.cc:270] Start()
0709 13:03:02.974947 (+   141us) write_op.cc:276] Timestamp: P: 1783602182974743 usec, L: 0
0709 13:03:02.974964 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:03:02.975601 (+   637us) log.cc:844] Serialized 4805 byte log entry
0709 13:03:03.107163 (+131562us) op_driver.cc:464] REPLICATION: finished
0709 13:03:03.109439 (+  2276us) write_op.cc:301] APPLY: starting
0709 13:03:03.109526 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:03.135991 (+ 26465us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:03.136083 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:03.144888 (+  8805us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:03.145168 (+   280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:03:03.145212 (+    44us) write_op.cc:312] APPLY: finished
0709 13:03:03.145512 (+   300us) log.cc:844] Serialized 113 byte log entry
0709 13:03:03.156961 (+ 11449us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:03.157107 (+   146us) write_op.cc:454] Released schema lock
0709 13:03:03.157164 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:03.180709 (+ 23545us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:03.180762 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":291082,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":1999,"apply.run_cpu_time_us":14748,"apply.run_wall_time_us":48105,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54335,"num_ops":12,"prepare.queue_time_us":217446,"prepare.run_cpu_time_us":33192,"prepare.run_wall_time_us":70168,"raft.queue_time_us":22916,"raft.run_cpu_time_us":1306,"raft.run_wall_time_us":2128,"replication_time_us":132012,"thread_start_us":197693,"threads_started":4,"wal-append.queue_time_us":99973}]]}
I20260709 13:03:03.364329  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet 953db44baef24f55a28e65ff051866d1 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:03:03.362594  7719 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:03:03.361531  7723 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:03:03.352767  1439 catalog_manager.cc:5697] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 14 to 16, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 16 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:03.371579  1439 catalog_manager.cc:5697] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 17 to 18, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 18 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:03.373126  1439 catalog_manager.cc:5697] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 6 to 10, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 10 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:03.374714  1439 catalog_manager.cc:5697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:03.376708  1439 catalog_manager.cc:5697] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 12 to 13, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 13 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:03.378460  1439 catalog_manager.cc:5697] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:03.381131  1439 catalog_manager.cc:5697] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 13 to 17, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 17 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:03.389583  1623 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:03.399034  7725 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:03.412492  1543 raft_consensus.cc:1275] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:03.415527  7723 consensus_queue.cc:1048] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:03:03.412698  1439 catalog_manager.cc:5697] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 13 to 17, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 17 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:03.429165  2266 raft_consensus.cc:1275] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:03.429627  2267 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:03.431170  7505 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:03.433072  7725 consensus_queue.cc:1048] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:03.427232  1439 catalog_manager.cc:5697] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 8 to 12, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 12 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:03.453760  1439 catalog_manager.cc:5697] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 11 to 12, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 12 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:03.455952  1439 catalog_manager.cc:5697] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 10 to 12, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 12 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:03.458616  1439 catalog_manager.cc:5697] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:03.460233  1439 catalog_manager.cc:5697] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 10 to 12, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 12 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:03.567950   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:03.591533  8014 ts_tablet_manager.cc:933] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:03.664016  8014 tablet_copy_client.cc:323] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:03:03.666915  1632 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 7a83a11e6c2348918b88fe74b7ee7361 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:03:03.667579  1632 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 7a83a11e6c2348918b88fe74b7ee7361 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-7a83a11e6c2348918b88fe74b7ee7361
I20260709 13:03:03.676149  1632 tablet_copy_source_session.cc:215] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:03.684636  8014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a83a11e6c2348918b88fe74b7ee7361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:03.718272  8014 tablet_copy_client.cc:806] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:03.718907  8014 tablet_copy_client.cc:670] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:03.729077  8014 tablet_copy_client.cc:538] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:03.742794  8014 tablet_bootstrap.cc:492] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:03:03.903136  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33072 (request call id 139) took 1255 ms. Trace:
I20260709 13:03:03.918741  8014 tablet_bootstrap.cc:492] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:03.920567  8014 tablet_bootstrap.cc:492] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:03.910733  1439 rpcz_store.cc:276] 0709 13:03:02.647741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.647991 (+   250us) service_pool.cc:224] Handling call
0709 13:03:03.903045 (+1255054us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:03.651288 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:03.651907 (+   619us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:03.651987 (+    80us) write_op.cc:435] Acquired schema lock
0709 13:03:03.652008 (+    21us) tablet.cc:662] Decoding operations
0709 13:03:03.654985 (+  2977us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:03.655066 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:03.655092 (+    26us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:03:03.656342 (+  1250us) tablet.cc:701] Row locks acquired
0709 13:03:03.656360 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:03:03.656510 (+   150us) write_op.cc:270] Start()
0709 13:03:03.656613 (+   103us) write_op.cc:276] Timestamp: P: 1783602183656451 usec, L: 0
0709 13:03:03.656634 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:03.657295 (+   661us) log.cc:844] Serialized 7431 byte log entry
0709 13:03:03.738960 (+ 81665us) op_driver.cc:464] REPLICATION: finished
0709 13:03:03.767932 (+ 28972us) write_op.cc:301] APPLY: starting
0709 13:03:03.768064 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:03.809915 (+ 41851us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:03.809998 (+    83us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:03.848962 (+ 38964us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:03.849271 (+   309us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:03:03.849315 (+    44us) write_op.cc:312] APPLY: finished
0709 13:03:03.849664 (+   349us) log.cc:844] Serialized 172 byte log entry
0709 13:03:03.875541 (+ 25877us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:03.875720 (+   179us) write_op.cc:454] Released schema lock
0709 13:03:03.875776 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:03.878324 (+  2548us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:03.878356 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8272,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":28712,"apply.run_cpu_time_us":23310,"apply.run_wall_time_us":110347,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83623,"num_ops":19,"prepare.queue_time_us":66002,"prepare.run_cpu_time_us":5021,"prepare.run_wall_time_us":6291,"replication_time_us":82164,"spinlock_wait_cycles":1920,"thread_start_us":92927,"threads_started":2}]]}
I20260709 13:03:03.908239  1441 catalog_manager.cc:5697] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 10 to 16, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:03.924968  1441 catalog_manager.cc:5697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:03.921365  8014 ts_tablet_manager.cc:1403] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.179s	user 0.040s	sys 0.008s
I20260709 13:03:03.927816  1441 catalog_manager.cc:5697] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 11 to 15, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 15 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:03.937494  1441 catalog_manager.cc:5697] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:03.961174  8014 raft_consensus.cc:359] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:03.962189  8014 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:03.962905  8014 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:03.971737  1441 catalog_manager.cc:5697] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 10 to 12, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 12 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:03.982043  8014 ts_tablet_manager.cc:1434] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:03:03.982125  1441 catalog_manager.cc:5697] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 10 to 14, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 14 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:03.983924  1632 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-7a83a11e6c2348918b88fe74b7ee7361 received from {username='slave'} at 127.0.0.1:33892
I20260709 13:03:03.984474  1632 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-7a83a11e6c2348918b88fe74b7ee7361 on tablet 7a83a11e6c2348918b88fe74b7ee7361 with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:04.038646  1441 catalog_manager.cc:5697] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 9 to 12, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 12 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:04.040784  1441 catalog_manager.cc:5697] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:04.042428  1441 catalog_manager.cc:5697] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 4 to 9, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 9 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.070070  1441 catalog_manager.cc:5697] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 7 to 12, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 12 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.085718  1441 catalog_manager.cc:5697] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 6 to 10, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 10 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.088740  1441 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 11 to 15, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 15 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:04.248209  1445 catalog_manager.cc:5697] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 15 to 16, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 16 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:04.249854  1445 catalog_manager.cc:5697] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 12 to 13, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 13 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:04.251225  1445 catalog_manager.cc:5697] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 13 to 14, leader changed from e37b8013aec24431a6672a857806329e (127.0.107.132) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 14 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:03:04.332592  1441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52808 (request call id 203) took 18970 ms (client timeout 15000 ms). Trace:
I20260709 13:03:04.335270  1444 catalog_manager.cc:5697] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.362046  1444 catalog_manager.cc:5697] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.363721  1444 catalog_manager.cc:5697] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.365341  1444 catalog_manager.cc:5697] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 10 to 17, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 17 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.367084  1444 catalog_manager.cc:5697] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 13 to 15, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 15 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.368629  1444 catalog_manager.cc:5697] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 8 to 13, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 13 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:04.371266  1444 catalog_manager.cc:5697] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.372954  1444 catalog_manager.cc:5697] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 11 to 14, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 14 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:04.374715  1444 catalog_manager.cc:5697] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 8 to 12, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 12 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.376222  1444 catalog_manager.cc:5697] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 15 to 18, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 18 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
W20260709 13:03:04.358404  1441 rpcz_store.cc:269] 0709 13:02:45.362525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.373197 (+ 10672us) service_pool.cc:224] Handling call
0709 13:03:04.332489 (+18959292us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:04.184759 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:04.185282 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:04.185314 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:03:04.185332 (+    18us) tablet.cc:662] Decoding operations
0709 13:03:04.186358 (+  1026us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:04.186441 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:04.186468 (+    27us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:03:04.197681 (+ 11213us) tablet.cc:701] Row locks acquired
0709 13:03:04.197702 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:03:04.197839 (+   137us) write_op.cc:270] Start()
0709 13:03:04.197949 (+   110us) write_op.cc:276] Timestamp: P: 1783602184197792 usec, L: 0
0709 13:03:04.197972 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:03:04.198529 (+   557us) log.cc:844] Serialized 4810 byte log entry
0709 13:03:04.200737 (+  2208us) op_driver.cc:464] REPLICATION: finished
0709 13:03:04.201170 (+   433us) write_op.cc:301] APPLY: starting
0709 13:03:04.201290 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:04.207236 (+  5946us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:04.207330 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:04.226861 (+ 19531us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:04.227126 (+   265us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:03:04.227177 (+    51us) write_op.cc:312] APPLY: finished
0709 13:03:04.227543 (+   366us) log.cc:844] Serialized 113 byte log entry
0709 13:03:04.228328 (+   785us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:04.228485 (+   157us) write_op.cc:454] Released schema lock
0709 13:03:04.228539 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:04.228910 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:04.228942 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":226,"apply.run_cpu_time_us":15085,"apply.run_wall_time_us":27692,"cfile_cache_hit":48,"cfile_cache_hit_bytes":50208,"num_ops":12,"prepare.queue_time_us":20043,"prepare.run_cpu_time_us":3885,"prepare.run_wall_time_us":14074,"replication_time_us":2630,"thread_start_us":19842,"threads_started":1}]]}
I20260709 13:03:04.378134  1444 catalog_manager.cc:5697] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 14 to 15, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 15 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.379405  1444 catalog_manager.cc:5697] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 10 to 12, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 12 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.380656  1444 catalog_manager.cc:5697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 13 to 21, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 21 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.382438  1444 catalog_manager.cc:5697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 9 to 17, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 17 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.384459  1444 catalog_manager.cc:5697] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 9 to 10, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 10 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.385875  1444 catalog_manager.cc:5697] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 10 to 15, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 15 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:04.387746  1444 catalog_manager.cc:5697] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.388927  1444 catalog_manager.cc:5697] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 10 to 15, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 15 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:04.443568  1445 catalog_manager.cc:5697] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index -1 to 12, term changed from 11 to 20, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to <none>, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 20 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:04.462884  1444 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52838 (request call id 257) took 5802 ms. Trace:
I20260709 13:03:04.472812  1446 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.474713  1446 catalog_manager.cc:5697] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 12 to 19, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 19 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:04.479691  1446 catalog_manager.cc:5697] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.482211  1446 catalog_manager.cc:5697] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.463354  1444 rpcz_store.cc:276] 0709 13:02:58.660447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.660609 (+   162us) service_pool.cc:224] Handling call
0709 13:03:04.462797 (+5802188us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:04.395991 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:04.396497 (+   506us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:04.396532 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:03:04.396544 (+    12us) tablet.cc:662] Decoding operations
0709 13:03:04.397970 (+  1426us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:04.398021 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:04.398050 (+    29us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:03:04.399284 (+  1234us) tablet.cc:701] Row locks acquired
0709 13:03:04.399301 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:03:04.399468 (+   167us) write_op.cc:270] Start()
0709 13:03:04.399571 (+   103us) write_op.cc:276] Timestamp: P: 1783602184399389 usec, L: 0
0709 13:03:04.399592 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:04.400190 (+   598us) log.cc:844] Serialized 7134 byte log entry
0709 13:03:04.402589 (+  2399us) op_driver.cc:464] REPLICATION: finished
0709 13:03:04.402981 (+   392us) write_op.cc:301] APPLY: starting
0709 13:03:04.403053 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:04.411654 (+  8601us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:04.411740 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:04.421608 (+  9868us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:04.421871 (+   263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:03:04.421915 (+    44us) write_op.cc:312] APPLY: finished
0709 13:03:04.422251 (+   336us) log.cc:844] Serialized 164 byte log entry
0709 13:03:04.423046 (+   795us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:04.423203 (+   157us) write_op.cc:454] Released schema lock
0709 13:03:04.423256 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:04.432542 (+  9286us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:04.432575 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23688,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":224,"apply.run_cpu_time_us":19774,"apply.run_wall_time_us":29522,"cfile_cache_hit":72,"cfile_cache_hit_bytes":75312,"num_ops":18,"prepare.queue_time_us":104,"prepare.run_cpu_time_us":4480,"prepare.run_wall_time_us":15568,"replication_time_us":2899}]]}
I20260709 13:03:04.484541  1446 catalog_manager.cc:5697] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 10 to 16, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:04.487661  1446 catalog_manager.cc:5697] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 11 to 18, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 18 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.504915  2272 raft_consensus.cc:1217] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 20 LEARNER]: Deduplicated request from leader. Original: 20.11->[20.12-20.12]   Dedup: 20.12->[]
I20260709 13:03:04.533064  1444 catalog_manager.cc:5697] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e reported cstate change: leader changed from <none> to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 20 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:04.605885  1443 catalog_manager.cc:5697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:04.612882  1446 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52824 (request call id 232) took 4470 ms. Trace:
I20260709 13:03:04.690389  1446 rpcz_store.cc:276] 0709 13:03:00.142780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.143096 (+   316us) service_pool.cc:224] Handling call
0709 13:03:04.612825 (+4469729us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:04.493389 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:04.493872 (+   483us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:04.493913 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:03:04.493924 (+    11us) tablet.cc:662] Decoding operations
0709 13:03:04.494682 (+   758us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:04.494736 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:04.494761 (+    25us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:03:04.495279 (+   518us) tablet.cc:701] Row locks acquired
0709 13:03:04.495294 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:03:04.495469 (+   175us) write_op.cc:270] Start()
0709 13:03:04.495568 (+    99us) write_op.cc:276] Timestamp: P: 1783602184495389 usec, L: 0
0709 13:03:04.495589 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:04.496154 (+   565us) log.cc:844] Serialized 2482 byte log entry
0709 13:03:04.498765 (+  2611us) op_driver.cc:464] REPLICATION: finished
0709 13:03:04.500097 (+  1332us) write_op.cc:301] APPLY: starting
0709 13:03:04.500149 (+    52us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:04.502263 (+  2114us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:04.502323 (+    60us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:04.515594 (+ 13271us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:04.515779 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:03:04.515822 (+    43us) write_op.cc:312] APPLY: finished
0709 13:03:04.530134 (+ 14312us) log.cc:844] Serialized 65 byte log entry
0709 13:03:04.530959 (+   825us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:04.531066 (+   107us) write_op.cc:454] Released schema lock
0709 13:03:04.531112 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:04.531485 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:04.531513 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25353,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":1157,"apply.run_cpu_time_us":6613,"apply.run_wall_time_us":31342,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25104,"num_ops":6,"prepare.queue_time_us":102,"prepare.run_cpu_time_us":3002,"prepare.run_wall_time_us":3011,"replication_time_us":3077}]]}
I20260709 13:03:04.737154   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:04.808315  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet 953db44baef24f55a28e65ff051866d1 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:46330
I20260709 13:03:04.815312  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet 953db44baef24f55a28e65ff051866d1 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
W20260709 13:03:04.818800  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52824 (request call id 231) took 23091 ms (client timeout 15000 ms). Trace:
W20260709 13:03:04.819432  1443 rpcz_store.cc:269] 0709 13:02:41.727380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.737691 (+ 10311us) service_pool.cc:224] Handling call
0709 13:03:04.818712 (+23081021us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:04.696679 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:04.697316 (+   637us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:04.697357 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:03:04.697374 (+    17us) tablet.cc:662] Decoding operations
0709 13:03:04.697717 (+   343us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:04.697775 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:04.697805 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:04.697996 (+   191us) tablet.cc:701] Row locks acquired
0709 13:03:04.698012 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:03:04.698161 (+   149us) write_op.cc:270] Start()
0709 13:03:04.698277 (+   116us) write_op.cc:276] Timestamp: P: 1783602184698116 usec, L: 0
0709 13:03:04.698296 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:03:04.698885 (+   589us) log.cc:844] Serialized 541 byte log entry
0709 13:03:04.700513 (+  1628us) op_driver.cc:464] REPLICATION: finished
0709 13:03:04.700894 (+   381us) write_op.cc:301] APPLY: starting
0709 13:03:04.700966 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:04.701758 (+   792us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:04.701839 (+    81us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:04.702523 (+   684us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:04.702673 (+   150us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:03:04.702714 (+    41us) write_op.cc:312] APPLY: finished
0709 13:03:04.702884 (+   170us) log.cc:844] Serialized 25 byte log entry
0709 13:03:04.703024 (+   140us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:04.703097 (+    73us) write_op.cc:454] Released schema lock
0709 13:03:04.703134 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:04.704057 (+   923us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:04.704094 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":106931,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":216,"apply.run_cpu_time_us":2505,"apply.run_wall_time_us":2506,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":149,"prepare.run_cpu_time_us":2475,"prepare.run_wall_time_us":2476,"replication_time_us":2098}]]}
W20260709 13:03:04.896499  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52838 (request call id 256) took 30123 ms (client timeout 15000 ms). Trace:
W20260709 13:03:04.896950  1442 rpcz_store.cc:269] 0709 13:02:34.772969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.773144 (+   175us) service_pool.cc:224] Handling call
0709 13:03:04.896299 (+30123155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17523,"reported_tablets":50}
I20260709 13:03:04.931794  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:03:04.932466  1614 raft_consensus.cc:606] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:04.938493  1614 raft_consensus.cc:614] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:04.943238  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:03:04.943842  1620 raft_consensus.cc:606] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:04.944150  1620 raft_consensus.cc:614] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:04.950125  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:03:04.950747  1620 raft_consensus.cc:606] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:04.970307  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c033fce18c634feb995adf2f2422308c"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:03:04.972651  1540 raft_consensus.cc:606] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 18 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:04.981261  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cecec9af1f82495390a4640f3927241f"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:03:04.982415  1620 raft_consensus.cc:606] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:04.984784  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "effd69042c284e8386aafb50372a93b6"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:03:04.985350  1620 raft_consensus.cc:606] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:04.986383   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:04.988070   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:05.017591  7616 raft_consensus.cc:1064] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:03:05.019991  7616 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 10, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:05.065869  7723 raft_consensus.cc:993] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:05.102734  8032 raft_consensus.cc:1081] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:05.108932  2272 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 20 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:05.122404  8033 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:05.128389  1545 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:05.159698  7723 raft_consensus.cc:993] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:05.160221  7723 raft_consensus.cc:1081] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:05.163497  1440 catalog_manager.cc:5697] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 10 to 12, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 12 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.165259  1440 catalog_manager.cc:5697] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 13 to 15, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 15 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.174926  1440 catalog_manager.cc:5697] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:05.176153  1440 catalog_manager.cc:5697] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.177955  1440 catalog_manager.cc:5697] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 9 to 17, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 17 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.184654  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cecec9af1f82495390a4640f3927241f"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39238
I20260709 13:03:05.185237  1696 raft_consensus.cc:493] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:05.185578  1696 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:05.207690  7846 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:05.210330  1696 raft_consensus.cc:515] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:05.180470  1440 catalog_manager.cc:5697] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } }
I20260709 13:03:05.212842  1440 catalog_manager.cc:5697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 15 to 19, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 19 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.218029  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:05.218595  1614 raft_consensus.cc:3055] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:05.218874  1614 raft_consensus.cc:740] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:05.219573  1614 consensus_queue.cc:260] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:05.220585  1614 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:05.226926  1696 leader_election.cc:290] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:05.230490  1440 catalog_manager.cc:5697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 10 to 17, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 17 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.234638  1696 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:03:05.238672  1440 catalog_manager.cc:5697] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 17 to 19, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 19 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.241443  1440 catalog_manager.cc:5697] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 12 to 13, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 13 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.266584  1689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39238
I20260709 13:03:05.267287  1689 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:05.268317  1689 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:05.275264  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecec9af1f82495390a4640f3927241f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:05.276008  1545 raft_consensus.cc:3060] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:05.282043  1614 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:03:05.283738  1663 leader_election.cc:304] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:05.298242  8022 raft_consensus.cc:2804] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:05.298759  8022 raft_consensus.cc:697] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:05.299618  8022 consensus_queue.cc:237] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:05.302851  7846 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:05.282544  1545 raft_consensus.cc:2468] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:03:05.368105  8028 raft_consensus.cc:2955] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 12 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:03:05.411816  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 109785us
I20260709 13:03:05.419124  1540 raft_consensus.cc:2955] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:05.434178  2272 raft_consensus.cc:2955] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:05.452898  8033 raft_consensus.cc:993] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:03:05.453442  8033 raft_consensus.cc:1081] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:03:05.474864  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "effd69042c284e8386aafb50372a93b6"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35712
I20260709 13:03:05.476051  1540 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:05.476508  1540 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.421567  1689 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:05.476887  1446 catalog_manager.cc:5697] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 15 to 17, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 17 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.479733  1689 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:05.485204  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:05.486330  1614 raft_consensus.cc:3055] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:05.492012  1614 raft_consensus.cc:740] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:05.496337  1614 consensus_queue.cc:260] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:05.497926  1614 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:05.501009  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52808 (request call id 204) took 2878 ms. Trace:
I20260709 13:03:05.501430  1440 rpcz_store.cc:276] 0709 13:03:02.622230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.622396 (+   166us) service_pool.cc:224] Handling call
0709 13:03:05.500921 (+2878525us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:05.305780 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:05.306313 (+   533us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:05.306344 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:03:05.306365 (+    21us) tablet.cc:662] Decoding operations
0709 13:03:05.307879 (+  1514us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:05.307992 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:05.308033 (+    41us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:03:05.316288 (+  8255us) tablet.cc:701] Row locks acquired
0709 13:03:05.316317 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:03:05.316505 (+   188us) write_op.cc:270] Start()
0709 13:03:05.316660 (+   155us) write_op.cc:276] Timestamp: P: 1783602185316444 usec, L: 0
0709 13:03:05.316701 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:03:05.344583 (+ 27882us) log.cc:844] Serialized 4030 byte log entry
0709 13:03:05.389655 (+ 45072us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b18003d5a00. stack: 00007f5c67a1f343 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70919de1 00007f5c709265b1 00007f5c67a1f2a6 00007f5c67a1f240 00007f5c673ae1d4 00007f5c710ec304 00007f5c710ec299 00007f5c70efa9e1 00007f5c70ef964c 00007f5c6e5753bb 00007f5c6e57771a
0709 13:03:05.389849 (+   194us) op_driver.cc:464] REPLICATION: finished
0709 13:03:05.392449 (+  2600us) write_op.cc:301] APPLY: starting
0709 13:03:05.392533 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:05.401479 (+  8946us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:05.401505 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:05.430159 (+ 28654us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:05.434267 (+  4108us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:03:05.434324 (+    57us) write_op.cc:312] APPLY: finished
0709 13:03:05.434592 (+   268us) log.cc:844] Serialized 97 byte log entry
0709 13:03:05.434753 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:05.434874 (+   121us) write_op.cc:454] Released schema lock
0709 13:03:05.434921 (+    47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":8444,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":2304,"apply.run_cpu_time_us":13612,"apply.run_wall_time_us":42856,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45967,"num_ops":10,"prepare.queue_time_us":45706,"prepare.run_cpu_time_us":4629,"prepare.run_wall_time_us":43094,"replication_time_us":37405,"spinlock_wait_cycles":61428736,"thread_start_us":114592,"threads_started":2}]]}
I20260709 13:03:05.496919  1540 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:05.512841  1688 raft_consensus.cc:2955] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:05.514568  1540 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:05.516461  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:05.517012  1623 raft_consensus.cc:3055] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:05.517315  1623 raft_consensus.cc:740] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:05.518035  1623 consensus_queue.cc:260] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:05.518041  8027 raft_consensus.cc:993] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:05.519999  7805 raft_consensus.cc:1081] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 18 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:05.521333  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:05.521857  2272 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.519119  1623 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.526081  1442 catalog_manager.cc:5697] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 12 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:05.518559  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:05.536212  1540 raft_consensus.cc:3060] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:05.539975  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c033fce18c634feb995adf2f2422308c"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39244
I20260709 13:03:05.540853  1696 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:05.541200  1696 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:05.546684  1540 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 18.
I20260709 13:03:05.547761  2272 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:03:05.554088  1623 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 15.
I20260709 13:03:05.567895  1513 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:05.568744  8036 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:05.569193  8036 raft_consensus.cc:697] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:05.569981  8036 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:05.570525  1614 raft_consensus.cc:2468] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 18.
I20260709 13:03:05.560724  1661 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:05.573472  8023 raft_consensus.cc:2804] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:05.573959  8023 raft_consensus.cc:697] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:05.574781  8023 consensus_queue.cc:237] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:05.647811  1614 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:05.629827  1696 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:05.654345  2272 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 20 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:05.657069  8028 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:05.664387  1543 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:05.666680  8028 raft_consensus.cc:2955] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:05.666710  8038 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:03:05.668563  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:05.674075  1614 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:05.673763  2267 raft_consensus.cc:2955] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:05.684247  1696 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 19 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:05.685474  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:05.686084  1543 raft_consensus.cc:3055] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:05.686394  1543 raft_consensus.cc:740] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:05.686604  1614 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 19.
I20260709 13:03:05.687120  1543 consensus_queue.cc:260] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:05.688510  1543 raft_consensus.cc:3060] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:05.692358  1663 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:05.693218  8023 raft_consensus.cc:2804] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:05.693706  8023 raft_consensus.cc:697] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:05.694545  8023 consensus_queue.cc:237] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:05.699544  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7a83a11e6c2348918b88fe74b7ee7361 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:05.702859  1543 raft_consensus.cc:2468] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 19.
I20260709 13:03:05.702965  1444 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52838 (request call id 258) took 1122 ms. Trace:
I20260709 13:03:05.703452  1444 rpcz_store.cc:276] 0709 13:03:04.580885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.580994 (+   109us) service_pool.cc:224] Handling call
0709 13:03:05.702903 (+1121909us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29383,"reported_tablets":38}
I20260709 13:03:05.717114  1444 catalog_manager.cc:5697] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 13 to 14, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 20 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.724527  1540 raft_consensus.cc:2955] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:05.741621  1446 catalog_manager.cc:5697] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 17 to 18, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 18 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.743352  1446 catalog_manager.cc:5697] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 18 to 19, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 19 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.745106  1446 catalog_manager.cc:5697] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 16 to 17, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 17 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.814986  1446 catalog_manager.cc:5697] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 14 to 15, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 15 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.914551  1614 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:05.919304  1540 raft_consensus.cc:1275] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:05.926148  8035 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:05.940897  8035 consensus_queue.cc:1048] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:05.965047  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a83a11e6c2348918b88fe74b7ee7361 with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:48090
I20260709 13:03:05.980562  8055 tablet_replica.cc:333] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:05.983635  8055 raft_consensus.cc:2243] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.984560  8055 raft_consensus.cc:2272] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.989066   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:05.997123  8055 ts_tablet_manager.cc:1916] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:06.008421  1540 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:06.017297  8022 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:06.050789  1621 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:06.053421  8036 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:06.074972  8055 ts_tablet_manager.cc:1929] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.13
I20260709 13:03:06.092603  8055 log.cc:1199] T 7a83a11e6c2348918b88fe74b7ee7361 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/7a83a11e6c2348918b88fe74b7ee7361
I20260709 13:03:06.103477  1621 raft_consensus.cc:1275] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:06.107192  2267 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:06.136236  8022 consensus_queue.cc:1048] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:06.138115  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet 7a83a11e6c2348918b88fe74b7ee7361 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:03:06.136269  8047 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:03:06.216595  1545 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:06.220292  8023 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:06.277827  1621 raft_consensus.cc:1275] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:03:06.279366  8022 consensus_queue.cc:1048] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:07.151504  1614 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:07.201701   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:07.205857  1588 consensus_peers.cc:597] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22659363e36446f9a1b47d2383b5621f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:07.207039  1696 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:03:07.210361  8042 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:03:07.222776  1543 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:03:07.224431  8042 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:07.262979  8028 raft_consensus.cc:2955] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 21 LEADER]: Committing config change with OpId 21.11: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:07.273485  1696 raft_consensus.cc:2955] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Committing config change with OpId 21.11: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:07.298987  1540 raft_consensus.cc:2955] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Committing config change with OpId 21.11: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:07.366379  1444 catalog_manager.cc:5697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 21 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:07.369144  1540 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:03:07.371935  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 78653us
W20260709 13:03:07.527257  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 110938us
I20260709 13:03:07.536367  1696 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:03:07.603209  1513 consensus_peers.cc:597] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a931eba8b604012a41ed982e7200b41. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:07.648171  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 91903.3us
I20260709 13:03:07.668812  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:03:07.669426  1540 raft_consensus.cc:606] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 19 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:07.672137  8072 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:07.678366  1614 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:07.692344  1548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:03:07.692996  1548 raft_consensus.cc:606] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:07.702965  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1f748970c74ef290462d25b2975815"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:03:07.703681  1545 raft_consensus.cc:606] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:07.712706  1544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:03:07.713270  1544 raft_consensus.cc:606] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:07.715620  8087 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:07.727120  1548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:03:07.727851  1548 raft_consensus.cc:606] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:07.733203   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:07.735050   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:07.742146  8083 raft_consensus.cc:2955] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:07.752064  1614 raft_consensus.cc:2955] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:07.765244  7929 raft_consensus.cc:993] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:07.765813  8087 raft_consensus.cc:1081] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:07.770676  7929 raft_consensus.cc:993] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:07.771134  8087 raft_consensus.cc:1081] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:07.794981  8088 raft_consensus.cc:993] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:07.795511  8087 raft_consensus.cc:1081] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 19 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:07.809906  8092 ts_tablet_manager.cc:933] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:07.822011  1440 catalog_manager.cc:5697] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 17 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:07.826924  1689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39244
I20260709 13:03:07.827523  1689 raft_consensus.cc:493] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:07.827890  1689 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:07.829557  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39244
I20260709 13:03:07.830179  1696 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:07.830544  1696 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:07.831601  1688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba1f748970c74ef290462d25b2975815"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39244
I20260709 13:03:07.832093  1688 raft_consensus.cc:493] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:07.832437  1688 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.832729  1697 raft_consensus.cc:2955] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:07.840088  1696 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:07.854430  7929 raft_consensus.cc:993] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:07.855010  7929 raft_consensus.cc:1081] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Signalling peer 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:07.856638  1623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:34192
I20260709 13:03:07.857122  1623 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:07.857453  1623 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.858201  1540 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:07.863608  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:07.864267  1621 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:07.872406  1623 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:07.873335  1689 raft_consensus.cc:515] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:07.874343  1688 raft_consensus.cc:515] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:07.884251  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:07.884816  2267 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.886036  8088 raft_consensus.cc:993] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:07.886524  8083 raft_consensus.cc:1081] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:07.886938  8092 tablet_copy_client.cc:323] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:03:07.887795  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:07.888329  1545 raft_consensus.cc:3055] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:07.888633  1545 raft_consensus.cc:740] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:07.889415  1545 consensus_queue.cc:260] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:07.891927  1632 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 22659363e36446f9a1b47d2383b5621f from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:03:07.878734  1696 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 20 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:07.878525  1621 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 20.
I20260709 13:03:07.894337  1632 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 22659363e36446f9a1b47d2383b5621f from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-22659363e36446f9a1b47d2383b5621f
I20260709 13:03:07.894821  1663 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:07.888346  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39244
I20260709 13:03:07.897665  1691 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:07.898005  1691 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.896891  8035 raft_consensus.cc:2804] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:07.898727  8035 raft_consensus.cc:697] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:07.899735  8035 consensus_queue.cc:237] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:03:07.902441  1513 consensus_peers.cc:597] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8820554e3d9a4662b150408d84019889. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:07.905640  1691 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:07.890959  1545 raft_consensus.cc:3060] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.907739  1696 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:07.908120  1621 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:07.912386  1623 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:07.875267  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:07.913479  2267 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:03:07.913980  1544 raft_consensus.cc:3055] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:07.914386  1544 raft_consensus.cc:740] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:07.914827  1588 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:07.915208  1544 consensus_queue.cc:260] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:07.914511  8083 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:03:07.917394  1544 raft_consensus.cc:3060] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:07.920051  8087 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:07.920882  1632 tablet_copy_source_session.cc:215] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:07.923388  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:07.924019  1540 raft_consensus.cc:3055] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:07.924312  1540 raft_consensus.cc:740] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:07.926141  1688 leader_election.cc:290] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:07.927222  1540 consensus_queue.cc:260] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:07.929394  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:07.930326  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1f748970c74ef290462d25b2975815" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:07.931244  1548 raft_consensus.cc:3055] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:07.931597  1548 raft_consensus.cc:740] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:07.926770  8038 raft_consensus.cc:2804] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:07.933651  8038 raft_consensus.cc:697] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:07.936983  1689 leader_election.cc:290] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:07.928752  1540 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.937958  1621 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.937939  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:07.938984  1543 raft_consensus.cc:3055] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:07.939353  1543 raft_consensus.cc:740] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:07.939343  1545 raft_consensus.cc:2468] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:03:07.940526  1543 consensus_queue.cc:260] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:07.943384  1544 raft_consensus.cc:2468] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 20.
I20260709 13:03:07.943650  8038 consensus_queue.cc:237] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:07.936093  1548 consensus_queue.cc:260] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:07.946816  1548 raft_consensus.cc:3060] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.946846  8092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22659363e36446f9a1b47d2383b5621f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.954252  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9457391f9c4971a27c4ef6fd3af809" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:07.954914  1614 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:07.967731  1543 raft_consensus.cc:3060] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:07.968436  1621 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:03:07.970043  1663 leader_election.cc:304] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:07.971923  1691 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:07.973192  1614 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:03:07.976238  1663 leader_election.cc:304] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:07.979367  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435d66c2e8e14e73af7cc63b8ce93e2d" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:07.980034  2272 raft_consensus.cc:3060] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.983039  1548 raft_consensus.cc:2468] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:03:07.991261  1540 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:03:07.993173  8080 raft_consensus.cc:2804] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:07.993854  8080 raft_consensus.cc:697] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:07.995723  8084 raft_consensus.cc:2804] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:07.994824  8080 consensus_queue.cc:237] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:07.992543  1661 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:07.996002  1440 catalog_manager.cc:5697] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 14 to 15, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 15 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.007141  2272 raft_consensus.cc:2468] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:03:08.014093  1543 raft_consensus.cc:2468] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:03:08.021019  8084 raft_consensus.cc:697] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:08.015692  8023 raft_consensus.cc:2804] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:08.022203  8023 raft_consensus.cc:697] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:08.022126  8084 consensus_queue.cc:237] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:08.023548  8023 consensus_queue.cc:237] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:08.047253  1442 catalog_manager.cc:5697] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 19 to 20, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 20 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.038133  8087 raft_consensus.cc:2955] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:08.053424  1691 raft_consensus.cc:2955] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:08.095431  8099 ts_tablet_manager.cc:933] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:03:08.141592  1442 catalog_manager.cc:5697] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 17 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.148914  1623 raft_consensus.cc:2955] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:08.145985  1540 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:08.165299  8092 tablet_copy_client.cc:806] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:08.167517  8092 tablet_copy_client.cc:670] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:08.165290  8099 tablet_copy_client.cc:323] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.129:46597
I20260709 13:03:08.178228  1440 catalog_manager.cc:5697] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 12 to 13, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 13 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.182657  8092 tablet_copy_client.cc:538] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:08.192262  1440 catalog_manager.cc:5697] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 12 to 13, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 13 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.193629  1440 catalog_manager.cc:5697] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 16 to 17, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 17 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.195024  1558 tablet_copy_service.cc:140] P 44c8c572048a40b1a5e71865068ed1bb: Received BeginTabletCopySession request for tablet 2a931eba8b604012a41ed982e7200b41 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:53718)
I20260709 13:03:08.195639  1558 tablet_copy_service.cc:161] P 44c8c572048a40b1a5e71865068ed1bb: Beginning new tablet copy session on tablet 2a931eba8b604012a41ed982e7200b41 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:53718: session id = e37b8013aec24431a6672a857806329e-2a931eba8b604012a41ed982e7200b41
W20260709 13:03:08.196092  1513 consensus_peers.cc:597] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3841c3258da84512aa1d5bec2bac5fe3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:08.200016  1697 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:08.203454  1614 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:08.208690  8083 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:03:08.212360  1558 tablet_copy_source_session.cc:215] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:08.217109  8099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a931eba8b604012a41ed982e7200b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:08.217206  8088 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:03:08.227839  8092 tablet_bootstrap.cc:492] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:03:08.249703  8083 raft_consensus.cc:2955] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:08.276890  8099 tablet_copy_client.cc:806] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:08.277745  8099 tablet_copy_client.cc:670] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:08.282194  8099 tablet_copy_client.cc:538] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:08.302621  1691 raft_consensus.cc:2955] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:08.325186  8099 tablet_bootstrap.cc:492] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:03:08.327782  1623 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:08.331209  8035 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:08.334432  1620 raft_consensus.cc:2955] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:08.358325  8108 ts_tablet_manager.cc:933] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:03:08.375030  1444 catalog_manager.cc:5697] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index -1 to 8, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 15 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.390707  1543 raft_consensus.cc:1275] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:03:08.397986  8035 consensus_queue.cc:1048] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:08.405418  1540 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:08.408578  8035 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:08.428514  1548 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:08.431103  8071 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:08.462370  1548 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:08.465000  8035 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:08.473109  2266 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:08.474802  1620 raft_consensus.cc:1275] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:08.513541  8035 consensus_queue.cc:1048] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:08.490868  8082 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:03:08.545020  2266 raft_consensus.cc:1275] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:08.525517  8108 tablet_copy_client.cc:323] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.129:46597
I20260709 13:03:08.547078  8071 consensus_queue.cc:1048] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:08.549603  1558 tablet_copy_service.cc:140] P 44c8c572048a40b1a5e71865068ed1bb: Received BeginTabletCopySession request for tablet 8820554e3d9a4662b150408d84019889 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:53718)
I20260709 13:03:08.550133  1558 tablet_copy_service.cc:161] P 44c8c572048a40b1a5e71865068ed1bb: Beginning new tablet copy session on tablet 8820554e3d9a4662b150408d84019889 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:53718: session id = e37b8013aec24431a6672a857806329e-8820554e3d9a4662b150408d84019889
I20260709 13:03:08.562604  1558 tablet_copy_source_session.cc:215] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:08.565899  8108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8820554e3d9a4662b150408d84019889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:08.570353  1540 raft_consensus.cc:1275] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:03:08.579694  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 101975us
I20260709 13:03:08.609887  8080 consensus_queue.cc:1048] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:08.625317  1623 raft_consensus.cc:1275] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:08.695376  8092 tablet_bootstrap.cc:492] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:08.696408  8092 tablet_bootstrap.cc:492] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:08.697192  8092 ts_tablet_manager.cc:1403] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.470s	user 0.047s	sys 0.027s
W20260709 13:03:08.700752  8111 log.cc:927] Time spent T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:03:08.735951   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:08.770658  8120 log.cc:927] Time spent T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:03:08.775673  8092 raft_consensus.cc:359] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:08.776645  8092 raft_consensus.cc:740] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:08.777330  8092 consensus_queue.cc:260] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:08.780037  8092 ts_tablet_manager.cc:1434] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.001s
I20260709 13:03:08.852167  8108 tablet_copy_client.cc:806] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:08.852787  8108 tablet_copy_client.cc:670] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:08.857713  8108 tablet_copy_client.cc:538] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:03:08.936497  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 302876us
I20260709 13:03:08.939018  1632 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-22659363e36446f9a1b47d2383b5621f received from {username='slave'} at 127.0.0.1:33892
I20260709 13:03:08.939553  1632 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-22659363e36446f9a1b47d2383b5621f on tablet 22659363e36446f9a1b47d2383b5621f with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:08.992480  8092 ts_tablet_manager.cc:933] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:03:08.958719  8082 consensus_queue.cc:1048] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 13:03:09.079221  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 108013us
I20260709 13:03:09.088049  8092 tablet_copy_client.cc:323] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.129:46597
I20260709 13:03:09.131693  2266 raft_consensus.cc:1217] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 21 LEARNER]: Deduplicated request from leader. Original: 21.10->[21.11-21.11]   Dedup: 21.11->[]
I20260709 13:03:09.157756  1558 tablet_copy_service.cc:140] P 44c8c572048a40b1a5e71865068ed1bb: Received BeginTabletCopySession request for tablet 3841c3258da84512aa1d5bec2bac5fe3 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:53718)
I20260709 13:03:09.158352  1558 tablet_copy_service.cc:161] P 44c8c572048a40b1a5e71865068ed1bb: Beginning new tablet copy session on tablet 3841c3258da84512aa1d5bec2bac5fe3 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:53718: session id = e37b8013aec24431a6672a857806329e-3841c3258da84512aa1d5bec2bac5fe3
W20260709 13:03:09.191910  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 110984us
I20260709 13:03:09.219496  8108 tablet_bootstrap.cc:492] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:03:09.237730  1558 tablet_copy_source_session.cc:215] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:03:09.376185  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 169255us
I20260709 13:03:09.409008  8126 raft_consensus.cc:1064] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:03:09.412766  8092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3841c3258da84512aa1d5bec2bac5fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.413290  8099 tablet_bootstrap.cc:492] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:09.414203  8099 tablet_bootstrap.cc:492] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:09.414904  8099 ts_tablet_manager.cc:1403] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 1.090s	user 0.041s	sys 0.014s
W20260709 13:03:09.474983  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 44784.6us
I20260709 13:03:09.481665  8126 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 9, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:09.471921  8099 raft_consensus.cc:359] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:09.535306  8099 raft_consensus.cc:740] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:09.578579  8099 consensus_queue.cc:260] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:09.582146  8099 ts_tablet_manager.cc:1434] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.167s	user 0.011s	sys 0.001s
W20260709 13:03:09.588987  8151 log.cc:927] Time spent T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.201s	user 0.003s	sys 0.003s
I20260709 13:03:09.604727  1558 tablet_copy_service.cc:342] P 44c8c572048a40b1a5e71865068ed1bb: Request end of tablet copy session e37b8013aec24431a6672a857806329e-2a931eba8b604012a41ed982e7200b41 received from {username='slave'} at 127.0.0.1:53718
I20260709 13:03:09.605249  1558 tablet_copy_service.cc:434] P 44c8c572048a40b1a5e71865068ed1bb: ending tablet copy session e37b8013aec24431a6672a857806329e-2a931eba8b604012a41ed982e7200b41 on tablet 2a931eba8b604012a41ed982e7200b41 with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:09.684442  2266 raft_consensus.cc:1217] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:03:09.746340  1688 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:09.758013  2266 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 21 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:09.756554  8042 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:03:09.770104  8092 tablet_copy_client.cc:806] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:09.770605  8092 tablet_copy_client.cc:670] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:09.855235  1545 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:03:09.877094  8071 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:09.962786  8092 tablet_copy_client.cc:538] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:10.017103  8042 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:10.169261  8108 tablet_bootstrap.cc:492] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:10.170590  8108 tablet_bootstrap.cc:492] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:10.198913   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:10.231983  8138 raft_consensus.cc:1064] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
W20260709 13:03:10.251354  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 54462.4us
I20260709 13:03:10.279278  8138 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:10.298818  8092 tablet_bootstrap.cc:492] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:03:10.271978  8108 ts_tablet_manager.cc:1403] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 1.053s	user 0.075s	sys 0.042s
I20260709 13:03:10.310523  2266 raft_consensus.cc:2955] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:10.306504  8159 raft_consensus.cc:2955] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 21 LEADER]: Committing config change with OpId 21.12: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:10.322117  1548 raft_consensus.cc:2955] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:10.338673  8108 raft_consensus.cc:359] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:10.376768  8108 raft_consensus.cc:740] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:10.377581  8108 consensus_queue.cc:260] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:10.423522  1614 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:10.396478  8108 ts_tablet_manager.cc:1434] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 13:03:10.439901  1444 catalog_manager.cc:5697] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:10.453191  1558 tablet_copy_service.cc:342] P 44c8c572048a40b1a5e71865068ed1bb: Request end of tablet copy session e37b8013aec24431a6672a857806329e-8820554e3d9a4662b150408d84019889 received from {username='slave'} at 127.0.0.1:53718
I20260709 13:03:10.453743  1558 tablet_copy_service.cc:434] P 44c8c572048a40b1a5e71865068ed1bb: ending tablet copy session e37b8013aec24431a6672a857806329e-8820554e3d9a4662b150408d84019889 on tablet 8820554e3d9a4662b150408d84019889 with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:10.442059  2266 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:10.442693  8138 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:10.448482  2263 raft_consensus.cc:1217] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:03:10.460758  8139 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:10.462347  1696 raft_consensus.cc:2955] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:10.532025  1696 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:10.574361  8083 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:10.617141  8083 raft_consensus.cc:2955] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:10.618556  2263 raft_consensus.cc:2955] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:10.739578  1695 raft_consensus.cc:2955] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:10.740163  1620 raft_consensus.cc:2955] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:10.763336  8092 tablet_bootstrap.cc:492] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:10.764617  8092 tablet_bootstrap.cc:492] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:10.765297  8092 ts_tablet_manager.cc:1403] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.467s	user 0.046s	sys 0.049s
I20260709 13:03:10.768946  8092 raft_consensus.cc:359] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:10.770435  8092 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:10.771245  8092 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:10.781461  8092 ts_tablet_manager.cc:1434] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:03:10.783634  1558 tablet_copy_service.cc:342] P 44c8c572048a40b1a5e71865068ed1bb: Request end of tablet copy session e37b8013aec24431a6672a857806329e-3841c3258da84512aa1d5bec2bac5fe3 received from {username='slave'} at 127.0.0.1:53718
I20260709 13:03:10.784092  1558 tablet_copy_service.cc:434] P 44c8c572048a40b1a5e71865068ed1bb: ending tablet copy session e37b8013aec24431a6672a857806329e-3841c3258da84512aa1d5bec2bac5fe3 on tablet 3841c3258da84512aa1d5bec2bac5fe3 with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:10.808657  1623 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:10.829912  1695 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:10.832368  8125 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:10.866235  1443 catalog_manager.cc:5697] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:10.884692  8071 raft_consensus.cc:2955] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index 12 to 13, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:10.889885  1696 raft_consensus.cc:2955] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:10.894735  7929 raft_consensus.cc:1064] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:03:10.898921  7929 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:10.903748  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 22659363e36446f9a1b47d2383b5621f with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:10.931974  2263 raft_consensus.cc:1275] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 21 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:03:10.937937  8146 consensus_queue.cc:1048] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:03:10.948307  1433 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 22659363e36446f9a1b47d2383b5621f with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 12 but the committed config has opid_index of 13
I20260709 13:03:10.976835  2267 raft_consensus.cc:2955] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index 12 to 13, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.002754  1446 catalog_manager.cc:5697] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 12 to 13, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 21 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.007498  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b189117895a48d4b813cda9e276c524"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:03:11.009164  1545 raft_consensus.cc:606] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:11.021678  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:03:11.022295  1545 raft_consensus.cc:606] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:11.032043  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:03:11.033188  1545 raft_consensus.cc:606] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:11.035507   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:11.037346   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:11.063984  2263 raft_consensus.cc:1217] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 15 LEARNER]: Deduplicated request from leader. Original: 15.7->[15.8-15.8]   Dedup: 15.8->[]
I20260709 13:03:11.083892  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 22659363e36446f9a1b47d2383b5621f with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:43336
I20260709 13:03:11.086740  1545 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:11.087528  1620 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:11.087981  1696 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:11.089617  8083 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:11.094797  2263 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:11.095010  7929 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:11.096544  8088 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:11.098845  1695 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:11.100914  2267 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:11.109234  8088 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:11.110060  8156 raft_consensus.cc:993] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:11.110666  8156 raft_consensus.cc:1081] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Signalling peer 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:11.112823  1623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:34192
I20260709 13:03:11.113529  1623 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.113958  1623 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.120244  8138 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:03:11.140969  8156 raft_consensus.cc:2955] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.142666  2267 raft_consensus.cc:2955] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.145753  1623 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:11.146018  1696 raft_consensus.cc:2955] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.180905  1623 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:11.182245  1443 catalog_manager.cc:5697] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 11 to 12, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 17 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.183532  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:11.184305  1543 raft_consensus.cc:3055] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:11.184748  1543 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:11.185911  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:11.186473  2267 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.207625  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2a931eba8b604012a41ed982e7200b41 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:11.185932  1543 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:11.215059  1543 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.223194  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a931eba8b604012a41ed982e7200b41 with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:46330
I20260709 13:03:11.238773  1543 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:03:11.244733  2267 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:03:11.261019  8088 raft_consensus.cc:993] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:11.261603  1587 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:03:11.263639  8042 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:11.264854  8042 raft_consensus.cc:697] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:11.265820  8042 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:11.254202  2266 raft_consensus.cc:2955] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.256924  1620 raft_consensus.cc:2955] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.251749  8138 raft_consensus.cc:2955] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.254017  8180 tablet_replica.cc:333] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:11.261560  8088 raft_consensus.cc:1081] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Signalling peer 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:11.281014  8184 tablet_replica.cc:333] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:11.298167  1620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b189117895a48d4b813cda9e276c524"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:34192
I20260709 13:03:11.300209  1620 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.300603  1620 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.305711  8184 raft_consensus.cc:2243] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:11.306864  8184 raft_consensus.cc:2272] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:11.311367  8180 raft_consensus.cc:2243] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:11.321553  1620 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:11.324990  8184 ts_tablet_manager.cc:1916] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:11.344511  8180 raft_consensus.cc:2272] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:11.347033  1446 catalog_manager.cc:5697] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.350140  8180 ts_tablet_manager.cc:1916] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:11.351604  1620 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:11.351747  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:11.351516  1443 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 14 to 15, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 15 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.352483  1548 raft_consensus.cc:3055] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:11.351517  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b189117895a48d4b813cda9e276c524" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:11.352939  1548 raft_consensus.cc:740] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:11.353338  1695 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.353837  1548 consensus_queue.cc:260] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:11.355011  1548 raft_consensus.cc:3060] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:11.365965  1695 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:03:11.369899  1586 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:11.373955  8042 raft_consensus.cc:2804] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:11.377787  8042 raft_consensus.cc:697] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:11.379236  8042 consensus_queue.cc:237] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:11.389609  1548 raft_consensus.cc:2468] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:03:11.431592  1695 raft_consensus.cc:2955] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.443917  1443 catalog_manager.cc:5697] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 14 to 15, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 15 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.456012  8180 ts_tablet_manager.cc:1929] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.12
I20260709 13:03:11.467528  8180 log.cc:1199] T 22659363e36446f9a1b47d2383b5621f P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/22659363e36446f9a1b47d2383b5621f
I20260709 13:03:11.489923  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet 22659363e36446f9a1b47d2383b5621f (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:03:11.489784  1548 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:11.526275  2266 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:11.526490  8184 ts_tablet_manager.cc:1929] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 13:03:11.528081  8156 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:11.543233  8156 raft_consensus.cc:993] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:11.544148  8156 raft_consensus.cc:1081] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:11.545614  1614 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:11.546671  1688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39244
I20260709 13:03:11.547170  1688 raft_consensus.cc:493] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.547574  1688 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:11.547899  8184 log.cc:1199] T 2a931eba8b604012a41ed982e7200b41 P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/2a931eba8b604012a41ed982e7200b41
I20260709 13:03:11.547967  8156 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:11.556803  2267 raft_consensus.cc:2955] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.576776  1688 raft_consensus.cc:515] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:11.555152  8083 raft_consensus.cc:2955] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.594368  1446 catalog_manager.cc:5697] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 11 to 12, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 17 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.599176  1618 raft_consensus.cc:2955] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.609810  1688 leader_election.cc:290] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:11.612155  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:11.611394  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891ecbb9d454fe98a0dfe359e3dfd71" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:11.613775  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 8820554e3d9a4662b150408d84019889 with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:48090
I20260709 13:03:11.613996  1540 raft_consensus.cc:3055] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:11.614302  1540 raft_consensus.cc:740] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:11.615214  1540 consensus_queue.cc:260] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:11.616596  1540 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:11.612800  1623 raft_consensus.cc:3060] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:11.626931  8088 raft_consensus.cc:1064] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:03:11.627097  1623 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 18.
I20260709 13:03:11.628386  1663 leader_election.cc:304] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:11.629352  8080 raft_consensus.cc:2804] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:11.629827  8080 raft_consensus.cc:697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:11.629894  8088 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 6, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:11.630744  8080 consensus_queue.cc:237] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:11.632645  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet 2a931eba8b604012a41ed982e7200b41 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:03:11.634482  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8820554e3d9a4662b150408d84019889 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:11.665524  1540 raft_consensus.cc:2468] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 18.
I20260709 13:03:11.675554  2267 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 15 LEARNER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:11.677419  8156 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:11.677937  1444 catalog_manager.cc:5697] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 17 to 18, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 18 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.679836  1695 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:11.685622  1618 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:11.688241  8138 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:11.700723  8083 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:11.745347  8188 tablet_replica.cc:333] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:11.752151  8188 raft_consensus.cc:2243] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:11.752871  8188 raft_consensus.cc:2272] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:11.744472  8190 log.cc:927] Time spent T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:03:11.773545  8083 raft_consensus.cc:2955] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index 8 to 9, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.775573  8188 ts_tablet_manager.cc:1916] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:11.778548  1540 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:11.781390  8146 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:11.797994  2267 raft_consensus.cc:2955] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.799450  2263 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:11.801187  8042 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:11.816327  1696 raft_consensus.cc:2955] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.869582  1443 catalog_manager.cc:5697] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 8 to 9, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.911540  1540 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:03:11.922816  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 48415us
I20260709 13:03:11.936380  1696 raft_consensus.cc:1275] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:11.947108  1623 raft_consensus.cc:2955] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:11.925384  8159 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:03:11.961709  8071 consensus_queue.cc:1048] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:11.980412  1540 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:12.025244  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 77237.4us
I20260709 13:03:12.041102   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:12.044593  2266 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:12.046550  8138 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:12.048817  1695 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:12.055011  8138 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:03:12.060187  8188 ts_tablet_manager.cc:1929] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 13:03:12.060688  8188 log.cc:1199] T 8820554e3d9a4662b150408d84019889 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/8820554e3d9a4662b150408d84019889
I20260709 13:03:12.061442  8083 raft_consensus.cc:2955] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:03:12.068517  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 81548.1us
I20260709 13:03:12.070839  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet 8820554e3d9a4662b150408d84019889 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:03:12.076475  2266 raft_consensus.cc:2955] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:12.105118  1695 raft_consensus.cc:2955] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:03:12.115192  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 96893.3us
I20260709 13:03:12.140204  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3841c3258da84512aa1d5bec2bac5fe3 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:12.163599  1620 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:12.165755  8082 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:12.167443  1444 catalog_manager.cc:5697] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 9 to 10, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 15 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:12.218488  1543 raft_consensus.cc:1275] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:03:12.226697  8204 consensus_queue.cc:1048] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:12.241376  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet 3841c3258da84512aa1d5bec2bac5fe3 with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:46330
I20260709 13:03:12.281509  8209 tablet_replica.cc:333] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:12.284559  8209 raft_consensus.cc:2243] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:12.285612  8209 raft_consensus.cc:2272] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:12.313254  8209 ts_tablet_manager.cc:1916] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:12.362727  8209 ts_tablet_manager.cc:1929] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 13:03:12.373208  8209 log.cc:1199] T 3841c3258da84512aa1d5bec2bac5fe3 P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/3841c3258da84512aa1d5bec2bac5fe3
I20260709 13:03:12.376929  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet 3841c3258da84512aa1d5bec2bac5fe3 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:03:13.220451   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:13.396657  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 44601us
I20260709 13:03:13.418500  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:03:13.419070  1614 raft_consensus.cc:606] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:13.434000  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:50792
I20260709 13:03:13.434598  1696 raft_consensus.cc:606] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:13.438827  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "738a15ae04514d49969f3624caa73f45"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:03:13.439353  1614 raft_consensus.cc:606] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:13.441229   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:13.442858   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:13.530179  1614 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:13.565078  8129 raft_consensus.cc:993] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: : Instructing follower 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:13.565580  8129 raft_consensus.cc:1081] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Signalling peer 27308aae2ef347ccba1b27e7f6f04334 to start an election
W20260709 13:03:13.567888  1588 consensus_peers.cc:597] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8819ed65aa948c9aa7a571bef50ca38. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.568234  1618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:34180
I20260709 13:03:13.568837  1618 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:13.569129  1696 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:13.569191  1618 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.572188  8202 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:13.576943  1543 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:13.581629  8071 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:13.589762  1618 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:13.608969  8071 raft_consensus.cc:2955] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:13.615145  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:13.615809  1540 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.649718  1614 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:13.672974  1695 raft_consensus.cc:2955] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:13.673374  1446 catalog_manager.cc:5697] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 17 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.678239  1618 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:13.678478  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a17adb150f4450b68adcffc1c3d655" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:13.679347  1696 raft_consensus.cc:3055] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:13.679673  1696 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:13.684653  1540 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:03:13.686111  1696 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:13.692140  1696 raft_consensus.cc:3060] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.692109  1587 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:03:13.695725  8198 raft_consensus.cc:2804] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:13.696229  8198 raft_consensus.cc:697] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:13.696478  1540 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:13.697177  8198 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:03:13.697885  1588 consensus_peers.cc:597] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 489da014ead84cbe9a9b46b9196c3356. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.705633  1696 raft_consensus.cc:2468] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:03:13.720798  8220 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:13.724932  8071 raft_consensus.cc:993] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:03:13.725494  8071 raft_consensus.cc:1081] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:03:13.737708  1695 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:13.742832  1548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35712
I20260709 13:03:13.743501  1548 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:13.743829  1548 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.742966  1540 raft_consensus.cc:2955] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:13.740576  8218 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:03:13.751729  1548 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:13.755082  1548 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:13.756014  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:13.756510  1695 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.762431  1695 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:03:13.763684  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:13.764371  1620 raft_consensus.cc:3055] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:13.764678  1620 raft_consensus.cc:740] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:13.765511  1620 consensus_queue.cc:260] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:13.775942  1620 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:13.778740  1511 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:13.780144  8083 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:13.785209  1620 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:03:13.791469  8198 raft_consensus.cc:2955] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:13.798805  8083 raft_consensus.cc:697] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:13.799736  8083 consensus_queue.cc:237] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:13.825893  1540 raft_consensus.cc:2955] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:13.830334  1618 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:13.832401  1696 raft_consensus.cc:2955] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:13.846261  8198 raft_consensus.cc:993] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:03:13.846915  8198 raft_consensus.cc:1081] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:03:13.848997  1543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "738a15ae04514d49969f3624caa73f45"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35712
I20260709 13:03:13.849520  1543 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:13.849844  1543 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:13.862674  1543 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:13.870623  1548 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:13.876439  1696 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:13.878912  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:13.879480  1696 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:13.884303  8198 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:13.889765  1588 consensus_peers.cc:597] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a5fdc87ebdd414ab8baa34e162bc8c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.894200  1543 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 20 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:13.895396  1696 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 20.
I20260709 13:03:13.895736  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:13.896302  1620 raft_consensus.cc:3055] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:03:13.896576  1620 raft_consensus.cc:740] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:13.898540  1444 catalog_manager.cc:5697] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 15 to 16, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.896696  1511 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:13.905441  8226 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:13.905952  8226 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 20 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:13.907058  8226 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:13.915313  8219 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:13.919178  1620 consensus_queue.cc:260] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:13.920451  1620 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:13.937697  1620 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 20.
I20260709 13:03:13.900307  1444 catalog_manager.cc:5697] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.973111  1446 catalog_manager.cc:5697] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 15 to 16, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 16 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.997603  1540 raft_consensus.cc:2955] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Committing config change with OpId 17.9: config changed from index -1 to 9, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:14.008939  8218 raft_consensus.cc:2955] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Committing config change with OpId 17.9: config changed from index -1 to 9, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:14.004241  1688 raft_consensus.cc:2955] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Committing config change with OpId 17.9: config changed from index -1 to 9, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:14.043226  1446 catalog_manager.cc:5697] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 19 to 20, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 20 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:14.045526  8234 ts_tablet_manager.cc:933] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:14.060680  1443 catalog_manager.cc:5697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 9, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 17 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:14.066363  1618 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:14.123191  1688 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:14.123394  1540 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:14.124734  8202 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:14.126798  8202 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:03:14.141871  1588 consensus_peers.cc:597] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ba0a0cae5d54e9a85eed27fed785932. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.144017  8234 tablet_copy_client.cc:323] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:03:14.146732  1632 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet a8819ed65aa948c9aa7a571bef50ca38 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:03:14.147261  1632 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet a8819ed65aa948c9aa7a571bef50ca38 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-a8819ed65aa948c9aa7a571bef50ca38
I20260709 13:03:14.166913  1632 tablet_copy_source_session.cc:215] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:14.173915  8234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8819ed65aa948c9aa7a571bef50ca38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:14.175513  1696 raft_consensus.cc:2955] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:14.171929  8218 raft_consensus.cc:2955] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:14.212898  8234 tablet_copy_client.cc:806] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:14.214071  8234 tablet_copy_client.cc:670] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:14.218564  1540 raft_consensus.cc:2955] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:14.219527  1444 catalog_manager.cc:5697] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 13, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 18 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:14.235715  1620 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:14.237690  8234 tablet_copy_client.cc:538] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:14.248597  8088 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:14.315565  8234 tablet_bootstrap.cc:492] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:03:14.321106  8243 ts_tablet_manager.cc:933] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:14.321067  8242 ts_tablet_manager.cc:933] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:14.323508  1696 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:14.336658  1543 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:14.338831  8243 tablet_copy_client.cc:323] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:03:14.352766  1618 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:14.354290  8226 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:14.355734  1632 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 489da014ead84cbe9a9b46b9196c3356 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:03:14.356266  1632 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 489da014ead84cbe9a9b46b9196c3356 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-489da014ead84cbe9a9b46b9196c3356
I20260709 13:03:14.338970  8198 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:03:14.358971  8218 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:14.414937  1695 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:03:14.409381  8242 tablet_copy_client.cc:323] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:03:14.420399  1695 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:14.444029   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:14.460609  8252 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:14.462145  8252 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:14.480099  1632 tablet_copy_source_session.cc:215] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:03:14.536613  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 63429.2us
W20260709 13:03:14.540315  1514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 75625.9us
W20260709 13:03:14.584184  8254 log.cc:927] Time spent T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:03:14.625815  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 122413us
W20260709 13:03:14.631690  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 131810us
W20260709 13:03:14.691037  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 180163us
I20260709 13:03:14.694238  1632 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 4a5fdc87ebdd414ab8baa34e162bc8c4 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:03:14.694783  1632 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 4a5fdc87ebdd414ab8baa34e162bc8c4 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-4a5fdc87ebdd414ab8baa34e162bc8c4
I20260709 13:03:14.706476  1632 tablet_copy_source_session.cc:215] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:14.764947  8243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 489da014ead84cbe9a9b46b9196c3356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:14.769846  8242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5fdc87ebdd414ab8baa34e162bc8c4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:14.815680  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 426747us
I20260709 13:03:14.853858  8273 ts_tablet_manager.cc:933] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:14.871126  8234 tablet_bootstrap.cc:492] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:14.911731  8243 tablet_copy_client.cc:806] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:14.912387  8243 tablet_copy_client.cc:670] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:14.915728  8234 tablet_bootstrap.cc:492] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:14.916590  8234 ts_tablet_manager.cc:1403] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.601s	user 0.033s	sys 0.015s
I20260709 13:03:14.931974  8242 tablet_copy_client.cc:806] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:14.932622  8242 tablet_copy_client.cc:670] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
W20260709 13:03:14.945369  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 104216us
I20260709 13:03:14.965018  8242 tablet_copy_client.cc:538] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:14.966465  8243 tablet_copy_client.cc:538] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:14.965240  8273 tablet_copy_client.cc:323] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:03:14.975222  8242 tablet_bootstrap.cc:492] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:03:14.985263  1632 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 6ba0a0cae5d54e9a85eed27fed785932 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:03:14.985863  1632 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 6ba0a0cae5d54e9a85eed27fed785932 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-6ba0a0cae5d54e9a85eed27fed785932
I20260709 13:03:14.986726  8234 raft_consensus.cc:359] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:14.987715  8234 raft_consensus.cc:740] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:14.988363  8234 consensus_queue.cc:260] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:14.993979  1632 tablet_copy_source_session.cc:215] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:14.994568  8234 ts_tablet_manager.cc:1434] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.001s
I20260709 13:03:14.996502  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-a8819ed65aa948c9aa7a571bef50ca38 received from {username='slave'} at 127.0.0.1:33892
I20260709 13:03:14.996975  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-a8819ed65aa948c9aa7a571bef50ca38 on tablet a8819ed65aa948c9aa7a571bef50ca38 with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:15.016506  8273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba0a0cae5d54e9a85eed27fed785932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.040081  8243 tablet_bootstrap.cc:492] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:03:15.118744  8273 tablet_copy_client.cc:806] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:15.123843  8273 tablet_copy_client.cc:670] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:15.135522  8273 tablet_copy_client.cc:538] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:15.156136  8273 tablet_bootstrap.cc:492] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:03:15.333840  8242 tablet_bootstrap.cc:492] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:15.334894  8242 tablet_bootstrap.cc:492] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:15.355479  8242 ts_tablet_manager.cc:1403] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.380s	user 0.041s	sys 0.004s
I20260709 13:03:15.376118  8242 raft_consensus.cc:359] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:15.377089  8242 raft_consensus.cc:740] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:15.394820  2263 raft_consensus.cc:1217] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:03:15.377799  8242 consensus_queue.cc:260] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:15.433039  8242 ts_tablet_manager.cc:1434] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.076s	user 0.003s	sys 0.004s
I20260709 13:03:15.435685  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-4a5fdc87ebdd414ab8baa34e162bc8c4 received from {username='slave'} at 127.0.0.1:33892
I20260709 13:03:15.436117  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-4a5fdc87ebdd414ab8baa34e162bc8c4 on tablet 4a5fdc87ebdd414ab8baa34e162bc8c4 with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:15.473125  8243 tablet_bootstrap.cc:492] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:15.474124  8243 tablet_bootstrap.cc:492] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:15.474856  8243 ts_tablet_manager.cc:1403] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.435s	user 0.063s	sys 0.050s
I20260709 13:03:15.478365  8243 raft_consensus.cc:359] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:15.488689  8243 raft_consensus.cc:740] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:15.489413  8243 consensus_queue.cc:260] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:15.495955  8243 ts_tablet_manager.cc:1434] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:03:15.504004  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-489da014ead84cbe9a9b46b9196c3356 received from {username='slave'} at 127.0.0.1:33892
I20260709 13:03:15.504499  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-489da014ead84cbe9a9b46b9196c3356 on tablet 489da014ead84cbe9a9b46b9196c3356 with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:15.529928  8273 tablet_bootstrap.cc:492] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:15.531090  8273 tablet_bootstrap.cc:492] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:15.531936  8273 ts_tablet_manager.cc:1403] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.376s	user 0.045s	sys 0.009s
I20260709 13:03:15.538450   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:15.538396  8273 raft_consensus.cc:359] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:15.540474  8273 raft_consensus.cc:740] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:15.541270  8273 consensus_queue.cc:260] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:15.549786  8273 ts_tablet_manager.cc:1434] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:03:15.551388  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-6ba0a0cae5d54e9a85eed27fed785932 received from {username='slave'} at 127.0.0.1:33892
I20260709 13:03:15.551808  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-6ba0a0cae5d54e9a85eed27fed785932 on tablet 6ba0a0cae5d54e9a85eed27fed785932 with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:15.704850  1543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:03:15.705508  1543 raft_consensus.cc:606] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:15.722884  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:03:15.723459  1620 raft_consensus.cc:606] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Received request to transfer leadership to TS c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:15.727334  1548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:03:15.727882  1548 raft_consensus.cc:606] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:15.732884   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:15.734562   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:15.781455  8245 raft_consensus.cc:993] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:15.782047  8226 raft_consensus.cc:1081] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Signalling peer 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:15.784102  1618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:34192
I20260709 13:03:15.784704  1618 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:15.785063  1618 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.798719  1618 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:15.812906  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:15.813562  1543 raft_consensus.cc:3055] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:15.813740  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94cdee269ec946a69f6c078885e844b0" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:15.813936  1543 raft_consensus.cc:740] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:15.814370  1696 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.815168  1543 consensus_queue.cc:260] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:15.816728  1618 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:15.816385  1543 raft_consensus.cc:3060] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.829247  2263 raft_consensus.cc:1217] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:03:15.859313  1696 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:03:15.860860  1543 raft_consensus.cc:2468] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 13.
I20260709 13:03:15.866425  1586 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:15.868923  8253 raft_consensus.cc:993] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:15.869472  8226 raft_consensus.cc:1081] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:15.871579  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39244
I20260709 13:03:15.877476  1696 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:15.877882  1696 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.880028  8272 raft_consensus.cc:2804] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:15.880553  8272 raft_consensus.cc:697] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:15.881472  8272 consensus_queue.cc:237] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:15.941782  2263 raft_consensus.cc:1217] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Deduplicated request from leader. Original: 17.8->[17.9-17.9]   Dedup: 17.9->[]
I20260709 13:03:15.964705  1696 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:15.973839  1696 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:15.975402  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:15.977952  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:15.978621  1543 raft_consensus.cc:3055] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:15.978948  1543 raft_consensus.cc:740] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:15.979779  1543 consensus_queue.cc:260] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:15.986837  1620 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.987962  1543 raft_consensus.cc:3060] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.992971  1543 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:03:16.058904  1620 raft_consensus.cc:2468] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 14.
I20260709 13:03:16.006424  1446 catalog_manager.cc:5697] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 12 to 13, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 13 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.113023  1663 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:16.114099  8286 raft_consensus.cc:2804] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:16.114630  8286 raft_consensus.cc:697] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:16.115564  8286 consensus_queue.cc:237] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:03:16.145936  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 165757us
W20260709 13:03:16.157614  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 172762us
I20260709 13:03:16.159106  8198 raft_consensus.cc:1064] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:03:16.212919  2263 raft_consensus.cc:1217] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:03:16.234575  8198 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:16.265547  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 46364us
I20260709 13:03:16.288024  1443 catalog_manager.cc:5697] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 13 to 14, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 14 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:16.307276  1548 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:16.309192  8282 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:16.331876  1696 raft_consensus.cc:1275] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:16.332429  1540 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:16.333912  8282 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:16.348263  2267 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:16.356421  8282 raft_consensus.cc:993] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:16.357100  8282 raft_consensus.cc:1081] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Signalling peer c20847a6dcea4c2a9cbaf35a2171e33d to start an election
I20260709 13:03:16.380573  8272 consensus_queue.cc:1048] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:16.382652  1696 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:16.388355  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
 from {username='slave'} at 127.0.0.1:39238
I20260709 13:03:16.388917  1696 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:16.389253  1696 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.398272  1696 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:16.402254  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:16.402549  1696 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:16.403069  1540 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.403453  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ae78eb08484929a4e2f3128c3b5f34" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:16.407054  1618 raft_consensus.cc:3055] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:16.407357  1618 raft_consensus.cc:740] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:16.411047  8283 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:16.414409  1618 consensus_queue.cc:260] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:16.421268  1618 raft_consensus.cc:3060] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.440949  1618 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:03:16.441860  1540 raft_consensus.cc:2468] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:03:16.442377  1663 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:16.447319  8284 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:16.463701  8212 raft_consensus.cc:2804] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:16.500880  8212 raft_consensus.cc:697] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:16.501910  8212 consensus_queue.cc:237] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:16.502626  8272 raft_consensus.cc:1064] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
W20260709 13:03:16.515095  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 44566.3us
I20260709 13:03:16.519584  8287 raft_consensus.cc:2955] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:16.531602  8272 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:16.570158  1623 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:16.572376  8289 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:16.588707  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 102653us
I20260709 13:03:16.596904  1548 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:03:16.596491  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 82503.2us
I20260709 13:03:16.611795  1697 raft_consensus.cc:2955] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:16.616729  2266 raft_consensus.cc:2955] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:16.621145  1545 raft_consensus.cc:2955] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:16.633188  8319 raft_consensus.cc:1064] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:03:16.637562  8286 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:16.640877  8198 raft_consensus.cc:1064] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:03:16.644246  8198 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:16.666225  1697 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:16.668989  8284 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:16.670604  8319 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:16.673985  8321 log.cc:927] Time spent T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:03:16.674600  2263 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:16.666453  1443 catalog_manager.cc:5697] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:16.678745  1545 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:16.736055   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:16.686345  8272 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:03:16.761061  8265 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:16.782965  1443 catalog_manager.cc:5697] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 12 to 13, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 13 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:16.844051  2266 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 17 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:16.856783  1697 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:16.871734  8287 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:16.876464  8318 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:16.889890  2266 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:16.905673  1697 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:16.905572  8283 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:16.921531  1548 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:03:16.955824  1540 raft_consensus.cc:2955] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:16.987600  1618 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:16.936731  8265 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:03:17.005174  1697 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:17.007705  8256 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:16.972376  8284 raft_consensus.cc:2955] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.021306  2263 raft_consensus.cc:1275] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:03:17.025184  1548 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:03:17.025305  1540 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:17.027036  2263 raft_consensus.cc:2955] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.034135  8319 consensus_queue.cc:1048] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:17.036760  8299 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:17.026059  8318 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:03:17.057607  8292 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:17.063531  1618 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:17.074206  1443 catalog_manager.cc:5697] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.078186  8265 raft_consensus.cc:2955] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.083871  2272 raft_consensus.cc:2955] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.089810  8304 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:17.099064  8272 raft_consensus.cc:2955] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index 9 to 10, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.110226  1696 raft_consensus.cc:2955] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.119617  2267 raft_consensus.cc:2955] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index 9 to 10, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.154470  1443 catalog_manager.cc:5697] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 12 to 13, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 17 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.160735  1697 raft_consensus.cc:2955] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.232008  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a8819ed65aa948c9aa7a571bef50ca38 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:17.234913  1540 raft_consensus.cc:2955] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index 9 to 10, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.244481  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet a8819ed65aa948c9aa7a571bef50ca38 with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:43336
I20260709 13:03:17.246143  1445 catalog_manager.cc:5697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 9 to 10, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.254302  1697 raft_consensus.cc:2955] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index 9 to 10, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.277626  8284 raft_consensus.cc:2955] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:03:17.298451  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 44167.9us
I20260709 13:03:17.306042  8343 tablet_replica.cc:333] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:17.307168  8343 raft_consensus.cc:2243] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.308204  8343 raft_consensus.cc:2272] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.315307  1623 consensus_queue.cc:237] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:17.302470  1689 raft_consensus.cc:2955] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.359988  2267 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:17.368733  8318 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:17.384150  2272 raft_consensus.cc:2955] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.383924  2267 raft_consensus.cc:2955] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.384204  1618 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:17.402287  1541 raft_consensus.cc:1275] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:17.382748  8287 raft_consensus.cc:2955] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.404791  1540 raft_consensus.cc:2955] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.365032  8343 ts_tablet_manager.cc:1916] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:17.412555  8319 consensus_queue.cc:1048] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:17.420734  2267 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:17.425469  8292 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:17.426131  1548 raft_consensus.cc:2955] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.443310  8318 raft_consensus.cc:2955] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.444693  1689 raft_consensus.cc:1275] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:17.446295  8265 consensus_queue.cc:1048] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:17.448632  1444 catalog_manager.cc:5697] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 13 to 14, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.450997  1689 raft_consensus.cc:2955] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.456079  2267 raft_consensus.cc:2955] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.487538  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4a5fdc87ebdd414ab8baa34e162bc8c4 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:17.489266  1614 consensus_queue.cc:237] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:17.494895  1540 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:17.495347  2267 raft_consensus.cc:1275] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:03:17.496804  8284 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:17.498979  8319 consensus_queue.cc:1048] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:17.502460  1445 catalog_manager.cc:5697] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 12 to 13, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.528096  1446 catalog_manager.cc:5697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index 10 to 11, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 17 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.563191  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a5fdc87ebdd414ab8baa34e162bc8c4 with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:43336
I20260709 13:03:17.567041  8319 raft_consensus.cc:2955] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.570470  2266 raft_consensus.cc:2955] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.589818  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 489da014ead84cbe9a9b46b9196c3356 with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:48090
I20260709 13:03:17.600358  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ba0a0cae5d54e9a85eed27fed785932 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:17.583837  1548 raft_consensus.cc:2955] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.605825  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 489da014ead84cbe9a9b46b9196c3356 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:17.614926  8345 tablet_replica.cc:333] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:17.610698  1445 catalog_manager.cc:5697] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 14 to 15, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 18 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:17.649955  8345 raft_consensus.cc:2243] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.650938  8345 raft_consensus.cc:2272] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.660296  8345 ts_tablet_manager.cc:1916] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:17.667757  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ba0a0cae5d54e9a85eed27fed785932 with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:48090
I20260709 13:03:17.673513  8343 ts_tablet_manager.cc:1929] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 13:03:17.698154  8343 log.cc:1199] T a8819ed65aa948c9aa7a571bef50ca38 P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/a8819ed65aa948c9aa7a571bef50ca38
I20260709 13:03:17.699889  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet a8819ed65aa948c9aa7a571bef50ca38 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:03:17.706297  8343 tablet_replica.cc:333] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:17.726475  8343 raft_consensus.cc:2243] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.727620  8343 raft_consensus.cc:2272] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.731849  8343 ts_tablet_manager.cc:1916] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:17.766237  8345 ts_tablet_manager.cc:1929] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:03:17.766860  8345 log.cc:1199] T 489da014ead84cbe9a9b46b9196c3356 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/489da014ead84cbe9a9b46b9196c3356
I20260709 13:03:17.768900  8345 tablet_replica.cc:333] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:17.768832  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet 489da014ead84cbe9a9b46b9196c3356 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:03:17.770731  8345 raft_consensus.cc:2243] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.772250  8345 raft_consensus.cc:2272] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.776295  8345 ts_tablet_manager.cc:1916] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:17.802040  8343 ts_tablet_manager.cc:1929] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.10
I20260709 13:03:17.808889  8343 log.cc:1199] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/4a5fdc87ebdd414ab8baa34e162bc8c4
I20260709 13:03:17.810907  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet 4a5fdc87ebdd414ab8baa34e162bc8c4 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:03:17.816475  8345 ts_tablet_manager.cc:1929] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.14
I20260709 13:03:17.816980  8345 log.cc:1199] T 6ba0a0cae5d54e9a85eed27fed785932 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/6ba0a0cae5d54e9a85eed27fed785932
I20260709 13:03:17.818363  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet 6ba0a0cae5d54e9a85eed27fed785932 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
W20260709 13:03:17.941768  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 54139.9us
I20260709 13:03:17.983603   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:18.180406  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 48648.9us
I20260709 13:03:18.205823  1697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:50792
I20260709 13:03:18.206735  1697 raft_consensus.cc:606] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Received request to transfer leadership to TS e37b8013aec24431a6672a857806329e
I20260709 13:03:18.214627  1697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084"
dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
mode: GRACEFUL
new_leader_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:50792
I20260709 13:03:18.215314  1697 raft_consensus.cc:606] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Received request to transfer leadership to TS 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:18.222625  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:03:18.223299  1614 raft_consensus.cc:606] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 LEADER]: Received request to transfer leadership to TS e37b8013aec24431a6672a857806329e
I20260709 13:03:18.224802   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:18.226575   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:18.382912  8303 raft_consensus.cc:993] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d: : Instructing follower e37b8013aec24431a6672a857806329e to start an election
I20260709 13:03:18.383533  8303 raft_consensus.cc:1081] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Signalling peer e37b8013aec24431a6672a857806329e to start an election
I20260709 13:03:18.391326  2266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b"
dest_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:54488
I20260709 13:03:18.391975  2266 raft_consensus.cc:493] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:18.392390  2266 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:18.411394  2266 raft_consensus.cc:515] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:18.417160  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:18.417797  1618 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:18.428831  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2ae0506db549df9409cfeceb2f3e3b" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:18.429519  1697 raft_consensus.cc:3055] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:03:18.429828  1697 raft_consensus.cc:740] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:18.430437  1618 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 18.
I20260709 13:03:18.430595  1697 consensus_queue.cc:260] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:18.431949  1697 raft_consensus.cc:3060] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:18.432402  2234 leader_election.cc:304] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:18.433694  8329 raft_consensus.cc:2804] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:18.434303  8329 raft_consensus.cc:697] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 18 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:18.435050  8329 consensus_queue.cc:237] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:18.441450  2266 leader_election.cc:290] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:18.484973  1697 raft_consensus.cc:2468] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 18.
I20260709 13:03:18.523860  1443 catalog_manager.cc:5697] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 17 to 18, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 18 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.543179  8287 raft_consensus.cc:993] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower e37b8013aec24431a6672a857806329e to start an election
I20260709 13:03:18.543787  8287 raft_consensus.cc:1081] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 LEADER]: Signalling peer e37b8013aec24431a6672a857806329e to start an election
I20260709 13:03:18.545483  2266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361"
dest_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:54496
I20260709 13:03:18.546072  2266 raft_consensus.cc:493] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:18.546427  2266 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:18.555706  2266 raft_consensus.cc:515] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:18.558722  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:18.559306  1540 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:18.578794  1540 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 21.
I20260709 13:03:18.585747  2232 leader_election.cc:304] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:18.588356  8329 raft_consensus.cc:2804] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:18.588857  8329 raft_consensus.cc:697] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 21 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:18.589810  8329 consensus_queue.cc:237] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:18.603891  2266 leader_election.cc:290] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 21 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:18.603829  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a83a11e6c2348918b88fe74b7ee7361" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:18.604549  1614 raft_consensus.cc:3055] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:18.604858  1614 raft_consensus.cc:740] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:18.605691  1614 consensus_queue.cc:260] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:18.609751  1614 raft_consensus.cc:3060] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:18.621923  1614 raft_consensus.cc:2468] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 21.
I20260709 13:03:18.650285  1443 catalog_manager.cc:5697] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 20 to 21, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 21 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.715838  8289 raft_consensus.cc:993] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d: : Instructing follower 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:18.716334  8289 raft_consensus.cc:1081] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Signalling peer 27308aae2ef347ccba1b27e7f6f04334 to start an election
I20260709 13:03:18.722450  1614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
 from {username='slave'} at 127.0.0.1:34180
I20260709 13:03:18.722987  1614 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:18.723335  1614 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.730906  1614 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:18.733659  1614 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:18.733911  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:18.734581  1696 raft_consensus.cc:3055] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:18.734956  1696 raft_consensus.cc:740] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:18.743978  1696 consensus_queue.cc:260] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:18.745303  1696 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.748862  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5408ceceb548a1a1cbe7d89f49c084" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:18.749475  1540 raft_consensus.cc:3060] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.753268  1696 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:03:18.757907  1540 raft_consensus.cc:2468] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 15.
I20260709 13:03:18.764367  1586 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:18.765251  8351 raft_consensus.cc:2804] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:18.766414  8351 raft_consensus.cc:697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:18.767225  8351 consensus_queue.cc:237] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:18.776326  1541 raft_consensus.cc:1240] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Rejecting Update request from peer c20847a6dcea4c2a9cbaf35a2171e33d for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:18.814620  1443 catalog_manager.cc:5697] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 14 to 15, leader changed from c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 15 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.856909  1697 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:03:18.858361  8356 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:18.877305  1614 raft_consensus.cc:1275] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:03:18.878750  8356 consensus_queue.cc:1048] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:18.913390  1696 consensus_queue.cc:237] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:03:18.941847  1662 consensus_peers.cc:597] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1352a2bbd594477385f629ba7222a83f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:18.945120  1623 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:18.947274  8348 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:18.948480  1541 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:03:18.961006  8364 log.cc:927] Time spent T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: Append to log took a long time: real 0.065s	user 0.005s	sys 0.000s
I20260709 13:03:18.958288  8348 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:03:19.017927  1618 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 21 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:03:19.019598  8329 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:03:19.061331  8347 raft_consensus.cc:2955] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:19.067598  1540 raft_consensus.cc:2955] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:19.077956  1623 raft_consensus.cc:2955] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:19.104132  1540 raft_consensus.cc:1275] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:03:19.103287  1444 catalog_manager.cc:5697] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 14 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:19.105643  8356 consensus_queue.cc:1048] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:19.195381  1618 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:19.225222  1695 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:19.227499   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:19.256415  8352 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:19.279399  1697 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:19.279712  1540 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:19.282353  8287 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:03:19.283697  1588 consensus_peers.cc:597] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10a17adb150f4450b68adcffc1c3d655. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:19.284592  8351 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:19.306430  1540 raft_consensus.cc:1275] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:19.307668  8352 raft_consensus.cc:2955] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:19.308992  8382 consensus_queue.cc:1048] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:19.311213  1541 raft_consensus.cc:2955] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:19.340359  1697 raft_consensus.cc:2955] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
W20260709 13:03:19.360127  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 45640us
I20260709 13:03:19.419818  8387 ts_tablet_manager.cc:933] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:19.422338  1446 catalog_manager.cc:5697] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 12, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.425244  1697 consensus_queue.cc:237] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:19.442545  8387 tablet_copy_client.cc:323] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.131:43987
I20260709 13:03:19.481211  1706 tablet_copy_service.cc:140] P c20847a6dcea4c2a9cbaf35a2171e33d: Received BeginTabletCopySession request for tablet 1352a2bbd594477385f629ba7222a83f from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:58526)
I20260709 13:03:19.481870  1706 tablet_copy_service.cc:161] P c20847a6dcea4c2a9cbaf35a2171e33d: Beginning new tablet copy session on tablet 1352a2bbd594477385f629ba7222a83f from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:58526: session id = e37b8013aec24431a6672a857806329e-1352a2bbd594477385f629ba7222a83f
I20260709 13:03:19.502233  1706 tablet_copy_source_session.cc:215] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:19.507102  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1352a2bbd594477385f629ba7222a83f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:19.522879  1662 consensus_peers.cc:597] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71ae78eb08484929a4e2f3128c3b5f34. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:19.520864  1618 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:19.524921  8303 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:19.553385  8387 tablet_copy_client.cc:806] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:19.554129  8387 tablet_copy_client.cc:670] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:19.559230  1540 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:19.566442  8347 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:19.586201  8387 tablet_copy_client.cc:538] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:19.593116  8348 raft_consensus.cc:2955] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:19.630829  8387 tablet_bootstrap.cc:492] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:03:19.676115  1444 catalog_manager.cc:5697] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 13 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.682073  1614 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:03:19.692013  8391 log.cc:927] Time spent T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:19.698716  1540 raft_consensus.cc:2955] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:19.725948  1618 raft_consensus.cc:2955] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
W20260709 13:03:19.746271  1588 consensus_peers.cc:597] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 181ed72be8c34c66b8d437212e73d0a9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:19.748263  1697 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:19.749742  8382 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:19.764153  1541 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:19.767386  8382 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:19.800072  8384 raft_consensus.cc:2955] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:19.804260  1697 raft_consensus.cc:2955] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:19.807997  1541 raft_consensus.cc:2955] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:19.815521  8398 ts_tablet_manager.cc:933] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:19.826839  1444 catalog_manager.cc:5697] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index -1 to 10, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.831691  8398 tablet_copy_client.cc:323] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:03:19.839586  1633 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 10a17adb150f4450b68adcffc1c3d655 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:03:19.840235  1633 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 10a17adb150f4450b68adcffc1c3d655 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-10a17adb150f4450b68adcffc1c3d655
I20260709 13:03:19.856446  1633 tablet_copy_source_session.cc:215] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:19.869351  8398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a17adb150f4450b68adcffc1c3d655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:19.897591  8387 tablet_bootstrap.cc:492] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:19.936184  8387 tablet_bootstrap.cc:492] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:19.936933  8387 ts_tablet_manager.cc:1403] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.306s	user 0.038s	sys 0.025s
I20260709 13:03:19.940390  8387 raft_consensus.cc:359] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:19.941197  8387 raft_consensus.cc:740] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:19.941869  8387 consensus_queue.cc:260] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:19.978010  8398 tablet_copy_client.cc:806] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:19.980597  8398 tablet_copy_client.cc:670] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:19.981334  8387 ts_tablet_manager.cc:1434] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 13:03:19.989167  1706 tablet_copy_service.cc:342] P c20847a6dcea4c2a9cbaf35a2171e33d: Request end of tablet copy session e37b8013aec24431a6672a857806329e-1352a2bbd594477385f629ba7222a83f received from {username='slave'} at 127.0.0.1:58526
I20260709 13:03:19.989647  1706 tablet_copy_service.cc:434] P c20847a6dcea4c2a9cbaf35a2171e33d: ending tablet copy session e37b8013aec24431a6672a857806329e-1352a2bbd594477385f629ba7222a83f on tablet 1352a2bbd594477385f629ba7222a83f with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:20.001737  8398 tablet_copy_client.cc:538] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:20.067481  8398 tablet_bootstrap.cc:492] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:03:20.231998  8387 ts_tablet_manager.cc:933] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:20.384142  8387 tablet_copy_client.cc:323] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.131:43987
I20260709 13:03:20.390980   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:20.391916  2272 raft_consensus.cc:1217] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:03:20.435986  8410 ts_tablet_manager.cc:933] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:20.474918  1706 tablet_copy_service.cc:140] P c20847a6dcea4c2a9cbaf35a2171e33d: Received BeginTabletCopySession request for tablet 71ae78eb08484929a4e2f3128c3b5f34 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:58526)
I20260709 13:03:20.475704  1706 tablet_copy_service.cc:161] P c20847a6dcea4c2a9cbaf35a2171e33d: Beginning new tablet copy session on tablet 71ae78eb08484929a4e2f3128c3b5f34 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:58526: session id = e37b8013aec24431a6672a857806329e-71ae78eb08484929a4e2f3128c3b5f34
I20260709 13:03:20.520741  8410 tablet_copy_client.cc:323] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.130:46095
I20260709 13:03:20.523053  1633 tablet_copy_service.cc:140] P 27308aae2ef347ccba1b27e7f6f04334: Received BeginTabletCopySession request for tablet 181ed72be8c34c66b8d437212e73d0a9 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:33892)
I20260709 13:03:20.523690  1633 tablet_copy_service.cc:161] P 27308aae2ef347ccba1b27e7f6f04334: Beginning new tablet copy session on tablet 181ed72be8c34c66b8d437212e73d0a9 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:33892: session id = e37b8013aec24431a6672a857806329e-181ed72be8c34c66b8d437212e73d0a9
I20260709 13:03:20.540756  1633 tablet_copy_source_session.cc:215] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:20.544251  8410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181ed72be8c34c66b8d437212e73d0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.545336  1706 tablet_copy_source_session.cc:215] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:20.566222  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ae78eb08484929a4e2f3128c3b5f34. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:20.567751  8398 log.cc:927] Time spent T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.060s	user 0.004s	sys 0.000s
I20260709 13:03:20.582466  8398 tablet_bootstrap.cc:492] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:20.583657  8398 tablet_bootstrap.cc:492] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:20.587373  8398 ts_tablet_manager.cc:1403] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.520s	user 0.048s	sys 0.008s
I20260709 13:03:20.598184  8398 raft_consensus.cc:359] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:20.599534  8398 raft_consensus.cc:740] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:20.600329  8398 consensus_queue.cc:260] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:20.624323  8410 tablet_copy_client.cc:806] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:20.643748  8410 tablet_copy_client.cc:670] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:20.628895  8387 tablet_copy_client.cc:806] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:20.645102  8387 tablet_copy_client.cc:670] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:20.652436  8410 tablet_copy_client.cc:538] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:20.655789  8387 tablet_copy_client.cc:538] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:20.644412  8398 ts_tablet_manager.cc:1434] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:03:20.662590  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-10a17adb150f4450b68adcffc1c3d655 received from {username='slave'} at 127.0.0.1:33892
I20260709 13:03:20.663107  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-10a17adb150f4450b68adcffc1c3d655 on tablet 10a17adb150f4450b68adcffc1c3d655 with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:20.689881  8410 tablet_bootstrap.cc:492] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:03:20.695504  8387 tablet_bootstrap.cc:492] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
I20260709 13:03:20.761895  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905"
dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
mode: GRACEFUL
new_leader_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:37742
I20260709 13:03:20.762702  1614 raft_consensus.cc:606] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Received request to transfer leadership to TS 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:20.764475   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:03:20.766263   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:20.817054  8393 raft_consensus.cc:1064] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:03:20.824018  2272 raft_consensus.cc:1217] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:03:20.821120  8393 consensus_queue.cc:237] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:20.874769  8410 tablet_bootstrap.cc:492] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:20.892323  8410 tablet_bootstrap.cc:492] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:20.893076  8410 ts_tablet_manager.cc:1403] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.203s	user 0.036s	sys 0.008s
I20260709 13:03:20.903908  2272 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [term 14 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:20.905699  8406 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:20.925665  1545 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:20.927054  8393 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:20.943552  8410 raft_consensus.cc:359] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:20.944448  8410 raft_consensus.cc:740] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:20.959486  8410 consensus_queue.cc:260] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:20.968498  8406 raft_consensus.cc:2955] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:20.976194  1541 raft_consensus.cc:2955] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:20.984211  8387 tablet_bootstrap.cc:492] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:20.990178  8410 ts_tablet_manager.cc:1434] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.001s
I20260709 13:03:20.991036  8387 tablet_bootstrap.cc:492] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:20.991815  8387 ts_tablet_manager.cc:1403] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.311s	user 0.037s	sys 0.012s
I20260709 13:03:20.993001  1633 tablet_copy_service.cc:342] P 27308aae2ef347ccba1b27e7f6f04334: Request end of tablet copy session e37b8013aec24431a6672a857806329e-181ed72be8c34c66b8d437212e73d0a9 received from {username='slave'} at 127.0.0.1:33892
I20260709 13:03:20.993439  1633 tablet_copy_service.cc:434] P 27308aae2ef347ccba1b27e7f6f04334: ending tablet copy session e37b8013aec24431a6672a857806329e-181ed72be8c34c66b8d437212e73d0a9 on tablet 181ed72be8c34c66b8d437212e73d0a9 with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:20.994524  8387 raft_consensus.cc:359] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:20.995292  8387 raft_consensus.cc:740] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:20.999938  8387 consensus_queue.cc:260] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:21.005450  8387 ts_tablet_manager.cc:1434] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:03:21.008582  1706 tablet_copy_service.cc:342] P c20847a6dcea4c2a9cbaf35a2171e33d: Request end of tablet copy session e37b8013aec24431a6672a857806329e-71ae78eb08484929a4e2f3128c3b5f34 received from {username='slave'} at 127.0.0.1:58526
I20260709 13:03:21.009004  1706 tablet_copy_service.cc:434] P c20847a6dcea4c2a9cbaf35a2171e33d: ending tablet copy session e37b8013aec24431a6672a857806329e-71ae78eb08484929a4e2f3128c3b5f34 on tablet 71ae78eb08484929a4e2f3128c3b5f34 with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:21.043051  1444 catalog_manager.cc:5697] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:03:21.051216  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 78837.2us
I20260709 13:03:21.058204  1614 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:03:21.077943  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 58208us
I20260709 13:03:21.080184  2272 raft_consensus.cc:2955] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:21.087306  8392 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:21.145920  1618 raft_consensus.cc:2955] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:21.167578  1696 consensus_queue.cc:237] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:21.180902  2272 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:21.181758  1545 raft_consensus.cc:1275] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:21.182353  8406 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:21.191642  8393 consensus_queue.cc:1048] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:21.203822  2272 raft_consensus.cc:2955] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:21.194816  8393 raft_consensus.cc:2955] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:21.228677  2266 raft_consensus.cc:1217] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:03:21.584160  8424 raft_consensus.cc:993] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334: : Instructing follower 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:03:21.584785  8385 raft_consensus.cc:1081] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Signalling peer 44c8c572048a40b1a5e71865068ed1bb to start an election
I20260709 13:03:21.638011  1548 raft_consensus.cc:2955] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:21.657747  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
 from {username='slave'} at 127.0.0.1:35712
I20260709 13:03:21.658481  1540 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:21.658885  1540 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.664644  1540 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:21.668691  1540 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:21.669562  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:21.670218  1623 raft_consensus.cc:3055] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:21.670498  1623 raft_consensus.cc:740] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:21.671955  1623 consensus_queue.cc:260] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:21.673081  1623 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.694453  1623 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:03:21.696002  1514 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb; no voters: 
I20260709 13:03:21.697116  8428 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:21.697674  8428 raft_consensus.cc:697] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Becoming Leader. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:21.698635  8428 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:21.709614  8415 raft_consensus.cc:1064] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:03:21.716668  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1352a2bbd594477385f629ba7222a83f with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:21.713711  8415 consensus_queue.cc:237] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:21.769507  2272 raft_consensus.cc:1217] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:03:21.781251   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:21.788148  1543 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:21.797317  8415 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:03:21.826737  1444 catalog_manager.cc:5697] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 11 to 12, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 14 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:21.841749  1444 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: term changed from 15 to 16, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129). New cstate: current_term: 16 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.862613  8287 raft_consensus.cc:1064] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:03:21.878852  8287 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:21.941404  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 78253.4us
I20260709 13:03:21.945957  2267 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [term 13 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:21.959107  8406 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:03:21.967387  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:21.968077  2267 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:21.969985  1623 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:03:21.971946  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 49189.4us
I20260709 13:03:22.002707  1692 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:22.004676  2263 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:22.021054  1543 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:22.024149  8426 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:22.028753  8424 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:22.027009  2267 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44c8c572048a40b1a5e71865068ed1bb in term 16.
I20260709 13:03:22.031941  8385 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:22.082789  8406 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:22.140574  8385 raft_consensus.cc:2955] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.146807  1690 raft_consensus.cc:2955] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:03:22.160677  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 149684us
I20260709 13:03:22.168015  8441 raft_consensus.cc:2955] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.169291  2263 raft_consensus.cc:2955] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.188651  1618 raft_consensus.cc:2955] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.200021  2267 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:22.210130  1541 raft_consensus.cc:2955] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.216820  8407 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:22.239567  2268 raft_consensus.cc:2955] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.261344  1443 catalog_manager.cc:5697] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: config changed from index 12 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.283200  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet 1352a2bbd594477385f629ba7222a83f with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:46330
I20260709 13:03:22.297632  1445 catalog_manager.cc:5697] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.304499  1548 raft_consensus.cc:2955] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.314762  1618 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:22.316350  8432 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:22.331149  8287 raft_consensus.cc:1064] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:03:22.333847  8287 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:22.345889  8459 tablet_replica.cc:333] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:22.353931  1690 consensus_queue.cc:237] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:22.393035  8459 raft_consensus.cc:2243] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:22.393885  8459 raft_consensus.cc:2272] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:22.397071  8459 ts_tablet_manager.cc:1916] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:22.400550  2267 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:22.402137  8393 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:22.410218  8448 raft_consensus.cc:2955] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.420617  2268 raft_consensus.cc:2955] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.441002  1541 raft_consensus.cc:1275] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:22.443323  8406 consensus_queue.cc:1048] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:22.447786  1548 raft_consensus.cc:2955] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.530494  2268 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 16 LEARNER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:22.521540  1443 catalog_manager.cc:5697] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 11 to 12, VOTER 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) evicted. New cstate: current_term: 13 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.549331  8459 ts_tablet_manager.cc:1929] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:03:22.564059  8459 log.cc:1199] T 1352a2bbd594477385f629ba7222a83f P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/1352a2bbd594477385f629ba7222a83f
I20260709 13:03:22.564443  8434 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:22.565917  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet 1352a2bbd594477385f629ba7222a83f (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:03:22.566644  1541 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:22.585433  1690 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:22.597357  1610 tablet_service.cc:1558] Processing DeleteTablet for tablet 71ae78eb08484929a4e2f3128c3b5f34 with delete_type TABLET_DATA_TOMBSTONED (TS 27308aae2ef347ccba1b27e7f6f04334 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:46330
I20260709 13:03:22.598392  8459 tablet_replica.cc:333] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:22.599507  8459 raft_consensus.cc:2243] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:22.612530  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 69972.2us
I20260709 13:03:22.641171  8459 raft_consensus.cc:2272] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:22.643661  8352 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
W20260709 13:03:22.673511  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 47485.9us
I20260709 13:03:22.678108  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 71ae78eb08484929a4e2f3128c3b5f34 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:22.681151  8468 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
W20260709 13:03:22.682293  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 51513us
I20260709 13:03:22.706504  8459 ts_tablet_manager.cc:1916] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:03:22.802935  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08002ebae0 after lost signal to thread 433
W20260709 13:03:22.804193  2293 debug-util.cc:398] Leaking SignalData structure 0x7b080026ce40 after lost signal to thread 1480
W20260709 13:03:22.805552  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08002acdc0 after lost signal to thread 1572
W20260709 13:03:22.806667  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08002588c0 after lost signal to thread 1647
W20260709 13:03:22.813958  2293 debug-util.cc:398] Leaking SignalData structure 0x7b0800350700 after lost signal to thread 1721
W20260709 13:03:22.815267  2293 debug-util.cc:398] Leaking SignalData structure 0x7b080003d3a0 after lost signal to thread 2296
I20260709 13:03:22.833778  1623 consensus_queue.cc:237] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:22.842907  1543 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:22.857564  2268 raft_consensus.cc:1275] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:22.869040  8287 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:22.869976  8459 ts_tablet_manager.cc:1929] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:03:22.870440  8459 log.cc:1199] T 71ae78eb08484929a4e2f3128c3b5f34 P 27308aae2ef347ccba1b27e7f6f04334: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-1-root/wals/71ae78eb08484929a4e2f3128c3b5f34
I20260709 13:03:22.873644  8287 consensus_queue.cc:1048] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:03:22.877326  8476 raft_consensus.cc:2955] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.886173  1689 raft_consensus.cc:2955] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.888280  1433 catalog_manager.cc:5028] TS 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): tablet 71ae78eb08484929a4e2f3128c3b5f34 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:03:22.889348  8469 raft_consensus.cc:2955] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.896806  2267 raft_consensus.cc:2955] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.900445  2263 raft_consensus.cc:2955] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.913084  1446 catalog_manager.cc:5697] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.939234  1548 raft_consensus.cc:2955] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } attrs { replace: true } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.940943  1445 catalog_manager.cc:5697] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 13 to 14, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New cstate: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.959101  1614 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:22.968925  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 10a17adb150f4450b68adcffc1c3d655 with delete_type TABLET_DATA_TOMBSTONED (TS c20847a6dcea4c2a9cbaf35a2171e33d not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:48090
I20260709 13:03:22.971101  1689 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:22.973210  2268 raft_consensus.cc:1275] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:22.976706  8474 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:22.977524  8287 consensus_queue.cc:1048] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:22.983451  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 10a17adb150f4450b68adcffc1c3d655 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:22.988570  1543 raft_consensus.cc:2955] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.990119  8476 raft_consensus.cc:2955] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:22.994102  2268 raft_consensus.cc:2955] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:23.009816  1696 raft_consensus.cc:2955] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:23.015879  8480 tablet_replica.cc:333] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:23.030131  1433 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 181ed72be8c34c66b8d437212e73d0a9 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:23.029862  1446 catalog_manager.cc:5697] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 11 to 12, VOTER 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) evicted. New cstate: current_term: 16 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:23.040904  8480 raft_consensus.cc:2243] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:23.051170  8480 raft_consensus.cc:2272] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:23.053933  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 181ed72be8c34c66b8d437212e73d0a9 with delete_type TABLET_DATA_TOMBSTONED (TS 44c8c572048a40b1a5e71865068ed1bb not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:43336
I20260709 13:03:23.067552  8480 ts_tablet_manager.cc:1916] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:23.091667  8481 tablet_replica.cc:333] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:23.147620  8481 raft_consensus.cc:2243] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:23.148607  8481 raft_consensus.cc:2272] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:23.153035  8481 ts_tablet_manager.cc:1916] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:23.153168  8480 ts_tablet_manager.cc:1929] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.13
I20260709 13:03:23.153725  8480 log.cc:1199] T 10a17adb150f4450b68adcffc1c3d655 P c20847a6dcea4c2a9cbaf35a2171e33d: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-2-root/wals/10a17adb150f4450b68adcffc1c3d655
I20260709 13:03:23.155426  1430 catalog_manager.cc:5028] TS c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): tablet 10a17adb150f4450b68adcffc1c3d655 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:03:23.189555  8481 ts_tablet_manager.cc:1929] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:03:23.191839  8481 log.cc:1199] T 181ed72be8c34c66b8d437212e73d0a9 P 44c8c572048a40b1a5e71865068ed1bb: Deleting WAL directory at /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601969268282-430-0/minicluster-data/ts-0-root/wals/181ed72be8c34c66b8d437212e73d0a9
I20260709 13:03:23.209224  1431 catalog_manager.cc:5028] TS 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): tablet 181ed72be8c34c66b8d437212e73d0a9 (table test-workload [id=c7ca422259724cef854945cea1ef66ae]) successfully deleted
I20260709 13:03:23.224637   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:23.338697  1543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3"
dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
mode: GRACEFUL
new_leader_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:41606
I20260709 13:03:23.339509  1543 raft_consensus.cc:606] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Received request to transfer leadership to TS e37b8013aec24431a6672a857806329e
I20260709 13:03:23.345872   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:03:23.347744   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:23.781771  8432 raft_consensus.cc:993] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: : Instructing follower e37b8013aec24431a6672a857806329e to start an election
I20260709 13:03:23.782328  8432 raft_consensus.cc:1081] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Signalling peer e37b8013aec24431a6672a857806329e to start an election
I20260709 13:03:23.784045  2268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3"
dest_uuid: "e37b8013aec24431a6672a857806329e"
 from {username='slave'} at 127.0.0.1:54504
I20260709 13:03:23.784576  2268 raft_consensus.cc:493] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:23.784958  2268 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.806417  2268 raft_consensus.cc:515] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:23.810880  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "44c8c572048a40b1a5e71865068ed1bb"
I20260709 13:03:23.811478  1543 raft_consensus.cc:3055] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:23.811786  1543 raft_consensus.cc:740] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 44c8c572048a40b1a5e71865068ed1bb, State: Running, Role: LEADER
I20260709 13:03:23.812520  1543 consensus_queue.cc:260] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:23.813686  1543 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.838748  2268 leader_election.cc:290] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:23.838893  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3841c3258da84512aa1d5bec2bac5fe3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:23.839519  1696 raft_consensus.cc:3060] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.843914  1543 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 16.
I20260709 13:03:23.850845  1696 raft_consensus.cc:2468] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 16.
I20260709 13:03:23.857779  2231 leader_election.cc:304] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:23.859170  8418 raft_consensus.cc:2804] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:23.859836  8418 raft_consensus.cc:697] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:23.861088  8418 consensus_queue.cc:237] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:23.924801  1445 catalog_manager.cc:5697] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 15 to 16, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 16 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.315615  1696 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:24.316963  8473 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:24.348520   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:24.391357  1541 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:24.395948  1543 raft_consensus.cc:1275] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:24.399992  8418 consensus_queue.cc:1048] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:24.422327  1696 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:03:24.423866  1513 consensus_peers.cc:597] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9e9b2c19f1f4f8a9f31fc7f721bf363. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:24.423998  8427 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:24.435390   430 tablet_server.cc:179] TabletServer@127.0.107.129:0 shutting down...
W20260709 13:03:24.484601  1587 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:03:24.586922  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 86591.4us
W20260709 13:03:24.588558  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 93257.2us
W20260709 13:03:24.592036  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 108480us
I20260709 13:03:24.603161  8454 raft_consensus.cc:2955] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
W20260709 13:03:24.598371  1661 consensus_peers.cc:597] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:24.612224  1689 raft_consensus.cc:2955] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
I20260709 13:03:24.625519  1614 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer 44c8c572048a40b1a5e71865068ed1bb: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:03:24.632916  1661 consensus_peers.cc:597] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.645160  2232 consensus_peers.cc:597] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.646071  2232 consensus_peers.cc:597] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.646768  2232 consensus_peers.cc:597] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.647482  2232 consensus_peers.cc:597] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.648299  1494 auto_rebalancer.cc:629] Failed to schedule move for tablet 07ae750f29dc4aceb08544eb94e8e716: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:24.651911  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 56989.4us
W20260709 13:03:24.656939  1661 consensus_peers.cc:597] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:24.657217  8502 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:03:24.658828  1587 consensus_peers.cc:597] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.653831  2232 consensus_peers.cc:597] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:24.653584  1445 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb reported cstate change: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New cstate: current_term: 17 leader_uuid: "44c8c572048a40b1a5e71865068ed1bb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:24.674401  2232 consensus_peers.cc:597] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.695749  1661 consensus_peers.cc:597] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.725637  1587 consensus_peers.cc:597] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.728452  1587 consensus_peers.cc:597] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.754187  1587 consensus_peers.cc:597] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:24.754063  1623 raft_consensus.cc:2955] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER e37b8013aec24431a6672a857806329e (127.0.107.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } }
W20260709 13:03:24.755260  1661 consensus_peers.cc:597] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.754859  1587 consensus_peers.cc:597] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.784013  1661 consensus_peers.cc:597] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.782739  1587 consensus_peers.cc:597] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.790231  1587 consensus_peers.cc:597] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.795024  1587 consensus_peers.cc:597] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.807863  2232 consensus_peers.cc:597] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.813962  1661 consensus_peers.cc:597] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.814745  1661 consensus_peers.cc:597] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.816035  2232 consensus_peers.cc:597] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.863395  1587 consensus_peers.cc:597] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.873992  1661 consensus_peers.cc:597] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:24.875782  1661 consensus_peers.cc:597] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:24.925956   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:24.932310   430 tablet_replica.cc:333] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:24.933241   430 raft_consensus.cc:2243] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:24.935326   430 raft_consensus.cc:2272] T effd69042c284e8386aafb50372a93b6 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:24.939991   430 tablet_replica.cc:333] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:24.943284  8509 ts_tablet_manager.cc:933] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
I20260709 13:03:24.941315   430 raft_consensus.cc:2243] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:24.951912   430 raft_consensus.cc:2272] T 3841c3258da84512aa1d5bec2bac5fe3 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:24.951947  8509 tablet_copy_client.cc:323] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.129:46597
I20260709 13:03:24.955107   430 tablet_replica.cc:333] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:24.956033   430 raft_consensus.cc:2243] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:24.957329   430 raft_consensus.cc:2272] T 18e6dd43c01541d3abf870473a28780a P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:24.963636   430 tablet_replica.cc:333] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:24.964704   430 raft_consensus.cc:2243] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:24.965646  1587 consensus_peers.cc:597] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:24.965659   430 raft_consensus.cc:2272] T 71ae78eb08484929a4e2f3128c3b5f34 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:24.975744   430 tablet_replica.cc:333] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:24.976985   430 raft_consensus.cc:2243] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:24.978134   430 raft_consensus.cc:2272] T 75790e14e47a47d9b0c447e78725e905 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:24.999501  1661 consensus_peers.cc:597] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:25.004393  2232 consensus_peers.cc:597] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.028487   430 tablet_replica.cc:333] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.037848   430 raft_consensus.cc:2243] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.038599   430 raft_consensus.cc:2272] T a70c773fba6b40bfad053ffbcc4b9d86 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.060050   430 tablet_replica.cc:333] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.068840   430 raft_consensus.cc:2243] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.071321   430 raft_consensus.cc:2272] T 2a931eba8b604012a41ed982e7200b41 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.076673   430 tablet_replica.cc:333] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.077844   430 raft_consensus.cc:2243] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.078491   430 raft_consensus.cc:2272] T ba9457391f9c4971a27c4ef6fd3af809 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.105688   430 tablet_replica.cc:333] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.106658   430 raft_consensus.cc:2243] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.107290   430 raft_consensus.cc:2272] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.122534   430 tablet_replica.cc:333] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.123468   430 raft_consensus.cc:2243] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.124085   430 raft_consensus.cc:2272] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.135702   430 tablet_replica.cc:333] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.136575   430 raft_consensus.cc:2243] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.137701   430 raft_consensus.cc:2272] T 42d9e3317d944e97b0f09db457e476f3 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.165582   430 tablet_replica.cc:333] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.173928   430 raft_consensus.cc:2243] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.174798   430 raft_consensus.cc:2272] T 1af6b960277d47bd994134d20b77c59a P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.183983   430 tablet_replica.cc:333] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.185009   430 raft_consensus.cc:2243] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.185986   430 raft_consensus.cc:2272] T 1cfabef9288d4d6ab7bbfaed954379e9 P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.199487   430 tablet_replica.cc:333] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.200448   430 raft_consensus.cc:2243] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.201112   430 raft_consensus.cc:2272] T 7bd2e8876bc642db9518e484c47f1ac3 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.205569   430 tablet_replica.cc:333] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.206404   430 raft_consensus.cc:2243] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.207492   430 raft_consensus.cc:2272] T e4ba9e8bda7e4019b703c785aae4f0a3 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.210186   430 tablet_replica.cc:333] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.215009   430 raft_consensus.cc:2243] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.215777   430 raft_consensus.cc:2272] T cecec9af1f82495390a4640f3927241f P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.218474   430 tablet_replica.cc:333] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.223929   430 raft_consensus.cc:2243] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.224560   430 raft_consensus.cc:2272] T 2f5408ceceb548a1a1cbe7d89f49c084 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.236923   430 tablet_replica.cc:333] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.237903   430 raft_consensus.cc:2243] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.240682   430 raft_consensus.cc:2272] T 8a63558e47a84017a3a62f52bb8cb3eb P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.243439   430 tablet_replica.cc:333] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.244271   430 raft_consensus.cc:2243] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.245066   430 raft_consensus.cc:2272] T ba1f748970c74ef290462d25b2975815 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.247830   430 tablet_replica.cc:333] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.252048   430 raft_consensus.cc:2243] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.252648   430 raft_consensus.cc:2272] T c3006951ad004b6b87217fff5303a9ab P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.283722   430 tablet_replica.cc:333] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.287390   430 raft_consensus.cc:2243] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.288035   430 raft_consensus.cc:2272] T 435d66c2e8e14e73af7cc63b8ce93e2d P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.323822   430 tablet_replica.cc:333] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.324787   430 raft_consensus.cc:2243] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.423343   430 raft_consensus.cc:2272] T 953db44baef24f55a28e65ff051866d1 P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.463296   430 tablet_replica.cc:333] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.474253  8502 raft_consensus.cc:493] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:25.482364  8502 raft_consensus.cc:515] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:25.484413  8502 leader_election.cc:290] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:25.491778   430 raft_consensus.cc:2243] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.492479   430 raft_consensus.cc:2272] T 33125bfca16d4902a09564d1eef1a47f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.495204   430 tablet_replica.cc:333] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.500455  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:25.502429  8502 raft_consensus.cc:493] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:03:25.502950  8502 raft_consensus.cc:515] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:25.505462  8502 leader_election.cc:290] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:25.507057  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:25.509191  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:25.526651  1514 leader_election.cc:304] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:25.527853  8502 raft_consensus.cc:2749] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:25.527918  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8493cdac98b4860b0ddbe729b652ee9" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:25.548993  8502 raft_consensus.cc:493] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:25.549516  8502 raft_consensus.cc:515] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:25.551553  8502 leader_election.cc:290] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:25.558180   430 raft_consensus.cc:2243] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.562942   430 raft_consensus.cc:2272] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.561297  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:25.559204  1514 leader_election.cc:304] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:03:25.573397   430 tablet_replica.cc:333] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.573475  8494 raft_consensus.cc:2749] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:25.578749  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c033fce18c634feb995adf2f2422308c" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:25.580420  8494 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:25.580942  8494 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:25.583721   430 raft_consensus.cc:2243] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.584348  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:25.588039  8494 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:25.589389   430 raft_consensus.cc:2272] T 07ae750f29dc4aceb08544eb94e8e716 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.592187   430 tablet_replica.cc:333] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.592353  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1352a2bbd594477385f629ba7222a83f" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:25.593099   430 raft_consensus.cc:2243] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.599972   430 raft_consensus.cc:2272] T 4b189117895a48d4b813cda9e276c524 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.596453  1511 leader_election.cc:304] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:25.600903  8494 raft_consensus.cc:2749] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:25.602268  1511 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:03:25.603390  8494 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:25.608346   430 tablet_replica.cc:333] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.619309   430 raft_consensus.cc:2243] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.620126   430 raft_consensus.cc:2272] T 5886b3175b9d44069e5ba1077b09a28f P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.637303   430 tablet_replica.cc:333] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.638211   430 raft_consensus.cc:2243] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.638829   430 raft_consensus.cc:2272] T 7a83a11e6c2348918b88fe74b7ee7361 P 44c8c572048a40b1a5e71865068ed1bb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.643688  8494 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:25.644281  8494 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:25.646569  8494 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:25.648224  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:25.648612  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "489da014ead84cbe9a9b46b9196c3356" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:25.651297  1513 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:03:25.652087  8494 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:25.655233   430 tablet_replica.cc:333] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.656229   430 raft_consensus.cc:2243] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.658136   430 raft_consensus.cc:2272] T 489da014ead84cbe9a9b46b9196c3356 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.661746  8494 raft_consensus.cc:493] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:03:25.662225  8494 raft_consensus.cc:515] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:25.664192  8494 leader_election.cc:290] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:25.664929  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:25.668640  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b77299e14b04383b105cbae0697fbca" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:25.670446  1513 leader_election.cc:304] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:03:25.672755   430 tablet_replica.cc:333] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.673696   430 raft_consensus.cc:2243] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.677234   430 raft_consensus.cc:2272] T 738a15ae04514d49969f3624caa73f45 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.683261  8502 raft_consensus.cc:2749] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:25.684651  8502 raft_consensus.cc:493] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e37b8013aec24431a6672a857806329e)
I20260709 13:03:25.685387  8502 raft_consensus.cc:515] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:25.693269  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:25.683280   430 tablet_replica.cc:333] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.695887   430 raft_consensus.cc:2243] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.697335  8407 raft_consensus.cc:493] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:25.697870   430 raft_consensus.cc:2272] T 76479b4c97fc4172991dba87da2718fc P 44c8c572048a40b1a5e71865068ed1bb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.697921  8407 raft_consensus.cc:515] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:25.700009  8502 leader_election.cc:290] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:25.700743  8407 leader_election.cc:290] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:25.701769  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4abaeaa789c4d7b9da036c18751f9b6" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:25.706959  1513 leader_election.cc:304] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e
I20260709 13:03:25.708635  8407 raft_consensus.cc:2749] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:25.703317  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:25.704351  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63fd709a0b0d464193cd5a7eac0f5955" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:25.712355  1514 leader_election.cc:304] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:25.713312   430 tablet_replica.cc:333] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.714229   430 raft_consensus.cc:2243] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.715778  8502 raft_consensus.cc:2749] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:25.714918   430 raft_consensus.cc:2272] T 8b77299e14b04383b105cbae0697fbca P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.722150   430 tablet_replica.cc:333] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.729851  8407 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:25.732288   430 raft_consensus.cc:2243] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.731999  8407 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:25.734277  8407 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:25.735868   430 raft_consensus.cc:2272] T 8820554e3d9a4662b150408d84019889 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.736882  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:25.739989  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba0a0cae5d54e9a85eed27fed785932" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:25.741314  1514 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:03:25.742364  8407 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:25.744983   430 tablet_replica.cc:333] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.747710   430 raft_consensus.cc:2243] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.748755   430 raft_consensus.cc:2272] T ea89d024b77243d097fd08bd251c9d5e P 44c8c572048a40b1a5e71865068ed1bb [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.752900   430 tablet_replica.cc:333] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.759544   430 raft_consensus.cc:2243] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.760262   430 raft_consensus.cc:2272] T 6ba0a0cae5d54e9a85eed27fed785932 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.771098   430 tablet_replica.cc:333] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.771927   430 raft_consensus.cc:2243] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.772534   430 raft_consensus.cc:2272] T c033fce18c634feb995adf2f2422308c P 44c8c572048a40b1a5e71865068ed1bb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.775040   430 tablet_replica.cc:333] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.782291   430 raft_consensus.cc:2243] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.785432   430 raft_consensus.cc:2272] T 94cdee269ec946a69f6c078885e844b0 P 44c8c572048a40b1a5e71865068ed1bb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.798032   430 tablet_replica.cc:333] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.797874  8407 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:25.799072   430 raft_consensus.cc:2243] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.798738  8407 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:25.799847   430 raft_consensus.cc:2272] T 63fd709a0b0d464193cd5a7eac0f5955 P 44c8c572048a40b1a5e71865068ed1bb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.802577  8407 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:25.805125  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:25.802858   430 tablet_replica.cc:333] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.806519   430 raft_consensus.cc:2243] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.806851  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f320525c0a40e79e76f607d8195977" candidate_uuid: "44c8c572048a40b1a5e71865068ed1bb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:25.807397   430 raft_consensus.cc:2272] T 11a34da7993e4fee9ff4fc1266a6af38 P 44c8c572048a40b1a5e71865068ed1bb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.808648  1514 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44c8c572048a40b1a5e71865068ed1bb; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:03:25.809957  8407 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:25.810240   430 tablet_replica.cc:333] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.811156   430 raft_consensus.cc:2243] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.813797   430 raft_consensus.cc:2272] T 10a17adb150f4450b68adcffc1c3d655 P 44c8c572048a40b1a5e71865068ed1bb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.821980   430 tablet_replica.cc:333] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.826277   430 raft_consensus.cc:2243] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.835572   430 raft_consensus.cc:2272] T e4abaeaa789c4d7b9da036c18751f9b6 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:25.851388  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.866340   430 tablet_replica.cc:333] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.867388   430 raft_consensus.cc:2243] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:25.868521   430 raft_consensus.cc:2272] T e60c013c7e324514aef1674561db1cc6 P 44c8c572048a40b1a5e71865068ed1bb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.877728   430 tablet_replica.cc:333] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.879822   430 raft_consensus.cc:2243] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.880519   430 raft_consensus.cc:2272] T d5f320525c0a40e79e76f607d8195977 P 44c8c572048a40b1a5e71865068ed1bb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.890704   430 tablet_replica.cc:333] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.894332   430 raft_consensus.cc:2243] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.895200   430 raft_consensus.cc:2272] T c8493cdac98b4860b0ddbe729b652ee9 P 44c8c572048a40b1a5e71865068ed1bb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:25.914132   430 tablet_replica.cc:333] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb: stopping tablet replica
I20260709 13:03:25.917114   430 raft_consensus.cc:2243] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:25.918181   430 raft_consensus.cc:2272] T 1352a2bbd594477385f629ba7222a83f P 44c8c572048a40b1a5e71865068ed1bb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.002274  8498 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.002916  8498 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.006428  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:03:26.009951  2232 leader_election.cc:336] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.010376  2232 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:26.011116  8473 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:26.011938  8498 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:26.123172  8487 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.123826  8487 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.127372  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:26.128459  8487 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:26.133991  8495 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.147178  8495 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.149439  8495 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:26.151019  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:03:26.157292  1587 leader_election.cc:336] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.158016  1587 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:03:26.173668  8511 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.174274  8511 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.162585  8487 raft_consensus.cc:2749] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:26.181478  8511 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:26.182725  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:03:26.179535  1587 leader_election.cc:336] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.188515  1587 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:26.191722  8495 raft_consensus.cc:2749] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:26.193673  1661 leader_election.cc:336] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.194245  1661 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:03:26.196098  8473 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.196709  8473 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.199221  8473 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:26.205180  8511 raft_consensus.cc:2749] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:26.211018  2232 leader_election.cc:336] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.215335  8495 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.216070  8495 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.218904  8495 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:26.221643  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:26.228571  8517 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:03:26.229947  1587 leader_election.cc:336] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.233897  1587 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:26.230600  8517 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.240566  8495 raft_consensus.cc:2749] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:26.240523  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:26.242444  1614 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 15.
I20260709 13:03:26.244371  8518 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.244903  8518 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.247262  8518 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:26.249349  1661 leader_election.cc:336] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.257484  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:26.259653  1662 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:03:26.264649  8475 raft_consensus.cc:2749] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:26.275851  8475 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.276466  8475 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.279179  8475 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:26.283308  8517 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:26.296689  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:26.297344  1618 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 19.
W20260709 13:03:26.294548  1661 leader_election.cc:336] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.307924  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:03:26.388933  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 75364.7us
W20260709 13:03:26.399917  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 72687.5us
I20260709 13:03:26.402823  1663 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:26.403609  8475 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:26.404031  8475 raft_consensus.cc:493] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.404402  8475 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:26.410145  8519 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.410759  8519 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.413175  2234 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:26.413941  8473 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:26.414292  8473 raft_consensus.cc:493] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.414640  8473 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:26.418898  2232 leader_election.cc:336] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:26.420348  8519 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:26.433015  8473 raft_consensus.cc:515] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.434605  8498 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.473563  8498 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:26.443912  1511 connection.cc:466] server connection from 127.0.0.1:35712 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35712 (request call id 4074) could send its response
I20260709 13:03:26.453981  8511 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.475852  8511 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:03:26.453951  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 44210us
W20260709 13:03:26.457217  1514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.464401  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:26.477658  1696 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 17.
I20260709 13:03:26.485863  8511 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:26.485994  1587 connection.cc:573] client connection to 127.0.107.129:46597 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:03:26.482798  1661 connection.cc:769] client connection to 127.0.107.129:46597 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260709 13:03:26.487233  1661 leader_election.cc:336] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 13:03:26.489661  8473 leader_election.cc:290] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:26.487550  8475 raft_consensus.cc:515] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.484462  8498 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:26.492722  8475 leader_election.cc:290] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 20 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:26.488104  1661 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:26.504316  8475 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:26.507748  8516 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.508425  8516 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.510601  8516 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:03:26.511781  2232 leader_election.cc:336] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:26.512645  2232 leader_election.cc:336] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:26.541219  1513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 51525.5us
I20260709 13:03:26.542459  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effd69042c284e8386aafb50372a93b6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:26.543135  1618 raft_consensus.cc:3060] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:26.545459  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:26.546048  2267 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 16.
I20260709 13:03:26.549612  1618 raft_consensus.cc:2468] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 16.
I20260709 13:03:26.554595  1588 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:26.561314  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:26.562605  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d9e3317d944e97b0f09db457e476f3" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:26.571846  1623 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:03:26.571875  1621 raft_consensus.cc:3060] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:26.574474  1663 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:26.575281  8517 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:26.575671  8517 raft_consensus.cc:493] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.576009  8517 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:26.578986  1621 raft_consensus.cc:2468] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 20.
I20260709 13:03:26.580796  1663 leader_election.cc:304] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:26.581537  8511 raft_consensus.cc:2804] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:26.581979  8511 raft_consensus.cc:697] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:26.582794  8511 consensus_queue.cc:237] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.588986  2231 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:26.593809  8523 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:26.594224  8523 raft_consensus.cc:493] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.594564  8523 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.590763  8517 raft_consensus.cc:515] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.602496  8523 raft_consensus.cc:515] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.604101  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e6dd43c01541d3abf870473a28780a" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:26.604672  1623 raft_consensus.cc:3060] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:26.609298  2232 leader_election.cc:336] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:26.611744  8515 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:26.612085  8523 leader_election.cc:290] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:26.612164  8515 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.612636  8515 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:26.570051  2234 leader_election.cc:304] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:03:26.613955  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 44039.9us
I20260709 13:03:26.617040  8519 raft_consensus.cc:2804] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:26.617511  8519 raft_consensus.cc:697] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:26.618346  8519 consensus_queue.cc:237] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:26.634486  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 80000.9us
I20260709 13:03:26.611310  1623 raft_consensus.cc:2468] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:03:26.640084  1663 leader_election.cc:304] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:26.641104  8475 raft_consensus.cc:2804] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:26.641711  8475 raft_consensus.cc:697] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:26.642575  8475 consensus_queue.cc:237] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.644490  8515 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:26.647035  1587 leader_election.cc:336] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:26.661020  1443 catalog_manager.cc:5697] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 19 to 20, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 20 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:26.646602  8517 leader_election.cc:290] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:26.662590  8515 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:26.687587  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:03:26.687790  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 72735.9us
I20260709 13:03:26.690485  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a931eba8b604012a41ed982e7200b41" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:26.693164  1689 raft_consensus.cc:3060] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:26.700922  1446 catalog_manager.cc:5697] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 15 to 16, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 16 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:26.702922  1696 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:03:26.710924  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:26.698997  8473 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:03:26.716538  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 78879.5us
I20260709 13:03:26.717871  8519 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:26.718400  8519 raft_consensus.cc:493] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.718878  8519 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:26.725749  8495 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.726325  8495 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.727236  8519 raft_consensus.cc:515] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.733120  8529 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.733642  8529 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.742038  1689 raft_consensus.cc:2468] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 18.
I20260709 13:03:26.743471  8475 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.766937  8475 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.715509  8473 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.769876  8473 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:26.752367  8522 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.770817  8522 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.742487  8519 leader_election.cc:290] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:26.771952  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 54423.2us
W20260709 13:03:26.777070  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 48324.7us
I20260709 13:03:26.785411  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75790e14e47a47d9b0c447e78725e905" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:26.779920  8519 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.786024  2268 raft_consensus.cc:3060] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:26.786435  8519 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:26.788061  1661 leader_election.cc:336] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:26.788734  1661 leader_election.cc:336] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:26.788687  8519 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:26.789455  1661 leader_election.cc:336] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:26.791314  1661 leader_election.cc:336] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:26.792649  8522 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:26.759601  8529 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:26.793433  2268 raft_consensus.cc:2468] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:03:26.781638  8495 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:26.801957  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 91129.1us
I20260709 13:03:26.805371  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ba9e8bda7e4019b703c785aae4f0a3" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:26.805992  1689 raft_consensus.cc:3060] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:26.805856  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:26.806814  1696 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 19.
I20260709 13:03:26.810153  1588 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:26.815358  1689 raft_consensus.cc:2468] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:03:26.818955  8495 raft_consensus.cc:2804] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:26.820003  8519 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.820567  8519 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.822744  8519 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:26.823329  1587 leader_election.cc:336] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:26.824215  1587 leader_election.cc:336] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:26.824715  1587 leader_election.cc:336] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:26.828271  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:26.829205  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:26.831164  1621 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 16.
I20260709 13:03:26.822633  8475 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:26.833395  1663 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:03:26.825337  1661 leader_election.cc:336] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:26.832214  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:26.835553  1689 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 12.
I20260709 13:03:26.840550  8522 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:26.841007  8522 raft_consensus.cc:493] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.841413  8522 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:26.841205  8495 raft_consensus.cc:697] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:26.843888  8495 consensus_queue.cc:237] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.848206  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:26.847643  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:26.855516  8515 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:03:26.855775  2232 leader_election.cc:336] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:26.855947  8515 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.856433  8515 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:26.856498  2232 leader_election.cc:336] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:26.853071  8541 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.861404  8541 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
W20260709 13:03:26.862562  2232 leader_election.cc:336] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:26.863229  2232 leader_election.cc:336] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:26.863909  8541 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:26.886303  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:26.886912  2268 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:03:26.888724  8515 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.902465  8515 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:26.905586  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cfabef9288d4d6ab7bbfaed954379e9" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:26.939945  1690 raft_consensus.cc:3060] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:26.942580  8515 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.906637  1443 catalog_manager.cc:5697] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 12 to 13, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 13 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:26.943125  8515 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.885416  2231 leader_election.cc:304] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:03:26.946347  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 61139.5us
I20260709 13:03:26.946417  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:26.947398  2231 leader_election.cc:304] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:26.948514  2231 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:03:26.908386  1587 leader_election.cc:336] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:26.891588  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:26.918794  8509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54504 (request call id 1377) took 2029 ms. Trace:
I20260709 13:03:26.931380  8522 raft_consensus.cc:515] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.952549  1586 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:26.952205  8509 rpcz_store.cc:276] 0709 13:03:24.889045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.889202 (+   157us) service_pool.cc:224] Handling call
0709 13:03:24.943935 (+ 54733us) ts_tablet_manager.cc:934] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597)
0709 13:03:26.918683 (+1974748us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":233,"tablet-copy.queue_time_us":53460,"thread_start_us":61339,"threads_started":2}
W20260709 13:03:26.953837  2233 connection.cc:466] server connection from 127.0.0.1:54504 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54504 (request call id 1377) could send its response
I20260709 13:03:26.954169  8522 leader_election.cc:290] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:26.954550  8539 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:26.956377  1696 raft_consensus.cc:2393] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27308aae2ef347ccba1b27e7f6f04334 in current term 17: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:03:26.957106  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ae750f29dc4aceb08544eb94e8e716" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:26.957643  1618 raft_consensus.cc:3060] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:26.962654  8519 raft_consensus.cc:2804] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:26.963285  8519 raft_consensus.cc:697] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 18 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:26.964016  1586 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:26.964402  8523 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:26.964269  8519 consensus_queue.cc:237] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:26.966270  1661 leader_election.cc:336] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:26.964270  8534 raft_consensus.cc:2804] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:26.970896  8534 raft_consensus.cc:697] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:26.971813  8534 consensus_queue.cc:237] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:26.979467  8475 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.979979  8475 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.982013  8475 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:26.980307  1587 leader_election.cc:336] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:26.985661  1587 leader_election.cc:336] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:26.986081  1587 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:03:26.986363  1661 leader_election.cc:336] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:26.987236  2231 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:26.988416  8542 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:26.988819  8542 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:26.988965  1618 raft_consensus.cc:2468] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:03:26.989228  8542 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:26.989467  8487 raft_consensus.cc:2749] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:26.986797  1587 consensus_peers.cc:597] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:26.987174  8539 raft_consensus.cc:2749] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:26.993930  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:26.994587  1623 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 20.
I20260709 13:03:26.994927  8515 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:26.996017  1621 raft_consensus.cc:1275] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:03:26.997061  1663 leader_election.cc:304] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:26.998090  8475 raft_consensus.cc:2804] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:26.998705  8475 raft_consensus.cc:697] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:26.999537  8475 consensus_queue.cc:237] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:26.997931  1662 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:27.003479  8522 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:27.003856  8522 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:27.004235  8522 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.005535  1663 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:27.006451  8530 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:27.006836  8530 raft_consensus.cc:493] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:27.007170  8530 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:27.007300  8517 consensus_queue.cc:1048] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:27.011243  8522 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:27.014420  8530 raft_consensus.cc:515] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:27.015242  8522 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:27.019932  8498 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:27.020488  8498 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:27.022497  8498 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:27.025511  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
W20260709 13:03:27.028378  2232 leader_election.cc:336] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:27.028821  2232 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:27.029830  8520 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:27.032823  8530 leader_election.cc:290] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 21 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:27.046886  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738a15ae04514d49969f3624caa73f45" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:27.049252  1623 raft_consensus.cc:3060] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:27.003032  1690 raft_consensus.cc:2468] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 20.
I20260709 13:03:27.053750  1446 catalog_manager.cc:5697] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 16 to 17, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 17 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.063692  1586 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:27.064589  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:27.067126  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:27.066735  8495 raft_consensus.cc:2804] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:27.075634  8495 raft_consensus.cc:697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:27.076551  8495 consensus_queue.cc:237] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:27.066910  8518 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:03:27.083159  1587 consensus_peers.cc:597] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.083511  8518 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:27.085561  8518 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:27.087656  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334" is_pre_election: true
I20260709 13:03:27.089533  1618 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:03:27.091586  1663 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:27.094072  8522 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:27.094432  8522 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:27.094785  8522 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:27.105551  1587 consensus_peers.cc:597] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.110574  1445 catalog_manager.cc:5697] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 17 to 18, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 18 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.114317  1445 catalog_manager.cc:5697] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 12 to 13, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 13 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.118111  8511 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:27.118657  8511 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:27.120685  1443 catalog_manager.cc:5697] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 16 to 17, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 17 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:27.121580  2232 consensus_peers.cc:597] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.126415  8511 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:03:27.133261  1662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 74350.9us
I20260709 13:03:27.135406  1623 raft_consensus.cc:2468] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 21.
I20260709 13:03:27.136783  2231 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:27.129874  8542 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:27.137764  1587 consensus_peers.cc:597] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.139688  8521 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:27.139900  2268 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c20847a6dcea4c2a9cbaf35a2171e33d in current term 13: Already voted for candidate e37b8013aec24431a6672a857806329e in this term.
I20260709 13:03:27.141263  1663 leader_election.cc:304] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:27.142335  8551 raft_consensus.cc:2804] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:27.143370  8551 raft_consensus.cc:697] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:27.144474  8551 consensus_queue.cc:237] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:27.145916  8522 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:27.148842  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:03:27.147593  2232 consensus_peers.cc:597] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.152331  8522 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:27.153087  2232 leader_election.cc:336] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:27.155046  1661 leader_election.cc:336] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:27.157236  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e9b2c19f1f4f8a9f31fc7f721bf363" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "27308aae2ef347ccba1b27e7f6f04334"
I20260709 13:03:27.158977  1621 raft_consensus.cc:3060] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.140986  8542 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:27.176553  1621 raft_consensus.cc:2468] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 18.
W20260709 13:03:27.160425  1661 consensus_peers.cc:597] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.179854  1661 leader_election.cc:336] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:27.181569  1663 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 
I20260709 13:03:27.184188  1661 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:03:27.198733  8518 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:27.199505  8518 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:27.198945  8522 raft_consensus.cc:2804] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:27.200704  8522 raft_consensus.cc:697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:27.201535  8518 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:03:27.202158  2232 consensus_peers.cc:597] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.201629  8522 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:27.209794  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:27.210438  2263 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 12.
I20260709 13:03:27.213099  1620 raft_consensus.cc:1275] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:27.205415  8551 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:27.216429  1445 catalog_manager.cc:5697] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 20 to 21, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 21 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.229619  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:27.230419  1697 raft_consensus.cc:2393] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e37b8013aec24431a6672a857806329e in current term 13: Already voted for candidate c20847a6dcea4c2a9cbaf35a2171e33d in this term.
I20260709 13:03:27.231462  1614 raft_consensus.cc:1275] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:03:27.232513  8515 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:27.232929  1662 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:27.233065  8515 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:27.235553  8551 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:27.235675  8518 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:27.235718  8534 consensus_queue.cc:1048] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:27.236443  8518 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:27.236166  8551 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:27.236864  8518 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.238253  8551 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:27.240082  8475 consensus_queue.cc:1048] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:03:27.242621  2232 consensus_peers.cc:597] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.243127  2232 consensus_peers.cc:597] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.235159  8515 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:27.244603  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:27.245220  2263 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 17.
I20260709 13:03:27.246212  1588 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:27.247903  2263 raft_consensus.cc:1275] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:03:27.248733  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:27.249298  2268 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 10.
I20260709 13:03:27.250803  1662 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:27.247273  8541 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:27.254527  8541 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:27.254930  8541 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.252633  8475 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:27.263072  8475 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:27.263484  8475 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:27.255467  8495 consensus_queue.cc:1048] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
W20260709 13:03:27.267339  1661 leader_election.cc:336] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:27.273362  2231 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:27.276952  8521 raft_consensus.cc:2749] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:27.281582  1445 catalog_manager.cc:5697] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 19 to 20, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 20 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:27.285640  1587 leader_election.cc:336] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:27.285988  8542 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
W20260709 13:03:27.286556  1587 consensus_peers.cc:597] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.286557  8542 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:27.319281  8518 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:27.322420  8518 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:27.323613  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76479b4c97fc4172991dba87da2718fc" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:27.324218  2263 raft_consensus.cc:3060] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:27.329160  2232 consensus_peers.cc:597] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.331190  2263 raft_consensus.cc:2468] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 13.
I20260709 13:03:27.332110  8542 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:27.333674  1662 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:27.334622  8518 raft_consensus.cc:2804] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:27.335074  8518 raft_consensus.cc:697] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:27.335937  8518 consensus_queue.cc:237] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:27.349529  1587 consensus_peers.cc:597] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.350263  2232 leader_election.cc:336] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:27.402920  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:27.403622  1694 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 17.
W20260709 13:03:27.404136  2232 consensus_peers.cc:597] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.404599  2232 consensus_peers.cc:597] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.406004  1661 leader_election.cc:336] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:27.406793  1661 consensus_peers.cc:597] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.407188  1661 consensus_peers.cc:597] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.407582  1661 leader_election.cc:336] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:27.411207  8541 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:27.413374  8541 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:27.415354  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8820554e3d9a4662b150408d84019889" candidate_uuid: "27308aae2ef347ccba1b27e7f6f04334" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:27.415963  2263 raft_consensus.cc:3060] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:27.391672  8475 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:27.417689  1587 consensus_peers.cc:597] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.418152  1587 consensus_peers.cc:597] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.422366  2263 raft_consensus.cc:2468] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27308aae2ef347ccba1b27e7f6f04334 in term 18.
I20260709 13:03:27.423671  1588 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:27.427589  8537 raft_consensus.cc:2804] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:27.428130  8537 raft_consensus.cc:697] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Becoming Leader. State: Replica: 27308aae2ef347ccba1b27e7f6f04334, State: Running, Role: LEADER
I20260709 13:03:27.429020  8537 consensus_queue.cc:237] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:27.431319  8475 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:27.433718  2231 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:03:27.434819  1587 leader_election.cc:336] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:27.435813  8473 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:27.436228  8473 raft_consensus.cc:493] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 44c8c572048a40b1a5e71865068ed1bb)
I20260709 13:03:27.436605  8473 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:27.440877  2232 consensus_peers.cc:597] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.441862  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 46131.6us
I20260709 13:03:27.435640  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea89d024b77243d097fd08bd251c9d5e" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:27.442763  2263 raft_consensus.cc:3060] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:27.444809  1661 leader_election.cc:336] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:27.445538  1661 consensus_peers.cc:597] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.446080  1661 leader_election.cc:336] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:27.446481  1661 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 44c8c572048a40b1a5e71865068ed1bb, e37b8013aec24431a6672a857806329e
I20260709 13:03:27.449487  8511 raft_consensus.cc:2749] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:27.459096  2232 consensus_peers.cc:597] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.459586  8473 raft_consensus.cc:515] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:27.462086  8473 leader_election.cc:290] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:27.461807  2232 consensus_peers.cc:597] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.467439  1445 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 17 to 18, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 18 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.468976  2263 raft_consensus.cc:2468] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 11.
W20260709 13:03:27.471123  1587 consensus_peers.cc:597] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.474509  1662 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:27.475324  8522 raft_consensus.cc:2804] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:27.476121  8522 raft_consensus.cc:697] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:27.478780  8522 consensus_queue.cc:237] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:27.487322  2232 leader_election.cc:336] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:27.493546  1661 consensus_peers.cc:597] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.496923  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 45433.6us
W20260709 13:03:27.500590  1661 consensus_peers.cc:597] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.525609  1446 catalog_manager.cc:5697] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 reported cstate change: term changed from 17 to 18, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130). New cstate: current_term: 18 leader_uuid: "27308aae2ef347ccba1b27e7f6f04334" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:27.532119  1661 consensus_peers.cc:597] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.539445  1696 raft_consensus.cc:1275] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:27.544740  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60c013c7e324514aef1674561db1cc6" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:27.545327  1696 raft_consensus.cc:3060] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:27.545802  1587 consensus_peers.cc:597] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.550251  1445 catalog_manager.cc:5697] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 12 to 13, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 13 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.551913  1445 catalog_manager.cc:5697] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 10 to 11, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 11 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.556937  1696 raft_consensus.cc:2468] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 18.
W20260709 13:03:27.561471  1661 leader_election.cc:336] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:27.586320  1587 consensus_peers.cc:597] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.589066  1587 consensus_peers.cc:597] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.589365  2232 consensus_peers.cc:597] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.562526  1696 raft_consensus.cc:1275] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:03:27.565174   430 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1569)
I20260709 13:03:27.603633  1614 raft_consensus.cc:1275] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:27.605125  8522 consensus_queue.cc:1048] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:27.615311  2231 leader_election.cc:304] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:27.615954  8534 consensus_queue.cc:1048] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:27.616500  8498 raft_consensus.cc:2804] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:27.617007  8498 raft_consensus.cc:697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 18 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:27.617841  8498 consensus_queue.cc:237] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:27.627115  1623 raft_consensus.cc:1275] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 21 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:03:27.626783  1662 consensus_peers.cc:597] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer e37b8013aec24431a6672a857806329e (127.0.107.132:39517): Couldn't send request to peer e37b8013aec24431a6672a857806329e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9e9b2c19f1f4f8a9f31fc7f721bf363. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.639801  8511 consensus_queue.cc:1048] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:03:27.634665  8521 consensus_queue.cc:1048] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
W20260709 13:03:27.659482  1661 consensus_peers.cc:597] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.660118  1661 consensus_peers.cc:597] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.660558  1661 leader_election.cc:336] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:27.661407  1661 consensus_peers.cc:597] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:27.678423  1696 raft_consensus.cc:1275] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:03:27.685613  1661 consensus_peers.cc:597] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.698997  1445 catalog_manager.cc:5697] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 17 to 18, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 18 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.709863  8495 consensus_queue.cc:1048] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:27.711943  1620 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:03:27.715658  8522 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:03:27.733403  1661 consensus_peers.cc:597] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.738044  1661 consensus_peers.cc:597] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.806193  2268 raft_consensus.cc:1275] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:27.814739  8522 consensus_queue.cc:1048] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:27.821393  2263 raft_consensus.cc:1275] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Refusing update from remote peer 27308aae2ef347ccba1b27e7f6f04334: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:27.822928  8495 consensus_queue.cc:1048] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:03:27.823947  1661 consensus_peers.cc:597] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.824496  1661 consensus_peers.cc:597] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.845840  1661 consensus_peers.cc:597] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.902848  1661 consensus_peers.cc:597] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:27.953235  1587 consensus_peers.cc:597] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.992331  1661 consensus_peers.cc:597] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.078291  2268 raft_consensus.cc:1275] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:28.090610  8560 consensus_queue.cc:1048] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:03:28.108178  2232 consensus_peers.cc:597] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.267341  1696 raft_consensus.cc:1275] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 13:03:28.343781  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 48503.5us
W20260709 13:03:28.349612  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 56552.3us
I20260709 13:03:28.369575  8519 consensus_queue.cc:1048] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:28.379565  8578 ts_tablet_manager.cc:933] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: Initiating tablet copy from peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:28.415373  8578 tablet_copy_client.cc:323] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.131:43987
W20260709 13:03:28.416338  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:43987, user_credentials={real_user=slave}} blocked reactor thread for 63366.4us
I20260709 13:03:28.427311  1706 tablet_copy_service.cc:140] P c20847a6dcea4c2a9cbaf35a2171e33d: Received BeginTabletCopySession request for tablet a9e9b2c19f1f4f8a9f31fc7f721bf363 from peer e37b8013aec24431a6672a857806329e ({username='slave'} at 127.0.0.1:58526)
I20260709 13:03:28.427987  1706 tablet_copy_service.cc:161] P c20847a6dcea4c2a9cbaf35a2171e33d: Beginning new tablet copy session on tablet a9e9b2c19f1f4f8a9f31fc7f721bf363 from peer e37b8013aec24431a6672a857806329e at {username='slave'} at 127.0.0.1:58526: session id = e37b8013aec24431a6672a857806329e-a9e9b2c19f1f4f8a9f31fc7f721bf363
I20260709 13:03:28.441955  1706 tablet_copy_source_session.cc:215] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:28.500355  8578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e9b2c19f1f4f8a9f31fc7f721bf363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:28.591959  8578 tablet_copy_client.cc:806] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:28.592738  8578 tablet_copy_client.cc:670] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: tablet copy: Starting download of 1 WAL segments...
W20260709 13:03:28.596268   430 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1569)
I20260709 13:03:28.616176  8578 tablet_copy_client.cc:538] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:28.632916  8578 tablet_bootstrap.cc:492] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: Bootstrap starting.
W20260709 13:03:29.034097  8578 log.cc:927] Time spent T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: Append to log took a long time: real 0.126s	user 0.000s	sys 0.003s
I20260709 13:03:29.044814  8580 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.045374  8580 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:29.052969  2232 leader_election.cc:336] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:29.053814  8580 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:29.070611  1663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:46095, user_credentials={real_user=slave}} blocked reactor thread for 76093.3us
I20260709 13:03:29.076304  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:29.078691  1697 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 13.
I20260709 13:03:29.081321  2231 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:29.088377  8580 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:29.088760  8580 raft_consensus.cc:493] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.089079  8580 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:29.100369  8578 tablet_bootstrap.cc:492] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:29.101388  8578 tablet_bootstrap.cc:492] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: Bootstrap complete.
I20260709 13:03:29.102121  8578 ts_tablet_manager.cc:1403] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: Time spent bootstrapping tablet: real 0.469s	user 0.035s	sys 0.022s
I20260709 13:03:29.105065  8578 raft_consensus.cc:359] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:29.105993  8578 raft_consensus.cc:740] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: e37b8013aec24431a6672a857806329e, State: Initialized, Role: LEARNER
I20260709 13:03:29.105932  8580 raft_consensus.cc:515] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:29.108282  8578 consensus_queue.cc:260] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } }
I20260709 13:03:29.141276  8578 ts_tablet_manager.cc:1434] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 13:03:29.125644  8580 leader_election.cc:290] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 election: Requested vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:29.126828  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953db44baef24f55a28e65ff051866d1" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
W20260709 13:03:29.129899  2232 leader_election.cc:336] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:29.144573  1690 raft_consensus.cc:3060] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:29.152683  1706 tablet_copy_service.cc:342] P c20847a6dcea4c2a9cbaf35a2171e33d: Request end of tablet copy session e37b8013aec24431a6672a857806329e-a9e9b2c19f1f4f8a9f31fc7f721bf363 received from {username='slave'} at 127.0.0.1:58526
I20260709 13:03:29.153174  1706 tablet_copy_service.cc:434] P c20847a6dcea4c2a9cbaf35a2171e33d: ending tablet copy session e37b8013aec24431a6672a857806329e-a9e9b2c19f1f4f8a9f31fc7f721bf363 on tablet a9e9b2c19f1f4f8a9f31fc7f721bf363 with peer e37b8013aec24431a6672a857806329e
I20260709 13:03:29.151342  1690 raft_consensus.cc:2468] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 14.
I20260709 13:03:29.160708  2231 leader_election.cc:304] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:29.162549  8580 raft_consensus.cc:2804] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:29.163092  8580 raft_consensus.cc:697] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 14 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:29.164021  8580 consensus_queue.cc:237] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:29.204591  1446 catalog_manager.cc:5697] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 12 to 14, leader changed from 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 14 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:29.390731  2232 consensus_peers.cc:597] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.493005  2232 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111) [suppressed 397 similar messages]
W20260709 13:03:29.535703  1587 consensus_peers.cc:597] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:29.555059  2267 raft_consensus.cc:1217] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [term 18 LEARNER]: Deduplicated request from leader. Original: 17.11->[18.12-18.12]   Dedup: 18.12->[]
W20260709 13:03:29.581235  1661 consensus_peers.cc:597] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.596711   430 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1569)
W20260709 13:03:29.596890  1587 consensus_peers.cc:597] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.618288  2232 consensus_peers.cc:597] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.650158  2232 consensus_peers.cc:597] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.689172  2232 consensus_peers.cc:597] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.690927  1587 consensus_peers.cc:597] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.694859  1587 consensus_peers.cc:597] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:29.719012  1690 raft_consensus.cc:1275] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Refusing update from remote peer e37b8013aec24431a6672a857806329e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:29.729648  8519 consensus_queue.cc:1048] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:29.740578  2232 consensus_peers.cc:597] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.743259  1587 consensus_peers.cc:597] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.748673  1661 consensus_peers.cc:597] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.769887  1661 consensus_peers.cc:597] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.778746  2232 consensus_peers.cc:597] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:29.789815  2232 consensus_peers.cc:597] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:29.800551  1661 consensus_peers.cc:597] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:29.876207  1661 consensus_peers.cc:597] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:29.881794  1587 consensus_peers.cc:597] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.883489  1661 consensus_peers.cc:597] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.900000  2232 consensus_peers.cc:597] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.906946  1661 consensus_peers.cc:597] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.923795  1587 consensus_peers.cc:597] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.967795  1661 consensus_peers.cc:597] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.968278  1661 consensus_peers.cc:597] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:29.985587  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08003d3940 after lost signal to thread 433
W20260709 13:03:29.986778  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08001324e0 after lost signal to thread 1480
W20260709 13:03:29.988307  1718 debug-util.cc:398] Leaking SignalData structure 0x7b0800373280 after lost signal to thread 1647
W20260709 13:03:29.989611  1718 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9540 after lost signal to thread 1721
W20260709 13:03:29.991004  1718 debug-util.cc:398] Leaking SignalData structure 0x7b0800102780 after lost signal to thread 2296
I20260709 13:03:29.993889  8517 raft_consensus.cc:1064] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: attempting to promote NON_VOTER e37b8013aec24431a6672a857806329e to VOTER
I20260709 13:03:29.996447  8517 consensus_queue.cc:237] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:30.019564  1587 consensus_peers.cc:597] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.030936  2232 consensus_peers.cc:597] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.031558  2232 consensus_peers.cc:597] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.053066  1661 consensus_peers.cc:597] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.053892  2232 consensus_peers.cc:597] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.071470  2232 consensus_peers.cc:597] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.104534  1587 consensus_peers.cc:597] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.121481  1587 consensus_peers.cc:597] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.123495  1587 consensus_peers.cc:597] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:30.158926  2266 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [term 18 LEARNER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:30.160629  8589 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:03:30.167557  1661 consensus_peers.cc:597] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:30.184024  1620 raft_consensus.cc:1275] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Refusing update from remote peer c20847a6dcea4c2a9cbaf35a2171e33d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:03:30.186254  8589 consensus_queue.cc:1048] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Connected to new peer: Peer: permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:03:30.206758  1661 consensus_peers.cc:597] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.250202  1587 consensus_peers.cc:597] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:30.265357  8583 raft_consensus.cc:2955] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 11 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
I20260709 13:03:30.278196  2266 raft_consensus.cc:2955] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 11 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:03:30.307570  1661 consensus_peers.cc:597] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:30.316951  1620 raft_consensus.cc:2955] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 11 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:03:30.334280  1661 consensus_peers.cc:597] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:30.380880  1446 catalog_manager.cc:5697] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e reported cstate change: config changed from index 11 to 13, e37b8013aec24431a6672a857806329e (127.0.107.132) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } } }
W20260709 13:03:30.519735  1661 consensus_peers.cc:597] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.538612  2232 consensus_peers.cc:597] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.542837  2232 consensus_peers.cc:597] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.566439  1587 consensus_peers.cc:597] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.569994  1661 consensus_peers.cc:597] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:30.594005  1661 consensus_peers.cc:597] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.597374   430 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1569)
W20260709 13:03:30.743022  1661 consensus_peers.cc:597] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:31.598255   430 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1569)
W20260709 13:03:31.842442  1587 consensus_peers.cc:597] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:31.925336  2232 consensus_peers.cc:597] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:31.998872  1661 consensus_peers.cc:597] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.023204  2232 consensus_peers.cc:597] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.071772  1587 consensus_peers.cc:597] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.096154  2232 consensus_peers.cc:597] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.098258  1587 consensus_peers.cc:597] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.156396  2232 consensus_peers.cc:597] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.156216  1661 consensus_peers.cc:597] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.192296  1587 consensus_peers.cc:597] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.260838  1661 consensus_peers.cc:597] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.281230  1661 consensus_peers.cc:597] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.285616  2232 consensus_peers.cc:597] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.288430  1587 consensus_peers.cc:597] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.294278  2232 consensus_peers.cc:597] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:32.342309  1661 consensus_peers.cc:597] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.349123  2232 consensus_peers.cc:597] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.367234  1587 consensus_peers.cc:597] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.419673  1587 consensus_peers.cc:597] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.419829  1661 consensus_peers.cc:597] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.457407  2232 consensus_peers.cc:597] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.467571  1661 consensus_peers.cc:597] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.503310  1587 consensus_peers.cc:597] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.546602  1587 consensus_peers.cc:597] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.546684  2232 consensus_peers.cc:597] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.549387  1661 consensus_peers.cc:597] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.590802  1661 consensus_peers.cc:597] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.593189  1661 consensus_peers.cc:597] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.599246   430 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1569)
W20260709 13:03:32.636256  2232 consensus_peers.cc:597] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.636785  2232 consensus_peers.cc:597] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.643996  1587 consensus_peers.cc:597] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.650816  1661 consensus_peers.cc:597] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.671449  2232 consensus_peers.cc:597] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.688380  1661 consensus_peers.cc:597] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.717285  1661 consensus_peers.cc:597] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.720110  1661 consensus_peers.cc:597] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.832327  1661 consensus_peers.cc:597] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.914278  1587 consensus_peers.cc:597] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:32.921748  1661 consensus_peers.cc:597] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:32.931090  1661 consensus_peers.cc:597] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:32.936774  1587 consensus_peers.cc:597] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:33.026019  1661 consensus_peers.cc:597] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:33.114737  2232 consensus_peers.cc:597] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:33.223208  2232 consensus_peers.cc:597] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:33.280102  1587 consensus_peers.cc:597] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:33.599735   430 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1569)
W20260709 13:03:34.008528  1588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:39517, user_credentials={real_user=slave}} blocked reactor thread for 60494us
W20260709 13:03:34.112255  2232 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 86346us
W20260709 13:03:34.361850  2232 consensus_peers.cc:597] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.400942  1587 consensus_peers.cc:597] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.405218  1661 consensus_peers.cc:597] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.478879  2232 consensus_peers.cc:597] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.493678  2232 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111) [suppressed 441 similar messages]
W20260709 13:03:34.561358  2232 consensus_peers.cc:597] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.594519  2232 consensus_peers.cc:597] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.600319   430 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1569)
W20260709 13:03:34.628988  1587 consensus_peers.cc:597] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.670913  1587 consensus_peers.cc:597] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.673812  1661 consensus_peers.cc:597] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.679970  1661 consensus_peers.cc:597] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.749091  2232 consensus_peers.cc:597] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.762300  2232 consensus_peers.cc:597] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:34.785578  1587 consensus_peers.cc:597] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.827723  1587 consensus_peers.cc:597] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.853487  1587 consensus_peers.cc:597] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.904249  2232 consensus_peers.cc:597] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:34.930821  2232 consensus_peers.cc:597] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:34.961808  2232 consensus_peers.cc:597] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:34.972354  1661 consensus_peers.cc:597] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.019906  1587 consensus_peers.cc:597] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.038017  2232 consensus_peers.cc:597] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:35.044174  1661 consensus_peers.cc:597] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.048589  1661 consensus_peers.cc:597] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.104858  1661 consensus_peers.cc:597] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.105481  1661 consensus_peers.cc:597] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.108503  1661 consensus_peers.cc:597] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.114826  1587 consensus_peers.cc:597] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.163789  1587 consensus_peers.cc:597] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.170784  1587 consensus_peers.cc:597] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.191068  1661 consensus_peers.cc:597] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.294368  2232 consensus_peers.cc:597] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.298110  2232 consensus_peers.cc:597] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.335659  1661 consensus_peers.cc:597] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.340814  1661 consensus_peers.cc:597] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.346998  1661 consensus_peers.cc:597] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:35.373878  1661 consensus_peers.cc:597] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.380756  1661 consensus_peers.cc:597] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.402519  1587 consensus_peers.cc:597] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:35.556949  1661 consensus_peers.cc:597] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:35.600862   430 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1569)
W20260709 13:03:36.161834  1587 consensus_peers.cc:597] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.353200  1587 consensus_peers.cc:597] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:36.397202  2232 consensus_peers.cc:597] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.419979  2232 consensus_peers.cc:597] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:36.601365   430 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1569)
W20260709 13:03:36.646116  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08003987e0 after lost signal to thread 433
W20260709 13:03:36.647672  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08003291a0 after lost signal to thread 1480
W20260709 13:03:36.649055  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca040 after lost signal to thread 1647
W20260709 13:03:36.650146  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08001c57e0 after lost signal to thread 1721
W20260709 13:03:36.651295  1644 debug-util.cc:398] Leaking SignalData structure 0x7b08000d3b20 after lost signal to thread 2296
W20260709 13:03:36.962553  1661 consensus_peers.cc:597] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:36.975975  1661 consensus_peers.cc:597] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:37.029924  1587 consensus_peers.cc:597] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.114023  2232 consensus_peers.cc:597] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.293448  2232 consensus_peers.cc:597] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.379992  2232 consensus_peers.cc:597] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.388497  1587 consensus_peers.cc:597] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.389071  1587 consensus_peers.cc:597] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.404373  1587 consensus_peers.cc:597] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.426996  2232 consensus_peers.cc:597] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.568249  2293 debug-util.cc:398] Leaking SignalData structure 0x7b0800323180 after lost signal to thread 433
W20260709 13:03:37.569386  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6aa0 after lost signal to thread 1480
W20260709 13:03:37.570685  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08000aece0 after lost signal to thread 1647
W20260709 13:03:37.571810  2293 debug-util.cc:398] Leaking SignalData structure 0x7b0800339640 after lost signal to thread 1721
W20260709 13:03:37.573042  2293 debug-util.cc:398] Leaking SignalData structure 0x7b0800227a00 after lost signal to thread 2296
W20260709 13:03:37.601974   430 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 1569)
W20260709 13:03:37.659272  1587 consensus_peers.cc:597] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.740752  1587 consensus_peers.cc:597] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.850493  1587 consensus_peers.cc:597] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:37.878456  2232 consensus_peers.cc:597] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:37.900843  2232 consensus_peers.cc:597] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.901930  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:46597, user_credentials={real_user=slave}} blocked reactor thread for 44173us
W20260709 13:03:37.954243  1587 consensus_peers.cc:597] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:37.987375  2232 consensus_peers.cc:597] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.000600  2232 consensus_peers.cc:597] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.009366  1587 consensus_peers.cc:597] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.026059  2232 consensus_peers.cc:597] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:38.037761  2232 consensus_peers.cc:597] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.056402  1587 consensus_peers.cc:597] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.057178  1661 consensus_peers.cc:597] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.107517  1661 consensus_peers.cc:597] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.140182  1661 consensus_peers.cc:597] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.171905  1661 consensus_peers.cc:597] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.257045  1587 consensus_peers.cc:597] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.383065  1661 consensus_peers.cc:597] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.418530  1587 consensus_peers.cc:597] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.473865  2232 consensus_peers.cc:597] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.482239  2232 consensus_peers.cc:597] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.483381  1661 consensus_peers.cc:597] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.544291  1661 consensus_peers.cc:597] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.602685   430 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 1569)
W20260709 13:03:38.648607  1661 consensus_peers.cc:597] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.755244  1661 consensus_peers.cc:597] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.879863  2232 consensus_peers.cc:597] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:38.892349  2232 consensus_peers.cc:597] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:38.996308  1587 consensus_peers.cc:597] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:39.018493  1661 consensus_peers.cc:597] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:39.020810  1661 consensus_peers.cc:597] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:39.036263  1661 consensus_peers.cc:597] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:39.056895  1661 consensus_peers.cc:597] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:39.057451  1661 consensus_peers.cc:597] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:39.058007  1661 consensus_peers.cc:597] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:39.261945  1661 consensus_peers.cc:597] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:39.511441  1661 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111) [suppressed 395 similar messages]
W20260709 13:03:39.571821  1661 consensus_peers.cc:597] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:39.572451  1587 consensus_peers.cc:597] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:39.660384  2232 consensus_peers.cc:597] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:39.691468  2232 consensus_peers.cc:597] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:39.731438  1587 consensus_peers.cc:597] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:39.830509  2232 consensus_peers.cc:597] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:39.836398  1587 consensus_peers.cc:597] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:39.880503  1661 consensus_peers.cc:597] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:39.888645  1587 consensus_peers.cc:597] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:39.910394   430 tablet_server.cc:196] TabletServer@127.0.107.129:0 shutdown complete.
I20260709 13:03:40.058315   430 tablet_server.cc:179] TabletServer@127.0.107.130:0 shutting down...
W20260709 13:03:40.068123  1587 consensus_peers.cc:597] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.097823  1587 consensus_peers.cc:597] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.104137  2232 consensus_peers.cc:597] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:40.110806  2234 consensus_peers.cc:597] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.118541  1663 consensus_peers.cc:597] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.122905  1663 consensus_peers.cc:597] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.135301  2232 consensus_peers.cc:597] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.143206  2232 consensus_peers.cc:597] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.148553  1663 consensus_peers.cc:597] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.152673   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:40.154219   430 tablet_replica.cc:333] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
W20260709 13:03:40.154379  1663 consensus_peers.cc:597] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.155189   430 raft_consensus.cc:2243] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.156013   430 raft_consensus.cc:2272] T 18e6dd43c01541d3abf870473a28780a P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.158820   430 tablet_replica.cc:333] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.159502   430 raft_consensus.cc:2243] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.160091   430 raft_consensus.cc:2272] T 75442f7324f24d4494f1ba99a64ed4ac P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.163065   430 tablet_replica.cc:333] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.164875   430 raft_consensus.cc:2243] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.165496   430 raft_consensus.cc:2272] T effd69042c284e8386aafb50372a93b6 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.168696   430 tablet_replica.cc:333] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.169397   430 raft_consensus.cc:2243] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.170286   430 raft_consensus.cc:2272] T 181ed72be8c34c66b8d437212e73d0a9 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.172118   430 tablet_replica.cc:333] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.172703   430 raft_consensus.cc:2243] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.173157   430 raft_consensus.cc:2272] T ba9457391f9c4971a27c4ef6fd3af809 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.175334   430 tablet_replica.cc:333] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.175899   430 raft_consensus.cc:2243] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.176457   430 raft_consensus.cc:2272] T a70c773fba6b40bfad053ffbcc4b9d86 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.178150   430 tablet_replica.cc:333] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.178681   430 raft_consensus.cc:2243] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.179562   430 raft_consensus.cc:2272] T 75790e14e47a47d9b0c447e78725e905 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.181367   430 tablet_replica.cc:333] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.181887   430 raft_consensus.cc:2243] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.182801   430 raft_consensus.cc:2272] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.185396   430 tablet_replica.cc:333] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.186165   430 raft_consensus.cc:2243] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.187268   430 raft_consensus.cc:2272] T 5e0e70f76a194ff7ab05b64009ded3c5 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:40.187733  1663 consensus_peers.cc:597] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.189558   430 tablet_replica.cc:333] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.190184   430 raft_consensus.cc:2243] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.190863   430 raft_consensus.cc:2272] T 6891ecbb9d454fe98a0dfe359e3dfd71 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.193524   430 tablet_replica.cc:333] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
W20260709 13:03:40.193850  2234 consensus_peers.cc:597] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.194305   430 raft_consensus.cc:2243] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.194962   430 raft_consensus.cc:2272] T 42d9e3317d944e97b0f09db457e476f3 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.198348   430 tablet_replica.cc:333] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.199085   430 raft_consensus.cc:2243] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.200156   430 raft_consensus.cc:2272] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:40.201282  2234 consensus_peers.cc:597] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.202675   430 tablet_replica.cc:333] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
W20260709 13:03:40.202953  2232 consensus_peers.cc:597] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:40.203581   430 raft_consensus.cc:2243] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.204314   430 raft_consensus.cc:2272] T 1d2ae0506db549df9409cfeceb2f3e3b P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.206918   430 tablet_replica.cc:333] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.207764   430 raft_consensus.cc:2243] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.208390   430 raft_consensus.cc:2272] T 1af6b960277d47bd994134d20b77c59a P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:40.208782  1663 consensus_peers.cc:597] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.211824   430 tablet_replica.cc:333] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.212719   430 raft_consensus.cc:2243] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.213322   430 raft_consensus.cc:2272] T 162dcbb665f341d1ab765403c5c3a480 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.215853   430 tablet_replica.cc:333] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.216609   430 raft_consensus.cc:2243] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.217622   430 raft_consensus.cc:2272] T 1cfabef9288d4d6ab7bbfaed954379e9 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.220717   430 tablet_replica.cc:333] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.221485   430 raft_consensus.cc:2243] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.222515   430 raft_consensus.cc:2272] T 7bd2e8876bc642db9518e484c47f1ac3 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.224963   430 tablet_replica.cc:333] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.225620   430 raft_consensus.cc:2243] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.226075   430 raft_consensus.cc:2272] T 89a432d1e3024e13a2d20229db9a8d85 P 27308aae2ef347ccba1b27e7f6f04334 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:40.226277  1663 consensus_peers.cc:597] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.228367   430 tablet_replica.cc:333] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.229143   430 raft_consensus.cc:2243] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.230161   430 raft_consensus.cc:2272] T 2f5408ceceb548a1a1cbe7d89f49c084 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.234591   430 tablet_replica.cc:333] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.235395   430 raft_consensus.cc:2243] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.236066   430 raft_consensus.cc:2272] T ba1f748970c74ef290462d25b2975815 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.238564   430 tablet_replica.cc:333] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
W20260709 13:03:40.238469  2234 consensus_peers.cc:597] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.239451   430 raft_consensus.cc:2243] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.240007   430 raft_consensus.cc:2272] T cecec9af1f82495390a4640f3927241f P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.242139   430 tablet_replica.cc:333] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.242965   430 raft_consensus.cc:2243] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.244051   430 raft_consensus.cc:2272] T 4b189117895a48d4b813cda9e276c524 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.246374   430 tablet_replica.cc:333] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.247005   430 raft_consensus.cc:2243] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.248211   430 raft_consensus.cc:2272] T 5886b3175b9d44069e5ba1077b09a28f P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.250630   430 tablet_replica.cc:333] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.251317   430 raft_consensus.cc:2243] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.251933   430 raft_consensus.cc:2272] T 7a83a11e6c2348918b88fe74b7ee7361 P 27308aae2ef347ccba1b27e7f6f04334 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.253886   430 tablet_replica.cc:333] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.254412   430 raft_consensus.cc:2243] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.254925   430 raft_consensus.cc:2272] T 07ae750f29dc4aceb08544eb94e8e716 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.257037   430 tablet_replica.cc:333] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.257565   430 raft_consensus.cc:2243] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.258149   430 raft_consensus.cc:2272] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.260013   430 tablet_replica.cc:333] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.260645   430 raft_consensus.cc:2243] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.261293   430 raft_consensus.cc:2272] T 63fd709a0b0d464193cd5a7eac0f5955 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.263725   430 tablet_replica.cc:333] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.264482   430 raft_consensus.cc:2243] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.265240   430 raft_consensus.cc:2272] T 11a34da7993e4fee9ff4fc1266a6af38 P 27308aae2ef347ccba1b27e7f6f04334 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:40.268077  2234 consensus_peers.cc:597] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.268859   430 tablet_replica.cc:333] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.269482   430 raft_consensus.cc:2243] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.270298   430 raft_consensus.cc:2272] T 10a17adb150f4450b68adcffc1c3d655 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.272169   430 tablet_replica.cc:333] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.272689   430 raft_consensus.cc:2243] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.274108   430 raft_consensus.cc:2272] T 8820554e3d9a4662b150408d84019889 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.276578   430 tablet_replica.cc:333] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.277333   430 raft_consensus.cc:2243] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.277894   430 raft_consensus.cc:2272] T 8b77299e14b04383b105cbae0697fbca P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:40.278805  1663 consensus_peers.cc:597] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.280388   430 tablet_replica.cc:333] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.280901   430 raft_consensus.cc:2243] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.281591   430 raft_consensus.cc:2272] T 489da014ead84cbe9a9b46b9196c3356 P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.283377   430 tablet_replica.cc:333] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.283968   430 raft_consensus.cc:2243] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.284533   430 raft_consensus.cc:2272] T debbced49eac4fa895623a8e492b9ce3 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.286183   430 tablet_replica.cc:333] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.286682   430 raft_consensus.cc:2243] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.287140   430 raft_consensus.cc:2272] T 58998217db5f42c08255f6a6a86b3dae P 27308aae2ef347ccba1b27e7f6f04334 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.288971   430 tablet_replica.cc:333] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.289466   430 raft_consensus.cc:2243] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.289922   430 raft_consensus.cc:2272] T 738a15ae04514d49969f3624caa73f45 P 27308aae2ef347ccba1b27e7f6f04334 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.291713   430 tablet_replica.cc:333] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.292317   430 raft_consensus.cc:2243] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.292842   430 raft_consensus.cc:2272] T 77eb0c0355254cf592e70feb5035e50f P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.295173   430 tablet_replica.cc:333] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.295959   430 raft_consensus.cc:2243] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.296556   430 raft_consensus.cc:2272] T c033fce18c634feb995adf2f2422308c P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:40.298303  1587 consensus_peers.cc:597] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:40.298816   430 tablet_replica.cc:333] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.299793   430 raft_consensus.cc:2243] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.300844   430 raft_consensus.cc:2272] T 6ba0a0cae5d54e9a85eed27fed785932 P 27308aae2ef347ccba1b27e7f6f04334 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:40.300981  1663 consensus_peers.cc:597] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.302752   430 tablet_replica.cc:333] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.303284   430 raft_consensus.cc:2243] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.304072   430 raft_consensus.cc:2272] T 94cdee269ec946a69f6c078885e844b0 P 27308aae2ef347ccba1b27e7f6f04334 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.305748   430 tablet_replica.cc:333] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.306363   430 raft_consensus.cc:2243] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.306842   430 raft_consensus.cc:2272] T 236ab34afb704d93bb2705d3aadbe163 P 27308aae2ef347ccba1b27e7f6f04334 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.308959   430 tablet_replica.cc:333] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.309630   430 raft_consensus.cc:2243] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.310642   430 raft_consensus.cc:2272] T d5f320525c0a40e79e76f607d8195977 P 27308aae2ef347ccba1b27e7f6f04334 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.313764   430 tablet_replica.cc:333] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
W20260709 13:03:40.313655  1663 consensus_peers.cc:597] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.314517   430 raft_consensus.cc:2243] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.315219   430 raft_consensus.cc:2272] T c8493cdac98b4860b0ddbe729b652ee9 P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:40.315791  1663 consensus_peers.cc:597] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:40.317406   430 tablet_replica.cc:333] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.318076   430 raft_consensus.cc:2243] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:40.318626   430 raft_consensus.cc:2272] T 3c5c9f43dc704dd09f6c603fa4ea346c P 27308aae2ef347ccba1b27e7f6f04334 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.320919   430 tablet_replica.cc:333] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.321501   430 raft_consensus.cc:2243] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.322535   430 raft_consensus.cc:2272] T a8819ed65aa948c9aa7a571bef50ca38 P 27308aae2ef347ccba1b27e7f6f04334 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:40.324934   430 tablet_replica.cc:333] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334: stopping tablet replica
I20260709 13:03:40.325522   430 raft_consensus.cc:2243] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:40.326537   430 raft_consensus.cc:2272] T 22659363e36446f9a1b47d2383b5621f P 27308aae2ef347ccba1b27e7f6f04334 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:40.336879  1663 consensus_peers.cc:597] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.361645  1663 consensus_peers.cc:597] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.369920  2232 consensus_peers.cc:597] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:40.375916  2234 consensus_peers.cc:597] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.379803  2234 consensus_peers.cc:597] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.431613  2234 consensus_peers.cc:597] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.432096  2234 consensus_peers.cc:597] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.448644  1663 consensus_peers.cc:597] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.452574  1663 consensus_peers.cc:597] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.514143  1661 consensus_peers.cc:597] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.515038  1661 consensus_peers.cc:597] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.524204  2232 consensus_peers.cc:597] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.538277  1663 consensus_peers.cc:597] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.545704  2232 consensus_peers.cc:597] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:40.549160  1661 consensus_peers.cc:597] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:40.555205  1661 consensus_peers.cc:597] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.602180  2234 consensus_peers.cc:597] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.670372  2234 consensus_peers.cc:597] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:40.792094  1661 consensus_peers.cc:597] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:40.876560  2232 consensus_peers.cc:597] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.922425  1661 consensus_peers.cc:597] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:40.956466  2232 consensus_peers.cc:597] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.130254  1661 consensus_peers.cc:597] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:41.169195  8665 raft_consensus.cc:493] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.170157  8665 raft_consensus.cc:515] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:41.172631  8665 leader_election.cc:290] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:41.179626  1663 leader_election.cc:336] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
W20260709 13:03:41.186368  1661 leader_election.cc:336] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:41.186739  1661 leader_election.cc:304] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:41.187390  8665 raft_consensus.cc:2749] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:41.260847  1661 consensus_peers.cc:597] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:41.297027  8665 raft_consensus.cc:493] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.297866  8665 raft_consensus.cc:515] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
W20260709 13:03:41.305193  1663 leader_election.cc:336] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.304095  8665 leader_election.cc:290] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:41.306777  1661 leader_election.cc:336] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:41.307261  1661 leader_election.cc:304] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:41.308053  8666 raft_consensus.cc:2749] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:41.313467  1661 consensus_peers.cc:597] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:41.320964  8666 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.321563  8666 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.324819  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:03:41.327814  1663 leader_election.cc:336] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.328270  1663 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:03:41.329027  8665 raft_consensus.cc:2749] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:41.330394  8666 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
W20260709 13:03:41.331993  2232 consensus_peers.cc:597] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:41.334975  8661 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.335642  8661 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.337613  8661 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:41.341459  2232 leader_election.cc:336] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:41.342891  8661 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.343473  8661 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:41.344244  2234 leader_election.cc:336] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.344719  2234 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:41.345947  8661 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:41.346544  8656 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:41.355346  8665 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.356120  8665 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:41.357038  2232 leader_election.cc:336] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:41.359045  8665 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:41.359337  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
W20260709 13:03:41.366617  2234 leader_election.cc:336] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.367051  2234 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:41.367852  8661 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:41.365358  1661 consensus_peers.cc:597] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:41.363072  8656 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.369051  8656 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.371531  8656 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:41.373497  8665 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.375345  8665 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:41.375838  2232 leader_election.cc:336] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:41.373052  8661 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.377722  8661 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.384779  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:03:41.385655  1663 leader_election.cc:336] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.386111  1663 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:03:41.387524  8666 raft_consensus.cc:2749] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:41.407995  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:41.409027  8661 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:41.411159  2234 leader_election.cc:336] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.414810  2234 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:41.405742  8665 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:41.416253  8661 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:41.422817  2234 leader_election.cc:336] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.423336  2234 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:41.424324  8656 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.427402  8656 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:41.425658  1663 leader_election.cc:336] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.426414  8663 raft_consensus.cc:2749] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:41.428421  1663 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, e37b8013aec24431a6672a857806329e
I20260709 13:03:41.425973  8665 raft_consensus.cc:493] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.429455  8665 raft_consensus.cc:515] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:41.430253  8656 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:41.431677  8665 leader_election.cc:290] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:41.432296  8657 raft_consensus.cc:2749] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:41.439211  1661 leader_election.cc:336] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:41.441551  2234 leader_election.cc:336] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
W20260709 13:03:41.445143  1663 leader_election.cc:336] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.445639  1663 leader_election.cc:304] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:41.446461  8657 raft_consensus.cc:2749] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:41.448643  2232 leader_election.cc:336] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:41.449164  2232 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:41.449369  8661 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.450290  8656 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:41.450040  8661 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.450992  8663 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.451735  8663 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.453778  8663 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:41.455363  8661 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:41.456625  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:03:41.467170  2232 leader_election.cc:336] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:41.467469  2234 leader_election.cc:336] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.468623  2234 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:03:41.469493  2234 leader_election.cc:336] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.476227  2234 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:41.472000  8661 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:41.484560  2232 consensus_peers.cc:597] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:41.486464  8663 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:41.509939   430 tablet_server.cc:196] TabletServer@127.0.107.130:0 shutdown complete.
I20260709 13:03:41.531860  8661 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.532651  8661 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.538338  8661 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:41.541450  8663 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:03:41.542068  2234 leader_election.cc:336] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.540182  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:41.541589  8665 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.543267  1696 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 17.
I20260709 13:03:41.544123  8665 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.542423  8663 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:41.540025  1661 consensus_peers.cc:597] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:41.547942  2231 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:41.548686  8663 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:41.549403  8661 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:41.549438  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:41.549961  8661 raft_consensus.cc:493] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.550237  2267 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 21.
I20260709 13:03:41.550390  8661 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:41.551110  8665 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:41.552062  1662 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:41.553052  8665 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:41.553897  8665 raft_consensus.cc:493] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.554329  8665 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:41.553485  2232 leader_election.cc:336] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:41.557926  2234 leader_election.cc:336] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.558445  2234 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:41.559804  8656 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:41.560663  8656 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.561339  8656 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.564486  8665 raft_consensus.cc:515] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.565478  8656 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:41.566995  8665 leader_election.cc:290] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 22 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:41.567619  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22659363e36446f9a1b47d2383b5621f" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:41.568153  2267 raft_consensus.cc:3060] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:41.568387  8661 raft_consensus.cc:515] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.570369  8661 leader_election.cc:290] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:41.571889  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
W20260709 13:03:41.572288  1661 consensus_peers.cc:597] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:41.572676  1696 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 17.
I20260709 13:03:41.573742  8665 raft_consensus.cc:493] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.574250  2231 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
I20260709 13:03:41.576676  8656 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:41.579887  8656 raft_consensus.cc:493] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.580379  8656 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:41.574335  8665 raft_consensus.cc:515] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:41.585750  8665 leader_election.cc:290] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:41.586199  1663 leader_election.cc:336] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.587927  2267 raft_consensus.cc:2468] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 22.
I20260709 13:03:41.589329  8657 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.589926  8657 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.592140  1662 leader_election.cc:304] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 
W20260709 13:03:41.593855  2234 leader_election.cc:336] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.594321  8666 raft_consensus.cc:2804] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:03:41.594653  2234 leader_election.cc:336] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.594944  8666 raft_consensus.cc:697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 22 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:41.596963  8666 consensus_queue.cc:237] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.597965  8657 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:41.601836  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8819ed65aa948c9aa7a571bef50ca38" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:41.602520  1696 raft_consensus.cc:3060] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:41.603574  8663 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.604291  8663 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:41.604646  1663 leader_election.cc:336] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.606600  8663 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:41.611784  1663 leader_election.cc:336] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
W20260709 13:03:41.613081  1663 leader_election.cc:336] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.615530  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e" is_pre_election: true
I20260709 13:03:41.645522  2267 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 17.
I20260709 13:03:41.645828  1445 catalog_manager.cc:5697] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 21 to 22, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 22 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:41.620007  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" is_pre_election: true
I20260709 13:03:41.624557  8661 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.647579  1690 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 16.
I20260709 13:03:41.647730  8661 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.617591  1696 raft_consensus.cc:2468] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 18.
W20260709 13:03:41.632341  1661 leader_election.cc:336] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:41.652041  1661 leader_election.cc:304] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:03:41.653128  1661 consensus_peers.cc:597] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:41.654891  2232 leader_election.cc:336] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:41.646835  1662 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:41.624140  8656 raft_consensus.cc:515] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.656576  8665 raft_consensus.cc:2749] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:41.657372  8665 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:41.657763  8665 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.658222  8665 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:41.659801  8656 leader_election.cc:290] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:41.661463  8661 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:41.663614  1661 consensus_peers.cc:597] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.626704  2234 leader_election.cc:336] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.667027  2231 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:41.667757  8661 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.668197  2231 leader_election.cc:304] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:41.669440  8628 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:41.669852  8628 raft_consensus.cc:493] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.670215  8628 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:41.670614  8663 raft_consensus.cc:2804] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:41.671272  8663 raft_consensus.cc:697] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 18 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:41.672689  8663 consensus_queue.cc:237] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.683528  8628 raft_consensus.cc:515] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.668298  8661 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.693364  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5fdc87ebdd414ab8baa34e162bc8c4" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:41.696122  1696 raft_consensus.cc:3060] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:41.697058  2234 leader_election.cc:336] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
W20260709 13:03:41.697597  2234 leader_election.cc:336] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.697976  2234 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:41.699589  8665 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.702389  8665 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), e37b8013aec24431a6672a857806329e (127.0.107.132:39517)
I20260709 13:03:41.703527  1696 raft_consensus.cc:2468] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 18.
W20260709 13:03:41.709757  2232 leader_election.cc:336] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:41.712577  1663 leader_election.cc:336] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.716028  8628 leader_election.cc:290] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 election: Requested vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:41.721441  1661 consensus_peers.cc:597] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.722041  1661 consensus_peers.cc:597] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:41.724874  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181ed72be8c34c66b8d437212e73d0a9" candidate_uuid: "e37b8013aec24431a6672a857806329e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d"
I20260709 13:03:41.725440  1690 raft_consensus.cc:3060] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:41.738982   430 tablet_server.cc:179] TabletServer@127.0.107.131:0 shutting down...
I20260709 13:03:41.717751  8670 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:41.718998  2234 leader_election.cc:336] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.741046  2234 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
W20260709 13:03:41.744290  2234 leader_election.cc:336] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:41.745515  8656 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:41.720582  8661 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:41.748579  1690 raft_consensus.cc:2468] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e37b8013aec24431a6672a857806329e in term 17.
I20260709 13:03:41.748905  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e0e70f76a194ff7ab05b64009ded3c5" candidate_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e37b8013aec24431a6672a857806329e"
I20260709 13:03:41.749522  2267 raft_consensus.cc:3060] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:41.750123  2231 leader_election.cc:304] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:41.752064  8663 raft_consensus.cc:2804] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:41.752521  8663 raft_consensus.cc:697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 18 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:41.753500  8663 consensus_queue.cc:237] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.754626  1446 catalog_manager.cc:5697] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 17 to 18, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 18 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.755568  2231 leader_election.cc:304] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:41.757067  8656 raft_consensus.cc:2804] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:41.757692  8656 raft_consensus.cc:697] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 17 LEADER]: Becoming Leader. State: Replica: e37b8013aec24431a6672a857806329e, State: Running, Role: LEADER
I20260709 13:03:41.758644  2267 raft_consensus.cc:2468] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c20847a6dcea4c2a9cbaf35a2171e33d in term 18.
I20260709 13:03:41.758885  8656 consensus_queue.cc:237] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.761935  1662 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d, e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334
I20260709 13:03:41.770056  8666 raft_consensus.cc:2804] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:41.770560  8666 raft_consensus.cc:697] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Becoming Leader. State: Replica: c20847a6dcea4c2a9cbaf35a2171e33d, State: Running, Role: LEADER
I20260709 13:03:41.771552  8666 consensus_queue.cc:237] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:41.773702  8657 raft_consensus.cc:493] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:41.774324  8657 raft_consensus.cc:515] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } }
I20260709 13:03:41.776515  8657 leader_election.cc:290] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:41.786608  1663 leader_election.cc:336] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
W20260709 13:03:41.829107  2231 consensus_peers.cc:597] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:41.831161  2231 consensus_peers.cc:597] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:41.834283  1661 leader_election.cc:336] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:41.834757  1661 leader_election.cc:304] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c20847a6dcea4c2a9cbaf35a2171e33d; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:41.843076  8630 raft_consensus.cc:2749] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:41.848978  2231 consensus_peers.cc:597] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:41.857142  1661 consensus_peers.cc:597] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:41.868542  2231 consensus_peers.cc:597] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:41.870046  2231 consensus_peers.cc:597] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:41.882025  2231 consensus_peers.cc:597] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:41.893311  2231 consensus_peers.cc:597] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:41.894425  1445 catalog_manager.cc:5697] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d reported cstate change: term changed from 17 to 18, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131). New cstate: current_term: 18 leader_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:41.913018  1446 catalog_manager.cc:5697] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 17 to 18, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 18 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:41.915031  1446 catalog_manager.cc:5697] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e reported cstate change: term changed from 16 to 17, leader changed from 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130) to e37b8013aec24431a6672a857806329e (127.0.107.132). New cstate: current_term: 17 leader_uuid: "e37b8013aec24431a6672a857806329e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:41.917699  2232 consensus_peers.cc:597] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:41.941505   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:41.942719   430 tablet_replica.cc:333] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:41.943944   430 raft_consensus.cc:2243] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:41.944967   430 raft_consensus.cc:2272] T 75442f7324f24d4494f1ba99a64ed4ac P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:41.947151   430 tablet_replica.cc:333] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:41.947924   430 raft_consensus.cc:2243] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:41.948987   430 raft_consensus.cc:2272] T 18e6dd43c01541d3abf870473a28780a P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:41.951341   430 tablet_replica.cc:333] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:41.952252   430 raft_consensus.cc:2243] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:41.953712   430 raft_consensus.cc:2272] T 3841c3258da84512aa1d5bec2bac5fe3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:41.956000   430 tablet_replica.cc:333] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:41.956568   430 raft_consensus.cc:2243] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:41.957304   430 raft_consensus.cc:2272] T 181ed72be8c34c66b8d437212e73d0a9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:41.960621   430 tablet_replica.cc:333] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:41.962108   430 raft_consensus.cc:2243] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:03:41.962579  1663 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.963086   430 raft_consensus.cc:2272] T 71ae78eb08484929a4e2f3128c3b5f34 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:41.965873   430 tablet_replica.cc:333] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:41.966975   430 raft_consensus.cc:2243] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:41.968308   430 raft_consensus.cc:2272] T ba9457391f9c4971a27c4ef6fd3af809 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:41.970824   430 tablet_replica.cc:333] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:41.971671   430 raft_consensus.cc:2243] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:41.972393   430 raft_consensus.cc:2272] T 2a931eba8b604012a41ed982e7200b41 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:41.975231   430 tablet_replica.cc:333] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:41.976080   430 raft_consensus.cc:2243] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:41.976748   430 raft_consensus.cc:2272] T 210a36eb12cf4ba2a2c5d8ffd07e37e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:41.979547   430 tablet_replica.cc:333] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:41.980301   430 raft_consensus.cc:2243] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:41.980798   430 raft_consensus.cc:2272] T 1cfabef9288d4d6ab7bbfaed954379e9 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:41.983135   430 tablet_replica.cc:333] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:41.983845   430 raft_consensus.cc:2243] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:41.985076   430 pending_rounds.cc:70] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Trying to abort 1 pending ops.
I20260709 13:03:41.985327   430 pending_rounds.cc:77] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting op as it isn't in flight: id { term: 18 index: 14 } timestamp: 7305634700455755776 op_type: NO_OP noop_request { }
I20260709 13:03:41.985931   430 raft_consensus.cc:2889] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:41.986653   430 raft_consensus.cc:2272] T 5e0e70f76a194ff7ab05b64009ded3c5 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:41.989461   430 tablet_replica.cc:333] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:41.990165   430 raft_consensus.cc:2243] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:41.991263   430 raft_consensus.cc:2272] T 6891ecbb9d454fe98a0dfe359e3dfd71 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:41.993695   430 tablet_replica.cc:333] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:41.994375   430 raft_consensus.cc:2243] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:41.995728   430 raft_consensus.cc:2272] T 42d9e3317d944e97b0f09db457e476f3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:41.997807   430 tablet_replica.cc:333] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:41.998349   430 raft_consensus.cc:2243] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:41.999759   430 raft_consensus.cc:2272] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.003008   430 tablet_replica.cc:333] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.003768   430 raft_consensus.cc:2243] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.004395   430 raft_consensus.cc:2272] T 162dcbb665f341d1ab765403c5c3a480 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.007311   430 tablet_replica.cc:333] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.007997   430 raft_consensus.cc:2243] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.008621   430 raft_consensus.cc:2272] T 1d2ae0506db549df9409cfeceb2f3e3b P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.012323   430 tablet_replica.cc:333] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.012868   430 raft_consensus.cc:2243] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.014088   430 raft_consensus.cc:2272] T e4ba9e8bda7e4019b703c785aae4f0a3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.016837   430 tablet_replica.cc:333] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.017728   430 raft_consensus.cc:2243] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.018850   430 raft_consensus.cc:2272] T cecec9af1f82495390a4640f3927241f P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:42.019018  2231 consensus_peers.cc:597] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:42.022049   430 tablet_replica.cc:333] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.022974   430 raft_consensus.cc:2243] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.023623   430 raft_consensus.cc:2272] T 953db44baef24f55a28e65ff051866d1 P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.026530   430 tablet_replica.cc:333] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.027302   430 raft_consensus.cc:2243] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.027982   430 raft_consensus.cc:2272] T 2f5408ceceb548a1a1cbe7d89f49c084 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.031246   430 tablet_replica.cc:333] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.031908   430 raft_consensus.cc:2243] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.033087   430 raft_consensus.cc:2272] T 89a432d1e3024e13a2d20229db9a8d85 P c20847a6dcea4c2a9cbaf35a2171e33d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.035006   430 tablet_replica.cc:333] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.035699   430 raft_consensus.cc:2243] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.036319   430 raft_consensus.cc:2272] T 8a63558e47a84017a3a62f52bb8cb3eb P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.039152   430 tablet_replica.cc:333] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.040155   430 raft_consensus.cc:2243] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.041242   430 raft_consensus.cc:2272] T ba1f748970c74ef290462d25b2975815 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.045301   430 tablet_replica.cc:333] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.047262   430 raft_consensus.cc:2243] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.048532   430 raft_consensus.cc:2272] T c3006951ad004b6b87217fff5303a9ab P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.051558   430 tablet_replica.cc:333] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.052506   430 raft_consensus.cc:2243] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.053640   430 raft_consensus.cc:2272] T 435d66c2e8e14e73af7cc63b8ce93e2d P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.056443   430 tablet_replica.cc:333] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.057119   430 raft_consensus.cc:2243] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.059270   430 raft_consensus.cc:2272] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.062752   430 tablet_replica.cc:333] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.064280   430 raft_consensus.cc:2243] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.065284   430 raft_consensus.cc:2272] T 07ae750f29dc4aceb08544eb94e8e716 P c20847a6dcea4c2a9cbaf35a2171e33d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.067322   430 tablet_replica.cc:333] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.068003   430 raft_consensus.cc:2243] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.068616   430 raft_consensus.cc:2272] T 4b189117895a48d4b813cda9e276c524 P c20847a6dcea4c2a9cbaf35a2171e33d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.071094   430 tablet_replica.cc:333] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.071717   430 raft_consensus.cc:2243] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.072290   430 raft_consensus.cc:2272] T 3c5c9f43dc704dd09f6c603fa4ea346c P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.074741   430 tablet_replica.cc:333] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.075636   430 raft_consensus.cc:2243] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.076799   430 raft_consensus.cc:2272] T a8819ed65aa948c9aa7a571bef50ca38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.079715   430 tablet_replica.cc:333] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.080470   430 raft_consensus.cc:2243] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.081631   430 raft_consensus.cc:2272] T 58998217db5f42c08255f6a6a86b3dae P c20847a6dcea4c2a9cbaf35a2171e33d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.084297   430 tablet_replica.cc:333] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.085031   430 raft_consensus.cc:2243] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.086269   430 raft_consensus.cc:2272] T debbced49eac4fa895623a8e492b9ce3 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:42.087741  2231 consensus_peers.cc:597] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:42.089201   430 tablet_replica.cc:333] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.090131   430 raft_consensus.cc:2243] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.091440   430 raft_consensus.cc:2272] T ea89d024b77243d097fd08bd251c9d5e P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:42.092768  2231 consensus_peers.cc:597] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:42.094293   430 tablet_replica.cc:333] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.095108   430 raft_consensus.cc:2243] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.096323   430 pending_rounds.cc:70] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Trying to abort 1 pending ops.
I20260709 13:03:42.096591   430 pending_rounds.cc:77] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d: Aborting op as it isn't in flight: id { term: 22 index: 14 } timestamp: 7305634699683684352 op_type: NO_OP noop_request { }
I20260709 13:03:42.096954   430 raft_consensus.cc:2889] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 22 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:42.097348   430 raft_consensus.cc:2272] T 22659363e36446f9a1b47d2383b5621f P c20847a6dcea4c2a9cbaf35a2171e33d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:42.099299  2234 consensus_peers.cc:597] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:42.100538   430 tablet_replica.cc:333] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.101181   430 raft_consensus.cc:2243] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.102450   430 raft_consensus.cc:2272] T c033fce18c634feb995adf2f2422308c P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:42.103643  2231 consensus_peers.cc:597] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:42.105075   430 tablet_replica.cc:333] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.105813   430 raft_consensus.cc:2243] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.106324   430 raft_consensus.cc:2272] T 94cdee269ec946a69f6c078885e844b0 P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.108436   430 tablet_replica.cc:333] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.108923   430 raft_consensus.cc:2243] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.109956   430 raft_consensus.cc:2272] T 738a15ae04514d49969f3624caa73f45 P c20847a6dcea4c2a9cbaf35a2171e33d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.112659   430 tablet_replica.cc:333] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.113359   430 raft_consensus.cc:2243] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.114562   430 raft_consensus.cc:2272] T 77eb0c0355254cf592e70feb5035e50f P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.116559   430 tablet_replica.cc:333] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.117079   430 raft_consensus.cc:2243] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.117998   430 raft_consensus.cc:2272] T 76479b4c97fc4172991dba87da2718fc P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.120350   430 tablet_replica.cc:333] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.120967   430 raft_consensus.cc:2243] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.121500   430 raft_consensus.cc:2272] T 236ab34afb704d93bb2705d3aadbe163 P c20847a6dcea4c2a9cbaf35a2171e33d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.123785   430 tablet_replica.cc:333] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.124323   430 raft_consensus.cc:2243] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.125180   430 raft_consensus.cc:2272] T 11a34da7993e4fee9ff4fc1266a6af38 P c20847a6dcea4c2a9cbaf35a2171e33d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.127111   430 tablet_replica.cc:333] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.127668   430 raft_consensus.cc:2243] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.128633   430 raft_consensus.cc:2272] T 63fd709a0b0d464193cd5a7eac0f5955 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.130499   430 tablet_replica.cc:333] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.130990   430 raft_consensus.cc:2243] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.131798   430 raft_consensus.cc:2272] T e60c013c7e324514aef1674561db1cc6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.133823   430 tablet_replica.cc:333] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.134375   430 raft_consensus.cc:2243] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.134938   430 raft_consensus.cc:2272] T 33125bfca16d4902a09564d1eef1a47f P c20847a6dcea4c2a9cbaf35a2171e33d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.137135   430 tablet_replica.cc:333] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.137853   430 raft_consensus.cc:2243] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:42.138509   430 raft_consensus.cc:2272] T e4abaeaa789c4d7b9da036c18751f9b6 P c20847a6dcea4c2a9cbaf35a2171e33d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:42.140702   430 tablet_replica.cc:333] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d: stopping tablet replica
I20260709 13:03:42.141183   430 raft_consensus.cc:2243] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:42.142423   430 raft_consensus.cc:2272] T 1352a2bbd594477385f629ba7222a83f P c20847a6dcea4c2a9cbaf35a2171e33d [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:42.176461  2231 consensus_peers.cc:597] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:42.211349  2231 consensus_peers.cc:597] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:42.227783  2231 consensus_peers.cc:597] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:42.247792  2232 consensus_peers.cc:597] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:42.248392  2232 consensus_peers.cc:597] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:42.254288  2231 consensus_peers.cc:597] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:42.256999  2234 consensus_peers.cc:597] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.098001  2231 connection.cc:769] client connection to 127.0.107.131:43987 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:03:43.108682  8682 raft_consensus.cc:493] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:43.109357  8682 raft_consensus.cc:515] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.111543  8682 leader_election.cc:290] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:43.119796  8682 raft_consensus.cc:493] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:43.120368  8682 raft_consensus.cc:515] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.125957  8682 leader_election.cc:290] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:43.126545  2234 consensus_peers.cc:597] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.128038  2234 consensus_peers.cc:597] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.128566  2234 consensus_peers.cc:597] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.129094  2234 consensus_peers.cc:597] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.129686  2234 consensus_peers.cc:597] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.126811  2231 consensus_peers.cc:597] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:43.136308  2232 consensus_peers.cc:597] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:43.137213  2232 consensus_peers.cc:597] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.138041  2232 consensus_peers.cc:597] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:43.142474  8682 raft_consensus.cc:493] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:43.143141  8682 raft_consensus.cc:515] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.145879  8682 leader_election.cc:290] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:43.149289  2231 leader_election.cc:336] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111)
W20260709 13:03:43.155228  2234 leader_election.cc:336] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
W20260709 13:03:43.159730  2232 leader_election.cc:336] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:43.160259  2232 leader_election.cc:304] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:43.160985  8682 raft_consensus.cc:2749] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:43.161052  2232 leader_election.cc:336] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:43.161514  2232 leader_election.cc:304] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:43.162160  8682 raft_consensus.cc:2749] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:43.165527  2231 leader_election.cc:336] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111)
W20260709 13:03:43.166049  2232 leader_election.cc:336] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:43.166962  2232 leader_election.cc:304] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:43.167660  8682 raft_consensus.cc:2749] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:43.273070  8682 raft_consensus.cc:493] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:43.273941  8682 raft_consensus.cc:515] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } attrs { replace: true } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.276877  8682 leader_election.cc:290] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:43.282357  2231 leader_election.cc:336] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111)
W20260709 13:03:43.284866  2234 leader_election.cc:336] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:43.285385  2234 leader_election.cc:304] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:03:43.285872  2232 leader_election.cc:336] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:43.286052  8682 raft_consensus.cc:2749] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:43.296358  8682 raft_consensus.cc:493] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:43.297358  8682 raft_consensus.cc:515] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.299993  8682 leader_election.cc:290] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:43.306023  2231 leader_election.cc:336] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111)
W20260709 13:03:43.306557  2234 leader_election.cc:336] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:43.306969  2234 leader_election.cc:304] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:43.307948  8682 raft_consensus.cc:2749] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:43.357604  8682 raft_consensus.cc:493] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:43.358256  8682 raft_consensus.cc:515] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.363245  8682 leader_election.cc:290] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:43.369032  2231 leader_election.cc:336] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111)
W20260709 13:03:43.371253  2234 leader_election.cc:336] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:43.371678  2234 leader_election.cc:304] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:43.372347  8682 raft_consensus.cc:2749] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:43.381042  8682 raft_consensus.cc:493] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:43.381636  8682 raft_consensus.cc:515] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.383790  8682 leader_election.cc:290] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:43.388692  2231 leader_election.cc:336] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111)
W20260709 13:03:43.389586  2234 leader_election.cc:336] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:43.389971  2234 leader_election.cc:304] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:43.390965  8682 raft_consensus.cc:2749] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:43.394352  8682 raft_consensus.cc:493] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:43.394812  8682 raft_consensus.cc:515] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.398547  8682 leader_election.cc:290] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:43.402014  2232 leader_election.cc:336] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:43.404003  2231 leader_election.cc:336] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111)
I20260709 13:03:43.404407  2231 leader_election.cc:304] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:43.405082  8682 raft_consensus.cc:2749] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:43.430738  1477 debug-util.cc:398] Leaking SignalData structure 0x7b08001786a0 after lost signal to thread 433
W20260709 13:03:43.431931  1477 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc360 after lost signal to thread 1480
W20260709 13:03:43.432497  1477 debug-util.cc:398] Leaking SignalData structure 0x7b0800366220 after lost signal to thread 1721
I20260709 13:03:43.433091  8682 raft_consensus.cc:493] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
W20260709 13:03:43.433669  1477 debug-util.cc:398] Leaking SignalData structure 0x7b080039b080 after lost signal to thread 2296
I20260709 13:03:43.433717  8682 raft_consensus.cc:515] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:43.434834  1477 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4f60 after lost signal to thread 8673
I20260709 13:03:43.451637  8693 raft_consensus.cc:493] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:43.452245  8693 raft_consensus.cc:515] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.454232  8693 leader_election.cc:290] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:43.459780  2231 leader_election.cc:336] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111)
W20260709 13:03:43.462958  2232 leader_election.cc:336] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:43.464715  2232 leader_election.cc:304] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
W20260709 13:03:43.465342  2231 leader_election.cc:336] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111)
I20260709 13:03:43.465853  8693 raft_consensus.cc:2749] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:43.463940  8682 leader_election.cc:290] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:43.471273  8682 raft_consensus.cc:493] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:43.472450  8682 raft_consensus.cc:515] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:43.471899  2234 leader_election.cc:336] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:43.487855  2234 leader_election.cc:304] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:43.488608  8682 leader_election.cc:290] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
I20260709 13:03:43.489157  8693 raft_consensus.cc:2749] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:43.490412  8692 raft_consensus.cc:493] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
W20260709 13:03:43.491086  2232 consensus_peers.cc:597] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.491621  2231 leader_election.cc:336] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111)
I20260709 13:03:43.491214  8692 raft_consensus.cc:515] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:43.493189  2232 leader_election.cc:336] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:43.494464  8692 leader_election.cc:290] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:43.501386  2232 leader_election.cc:304] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:43.506484  8692 raft_consensus.cc:2749] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:43.503070  2234 leader_election.cc:336] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
W20260709 13:03:43.519862  2234 consensus_peers.cc:597] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.529480  2232 leader_election.cc:336] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:43.533722  2234 consensus_peers.cc:597] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:43.533491  2232 leader_election.cc:304] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:43.535116  8692 raft_consensus.cc:2749] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:43.535321  2232 consensus_peers.cc:597] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:43.538841  8682 raft_consensus.cc:493] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c20847a6dcea4c2a9cbaf35a2171e33d)
I20260709 13:03:43.539466  8682 raft_consensus.cc:515] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.542515  8682 leader_election.cc:290] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:43.550797  2234 consensus_peers.cc:597] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:43.558879  8682 raft_consensus.cc:493] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:43.559511  8682 raft_consensus.cc:515] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.563190  8682 leader_election.cc:290] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:43.559787  2232 leader_election.cc:336] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:43.568241  2232 consensus_peers.cc:597] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:43.569236  2234 leader_election.cc:336] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
W20260709 13:03:43.573357  2232 leader_election.cc:336] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:43.578712  2232 leader_election.cc:304] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:43.580430  8692 raft_consensus.cc:2749] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:43.582322  2231 leader_election.cc:336] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111)
I20260709 13:03:43.583268  2231 leader_election.cc:304] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 44c8c572048a40b1a5e71865068ed1bb, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:43.584278  8692 raft_consensus.cc:2749] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:43.602219  2234 consensus_peers.cc:597] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:43.611629  8693 raft_consensus.cc:493] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:43.612142  8693 raft_consensus.cc:515] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.616767  8693 leader_election.cc:290] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:43.617928  2234 consensus_peers.cc:597] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.637025  2232 leader_election.cc:336] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:43.646443  8682 raft_consensus.cc:493] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:43.647058  8682 raft_consensus.cc:515] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.651376  8682 leader_election.cc:290] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:43.659248  2234 consensus_peers.cc:597] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:43.662504  2232 leader_election.cc:336] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:43.683632  2234 leader_election.cc:336] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:43.685832  2234 leader_election.cc:304] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:43.687573  8682 raft_consensus.cc:2749] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:43.698670  8682 raft_consensus.cc:493] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:43.699316  8682 raft_consensus.cc:515] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:43.705497  2232 leader_election.cc:336] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:43.706593  8682 leader_election.cc:290] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
I20260709 13:03:43.707659  8693 raft_consensus.cc:493] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:43.708129  8693 raft_consensus.cc:515] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
I20260709 13:03:43.710033  8693 leader_election.cc:290] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:43.717206  2232 leader_election.cc:336] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
W20260709 13:03:43.726614  2232 consensus_peers.cc:597] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:43.727321  2234 leader_election.cc:336] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:43.728102  2234 leader_election.cc:304] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:43.729610  8682 raft_consensus.cc:2749] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:43.737210  2234 leader_election.cc:336] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:43.737762  2234 leader_election.cc:304] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:43.738495  8682 raft_consensus.cc:2749] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:43.739446  2234 leader_election.cc:336] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:43.739885  2234 leader_election.cc:304] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:43.740566  8682 raft_consensus.cc:2749] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:43.839393  8682 raft_consensus.cc:493] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.840054  8682 raft_consensus.cc:515] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:43.861385  2232 consensus_peers.cc:597] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:43.861917  2231 leader_election.cc:336] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111)
I20260709 13:03:43.863364  8682 leader_election.cc:290] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095), c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987)
W20260709 13:03:43.870628  2234 leader_election.cc:336] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:43.871357  2234 leader_election.cc:304] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, c20847a6dcea4c2a9cbaf35a2171e33d
I20260709 13:03:43.873076  8682 raft_consensus.cc:2749] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:43.982191  8682 raft_consensus.cc:493] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 27308aae2ef347ccba1b27e7f6f04334)
I20260709 13:03:43.983973  8682 raft_consensus.cc:515] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: false } }
W20260709 13:03:43.997978  2232 leader_election.cc:336] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111)
I20260709 13:03:44.001317  8682 leader_election.cc:290] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597), 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095)
W20260709 13:03:44.006873  2234 consensus_peers.cc:597] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e -> Peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Couldn't send request to peer 27308aae2ef347ccba1b27e7f6f04334. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:44.011767  2234 leader_election.cc:336] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 27308aae2ef347ccba1b27e7f6f04334 (127.0.107.130:46095): Network error: Client connection negotiation failed: client connection to 127.0.107.130:46095: connect: Connection refused (error 111)
I20260709 13:03:44.012403  2234 leader_election.cc:304] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e37b8013aec24431a6672a857806329e; no voters: 27308aae2ef347ccba1b27e7f6f04334, 44c8c572048a40b1a5e71865068ed1bb
I20260709 13:03:44.013257  8682 raft_consensus.cc:2749] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:44.049383  2232 consensus_peers.cc:597] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e -> Peer 44c8c572048a40b1a5e71865068ed1bb (127.0.107.129:46597): Couldn't send request to peer 44c8c572048a40b1a5e71865068ed1bb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:46597: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:44.105796   430 tablet_server.cc:196] TabletServer@127.0.107.131:0 shutdown complete.
I20260709 13:03:44.231276   430 tablet_server.cc:179] TabletServer@127.0.107.132:0 shutting down...
I20260709 13:03:44.290664   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:44.291580   430 tablet_replica.cc:333] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.292759   430 raft_consensus.cc:2243] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.294088   430 raft_consensus.cc:2272] T 71ae78eb08484929a4e2f3128c3b5f34 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.297719   430 tablet_replica.cc:333] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.298659   430 raft_consensus.cc:2243] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.299737   430 raft_consensus.cc:2272] T 10a17adb150f4450b68adcffc1c3d655 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.302186   430 tablet_replica.cc:333] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.302846   430 raft_consensus.cc:2243] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.303599   430 raft_consensus.cc:2272] T 1352a2bbd594477385f629ba7222a83f P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.306779   430 tablet_replica.cc:333] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.308084   430 raft_consensus.cc:2243] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.309700   430 pending_rounds.cc:70] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e: Trying to abort 1 pending ops.
I20260709 13:03:44.310035   430 pending_rounds.cc:77] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e: Aborting op as it isn't in flight: id { term: 18 index: 12 } timestamp: 7305634700359966720 op_type: NO_OP noop_request { }
I20260709 13:03:44.310467   430 raft_consensus.cc:2889] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:44.310875   430 raft_consensus.cc:2272] T 4a5fdc87ebdd414ab8baa34e162bc8c4 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.312019  2231 consensus_peers.cc:597] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e -> Peer c20847a6dcea4c2a9cbaf35a2171e33d (127.0.107.131:43987): Couldn't send request to peer c20847a6dcea4c2a9cbaf35a2171e33d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.131:43987: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:44.314469   430 tablet_replica.cc:333] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.315711   430 raft_consensus.cc:2243] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.318030   430 raft_consensus.cc:2272] T 2a931eba8b604012a41ed982e7200b41 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.321967   430 tablet_replica.cc:333] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.322898   430 raft_consensus.cc:2243] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.323926   430 pending_rounds.cc:70] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e: Trying to abort 1 pending ops.
I20260709 13:03:44.324152   430 pending_rounds.cc:77] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e: Aborting op as it isn't in flight: id { term: 17 index: 13 } timestamp: 7305634700373172224 op_type: NO_OP noop_request { }
I20260709 13:03:44.324433   430 raft_consensus.cc:2889] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 17 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:44.324762   430 raft_consensus.cc:2272] T 181ed72be8c34c66b8d437212e73d0a9 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.326936   430 tablet_replica.cc:333] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.327654   430 raft_consensus.cc:2243] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.328369   430 raft_consensus.cc:2272] T 6ba0a0cae5d54e9a85eed27fed785932 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.330958   430 tablet_replica.cc:333] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.331672   430 raft_consensus.cc:2243] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.332419   430 raft_consensus.cc:2272] T 22659363e36446f9a1b47d2383b5621f P e37b8013aec24431a6672a857806329e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.334857   430 tablet_replica.cc:333] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.335822   430 raft_consensus.cc:2243] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.336615   430 raft_consensus.cc:2272] T 7a83a11e6c2348918b88fe74b7ee7361 P e37b8013aec24431a6672a857806329e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.339097   430 tablet_replica.cc:333] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.339811   430 raft_consensus.cc:2243] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Raft consensus shutting down.
I20260709 13:03:44.340312   430 pending_rounds.cc:70] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Trying to abort 1 pending ops.
I20260709 13:03:44.340576   430 pending_rounds.cc:77] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7305633979602186240 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "11a34da7993e4fee9ff4fc1266a6af38" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } } } new_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "44c8c572048a40b1a5e71865068ed1bb" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 46597 } } peers { permanent_uuid: "27308aae2ef347ccba1b27e7f6f04334" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46095 } } peers { permanent_uuid: "c20847a6dcea4c2a9cbaf35a2171e33d" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43987 } attrs { replace: true } } peers { permanent_uuid: "e37b8013aec24431a6672a857806329e" member_type: NON_VOTER last_known_addr { host: "127.0.107.132" port: 39517 } attrs { promote: true } } } }
I20260709 13:03:44.341591   430 raft_consensus.cc:2917] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e [term 1 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted
I20260709 13:03:44.342029   430 raft_consensus.cc:2889] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e [term 1 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:03:44.342348   430 raft_consensus.cc:2272] T 11a34da7993e4fee9ff4fc1266a6af38 P e37b8013aec24431a6672a857806329e [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:03:44.345779   430 tablet_replica.cc:333] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.346402   430 raft_consensus.cc:2243] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.346839   430 raft_consensus.cc:2272] T 75442f7324f24d4494f1ba99a64ed4ac P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.349359   430 tablet_replica.cc:333] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.349953   430 raft_consensus.cc:2243] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.350737   430 raft_consensus.cc:2272] T 33125bfca16d4902a09564d1eef1a47f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.352730   430 tablet_replica.cc:333] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.353267   430 raft_consensus.cc:2243] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.354058   430 raft_consensus.cc:2272] T 236ab34afb704d93bb2705d3aadbe163 P e37b8013aec24431a6672a857806329e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.356038   430 tablet_replica.cc:333] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.356600   430 raft_consensus.cc:2243] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.357338   430 raft_consensus.cc:2272] T a70c773fba6b40bfad053ffbcc4b9d86 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.359261   430 tablet_replica.cc:333] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.359896   430 raft_consensus.cc:2243] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.360698   430 raft_consensus.cc:2272] T e60c013c7e324514aef1674561db1cc6 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.362846   430 tablet_replica.cc:333] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.363488   430 raft_consensus.cc:2243] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.364187   430 pending_rounds.cc:70] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e: Trying to abort 1 pending ops.
I20260709 13:03:44.364373   430 pending_rounds.cc:77] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e: Aborting op as it isn't in flight: id { term: 18 index: 14 } timestamp: 7305634699985309696 op_type: NO_OP noop_request { }
I20260709 13:03:44.364646   430 raft_consensus.cc:2889] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:44.364905   430 raft_consensus.cc:2272] T a8819ed65aa948c9aa7a571bef50ca38 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.367102   430 tablet_replica.cc:333] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.367753   430 raft_consensus.cc:2243] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.368532   430 raft_consensus.cc:2272] T 3c5c9f43dc704dd09f6c603fa4ea346c P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.370707   430 tablet_replica.cc:333] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.371268   430 raft_consensus.cc:2243] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.371804   430 raft_consensus.cc:2272] T c3006951ad004b6b87217fff5303a9ab P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.373984   430 tablet_replica.cc:333] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.374521   430 raft_consensus.cc:2243] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.375288   430 raft_consensus.cc:2272] T effd69042c284e8386aafb50372a93b6 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.377276   430 tablet_replica.cc:333] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.377808   430 raft_consensus.cc:2243] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.378336   430 raft_consensus.cc:2272] T 5e0e70f76a194ff7ab05b64009ded3c5 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.380412   430 tablet_replica.cc:333] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.381008   430 raft_consensus.cc:2243] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.381518   430 raft_consensus.cc:2272] T a9e9b2c19f1f4f8a9f31fc7f721bf363 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.383746   430 tablet_replica.cc:333] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.384285   430 raft_consensus.cc:2243] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.385047   430 raft_consensus.cc:2272] T 1d2ae0506db549df9409cfeceb2f3e3b P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.388003   430 tablet_replica.cc:333] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.388808   430 raft_consensus.cc:2243] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:03:44.389281  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.389997   430 raft_consensus.cc:2272] T e4ba9e8bda7e4019b703c785aae4f0a3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.393052   430 tablet_replica.cc:333] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.394083   430 raft_consensus.cc:2243] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.395035   430 raft_consensus.cc:2272] T 5886b3175b9d44069e5ba1077b09a28f P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.397253   430 tablet_replica.cc:333] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.397883   430 raft_consensus.cc:2243] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.398763   430 raft_consensus.cc:2272] T 8b77299e14b04383b105cbae0697fbca P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.400748   430 tablet_replica.cc:333] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.401371   430 raft_consensus.cc:2243] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.402179   430 raft_consensus.cc:2272] T e4abaeaa789c4d7b9da036c18751f9b6 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.404183   430 tablet_replica.cc:333] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.404733   430 raft_consensus.cc:2243] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.405424   430 raft_consensus.cc:2272] T ea89d024b77243d097fd08bd251c9d5e P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.407653   430 tablet_replica.cc:333] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.408764   430 raft_consensus.cc:2243] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.409516   430 raft_consensus.cc:2272] T 75790e14e47a47d9b0c447e78725e905 P e37b8013aec24431a6672a857806329e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.412045   430 tablet_replica.cc:333] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.412681   430 raft_consensus.cc:2243] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.413237   430 raft_consensus.cc:2272] T 7bd2e8876bc642db9518e484c47f1ac3 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.415689   430 tablet_replica.cc:333] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.416344   430 raft_consensus.cc:2243] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.417361   430 raft_consensus.cc:2272] T 3841c3258da84512aa1d5bec2bac5fe3 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.420140   430 tablet_replica.cc:333] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.420727   430 raft_consensus.cc:2243] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.421641   430 raft_consensus.cc:2272] T 162dcbb665f341d1ab765403c5c3a480 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.423727   430 tablet_replica.cc:333] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.424652   430 raft_consensus.cc:2243] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.425392   430 raft_consensus.cc:2272] T d5f320525c0a40e79e76f607d8195977 P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.427253   430 tablet_replica.cc:333] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.428107   430 raft_consensus.cc:2243] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.429046   430 raft_consensus.cc:2272] T c8493cdac98b4860b0ddbe729b652ee9 P e37b8013aec24431a6672a857806329e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.431206   430 tablet_replica.cc:333] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.431854   430 raft_consensus.cc:2243] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.432574   430 raft_consensus.cc:2272] T 489da014ead84cbe9a9b46b9196c3356 P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.434994   430 tablet_replica.cc:333] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.435544   430 raft_consensus.cc:2243] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.435979   430 raft_consensus.cc:2272] T 58998217db5f42c08255f6a6a86b3dae P e37b8013aec24431a6672a857806329e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.437785   430 tablet_replica.cc:333] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.438289   430 raft_consensus.cc:2243] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.438776   430 raft_consensus.cc:2272] T debbced49eac4fa895623a8e492b9ce3 P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.441534   430 tablet_replica.cc:333] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.442129   430 raft_consensus.cc:2243] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.442584   430 raft_consensus.cc:2272] T 77eb0c0355254cf592e70feb5035e50f P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.445075   430 tablet_replica.cc:333] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.445691   430 raft_consensus.cc:2243] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.446643   430 raft_consensus.cc:2272] T 953db44baef24f55a28e65ff051866d1 P e37b8013aec24431a6672a857806329e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.451078   430 tablet_replica.cc:333] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.451720   430 raft_consensus.cc:2243] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.452821   430 raft_consensus.cc:2272] T 1af6b960277d47bd994134d20b77c59a P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.455855   430 tablet_replica.cc:333] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.456403   430 raft_consensus.cc:2243] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.457289   430 raft_consensus.cc:2272] T 89a432d1e3024e13a2d20229db9a8d85 P e37b8013aec24431a6672a857806329e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.459385   430 tablet_replica.cc:333] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.459928   430 raft_consensus.cc:2243] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.460712   430 raft_consensus.cc:2272] T 8a63558e47a84017a3a62f52bb8cb3eb P e37b8013aec24431a6672a857806329e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.462627   430 tablet_replica.cc:333] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.463158   430 raft_consensus.cc:2243] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.463706   430 raft_consensus.cc:2272] T 435d66c2e8e14e73af7cc63b8ce93e2d P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.465515   430 tablet_replica.cc:333] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.466136   430 raft_consensus.cc:2243] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.466777   430 raft_consensus.cc:2272] T 8820554e3d9a4662b150408d84019889 P e37b8013aec24431a6672a857806329e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.468983   430 tablet_replica.cc:333] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e: stopping tablet replica
I20260709 13:03:44.469408   430 raft_consensus.cc:2243] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.469918   430 raft_consensus.cc:2272] T 76479b4c97fc4172991dba87da2718fc P e37b8013aec24431a6672a857806329e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.842635   430 tablet_server.cc:196] TabletServer@127.0.107.132:0 shutdown complete.
I20260709 13:03:44.927852   430 master.cc:562] Master@127.0.107.190:37205 shutting down...
W20260709 13:03:44.969604  1494 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:03:44.969992  1494 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:44.970214  1494 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:03:44.973784   430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.974308   430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.974632   430 tablet_replica.cc:333] T 00000000000000000000000000000000 P ee9debc877d548cb9a1a1187cf0a2dcd: stopping tablet replica
I20260709 13:03:45.246371   430 master.cc:584] Master@127.0.107.190:37205 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (232497 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:03:45.359678   430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.190:46327
I20260709 13:03:45.360754   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:45.368816  8698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:45.368921  8699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:45.369580  8701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:45.370707   430 server_base.cc:1061] running on GCE node
I20260709 13:03:45.373826   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:45.374012   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:45.374257   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602225374243 us; error 0 us; skew 500 ppm
I20260709 13:03:45.374828   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:45.378960   430 webserver.cc:533] Webserver started at http://127.0.107.190:34151/ using document root <none> and password file <none>
I20260709 13:03:45.379539   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:45.379703   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:45.380025   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:45.381217   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/master-0-root/instance:
uuid: "b3aa4ec0e3cc435d99f45f3f24f70e4c"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-th5x"
I20260709 13:03:45.385615   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:45.389159  8706 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.390177   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:03:45.390491   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/master-0-root
uuid: "b3aa4ec0e3cc435d99f45f3f24f70e4c"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-th5x"
I20260709 13:03:45.390810   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:45.425060   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:45.426426   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:45.479681   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.190:46327
I20260709 13:03:45.479797  8757 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.190:46327 every 8 connection(s)
I20260709 13:03:45.484547  8758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.502895  8758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c: Bootstrap starting.
I20260709 13:03:45.511746  8758 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.521478  8758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c: No bootstrap required, opened a new log
I20260709 13:03:45.525995  8758 raft_consensus.cc:359] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3aa4ec0e3cc435d99f45f3f24f70e4c" member_type: VOTER }
I20260709 13:03:45.526429  8758 raft_consensus.cc:385] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.526619  8758 raft_consensus.cc:740] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3aa4ec0e3cc435d99f45f3f24f70e4c, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.527294  8758 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3aa4ec0e3cc435d99f45f3f24f70e4c" member_type: VOTER }
I20260709 13:03:45.527736  8758 raft_consensus.cc:399] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:45.527944  8758 raft_consensus.cc:493] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:45.528746  8758 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:45.534962  8758 raft_consensus.cc:515] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3aa4ec0e3cc435d99f45f3f24f70e4c" member_type: VOTER }
I20260709 13:03:45.535547  8758 leader_election.cc:304] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3aa4ec0e3cc435d99f45f3f24f70e4c; no voters: 
I20260709 13:03:45.536878  8758 leader_election.cc:290] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:45.537295  8761 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:45.539258  8761 raft_consensus.cc:697] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [term 1 LEADER]: Becoming Leader. State: Replica: b3aa4ec0e3cc435d99f45f3f24f70e4c, State: Running, Role: LEADER
I20260709 13:03:45.539963  8761 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3aa4ec0e3cc435d99f45f3f24f70e4c" member_type: VOTER }
I20260709 13:03:45.539979  8758 sys_catalog.cc:565] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:45.545401  8762 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3aa4ec0e3cc435d99f45f3f24f70e4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3aa4ec0e3cc435d99f45f3f24f70e4c" member_type: VOTER } }
I20260709 13:03:45.546032  8763 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3aa4ec0e3cc435d99f45f3f24f70e4c. Latest consensus state: current_term: 1 leader_uuid: "b3aa4ec0e3cc435d99f45f3f24f70e4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3aa4ec0e3cc435d99f45f3f24f70e4c" member_type: VOTER } }
I20260709 13:03:45.546784  8763 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:45.546865  8762 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:45.554260  8769 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:45.561395  8769 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:45.563308   430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:45.570674  8769 catalog_manager.cc:1383] Generated new cluster ID: 1766efaa3c8f43adb80f89432f46f592
I20260709 13:03:45.570966  8769 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:45.589941  8769 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:45.591835  8769 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:45.611039  8769 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c: Generated new TSK 0
I20260709 13:03:45.611721  8769 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:45.629807   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:45.636852  8779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:45.637876  8780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:45.641323   430 server_base.cc:1061] running on GCE node
W20260709 13:03:45.641427  8782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:45.644116   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:45.644347   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:45.644539   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602225644523 us; error 0 us; skew 500 ppm
I20260709 13:03:45.645121   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:45.649019   430 webserver.cc:533] Webserver started at http://127.0.107.129:46085/ using document root <none> and password file <none>
I20260709 13:03:45.649665   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:45.649967   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:45.650278   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:45.651461   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-0-root/instance:
uuid: "0c955bfd0b9541f9860c5f84cb255b90"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-th5x"
I20260709 13:03:45.656073   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:45.659611  8787 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.661056   430 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:03:45.661543   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-0-root
uuid: "0c955bfd0b9541f9860c5f84cb255b90"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-th5x"
I20260709 13:03:45.661942   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:45.680693   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:45.681869   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:45.683328   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:45.686040   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:45.686276   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.686514   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:45.686693   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.734125   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.129:45051
I20260709 13:03:45.734261  8849 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.129:45051 every 8 connection(s)
I20260709 13:03:45.739234   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:45.747139  8854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:45.748992  8855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:45.750486  8857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:45.753304   430 server_base.cc:1061] running on GCE node
I20260709 13:03:45.754426  8850 heartbeater.cc:344] Connected to a master server at 127.0.107.190:46327
I20260709 13:03:45.755174  8850 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:45.756356  8850 heartbeater.cc:507] Master 127.0.107.190:46327 requested a full tablet report, sending...
I20260709 13:03:45.757504   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:45.758080   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:45.758322   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602225758296 us; error 0 us; skew 500 ppm
I20260709 13:03:45.759100   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:45.759714  8723 ts_manager.cc:194] Registered new tserver with Master: 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:45.761701  8723 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45922
I20260709 13:03:45.762377   430 webserver.cc:533] Webserver started at http://127.0.107.130:44183/ using document root <none> and password file <none>
I20260709 13:03:45.762981   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:45.763197   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:45.763550   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:45.764724   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-1-root/instance:
uuid: "60a19ab523e3468bb9aacada2c24362c"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-th5x"
I20260709 13:03:45.769685   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:45.773759  8862 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.774724   430 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:03:45.775085   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-1-root
uuid: "60a19ab523e3468bb9aacada2c24362c"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-th5x"
I20260709 13:03:45.775378   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:45.789067   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:45.790450   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:45.792815   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:45.795539   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:45.795789   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.796063   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:45.796260   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.846824   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.130:43707
I20260709 13:03:45.847007  8924 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.130:43707 every 8 connection(s)
I20260709 13:03:45.851706   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:45.861094  8928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:45.861796  8929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:45.865036  8931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:45.865710   430 server_base.cc:1061] running on GCE node
I20260709 13:03:45.866528   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:45.866752   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:45.866819  8925 heartbeater.cc:344] Connected to a master server at 127.0.107.190:46327
I20260709 13:03:45.867007   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602225866987 us; error 0 us; skew 500 ppm
I20260709 13:03:45.867237  8925 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:45.867832   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:45.868162  8925 heartbeater.cc:507] Master 127.0.107.190:46327 requested a full tablet report, sending...
I20260709 13:03:45.870702   430 webserver.cc:533] Webserver started at http://127.0.107.131:37855/ using document root <none> and password file <none>
I20260709 13:03:45.870863  8723 ts_manager.cc:194] Registered new tserver with Master: 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:45.871565   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:45.871851   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:45.872164   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:45.872865  8723 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45938
I20260709 13:03:45.873826   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-2-root/instance:
uuid: "245d19d5c71647a9857ac68df13802d5"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-th5x"
I20260709 13:03:45.879814   430 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:03:45.883893  8936 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.885156   430 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:03:45.885602   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-2-root
uuid: "245d19d5c71647a9857ac68df13802d5"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-th5x"
I20260709 13:03:45.885969   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:45.901468   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:45.902657   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:45.904175   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:45.906399   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:45.906617   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.906857   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:45.907035   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.960167   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.131:33479
I20260709 13:03:45.960278  8998 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.131:33479 every 8 connection(s)
I20260709 13:03:45.964923   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:45.972662  9002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:45.974478  9003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:45.975519   430 server_base.cc:1061] running on GCE node
W20260709 13:03:45.976894  9005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:45.978070   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:45.978439   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:45.978982   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602225978962 us; error 0 us; skew 500 ppm
I20260709 13:03:45.979130  8999 heartbeater.cc:344] Connected to a master server at 127.0.107.190:46327
I20260709 13:03:45.979743   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:45.979893  8999 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:45.980747  8999 heartbeater.cc:507] Master 127.0.107.190:46327 requested a full tablet report, sending...
I20260709 13:03:45.982522   430 webserver.cc:533] Webserver started at http://127.0.107.132:32861/ using document root <none> and password file <none>
I20260709 13:03:45.983065   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:45.983273   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:45.983366  8723 ts_manager.cc:194] Registered new tserver with Master: 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:45.983559   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:45.984736   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-3-root/instance:
uuid: "a6a0de662d36410c907287e73cb2e4db"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-th5x"
I20260709 13:03:45.984885  8723 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45954
I20260709 13:03:45.989861   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:45.994392  9010 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.995389   430 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:03:45.995874   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-3-root
uuid: "a6a0de662d36410c907287e73cb2e4db"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-th5x"
I20260709 13:03:45.996142   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:46.024147   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:46.026795   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:46.028734   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:46.031883   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:46.032088   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:46.032375   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:46.032847   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:46.090718   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.132:45733
I20260709 13:03:46.090999  9072 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.132:45733 every 8 connection(s)
I20260709 13:03:46.106057  9073 heartbeater.cc:344] Connected to a master server at 127.0.107.190:46327
I20260709 13:03:46.106477  9073 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:46.107215  9073 heartbeater.cc:507] Master 127.0.107.190:46327 requested a full tablet report, sending...
I20260709 13:03:46.109826  8723 ts_manager.cc:194] Registered new tserver with Master: a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:46.110642   430 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016604735s
I20260709 13:03:46.111593  8723 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45962
I20260709 13:03:46.140455  8723 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45966:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:03:46.391539  8890 tablet_service.cc:1511] Processing CreateTablet for tablet 08168b90c9574205bcbca774c321f66c (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:46.392253  8889 tablet_service.cc:1511] Processing CreateTablet for tablet 572cae6a298d45448d43956a1842ecc5 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:46.393141  8890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08168b90c9574205bcbca774c321f66c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.393739  8889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572cae6a298d45448d43956a1842ecc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.409116  8888 tablet_service.cc:1511] Processing CreateTablet for tablet 237e06066ca940fb8dd923588f437acb (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:46.410784  8888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237e06066ca940fb8dd923588f437acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.412022  8963 tablet_service.cc:1511] Processing CreateTablet for tablet 350fc78f6e2a42ce8ec15f7a6d7a7a27 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:46.413388  8963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 350fc78f6e2a42ce8ec15f7a6d7a7a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.416018  8964 tablet_service.cc:1511] Processing CreateTablet for tablet 08168b90c9574205bcbca774c321f66c (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:46.417272  8964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08168b90c9574205bcbca774c321f66c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.420019  8887 tablet_service.cc:1511] Processing CreateTablet for tablet 8de975aeaa3f4271942a80c6f15c6c98 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:46.421936  8887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de975aeaa3f4271942a80c6f15c6c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.424575  9036 tablet_service.cc:1511] Processing CreateTablet for tablet 237e06066ca940fb8dd923588f437acb (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:46.425941  9036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237e06066ca940fb8dd923588f437acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.425216  8886 tablet_service.cc:1511] Processing CreateTablet for tablet 1ede05852c17421192022144629e6a6b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:46.427574  9037 tablet_service.cc:1511] Processing CreateTablet for tablet 350fc78f6e2a42ce8ec15f7a6d7a7a27 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:46.428889  9037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 350fc78f6e2a42ce8ec15f7a6d7a7a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.431535  9038 tablet_service.cc:1511] Processing CreateTablet for tablet 572cae6a298d45448d43956a1842ecc5 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:46.432976  9038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572cae6a298d45448d43956a1842ecc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.434123  8885 tablet_service.cc:1511] Processing CreateTablet for tablet 99a4989c61c249ebab0dfa6b8990d350 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:46.436600  8885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a4989c61c249ebab0dfa6b8990d350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.437335  9035 tablet_service.cc:1511] Processing CreateTablet for tablet 1ede05852c17421192022144629e6a6b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:46.438570  9035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ede05852c17421192022144629e6a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.440575  9034 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcaea8afc7941f0aaaa6b3b2c0d1171 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:46.441798  9034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcaea8afc7941f0aaaa6b3b2c0d1171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.441526  8884 tablet_service.cc:1511] Processing CreateTablet for tablet b74beae5607c4a46be83e22d48744dcb (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:46.443341  8884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74beae5607c4a46be83e22d48744dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.445211  9033 tablet_service.cc:1511] Processing CreateTablet for tablet 99a4989c61c249ebab0dfa6b8990d350 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:46.446532  9033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a4989c61c249ebab0dfa6b8990d350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.451332  8883 tablet_service.cc:1511] Processing CreateTablet for tablet 2b608c0e2df74b2a898f03761cfc1813 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:46.450840  8882 tablet_service.cc:1511] Processing CreateTablet for tablet e40b1dd371c548b58e6454e560a04271 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:46.453707  8883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b608c0e2df74b2a898f03761cfc1813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.454576  8886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ede05852c17421192022144629e6a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.459831  8882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40b1dd371c548b58e6454e560a04271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.465076  9032 tablet_service.cc:1511] Processing CreateTablet for tablet 2b608c0e2df74b2a898f03761cfc1813 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:46.466455  9032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b608c0e2df74b2a898f03761cfc1813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.469017  9031 tablet_service.cc:1511] Processing CreateTablet for tablet ff17e11e1d8e4902ac9cfb17935d7de6 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:46.470326  9031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff17e11e1d8e4902ac9cfb17935d7de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.470059  8881 tablet_service.cc:1511] Processing CreateTablet for tablet 7455286aa620402d980c0923537d619a (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:46.471868  8881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7455286aa620402d980c0923537d619a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.502418  9030 tablet_service.cc:1511] Processing CreateTablet for tablet e40b1dd371c548b58e6454e560a04271 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:46.504478  9030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40b1dd371c548b58e6454e560a04271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.505223  8890 tablet_service.cc:1511] Processing CreateTablet for tablet 977d385d3eeb49a799b9c161940c175a (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:46.508667  8815 tablet_service.cc:1511] Processing CreateTablet for tablet 08168b90c9574205bcbca774c321f66c (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:46.510102  8815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08168b90c9574205bcbca774c321f66c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.511986  8807 tablet_service.cc:1511] Processing CreateTablet for tablet ff17e11e1d8e4902ac9cfb17935d7de6 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:46.512575  8812 tablet_service.cc:1511] Processing CreateTablet for tablet 8de975aeaa3f4271942a80c6f15c6c98 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:46.513298  8807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff17e11e1d8e4902ac9cfb17935d7de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.513854  8812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de975aeaa3f4271942a80c6f15c6c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.516534  8811 tablet_service.cc:1511] Processing CreateTablet for tablet 1ede05852c17421192022144629e6a6b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:46.517861  8811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ede05852c17421192022144629e6a6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.520887  8810 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcaea8afc7941f0aaaa6b3b2c0d1171 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:46.521821  8962 tablet_service.cc:1511] Processing CreateTablet for tablet 237e06066ca940fb8dd923588f437acb (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:46.522270  8810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcaea8afc7941f0aaaa6b3b2c0d1171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.523159  8962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237e06066ca940fb8dd923588f437acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.524590  8809 tablet_service.cc:1511] Processing CreateTablet for tablet b74beae5607c4a46be83e22d48744dcb (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:46.525923  8809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74beae5607c4a46be83e22d48744dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.528384  8883 tablet_service.cc:1511] Processing CreateTablet for tablet 205bb6a61d8f4ea4aa9d7c5844d05930 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:46.528651  8808 tablet_service.cc:1511] Processing CreateTablet for tablet 2b608c0e2df74b2a898f03761cfc1813 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:46.530016  8961 tablet_service.cc:1511] Processing CreateTablet for tablet 8de975aeaa3f4271942a80c6f15c6c98 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:46.530666  8808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b608c0e2df74b2a898f03761cfc1813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.531720  8961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de975aeaa3f4271942a80c6f15c6c98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.508597  8813 tablet_service.cc:1511] Processing CreateTablet for tablet 350fc78f6e2a42ce8ec15f7a6d7a7a27 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:46.534245  8813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 350fc78f6e2a42ce8ec15f7a6d7a7a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.534830  8960 tablet_service.cc:1511] Processing CreateTablet for tablet 5fcaea8afc7941f0aaaa6b3b2c0d1171 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:46.508671  8814 tablet_service.cc:1511] Processing CreateTablet for tablet 572cae6a298d45448d43956a1842ecc5 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:46.536136  8960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcaea8afc7941f0aaaa6b3b2c0d1171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.536711  8806 tablet_service.cc:1511] Processing CreateTablet for tablet 7455286aa620402d980c0923537d619a (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:46.508576  9029 tablet_service.cc:1511] Processing CreateTablet for tablet 205bb6a61d8f4ea4aa9d7c5844d05930 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:46.538640  9029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205bb6a61d8f4ea4aa9d7c5844d05930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.543583  8890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 977d385d3eeb49a799b9c161940c175a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.547813  8883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205bb6a61d8f4ea4aa9d7c5844d05930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.548825  8814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572cae6a298d45448d43956a1842ecc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.549957  8806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7455286aa620402d980c0923537d619a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.555060  8959 tablet_service.cc:1511] Processing CreateTablet for tablet 99a4989c61c249ebab0dfa6b8990d350 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
W20260709 13:03:46.556159  8771 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:46.556790  8959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a4989c61c249ebab0dfa6b8990d350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.582479  8958 tablet_service.cc:1511] Processing CreateTablet for tablet b74beae5607c4a46be83e22d48744dcb (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:46.583985  8958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74beae5607c4a46be83e22d48744dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.608770  8957 tablet_service.cc:1511] Processing CreateTablet for tablet ff17e11e1d8e4902ac9cfb17935d7de6 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:46.610157  8957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff17e11e1d8e4902ac9cfb17935d7de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.626495  8956 tablet_service.cc:1511] Processing CreateTablet for tablet e40b1dd371c548b58e6454e560a04271 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:46.635200  8956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40b1dd371c548b58e6454e560a04271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.640148  9092 tablet_bootstrap.cc:492] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:46.604839  8882 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd20e59c4c5460cb2da30a82e188e4b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:46.648208  8882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd20e59c4c5460cb2da30a82e188e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.658044  9035 tablet_service.cc:1511] Processing CreateTablet for tablet 64b41045f959459f885308feb894963c (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:46.673152  8955 tablet_service.cc:1511] Processing CreateTablet for tablet 977d385d3eeb49a799b9c161940c175a (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:46.675094  8955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 977d385d3eeb49a799b9c161940c175a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.680437  9092 tablet_bootstrap.cc:654] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:46.686246  8811 tablet_service.cc:1511] Processing CreateTablet for tablet 205bb6a61d8f4ea4aa9d7c5844d05930 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:46.686331  8963 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd20e59c4c5460cb2da30a82e188e4b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:46.659368  9035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b41045f959459f885308feb894963c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.705127  8887 tablet_service.cc:1511] Processing CreateTablet for tablet 76d0a76f1a2b45df971cecac7ccb46b3 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:46.710739  8887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d0a76f1a2b45df971cecac7ccb46b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.711661  8885 tablet_service.cc:1511] Processing CreateTablet for tablet dce2804142c04505bd469904f288178b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:46.712922  8885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce2804142c04505bd469904f288178b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.720311  8956 tablet_service.cc:1511] Processing CreateTablet for tablet 64b41045f959459f885308feb894963c (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:46.699267  9094 tablet_bootstrap.cc:492] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:46.724242  9093 tablet_bootstrap.cc:492] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:46.730778  9094 tablet_bootstrap.cc:654] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:46.737979  8964 tablet_service.cc:1511] Processing CreateTablet for tablet 7455286aa620402d980c0923537d619a (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:46.742492  8887 tablet_service.cc:1511] Processing CreateTablet for tablet 84a27cc447a248368bcf0475b54f0b3d (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:46.743930  8887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a27cc447a248368bcf0475b54f0b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.752930  9037 tablet_service.cc:1511] Processing CreateTablet for tablet 76d0a76f1a2b45df971cecac7ccb46b3 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:46.754276  9037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d0a76f1a2b45df971cecac7ccb46b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.754789  9036 tablet_service.cc:1511] Processing CreateTablet for tablet dce2804142c04505bd469904f288178b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:46.756008  9036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce2804142c04505bd469904f288178b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.756441  9033 tablet_service.cc:1511] Processing CreateTablet for tablet bddeae20846c4ef98e62e0666f4030b4 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:46.757653  9033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddeae20846c4ef98e62e0666f4030b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.748461  9030 tablet_service.cc:1511] Processing CreateTablet for tablet 977d385d3eeb49a799b9c161940c175a (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:46.760198  9030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 977d385d3eeb49a799b9c161940c175a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.761238  8807 tablet_service.cc:1511] Processing CreateTablet for tablet 64b41045f959459f885308feb894963c (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:46.761349  9031 tablet_service.cc:1511] Processing CreateTablet for tablet f5eae864d4cf4f2ea2d5b52e7ffc1c12 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:46.762552  8811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205bb6a61d8f4ea4aa9d7c5844d05930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.762626  9031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5eae864d4cf4f2ea2d5b52e7ffc1c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.764515  8850 heartbeater.cc:499] Master 127.0.107.190:46327 was elected leader, sending a full tablet report...
I20260709 13:03:46.769503  9093 tablet_bootstrap.cc:654] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:46.774914  8963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd20e59c4c5460cb2da30a82e188e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.787096  8956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b41045f959459f885308feb894963c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.788908  8814 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd20e59c4c5460cb2da30a82e188e4b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:46.792428  8964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7455286aa620402d980c0923537d619a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.801203  8959 tablet_service.cc:1511] Processing CreateTablet for tablet bddeae20846c4ef98e62e0666f4030b4 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:46.793747  8807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b41045f959459f885308feb894963c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.812929  8812 tablet_service.cc:1511] Processing CreateTablet for tablet 76d0a76f1a2b45df971cecac7ccb46b3 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:46.813642  9095 tablet_bootstrap.cc:492] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:46.813316  8883 tablet_service.cc:1511] Processing CreateTablet for tablet ebefe5d3d0a64ae087a329b7c032225a (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:46.793548  8885 tablet_service.cc:1511] Processing CreateTablet for tablet f5eae864d4cf4f2ea2d5b52e7ffc1c12 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:46.815167  8883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebefe5d3d0a64ae087a329b7c032225a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.815694  8959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddeae20846c4ef98e62e0666f4030b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.816170  8815 tablet_service.cc:1511] Processing CreateTablet for tablet bddeae20846c4ef98e62e0666f4030b4 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:46.817380  8815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bddeae20846c4ef98e62e0666f4030b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.822749  8814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd20e59c4c5460cb2da30a82e188e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.822937  9032 tablet_service.cc:1511] Processing CreateTablet for tablet ebefe5d3d0a64ae087a329b7c032225a (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:46.824285  9032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebefe5d3d0a64ae087a329b7c032225a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.824803  8812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76d0a76f1a2b45df971cecac7ccb46b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.828810  8885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5eae864d4cf4f2ea2d5b52e7ffc1c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.832412  8961 tablet_service.cc:1511] Processing CreateTablet for tablet 84a27cc447a248368bcf0475b54f0b3d (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:46.833735  8961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a27cc447a248368bcf0475b54f0b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.834628  8813 tablet_service.cc:1511] Processing CreateTablet for tablet 84a27cc447a248368bcf0475b54f0b3d (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:46.839336  8955 tablet_service.cc:1511] Processing CreateTablet for tablet d979f18121e6477a8261596acbc4f58a (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:46.856668  9092 tablet_bootstrap.cc:492] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:46.856827  8955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d979f18121e6477a8261596acbc4f58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.857197  9092 ts_tablet_manager.cc:1403] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.217s	user 0.014s	sys 0.000s
I20260709 13:03:46.842792  8890 tablet_service.cc:1511] Processing CreateTablet for tablet 3fad6c9b1a1948c6a7135330c5ed070b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:46.843547  8960 tablet_service.cc:1511] Processing CreateTablet for tablet dce2804142c04505bd469904f288178b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:46.845180  8806 tablet_service.cc:1511] Processing CreateTablet for tablet d979f18121e6477a8261596acbc4f58a (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:46.846830  9094 tablet_bootstrap.cc:492] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:46.854964  9038 tablet_service.cc:1511] Processing CreateTablet for tablet 1ec2f73ef1f1465cb94938ff88587897 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:46.848119  9029 tablet_service.cc:1511] Processing CreateTablet for tablet d979f18121e6477a8261596acbc4f58a (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:46.847323  9095 tablet_bootstrap.cc:654] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:46.865360  9094 ts_tablet_manager.cc:1403] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.166s	user 0.028s	sys 0.012s
I20260709 13:03:46.876281  9093 tablet_bootstrap.cc:492] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:46.877039  9093 ts_tablet_manager.cc:1403] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.005s
I20260709 13:03:46.880800  8925 heartbeater.cc:499] Master 127.0.107.190:46327 was elected leader, sending a full tablet report...
I20260709 13:03:46.875303  8813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a27cc447a248368bcf0475b54f0b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.886943  8810 tablet_service.cc:1511] Processing CreateTablet for tablet 1ec2f73ef1f1465cb94938ff88587897 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:46.889048  9034 tablet_service.cc:1511] Processing CreateTablet for tablet 0986587761fb4f0387746bee54af0e5b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:46.883991  8960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce2804142c04505bd469904f288178b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.900149  8886 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa59e81ed8e4c0ca2890a10befbf996 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:46.907783  8962 tablet_service.cc:1511] Processing CreateTablet for tablet 0986587761fb4f0387746bee54af0e5b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:46.909885  8962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0986587761fb4f0387746bee54af0e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.910370  8888 tablet_service.cc:1511] Processing CreateTablet for tablet 1ec2f73ef1f1465cb94938ff88587897 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:46.912027  9034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0986587761fb4f0387746bee54af0e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.896886  8890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fad6c9b1a1948c6a7135330c5ed070b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.915061  8806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d979f18121e6477a8261596acbc4f58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.864553  8808 tablet_service.cc:1511] Processing CreateTablet for tablet f5eae864d4cf4f2ea2d5b52e7ffc1c12 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:46.919456  9038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ec2f73ef1f1465cb94938ff88587897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.930280  8886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa59e81ed8e4c0ca2890a10befbf996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.939740  8888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ec2f73ef1f1465cb94938ff88587897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.940398  8958 tablet_service.cc:1511] Processing CreateTablet for tablet 3fad6c9b1a1948c6a7135330c5ed070b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:46.941849  8958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fad6c9b1a1948c6a7135330c5ed070b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.944788  9094 raft_consensus.cc:359] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:46.945564  9094 raft_consensus.cc:385] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:46.945880  9094 raft_consensus.cc:740] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:46.946660  9094 consensus_queue.cc:260] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:46.946830  8957 tablet_service.cc:1511] Processing CreateTablet for tablet ebefe5d3d0a64ae087a329b7c032225a (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:46.947181  9093 raft_consensus.cc:359] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:46.948283  9093 raft_consensus.cc:385] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:46.948598  8957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebefe5d3d0a64ae087a329b7c032225a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.951622  8809 tablet_service.cc:1511] Processing CreateTablet for tablet 3fad6c9b1a1948c6a7135330c5ed070b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:46.952067  9092 raft_consensus.cc:359] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:46.952801  9092 raft_consensus.cc:385] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:46.953109  9092 raft_consensus.cc:740] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:46.953979  9092 consensus_queue.cc:260] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:46.954532  8810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ec2f73ef1f1465cb94938ff88587897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.963846  8808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5eae864d4cf4f2ea2d5b52e7ffc1c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.965587  8807 tablet_service.cc:1511] Processing CreateTablet for tablet 0986587761fb4f0387746bee54af0e5b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:46.966908  8807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0986587761fb4f0387746bee54af0e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.971774  8809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fad6c9b1a1948c6a7135330c5ed070b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.972476  9036 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa59e81ed8e4c0ca2890a10befbf996 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:46.983997  8956 tablet_service.cc:1511] Processing CreateTablet for tablet ac2b10a48f9d4bd0988ff98f6bf66e66 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:46.985478  8956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2b10a48f9d4bd0988ff98f6bf66e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.987394  8999 heartbeater.cc:499] Master 127.0.107.190:46327 was elected leader, sending a full tablet report...
I20260709 13:03:46.948603  9093 raft_consensus.cc:740] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:46.992942  9093 consensus_queue.cc:260] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:46.997095  8887 tablet_service.cc:1511] Processing CreateTablet for tablet ac2b10a48f9d4bd0988ff98f6bf66e66 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:46.998677  8887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2b10a48f9d4bd0988ff98f6bf66e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:46.971037  8815 tablet_service.cc:1511] Processing CreateTablet for tablet ac2b10a48f9d4bd0988ff98f6bf66e66 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:46.991578  9029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d979f18121e6477a8261596acbc4f58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.006726  8959 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa59e81ed8e4c0ca2890a10befbf996 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:47.008803  9095 tablet_bootstrap.cc:492] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:47.009330  9095 ts_tablet_manager.cc:1403] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.202s	user 0.014s	sys 0.004s
I20260709 13:03:47.012166  8959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa59e81ed8e4c0ca2890a10befbf996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.013741  8883 tablet_service.cc:1511] Processing CreateTablet for tablet 5b8666482fd746c1bc9d0c3c1bc30613 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:47.015455  8815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2b10a48f9d4bd0988ff98f6bf66e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.016534  8883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b8666482fd746c1bc9d0c3c1bc30613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.020315  9032 tablet_service.cc:1511] Processing CreateTablet for tablet 92e29794ffb24d7c898647fbcf5e0d77 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:47.023995  9031 tablet_service.cc:1511] Processing CreateTablet for tablet 5b8666482fd746c1bc9d0c3c1bc30613 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:47.038618  9092 ts_tablet_manager.cc:1434] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.181s	user 0.009s	sys 0.000s
I20260709 13:03:47.039848  9092 tablet_bootstrap.cc:492] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:47.051293  9036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa59e81ed8e4c0ca2890a10befbf996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.055158  9032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e29794ffb24d7c898647fbcf5e0d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.055315  9093 ts_tablet_manager.cc:1434] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.176s	user 0.008s	sys 0.001s
I20260709 13:03:47.064996  8813 tablet_service.cc:1511] Processing CreateTablet for tablet 5b8666482fd746c1bc9d0c3c1bc30613 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:47.066401  8813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b8666482fd746c1bc9d0c3c1bc30613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.068106  9093 tablet_bootstrap.cc:492] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:47.072649  9095 raft_consensus.cc:359] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:47.073410  9095 raft_consensus.cc:385] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:47.073712  9095 raft_consensus.cc:740] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:47.074563  9095 consensus_queue.cc:260] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:47.065161  8814 tablet_service.cc:1511] Processing CreateTablet for tablet 92e29794ffb24d7c898647fbcf5e0d77 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:47.083396  8814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e29794ffb24d7c898647fbcf5e0d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.088788  8962 tablet_service.cc:1511] Processing CreateTablet for tablet 92e29794ffb24d7c898647fbcf5e0d77 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:47.090096  8962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e29794ffb24d7c898647fbcf5e0d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.088502  9031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b8666482fd746c1bc9d0c3c1bc30613. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:47.102090  8926 tablet.cc:2406] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:47.114938  9073 heartbeater.cc:499] Master 127.0.107.190:46327 was elected leader, sending a full tablet report...
I20260709 13:03:47.121392  8882 tablet_service.cc:1511] Processing CreateTablet for tablet dec23c2e3be3416a84d3d12becfa90fa (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:47.122749  8882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec23c2e3be3416a84d3d12becfa90fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.127002  9093 tablet_bootstrap.cc:654] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:47.114183  8961 tablet_service.cc:1511] Processing CreateTablet for tablet dec23c2e3be3416a84d3d12becfa90fa (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:47.129156  8961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec23c2e3be3416a84d3d12becfa90fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.139083  9092 tablet_bootstrap.cc:654] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:47.146195  9095 ts_tablet_manager.cc:1434] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.137s	user 0.012s	sys 0.001s
I20260709 13:03:47.175252  9103 raft_consensus.cc:493] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.175246  9094 ts_tablet_manager.cc:1434] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.309s	user 0.009s	sys 0.004s
I20260709 13:03:47.181679  9036 tablet_service.cc:1511] Processing CreateTablet for tablet dec23c2e3be3416a84d3d12becfa90fa (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:47.184193  8886 tablet_service.cc:1511] Processing CreateTablet for tablet 598391aa086d4cd684b11636fb4c788b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:47.195226  8886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598391aa086d4cd684b11636fb4c788b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.184193  8813 tablet_service.cc:1511] Processing CreateTablet for tablet 598391aa086d4cd684b11636fb4c788b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:47.198957  8813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598391aa086d4cd684b11636fb4c788b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.203594  9094 tablet_bootstrap.cc:492] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:47.206058  9034 tablet_service.cc:1511] Processing CreateTablet for tablet 6221e3a375814ae5ba834de940d071af (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:47.207281  9034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6221e3a375814ae5ba834de940d071af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.210254  9094 tablet_bootstrap.cc:654] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:47.214193  9095 tablet_bootstrap.cc:492] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:47.217998  8883 tablet_service.cc:1511] Processing CreateTablet for tablet 6221e3a375814ae5ba834de940d071af (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:47.219895  9036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec23c2e3be3416a84d3d12becfa90fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.220731  8883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6221e3a375814ae5ba834de940d071af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.220999  9093 tablet_bootstrap.cc:492] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:47.221521  9093 ts_tablet_manager.cc:1403] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.154s	user 0.012s	sys 0.019s
I20260709 13:03:47.222776  9095 tablet_bootstrap.cc:654] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:47.225904  8812 tablet_service.cc:1511] Processing CreateTablet for tablet 6221e3a375814ae5ba834de940d071af (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:47.226233  9093 raft_consensus.cc:359] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.226991  9093 raft_consensus.cc:385] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:47.227180  8812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6221e3a375814ae5ba834de940d071af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.227313  9093 raft_consensus.cc:740] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:47.232832  9100 raft_consensus.cc:493] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.233321  9100 raft_consensus.cc:515] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.233606  9029 tablet_service.cc:1511] Processing CreateTablet for tablet aa6de9e2aaa341cfb862ee9073bab6dd (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:47.234862  9029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6de9e2aaa341cfb862ee9073bab6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.240342  9102 raft_consensus.cc:493] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.241088  9102 raft_consensus.cc:515] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.256630  9100 leader_election.cc:290] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:47.211761  9103 raft_consensus.cc:515] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:47.257272  8888 tablet_service.cc:1511] Processing CreateTablet for tablet e7a1a88fae5d41d0abb4bd9ee1898658 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:47.249272  9102 leader_election.cc:290] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:47.262797  8888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a1a88fae5d41d0abb4bd9ee1898658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.246711  9093 consensus_queue.cc:260] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.284237  8956 tablet_service.cc:1511] Processing CreateTablet for tablet aa6de9e2aaa341cfb862ee9073bab6dd (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:47.264822  8962 tablet_service.cc:1511] Processing CreateTablet for tablet 598391aa086d4cd684b11636fb4c788b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:47.280344  8815 tablet_service.cc:1511] Processing CreateTablet for tablet aa6de9e2aaa341cfb862ee9073bab6dd (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:47.301513  8815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6de9e2aaa341cfb862ee9073bab6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.322089  8956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6de9e2aaa341cfb862ee9073bab6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.322521  9092 tablet_bootstrap.cc:492] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:47.323108  9092 ts_tablet_manager.cc:1403] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.283s	user 0.000s	sys 0.032s
I20260709 13:03:47.326256  9092 raft_consensus.cc:359] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.327006  9092 raft_consensus.cc:385] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:47.298698  9103 leader_election.cc:290] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:47.346401  9093 ts_tablet_manager.cc:1434] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.125s	user 0.009s	sys 0.001s
I20260709 13:03:47.362344  8962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598391aa086d4cd684b11636fb4c788b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.367198  9032 tablet_service.cc:1511] Processing CreateTablet for tablet 448e990629c04a25945e8b2f7c71d414 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:47.368650  9032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 448e990629c04a25945e8b2f7c71d414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.368774  9038 tablet_service.cc:1511] Processing CreateTablet for tablet e7a1a88fae5d41d0abb4bd9ee1898658 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:47.370440  9038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a1a88fae5d41d0abb4bd9ee1898658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.353780  9092 raft_consensus.cc:740] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:47.388479  9101 raft_consensus.cc:493] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.389061  9101 raft_consensus.cc:515] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:47.393337  9093 tablet_bootstrap.cc:492] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:47.391321  9101 leader_election.cc:290] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:47.400430  8812 tablet_service.cc:1511] Processing CreateTablet for tablet 203428dde6c042b096205916d590b4d5 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:47.401718  8812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203428dde6c042b096205916d590b4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.404408  8887 tablet_service.cc:1511] Processing CreateTablet for tablet 203428dde6c042b096205916d590b4d5 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:47.405675  8887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203428dde6c042b096205916d590b4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.407236  9095 tablet_bootstrap.cc:492] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:47.408315  9095 ts_tablet_manager.cc:1403] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.194s	user 0.004s	sys 0.017s
I20260709 13:03:47.427311  9092 consensus_queue.cc:260] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.436661  9092 ts_tablet_manager.cc:1434] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.000s
I20260709 13:03:47.437703  9092 tablet_bootstrap.cc:492] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:47.451089  8882 tablet_service.cc:1511] Processing CreateTablet for tablet de518c02ce8d4d278d359e001b96db41 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:47.452512  8882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de518c02ce8d4d278d359e001b96db41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.437829  9095 raft_consensus.cc:359] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:47.453661  9095 raft_consensus.cc:385] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:47.454066  9095 raft_consensus.cc:740] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:47.455622  9094 tablet_bootstrap.cc:492] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:47.456156  9094 ts_tablet_manager.cc:1403] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.253s	user 0.013s	sys 0.016s
I20260709 13:03:47.456936  8886 tablet_service.cc:1511] Processing CreateTablet for tablet 448e990629c04a25945e8b2f7c71d414 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:47.458287  8886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 448e990629c04a25945e8b2f7c71d414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.463178  9095 consensus_queue.cc:260] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:47.465726  9095 ts_tablet_manager.cc:1434] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260709 13:03:47.467139  8890 tablet_service.cc:1511] Processing CreateTablet for tablet d9b04160c71b417c9a4db4e3f6692906 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:47.467932  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:47.468451  8890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b04160c71b417c9a4db4e3f6692906. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:47.469599  8865 leader_election.cc:343] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:47.477934  9034 tablet_service.cc:1511] Processing CreateTablet for tablet a097a815a3194dc7a54ca93a122cfed8 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:47.459151  9094 raft_consensus.cc:359] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.478883  8885 tablet_service.cc:1511] Processing CreateTablet for tablet 5c4408002b8e4e67a7bf17118232afd5 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:47.479396  9034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a097a815a3194dc7a54ca93a122cfed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.480885  8885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c4408002b8e4e67a7bf17118232afd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.479710  9094 raft_consensus.cc:385] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:47.483922  9094 raft_consensus.cc:740] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:47.484856  9094 consensus_queue.cc:260] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.488066  8813 tablet_service.cc:1511] Processing CreateTablet for tablet 448e990629c04a25945e8b2f7c71d414 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:47.489331  8813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 448e990629c04a25945e8b2f7c71d414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.490833  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:47.496807  8815 tablet_service.cc:1511] Processing CreateTablet for tablet a097a815a3194dc7a54ca93a122cfed8 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:47.498610  8815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a097a815a3194dc7a54ca93a122cfed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.499058  9093 tablet_bootstrap.cc:654] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:47.502669  9101 raft_consensus.cc:493] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.503172  9101 raft_consensus.cc:515] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.503855  9102 raft_consensus.cc:493] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.503715  8814 tablet_service.cc:1511] Processing CreateTablet for tablet 26c7449c44d44a30a7de276d3d6a9c25 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:47.504513  9102 raft_consensus.cc:515] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.505054  8814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c7449c44d44a30a7de276d3d6a9c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.504783  8883 tablet_service.cc:1511] Processing CreateTablet for tablet 26c7449c44d44a30a7de276d3d6a9c25 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:47.505409  9101 leader_election.cc:290] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:47.506560  8883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c7449c44d44a30a7de276d3d6a9c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.506889  9102 leader_election.cc:290] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:47.512475  9031 tablet_service.cc:1511] Processing CreateTablet for tablet de518c02ce8d4d278d359e001b96db41 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:47.513314  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:47.513789  9031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de518c02ce8d4d278d359e001b96db41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.515746  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ede05852c17421192022144629e6a6b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
W20260709 13:03:47.518379  8865 leader_election.cc:343] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:47.518918  8865 leader_election.cc:304] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:47.519997  9100 raft_consensus.cc:2749] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:47.521373  8961 tablet_service.cc:1511] Processing CreateTablet for tablet e7a1a88fae5d41d0abb4bd9ee1898658 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:47.523707  8961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a1a88fae5d41d0abb4bd9ee1898658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.527626  9095 tablet_bootstrap.cc:492] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:47.527799  8959 tablet_service.cc:1511] Processing CreateTablet for tablet 203428dde6c042b096205916d590b4d5 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:03:47.528194  9011 leader_election.cc:343] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:47.529099  9011 leader_election.cc:343] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:47.529227  8959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203428dde6c042b096205916d590b4d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.543286  9094 ts_tablet_manager.cc:1434] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.003s
I20260709 13:03:47.544708  9094 tablet_bootstrap.cc:492] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
W20260709 13:03:47.558738  8771 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:47.563705  8960 tablet_service.cc:1511] Processing CreateTablet for tablet de518c02ce8d4d278d359e001b96db41 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:47.563551  8958 tablet_service.cc:1511] Processing CreateTablet for tablet a097a815a3194dc7a54ca93a122cfed8 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:47.565088  8960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de518c02ce8d4d278d359e001b96db41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.565712  8958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a097a815a3194dc7a54ca93a122cfed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.572959  8807 tablet_service.cc:1511] Processing CreateTablet for tablet 75657aca6e034936ba57c704cedb5563 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:47.574303  8807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75657aca6e034936ba57c704cedb5563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.568892  8957 tablet_service.cc:1511] Processing CreateTablet for tablet 5c4408002b8e4e67a7bf17118232afd5 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:47.576221  8957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c4408002b8e4e67a7bf17118232afd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.571768  8964 tablet_service.cc:1511] Processing CreateTablet for tablet 75657aca6e034936ba57c704cedb5563 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:47.571805  9036 tablet_service.cc:1511] Processing CreateTablet for tablet 75657aca6e034936ba57c704cedb5563 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:47.580229  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:47.572996  8963 tablet_service.cc:1511] Processing CreateTablet for tablet 26c7449c44d44a30a7de276d3d6a9c25 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:47.580873  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:47.581753  9036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75657aca6e034936ba57c704cedb5563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.585321  9095 tablet_bootstrap.cc:654] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:47.563730  8865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:45733, user_credentials={real_user=slave}} blocked reactor thread for 45408.6us
I20260709 13:03:47.596692  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:47.597265  9030 tablet_service.cc:1511] Processing CreateTablet for tablet 5c4408002b8e4e67a7bf17118232afd5 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:47.598284  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ede05852c17421192022144629e6a6b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:47.598555  9030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c4408002b8e4e67a7bf17118232afd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.598973  8825 raft_consensus.cc:2468] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:47.604235  8806 tablet_service.cc:1511] Processing CreateTablet for tablet de61bcc226d7496e80bec49c06bd35f0 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:47.606148  8806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de61bcc226d7496e80bec49c06bd35f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.606945  9100 raft_consensus.cc:493] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.607699  9100 raft_consensus.cc:515] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.607968  9029 tablet_service.cc:1511] Processing CreateTablet for tablet d9b04160c71b417c9a4db4e3f6692906 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:47.609066  9092 tablet_bootstrap.cc:654] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:47.609437  9029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b04160c71b417c9a4db4e3f6692906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.609647  9100 leader_election.cc:290] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
W20260709 13:03:47.612080  9013 leader_election.cc:343] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:47.612608  9013 leader_election.cc:304] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:47.613382  9102 raft_consensus.cc:2749] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:47.613833  8963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c7449c44d44a30a7de276d3d6a9c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.614403  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b608c0e2df74b2a898f03761cfc1813" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:47.614733  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b608c0e2df74b2a898f03761cfc1813" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:47.615689  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ede05852c17421192022144629e6a6b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:47.617792  8888 tablet_service.cc:1511] Processing CreateTablet for tablet de61bcc226d7496e80bec49c06bd35f0 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:47.619007  8888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de61bcc226d7496e80bec49c06bd35f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.619922  8964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75657aca6e034936ba57c704cedb5563. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.620517  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff17e11e1d8e4902ac9cfb17935d7de6" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:47.622013  8791 leader_election.cc:343] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:47.627784  8788 leader_election.cc:343] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:47.630177  8939 leader_election.cc:343] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:47.630872  8939 leader_election.cc:343] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:47.630764  8956 tablet_service.cc:1511] Processing CreateTablet for tablet de61bcc226d7496e80bec49c06bd35f0 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:47.631353  8939 leader_election.cc:304] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:47.638916  9103 raft_consensus.cc:2749] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:47.639252  8956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de61bcc226d7496e80bec49c06bd35f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.643754  9013 leader_election.cc:304] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:47.644627  9102 raft_consensus.cc:2804] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:47.645004  9102 raft_consensus.cc:493] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.645329  9102 raft_consensus.cc:3060] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:47.657950  9102 raft_consensus.cc:515] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
W20260709 13:03:47.659615  8865 leader_election.cc:343] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:47.660331  8865 leader_election.cc:343] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:47.660749  8865 leader_election.cc:304] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:47.661489  9100 raft_consensus.cc:2749] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:47.674157  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ede05852c17421192022144629e6a6b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:47.682288  9047 raft_consensus.cc:2393] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c955bfd0b9541f9860c5f84cb255b90 in current term 1: Already voted for candidate a6a0de662d36410c907287e73cb2e4db in this term.
I20260709 13:03:47.678556  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff17e11e1d8e4902ac9cfb17935d7de6" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:47.683693  8790 leader_election.cc:304] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:47.684490  9101 raft_consensus.cc:3060] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:47.686139  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ede05852c17421192022144629e6a6b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
W20260709 13:03:47.688239  9011 leader_election.cc:343] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:47.688297  9038 tablet_service.cc:1511] Processing CreateTablet for tablet e3411c58e61642e499aafe48daae38e0 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:47.691108  9038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3411c58e61642e499aafe48daae38e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.693439  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ede05852c17421192022144629e6a6b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
W20260709 13:03:47.694306  8790 leader_election.cc:343] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:47.694782  8790 leader_election.cc:304] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:47.698302  9101 raft_consensus.cc:2749] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:47.705610  9095 tablet_bootstrap.cc:492] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:47.706125  9095 ts_tablet_manager.cc:1403] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.179s	user 0.002s	sys 0.017s
I20260709 13:03:47.696512  9102 leader_election.cc:290] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:47.701853  8812 tablet_service.cc:1511] Processing CreateTablet for tablet d9b04160c71b417c9a4db4e3f6692906 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:47.720932  8812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b04160c71b417c9a4db4e3f6692906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.725636  9094 tablet_bootstrap.cc:654] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:47.715637  9101 raft_consensus.cc:2749] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:47.730741  9093 tablet_bootstrap.cc:492] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:47.731726  9093 ts_tablet_manager.cc:1403] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.347s	user 0.023s	sys 0.002s
I20260709 13:03:47.731876  8825 raft_consensus.cc:2468] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:47.735003  9093 raft_consensus.cc:359] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:47.736536  9095 raft_consensus.cc:359] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:47.737787  8883 tablet_service.cc:1511] Processing CreateTablet for tablet e3411c58e61642e499aafe48daae38e0 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:47.743803  9103 raft_consensus.cc:493] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.743949  9093 raft_consensus.cc:385] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:47.744678  9093 raft_consensus.cc:740] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:47.745007  8883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3411c58e61642e499aafe48daae38e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.744493  9103 raft_consensus.cc:515] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:47.746264  9093 consensus_queue.cc:260] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:47.748121  9103 leader_election.cc:290] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:47.750152  9093 ts_tablet_manager.cc:1434] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:03:47.751369  9093 tablet_bootstrap.cc:492] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:47.752084  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40b1dd371c548b58e6454e560a04271" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
W20260709 13:03:47.753499  8939 leader_election.cc:343] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:47.754181  9095 raft_consensus.cc:385] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:47.754503  9095 raft_consensus.cc:740] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:47.742797  8964 tablet_service.cc:1511] Processing CreateTablet for tablet cfb43858b9264896af25d56cdbb44d80 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:47.757899  8964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfb43858b9264896af25d56cdbb44d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.759850  9092 tablet_bootstrap.cc:492] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:47.760351  9092 ts_tablet_manager.cc:1403] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.323s	user 0.015s	sys 0.036s
W20260709 13:03:47.763165  8790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:45733, user_credentials={real_user=slave}} blocked reactor thread for 68904.9us
I20260709 13:03:47.755290  9095 consensus_queue.cc:260] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:47.773142  8807 tablet_service.cc:1511] Processing CreateTablet for tablet e3411c58e61642e499aafe48daae38e0 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:47.773788  8815 tablet_service.cc:1511] Processing CreateTablet for tablet cfb43858b9264896af25d56cdbb44d80 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:47.775880  9092 raft_consensus.cc:359] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:47.785044  9093 tablet_bootstrap.cc:654] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:47.780117  8890 tablet_service.cc:1511] Processing CreateTablet for tablet b17c73a16b7141ef885babed8fb13dc6 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:47.811482  8890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17c73a16b7141ef885babed8fb13dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.813287  8885 tablet_service.cc:1511] Processing CreateTablet for tablet e6933846b78c4c4cbeb23a2bedaff18b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:47.814467  8885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6933846b78c4c4cbeb23a2bedaff18b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.814890  8957 tablet_service.cc:1511] Processing CreateTablet for tablet e6933846b78c4c4cbeb23a2bedaff18b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:47.816254  8957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6933846b78c4c4cbeb23a2bedaff18b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.774916  8807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3411c58e61642e499aafe48daae38e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.819468  8815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfb43858b9264896af25d56cdbb44d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.793186  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40b1dd371c548b58e6454e560a04271" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:47.796770  9013 leader_election.cc:304] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:47.797153  9092 raft_consensus.cc:385] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:47.800173  8956 tablet_service.cc:1511] Processing CreateTablet for tablet b17c73a16b7141ef885babed8fb13dc6 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:47.822194  8956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17c73a16b7141ef885babed8fb13dc6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:47.825103  8937 leader_election.cc:343] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:47.824698  9038 tablet_service.cc:1511] Processing CreateTablet for tablet b17c73a16b7141ef885babed8fb13dc6 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:47.826331  9038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b17c73a16b7141ef885babed8fb13dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.825667  8937 leader_election.cc:304] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:47.827623  9102 raft_consensus.cc:2804] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:47.827718  9103 raft_consensus.cc:2749] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:47.829952  9092 raft_consensus.cc:740] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:47.830096  9031 tablet_service.cc:1511] Processing CreateTablet for tablet 21c21ca1a09148199552cd054209efd1 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:47.831601  9031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c21ca1a09148199552cd054209efd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.834262  8813 tablet_service.cc:1511] Processing CreateTablet for tablet 21c21ca1a09148199552cd054209efd1 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:47.835541  8813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c21ca1a09148199552cd054209efd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.835888  9092 consensus_queue.cc:260] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:47.836455  8882 tablet_service.cc:1511] Processing CreateTablet for tablet 21c21ca1a09148199552cd054209efd1 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:47.837738  8882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21c21ca1a09148199552cd054209efd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.839579  9092 ts_tablet_manager.cc:1434] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.003s
I20260709 13:03:47.804484  9094 tablet_bootstrap.cc:492] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:47.809196  8806 tablet_service.cc:1511] Processing CreateTablet for tablet e6933846b78c4c4cbeb23a2bedaff18b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:47.777429  9029 tablet_service.cc:1511] Processing CreateTablet for tablet cfb43858b9264896af25d56cdbb44d80 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:47.842218  9029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfb43858b9264896af25d56cdbb44d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.778663  9095 ts_tablet_manager.cc:1434] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:03:47.842664  8814 tablet_service.cc:1511] Processing CreateTablet for tablet 105ca1309d4c495293d5da6c6b316b04 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:47.850173  9030 tablet_service.cc:1511] Processing CreateTablet for tablet 105ca1309d4c495293d5da6c6b316b04 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:47.854526  8886 tablet_service.cc:1511] Processing CreateTablet for tablet f5624f032fa846eebb830e2ea2bb857b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:47.842862  9094 ts_tablet_manager.cc:1403] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.298s	user 0.014s	sys 0.002s
I20260709 13:03:47.856624  8886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5624f032fa846eebb830e2ea2bb857b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.857417  9030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105ca1309d4c495293d5da6c6b316b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.843645  9103 raft_consensus.cc:493] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.859679  9103 raft_consensus.cc:515] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:47.844815  9095 tablet_bootstrap.cc:492] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:47.862694  9103 leader_election.cc:290] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:47.862922  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08168b90c9574205bcbca774c321f66c" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:47.865049  8961 tablet_service.cc:1511] Processing CreateTablet for tablet f5624f032fa846eebb830e2ea2bb857b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:03:47.865554  8939 leader_election.cc:343] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:47.866384  8961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5624f032fa846eebb830e2ea2bb857b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.866930  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08168b90c9574205bcbca774c321f66c" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:47.867738  8900 raft_consensus.cc:2468] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 0.
I20260709 13:03:47.846232  8963 tablet_service.cc:1511] Processing CreateTablet for tablet 105ca1309d4c495293d5da6c6b316b04 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:47.872802  8963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105ca1309d4c495293d5da6c6b316b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.874905  8937 leader_election.cc:304] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:03:47.877913  8806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6933846b78c4c4cbeb23a2bedaff18b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.878840  9034 tablet_service.cc:1511] Processing CreateTablet for tablet f5624f032fa846eebb830e2ea2bb857b (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:47.880107  9034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5624f032fa846eebb830e2ea2bb857b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.883711  8814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105ca1309d4c495293d5da6c6b316b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.895530  9103 raft_consensus.cc:2804] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:47.895839  9092 tablet_bootstrap.cc:492] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:47.896154  9103 raft_consensus.cc:493] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.896683  9103 raft_consensus.cc:3060] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:47.898583  9102 raft_consensus.cc:697] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:47.900179  9102 consensus_queue.cc:237] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.904821  9094 raft_consensus.cc:359] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.905803  9094 raft_consensus.cc:385] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:47.906170  9094 raft_consensus.cc:740] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:47.952201  9094 consensus_queue.cc:260] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:47.955096  9094 ts_tablet_manager.cc:1434] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.006s
I20260709 13:03:47.956629  9094 tablet_bootstrap.cc:492] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
W20260709 13:03:47.955899  8709 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.132:45733, user_credentials={real_user=slave}} blocked reactor thread for 60908.2us
W20260709 13:03:47.959300  8707 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 63400.9us
I20260709 13:03:47.957499  9095 tablet_bootstrap.cc:654] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:47.990428  8808 tablet_service.cc:1511] Processing CreateTablet for tablet 828b8a5a081e4a93812c8523ddc2dd56 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:47.990667  8964 tablet_service.cc:1511] Processing CreateTablet for tablet 828b8a5a081e4a93812c8523ddc2dd56 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:47.991819  8808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 828b8a5a081e4a93812c8523ddc2dd56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:47.996668  8723 catalog_manager.cc:5697] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:47.980093  9103 raft_consensus.cc:515] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:47.991819  8964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 828b8a5a081e4a93812c8523ddc2dd56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.000550  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08168b90c9574205bcbca774c321f66c" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:48.001353  8900 raft_consensus.cc:3060] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:47.991009  9093 tablet_bootstrap.cc:492] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:48.010278  9093 ts_tablet_manager.cc:1403] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.259s	user 0.022s	sys 0.033s
I20260709 13:03:47.999082  8890 tablet_service.cc:1511] Processing CreateTablet for tablet 828b8a5a081e4a93812c8523ddc2dd56 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:48.019601  9092 tablet_bootstrap.cc:654] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.057175  9103 leader_election.cc:290] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:48.058461  8900 raft_consensus.cc:2468] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:03:48.058686  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08168b90c9574205bcbca774c321f66c" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:48.059981  8937 leader_election.cc:304] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
W20260709 13:03:48.060936  8939 leader_election.cc:343] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.068117  8813 tablet_service.cc:1511] Processing CreateTablet for tablet ca29694da91044f28b09dc349794ab78 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:48.069409  8813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca29694da91044f28b09dc349794ab78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.070727  9103 raft_consensus.cc:2804] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:48.072023  9094 tablet_bootstrap.cc:654] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.066854  9093 raft_consensus.cc:359] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.078521  8890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 828b8a5a081e4a93812c8523ddc2dd56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.074146  9034 tablet_service.cc:1511] Processing CreateTablet for tablet ca29694da91044f28b09dc349794ab78 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:48.083258  9034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca29694da91044f28b09dc349794ab78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.089972  9103 raft_consensus.cc:697] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:03:48.084509  9093 raft_consensus.cc:385] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.093462  8886 tablet_service.cc:1511] Processing CreateTablet for tablet ca29694da91044f28b09dc349794ab78 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:48.096957  8886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca29694da91044f28b09dc349794ab78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.101085  9038 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3d7a987863451999601c9a8735d401 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:48.102334  9038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3d7a987863451999601c9a8735d401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.093055  9103 consensus_queue.cc:237] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.094525  9093 raft_consensus.cc:740] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.121862  8814 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3d7a987863451999601c9a8735d401 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:48.123680  8885 tablet_service.cc:1511] Processing CreateTablet for tablet 41c1944d902340e79c6e9648cad9d681 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:48.125053  8885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c1944d902340e79c6e9648cad9d681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.125293  8882 tablet_service.cc:1511] Processing CreateTablet for tablet 4a72811528754f96a5b00504f8d032e0 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:48.125222  8956 tablet_service.cc:1511] Processing CreateTablet for tablet 41c1944d902340e79c6e9648cad9d681 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:48.126286  9095 tablet_bootstrap.cc:492] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:48.126767  8882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a72811528754f96a5b00504f8d032e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.126878  9095 ts_tablet_manager.cc:1403] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.283s	user 0.020s	sys 0.016s
I20260709 13:03:48.122239  9102 raft_consensus.cc:493] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.127704  9102 raft_consensus.cc:515] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:48.128958  9031 tablet_service.cc:1511] Processing CreateTablet for tablet 41c1944d902340e79c6e9648cad9d681 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:48.120425  9093 consensus_queue.cc:260] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.129822  9102 leader_election.cc:290] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:48.130386  9031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c1944d902340e79c6e9648cad9d681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.128958  8815 tablet_service.cc:1511] Processing CreateTablet for tablet 4a72811528754f96a5b00504f8d032e0 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:48.131238  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b608c0e2df74b2a898f03761cfc1813" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:48.141489  8900 raft_consensus.cc:2468] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:48.142831  9011 leader_election.cc:304] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:48.132102  8814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3d7a987863451999601c9a8735d401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.144941  8815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a72811528754f96a5b00504f8d032e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.145422  9102 raft_consensus.cc:2804] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:48.145812  9102 raft_consensus.cc:493] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.146159  9102 raft_consensus.cc:3060] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.150835  9093 ts_tablet_manager.cc:1434] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.140s	user 0.004s	sys 0.013s
I20260709 13:03:48.127017  8956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c1944d902340e79c6e9648cad9d681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.133351  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b608c0e2df74b2a898f03761cfc1813" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:48.121414  8957 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3d7a987863451999601c9a8735d401 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:03:48.154708  9013 leader_election.cc:343] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.155256  9092 tablet_bootstrap.cc:492] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:48.155830  9092 ts_tablet_manager.cc:1403] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.260s	user 0.030s	sys 0.018s
I20260709 13:03:48.156736  8957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3d7a987863451999601c9a8735d401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.160264  8964 tablet_service.cc:1511] Processing CreateTablet for tablet 4a72811528754f96a5b00504f8d032e0 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:48.160950  9030 tablet_service.cc:1511] Processing CreateTablet for tablet 27ed6c910f234c96ad999ea23411bc89 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:48.162181  8964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a72811528754f96a5b00504f8d032e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.162240  9030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ed6c910f234c96ad999ea23411bc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.167514  9095 raft_consensus.cc:359] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.168275  9095 raft_consensus.cc:385] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.168612  9095 raft_consensus.cc:740] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.169516  9095 consensus_queue.cc:260] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.168416  9092 raft_consensus.cc:359] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.181948  8890 tablet_service.cc:1511] Processing CreateTablet for tablet 27ed6c910f234c96ad999ea23411bc89 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:48.182593  9126 raft_consensus.cc:493] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.192040  9126 raft_consensus.cc:515] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.193692  8808 tablet_service.cc:1511] Processing CreateTablet for tablet 8d68cd517ce44baf88aa239a275ce8d0 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:48.194156  9126 leader_election.cc:290] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:48.183521  8890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ed6c910f234c96ad999ea23411bc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.194998  8808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d68cd517ce44baf88aa239a275ce8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.196789  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:48.197427  8974 raft_consensus.cc:2468] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:48.198506  8791 leader_election.cc:304] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:48.199554  9103 raft_consensus.cc:493] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.200045  9103 raft_consensus.cc:515] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.202036  9103 leader_election.cc:290] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:48.187453  8963 tablet_service.cc:1511] Processing CreateTablet for tablet 8d68cd517ce44baf88aa239a275ce8d0 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:48.203691  9126 raft_consensus.cc:2804] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:48.204236  9126 raft_consensus.cc:493] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.204452  8963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d68cd517ce44baf88aa239a275ce8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.204294  9102 raft_consensus.cc:515] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:48.190449  9029 tablet_service.cc:1511] Processing CreateTablet for tablet 8d68cd517ce44baf88aa239a275ce8d0 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:48.207719  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b608c0e2df74b2a898f03761cfc1813" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:48.208058  9029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d68cd517ce44baf88aa239a275ce8d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:48.209154  9013 leader_election.cc:343] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.211570  9126 raft_consensus.cc:3060] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.213449  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
W20260709 13:03:48.214910  8939 leader_election.cc:343] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.215794  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:48.182227  8812 tablet_service.cc:1511] Processing CreateTablet for tablet 27ed6c910f234c96ad999ea23411bc89 (DEFAULT_TABLE table=test-workload [id=45cc28180e5044428f51f738f456ec57]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:48.185554  8722 catalog_manager.cc:5697] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.217968  8812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ed6c910f234c96ad999ea23411bc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:48.219273  9093 tablet_bootstrap.cc:492] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:48.199575  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:48.178900  9092 raft_consensus.cc:385] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.223860  9092 raft_consensus.cc:740] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
W20260709 13:03:48.224601  8790 leader_election.cc:343] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.224606  9092 consensus_queue.cc:260] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.216572  9095 ts_tablet_manager.cc:1434] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.089s	user 0.010s	sys 0.000s
I20260709 13:03:48.226882  9092 ts_tablet_manager.cc:1434] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.071s	user 0.003s	sys 0.001s
I20260709 13:03:48.228304  9095 tablet_bootstrap.cc:492] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:48.182024  9094 tablet_bootstrap.cc:492] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:48.228969  9094 ts_tablet_manager.cc:1403] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.273s	user 0.015s	sys 0.005s
I20260709 13:03:48.234441  9095 tablet_bootstrap.cc:654] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.235260  9094 raft_consensus.cc:359] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.240325  9092 tablet_bootstrap.cc:492] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:48.242131  9126 raft_consensus.cc:515] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.246479  9093 tablet_bootstrap.cc:654] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.248030  9094 raft_consensus.cc:385] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.253161  9094 raft_consensus.cc:740] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.258616  9102 leader_election.cc:290] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:48.261658  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b608c0e2df74b2a898f03761cfc1813" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:48.262272  8900 raft_consensus.cc:3060] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.263593  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:48.264207  8974 raft_consensus.cc:3060] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.266763  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:48.259218  8825 raft_consensus.cc:2393] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate 0c955bfd0b9541f9860c5f84cb255b90 in this term.
W20260709 13:03:48.271477  8790 leader_election.cc:343] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.271354  9094 consensus_queue.cc:260] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.273463  8939 leader_election.cc:304] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:48.282195  8974 raft_consensus.cc:2468] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:48.282836  9103 raft_consensus.cc:2749] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:48.286060  8791 leader_election.cc:304] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:48.293334  8900 raft_consensus.cc:2468] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:48.294906  9011 leader_election.cc:304] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:03:48.296044  9102 raft_consensus.cc:2804] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:48.296496  9102 raft_consensus.cc:697] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:48.268460  9126 leader_election.cc:290] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:48.273867  9094 ts_tablet_manager.cc:1434] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:03:48.298596  9102 consensus_queue.cc:237] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:48.299863  9126 raft_consensus.cc:2804] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:48.306102  9126 raft_consensus.cc:697] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:48.307117  9094 tablet_bootstrap.cc:492] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:48.306958  9126 consensus_queue.cc:237] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.317215  9093 tablet_bootstrap.cc:492] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:48.317911  9093 ts_tablet_manager.cc:1403] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.099s	user 0.023s	sys 0.001s
I20260709 13:03:48.321053  9093 raft_consensus.cc:359] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:48.321775  9093 raft_consensus.cc:385] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.321961  9094 tablet_bootstrap.cc:654] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.322098  9093 raft_consensus.cc:740] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.323063  9093 consensus_queue.cc:260] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:48.325302  9093 ts_tablet_manager.cc:1434] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:48.325840  9092 tablet_bootstrap.cc:654] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.326325  9093 tablet_bootstrap.cc:492] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:48.332971  9141 raft_consensus.cc:493] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.333525  9141 raft_consensus.cc:515] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.337814  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7455286aa620402d980c0923537d619a" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:48.339349  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7455286aa620402d980c0923537d619a" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:48.340830  8791 leader_election.cc:343] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:48.341915  8788 leader_election.cc:343] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.342242  9093 tablet_bootstrap.cc:654] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.342415  8788 leader_election.cc:304] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:48.343484  9141 leader_election.cc:290] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:48.344756  9141 raft_consensus.cc:2749] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:48.349342  9095 tablet_bootstrap.cc:492] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:48.353176  9095 ts_tablet_manager.cc:1403] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.026s
I20260709 13:03:48.356794  9095 raft_consensus.cc:359] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.348760  8723 catalog_manager.cc:5697] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.359025  9095 raft_consensus.cc:385] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.359422  9095 raft_consensus.cc:740] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.360247  9095 consensus_queue.cc:260] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.363104  9095 ts_tablet_manager.cc:1434] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:03:48.364451  9095 tablet_bootstrap.cc:492] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:48.366307  8722 catalog_manager.cc:5697] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.372620  9095 tablet_bootstrap.cc:654] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.373171  9092 tablet_bootstrap.cc:492] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:48.373713  9092 ts_tablet_manager.cc:1403] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.134s	user 0.015s	sys 0.006s
I20260709 13:03:48.375180  9147 raft_consensus.cc:493] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.375686  9147 raft_consensus.cc:515] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:48.377405  9103 raft_consensus.cc:493] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.377483  9092 raft_consensus.cc:359] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.378571  9103 raft_consensus.cc:515] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.381567  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237e06066ca940fb8dd923588f437acb" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
W20260709 13:03:48.382966  8937 leader_election.cc:343] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.383164  9093 tablet_bootstrap.cc:492] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:48.383764  9093 ts_tablet_manager.cc:1403] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.007s
I20260709 13:03:48.384452  9103 leader_election.cc:290] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:48.385917  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237e06066ca940fb8dd923588f437acb" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:48.386557  9094 tablet_bootstrap.cc:492] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:48.388526  9094 ts_tablet_manager.cc:1403] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.082s	user 0.022s	sys 0.010s
W20260709 13:03:48.387144  8939 leader_election.cc:343] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.389384  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:48.389752  8939 leader_election.cc:304] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:48.390028  9093 raft_consensus.cc:359] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.390821  9093 raft_consensus.cc:385] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.390957  9103 raft_consensus.cc:2749] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:48.391153  9093 raft_consensus.cc:740] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.383164  9095 tablet_bootstrap.cc:492] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:48.391469  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:48.392030  9095 ts_tablet_manager.cc:1403] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.012s
I20260709 13:03:48.392474  8900 raft_consensus.cc:2468] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:48.392114  9093 consensus_queue.cc:260] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
W20260709 13:03:48.393513  8790 leader_election.cc:343] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.394706  9093 ts_tablet_manager.cc:1434] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:03:48.395267  9095 raft_consensus.cc:359] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.396066  9095 raft_consensus.cc:385] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.396371  9095 raft_consensus.cc:740] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.396256  9102 consensus_queue.cc:1048] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:48.397245  8788 leader_election.cc:304] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:48.397156  9095 consensus_queue.cc:260] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.398236  9126 raft_consensus.cc:2804] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:48.398197  9094 raft_consensus.cc:359] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.398893  9126 raft_consensus.cc:493] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.399216  9094 raft_consensus.cc:385] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.399276  9126 raft_consensus.cc:3060] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.389202  9147 leader_election.cc:290] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:48.399392  9095 ts_tablet_manager.cc:1434] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:03:48.399639  9094 raft_consensus.cc:740] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.400664  9095 tablet_bootstrap.cc:492] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:48.401001  9094 consensus_queue.cc:260] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.403251  9094 ts_tablet_manager.cc:1434] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:03:48.407269  9094 tablet_bootstrap.cc:492] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:48.409153  9093 tablet_bootstrap.cc:492] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:48.414079  9093 tablet_bootstrap.cc:654] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.414721  9094 tablet_bootstrap.cc:654] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.407773  9095 tablet_bootstrap.cc:654] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.417744  9126 raft_consensus.cc:515] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:48.424446  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
W20260709 13:03:48.426433  8790 leader_election.cc:343] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.378857  9092 raft_consensus.cc:385] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.427392  9092 raft_consensus.cc:740] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.428673  9092 consensus_queue.cc:260] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.431865  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:48.432685  8900 raft_consensus.cc:3060] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.439620  9126 leader_election.cc:290] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:48.448879  9092 ts_tablet_manager.cc:1434] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.000s
I20260709 13:03:48.449561  9095 tablet_bootstrap.cc:492] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:48.450161  9093 tablet_bootstrap.cc:492] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:48.450321  9092 tablet_bootstrap.cc:492] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:48.450824  9093 ts_tablet_manager.cc:1403] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.020s
I20260709 13:03:48.450157  9095 ts_tablet_manager.cc:1403] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.050s	user 0.023s	sys 0.000s
I20260709 13:03:48.454587  9093 raft_consensus.cc:359] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.455363  9093 raft_consensus.cc:385] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.455749  9093 raft_consensus.cc:740] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.456573  9093 consensus_queue.cc:260] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.458045  9095 raft_consensus.cc:359] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.458788  9095 raft_consensus.cc:385] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.459069  9095 raft_consensus.cc:740] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.452553  9094 tablet_bootstrap.cc:492] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:48.460700  9094 ts_tablet_manager.cc:1403] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.009s
I20260709 13:03:48.462590  9093 ts_tablet_manager.cc:1434] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:03:48.463817  9093 tablet_bootstrap.cc:492] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:48.464681  9094 raft_consensus.cc:359] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.465574  9094 raft_consensus.cc:385] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.466480  9094 raft_consensus.cc:740] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.467808  9094 consensus_queue.cc:260] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.470602  9095 consensus_queue.cc:260] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.473196  9093 tablet_bootstrap.cc:654] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.473393  9095 ts_tablet_manager.cc:1434] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:03:48.474558  9094 ts_tablet_manager.cc:1434] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.002s
I20260709 13:03:48.482455  9092 tablet_bootstrap.cc:654] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:48.485092  9011 consensus_peers.cc:597] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:48.486399  8900 raft_consensus.cc:2468] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:48.486996  9095 tablet_bootstrap.cc:492] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:48.487641  8788 leader_election.cc:304] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:48.488783  9126 raft_consensus.cc:2804] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:48.489245  9126 raft_consensus.cc:697] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:48.490054  9126 consensus_queue.cc:237] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:48.494764  9094 tablet_bootstrap.cc:492] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:48.496235  9095 tablet_bootstrap.cc:654] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.518549  9094 tablet_bootstrap.cc:654] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.535010  9092 tablet_bootstrap.cc:492] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:48.535732  9092 ts_tablet_manager.cc:1403] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.007s
I20260709 13:03:48.536407  8720 catalog_manager.cc:5697] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.542958  9093 tablet_bootstrap.cc:492] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:48.543807  9093 ts_tablet_manager.cc:1403] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.080s	user 0.040s	sys 0.033s
I20260709 13:03:48.544202  9094 tablet_bootstrap.cc:492] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:48.544865  9094 ts_tablet_manager.cc:1403] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.005s
I20260709 13:03:48.544873  9103 consensus_queue.cc:1048] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:48.547164  9093 raft_consensus.cc:359] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:48.547936  9093 raft_consensus.cc:385] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.548182  9093 raft_consensus.cc:740] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.549103  9093 consensus_queue.cc:260] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:48.552011  9093 ts_tablet_manager.cc:1434] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:48.551899  9094 raft_consensus.cc:359] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.552902  9094 raft_consensus.cc:385] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.553217  9093 tablet_bootstrap.cc:492] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:48.558663  9092 raft_consensus.cc:359] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.559770  9093 tablet_bootstrap.cc:654] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.553248  9094 raft_consensus.cc:740] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.559579  9092 raft_consensus.cc:385] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.562110  9094 consensus_queue.cc:260] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.562915  9092 raft_consensus.cc:740] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.563974  9092 consensus_queue.cc:260] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.565682  9094 ts_tablet_manager.cc:1434] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:03:48.566535  9092 ts_tablet_manager.cc:1434] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:03:48.567731  9094 tablet_bootstrap.cc:492] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:48.576996  9094 tablet_bootstrap.cc:654] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.579500  9092 tablet_bootstrap.cc:492] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:48.587313  9092 tablet_bootstrap.cc:654] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.592017  9100 raft_consensus.cc:493] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.592648  9100 raft_consensus.cc:515] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.596755  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:48.598574  9100 leader_election.cc:290] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
W20260709 13:03:48.600237  8865 leader_election.cc:343] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:48.613132  8771 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:48.632573  9092 tablet_bootstrap.cc:492] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:48.633570  9095 tablet_bootstrap.cc:492] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:48.634382  9095 ts_tablet_manager.cc:1403] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.148s	user 0.016s	sys 0.000s
I20260709 13:03:48.636515  8825 raft_consensus.cc:3060] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.637042  9095 raft_consensus.cc:359] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.637768  9095 raft_consensus.cc:385] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.638020  9095 raft_consensus.cc:740] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.638664  9095 consensus_queue.cc:260] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.633421  9092 ts_tablet_manager.cc:1403] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.036s
I20260709 13:03:48.646358  9092 raft_consensus.cc:359] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.647027  9092 raft_consensus.cc:385] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.651556  9100 raft_consensus.cc:493] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.652020  9093 tablet_bootstrap.cc:492] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:48.652511  9093 ts_tablet_manager.cc:1403] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.100s	user 0.037s	sys 0.053s
I20260709 13:03:48.652143  9100 raft_consensus.cc:515] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.655555  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40b1dd371c548b58e6454e560a04271" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:48.656153  9048 raft_consensus.cc:2468] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:48.655951  9093 raft_consensus.cc:359] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.657946  9093 raft_consensus.cc:385] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.660100  9094 tablet_bootstrap.cc:492] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:48.660734  9094 ts_tablet_manager.cc:1403] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.013s
I20260709 13:03:48.661974  8865 leader_election.cc:304] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:48.663888  9100 leader_election.cc:290] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:48.664307  9172 raft_consensus.cc:2804] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:48.665071  9094 raft_consensus.cc:359] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.665071  9172 raft_consensus.cc:493] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.647329  9092 raft_consensus.cc:740] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.666836  9172 raft_consensus.cc:3060] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.667650  9092 consensus_queue.cc:260] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.666234  9094 raft_consensus.cc:385] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.670178  9094 raft_consensus.cc:740] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.670833  9092 ts_tablet_manager.cc:1434] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:03:48.670929  9094 consensus_queue.cc:260] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.671978  9092 tablet_bootstrap.cc:492] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:48.678622  9092 tablet_bootstrap.cc:654] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.679476  9093 raft_consensus.cc:740] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.680563  9093 consensus_queue.cc:260] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.681252  9094 ts_tablet_manager.cc:1434] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:03:48.682562  9094 tablet_bootstrap.cc:492] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:48.685710  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:48.687659  9093 ts_tablet_manager.cc:1434] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:03:48.688776  9103 raft_consensus.cc:493] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.689669  9093 tablet_bootstrap.cc:492] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:48.689604  9103 raft_consensus.cc:515] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.691955  9172 raft_consensus.cc:515] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.694010  9172 leader_election.cc:290] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:48.694082  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977d385d3eeb49a799b9c161940c175a" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:48.697330  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40b1dd371c548b58e6454e560a04271" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:48.698144  9048 raft_consensus.cc:3060] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.697621  9093 tablet_bootstrap.cc:654] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:48.700265  8937 leader_election.cc:343] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.700909  9094 tablet_bootstrap.cc:654] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.710487  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977d385d3eeb49a799b9c161940c175a" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
W20260709 13:03:48.712658  8939 leader_election.cc:343] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.713033  9094 tablet_bootstrap.cc:492] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:48.713529  9094 ts_tablet_manager.cc:1403] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.031s	user 0.004s	sys 0.007s
I20260709 13:03:48.713310  8939 leader_election.cc:304] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:48.714468  9103 leader_election.cc:290] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:48.716722  9126 consensus_queue.cc:1048] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:48.718029  9094 raft_consensus.cc:359] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:48.737144  9094 raft_consensus.cc:385] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.737476  9094 raft_consensus.cc:740] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.738209  9094 consensus_queue.cc:260] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:48.739197  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40b1dd371c548b58e6454e560a04271" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:48.719202  9092 tablet_bootstrap.cc:492] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:48.721798  9141 raft_consensus.cc:493] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.724026  9093 tablet_bootstrap.cc:492] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:48.724714  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40b1dd371c548b58e6454e560a04271" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:48.742702  9092 ts_tablet_manager.cc:1403] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.000s
I20260709 13:03:48.740324  9094 ts_tablet_manager.cc:1434] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:03:48.740623  8973 raft_consensus.cc:3060] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.744334  9094 tablet_bootstrap.cc:492] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
W20260709 13:03:48.735430  8866 leader_election.cc:343] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.743032  9093 ts_tablet_manager.cc:1403] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.004s
I20260709 13:03:48.746335  9141 raft_consensus.cc:515] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.747258  9171 consensus_queue.cc:1048] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:48.743656  9095 ts_tablet_manager.cc:1434] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.109s	user 0.065s	sys 0.027s
I20260709 13:03:48.754688  8866 leader_election.cc:304] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:48.755496  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de975aeaa3f4271942a80c6f15c6c98" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:48.756162  8974 raft_consensus.cc:2468] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:48.757294  8791 leader_election.cc:304] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:48.758119  9126 raft_consensus.cc:2804] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:48.758486  9126 raft_consensus.cc:493] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.758534  9095 tablet_bootstrap.cc:492] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:48.757863  9092 raft_consensus.cc:359] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.762866  9092 raft_consensus.cc:385] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.763320  9092 raft_consensus.cc:740] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.758796  9126 raft_consensus.cc:3060] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.759316  9172 raft_consensus.cc:2749] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:48.771700  8825 raft_consensus.cc:3060] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.754240  9141 leader_election.cc:290] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:48.772771  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de975aeaa3f4271942a80c6f15c6c98" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:48.778803  9094 tablet_bootstrap.cc:654] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.782645  8973 raft_consensus.cc:2468] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:03:48.739233  9103 raft_consensus.cc:2749] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:48.780208  9102 consensus_queue.cc:1048] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:48.780261  9093 raft_consensus.cc:359] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.786846  9093 raft_consensus.cc:385] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.787245  9093 raft_consensus.cc:740] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.782742  9171 raft_consensus.cc:493] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.782171  9048 raft_consensus.cc:2468] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:03:48.789136  9093 consensus_queue.cc:260] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.789214  9092 consensus_queue.cc:260] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.790717  8866 leader_election.cc:304] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:48.796298  9093 ts_tablet_manager.cc:1434] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:03:48.798535  9093 tablet_bootstrap.cc:492] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:48.797243  9172 raft_consensus.cc:2804] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:48.794935  8900 raft_consensus.cc:2468] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:48.794111  9171 raft_consensus.cc:515] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.801240  9100 raft_consensus.cc:493] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.805399  9102 raft_consensus.cc:493] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.807684  9100 raft_consensus.cc:515] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.807842  9102 raft_consensus.cc:515] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.809862  9100 leader_election.cc:290] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:48.811924  9102 leader_election.cc:290] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:48.824928  9094 tablet_bootstrap.cc:492] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:48.829635  9093 tablet_bootstrap.cc:654] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.819603  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7455286aa620402d980c0923537d619a" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:48.821400  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a4989c61c249ebab0dfa6b8990d350" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:48.828163  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7455286aa620402d980c0923537d619a" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:48.835037  9171 leader_election.cc:290] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:48.836294  9095 tablet_bootstrap.cc:654] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.838662  9094 ts_tablet_manager.cc:1403] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.023s
I20260709 13:03:48.840879  8823 raft_consensus.cc:2468] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:48.842244  8865 leader_election.cc:304] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:48.843019  9100 raft_consensus.cc:2804] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:48.849145  9094 raft_consensus.cc:359] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.849705  9094 raft_consensus.cc:385] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:48.848419  8900 raft_consensus.cc:2468] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:48.843694  9172 raft_consensus.cc:697] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:03:48.850190  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a4989c61c249ebab0dfa6b8990d350" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:48.850049  9094 raft_consensus.cc:740] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.851588  9094 consensus_queue.cc:260] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.844818  9100 raft_consensus.cc:493] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.852501  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a4989c61c249ebab0dfa6b8990d350" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:48.852787  9011 leader_election.cc:304] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:48.856220  9094 ts_tablet_manager.cc:1434] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:03:48.853133  9048 raft_consensus.cc:2468] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 0.
W20260709 13:03:48.856093  8866 leader_election.cc:343] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.856889  9102 raft_consensus.cc:2804] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:48.858033  9094 tablet_bootstrap.cc:492] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:48.854405  9172 consensus_queue.cc:237] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.852793  9100 raft_consensus.cc:3060] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.861212  9092 ts_tablet_manager.cc:1434] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.118s	user 0.010s	sys 0.000s
I20260709 13:03:48.850951  8898 raft_consensus.cc:2468] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 0.
I20260709 13:03:48.863166  9092 tablet_bootstrap.cc:492] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:48.864130  8937 leader_election.cc:304] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:48.865535  9170 raft_consensus.cc:2804] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:48.865927  9170 raft_consensus.cc:493] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.866240  9170 raft_consensus.cc:3060] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.869959  9092 tablet_bootstrap.cc:654] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.874567  9094 tablet_bootstrap.cc:654] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:48.860859  9102 raft_consensus.cc:493] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.878021  9102 raft_consensus.cc:3060] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.884423  9128 raft_consensus.cc:493] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.884965  9128 raft_consensus.cc:515] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:48.891767  9128 leader_election.cc:290] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:48.901765  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:48.904543  9102 raft_consensus.cc:515] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.906937  9095 tablet_bootstrap.cc:492] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:48.909353  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a4989c61c249ebab0dfa6b8990d350" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:48.910228  8898 raft_consensus.cc:3060] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.914835  9147 raft_consensus.cc:493] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.915396  9147 raft_consensus.cc:515] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:48.919471  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:48.919698  9147 leader_election.cc:290] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:48.920442  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b608c0e2df74b2a898f03761cfc1813" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:48.921029  8972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a4989c61c249ebab0dfa6b8990d350" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:48.910900  9126 raft_consensus.cc:515] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.922449  9014 leader_election.cc:304] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:48.923965  9128 raft_consensus.cc:2749] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:48.924247  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de975aeaa3f4271942a80c6f15c6c98" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:48.925081  8900 raft_consensus.cc:3060] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.924240  9126 leader_election.cc:290] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:48.927927  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de975aeaa3f4271942a80c6f15c6c98" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:48.928593  8973 raft_consensus.cc:3060] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.931129  9100 raft_consensus.cc:515] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.931638  9128 consensus_queue.cc:1048] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:48.933775  9126 raft_consensus.cc:493] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.934362  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7455286aa620402d980c0923537d619a" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
W20260709 13:03:48.935561  9181 log.cc:927] Time spent T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:03:48.936131  8866 leader_election.cc:343] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:48.934249  9126 raft_consensus.cc:515] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:48.936959  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b608c0e2df74b2a898f03761cfc1813" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:48.937472  9047 raft_consensus.cc:3060] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.938678  8790 leader_election.cc:304] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:48.939813  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:48.940577  9095 ts_tablet_manager.cc:1403] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.191s	user 0.013s	sys 0.009s
I20260709 13:03:48.940902  8897 raft_consensus.cc:2468] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:48.942509  8788 leader_election.cc:304] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:48.936496  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7455286aa620402d980c0923537d619a" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:48.933310  9100 leader_election.cc:290] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:48.945801  9102 leader_election.cc:290] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:48.956055  8825 raft_consensus.cc:3060] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:48.898085  9170 raft_consensus.cc:515] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.974660  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:48.970315  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a4989c61c249ebab0dfa6b8990d350" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:48.956399  9126 leader_election.cc:290] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:48.977682  9184 raft_consensus.cc:2804] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:48.978456  9147 raft_consensus.cc:2749] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:48.980937  8972 raft_consensus.cc:2393] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6a0de662d36410c907287e73cb2e4db in current term 1: Already voted for candidate 245d19d5c71647a9857ac68df13802d5 in this term.
I20260709 13:03:48.981916  9170 leader_election.cc:290] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:48.982725  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a4989c61c249ebab0dfa6b8990d350" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:48.984328  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a4989c61c249ebab0dfa6b8990d350" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:48.986466  9095 raft_consensus.cc:359] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.004794  9095 raft_consensus.cc:385] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.005087  9095 raft_consensus.cc:740] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:48.987941  8825 raft_consensus.cc:2468] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:03:48.989703  9128 raft_consensus.cc:493] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.011490  9128 raft_consensus.cc:515] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:48.977238  8973 raft_consensus.cc:2468] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:48.994661  8721 catalog_manager.cc:5697] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 0 to 1, leader changed from <none> to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.015744  8791 leader_election.cc:304] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:49.016451  9147 consensus_queue.cc:1048] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:49.016903  9141 raft_consensus.cc:2804] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:49.017453  9141 raft_consensus.cc:697] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:48.992854  9184 raft_consensus.cc:493] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.018282  9184 raft_consensus.cc:3060] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.018288  9141 consensus_queue.cc:237] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.000710  8898 raft_consensus.cc:2468] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:49.005785  9095 consensus_queue.cc:260] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.026580  9095 ts_tablet_manager.cc:1434] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.086s	user 0.005s	sys 0.002s
I20260709 13:03:49.007762  9092 tablet_bootstrap.cc:492] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:49.008620  9048 raft_consensus.cc:2393] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate a6a0de662d36410c907287e73cb2e4db in this term.
I20260709 13:03:49.027207  9092 ts_tablet_manager.cc:1403] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.164s	user 0.011s	sys 0.007s
I20260709 13:03:49.028578  8939 leader_election.cc:304] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:49.029800  9171 raft_consensus.cc:2749] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:49.030231  8971 raft_consensus.cc:2468] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:49.030411  9092 raft_consensus.cc:359] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.031121  9092 raft_consensus.cc:385] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.031590  9095 tablet_bootstrap.cc:492] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:49.032665  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237e06066ca940fb8dd923588f437acb" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:49.008508  9047 raft_consensus.cc:3060] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.031360  9092 raft_consensus.cc:740] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
W20260709 13:03:49.034833  9011 leader_election.cc:343] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.046728  9092 consensus_queue.cc:260] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.047176  8865 leader_election.cc:304] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:49.049408  9011 leader_election.cc:304] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:49.051397  9094 tablet_bootstrap.cc:492] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:49.051891  9128 leader_election.cc:290] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:49.051926  9094 ts_tablet_manager.cc:1403] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.194s	user 0.013s	sys 0.000s
I20260709 13:03:49.058528  9092 ts_tablet_manager.cc:1434] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:03:49.059926  9191 raft_consensus.cc:493] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.059993  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237e06066ca940fb8dd923588f437acb" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:49.060607  9191 raft_consensus.cc:515] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.060887  8971 raft_consensus.cc:2468] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:49.061297  9093 tablet_bootstrap.cc:492] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:49.061801  9093 ts_tablet_manager.cc:1403] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.264s	user 0.025s	sys 0.029s
I20260709 13:03:49.062633  8900 raft_consensus.cc:2468] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:49.062822  9014 leader_election.cc:304] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:49.063520  9172 raft_consensus.cc:2804] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:49.064056  9172 raft_consensus.cc:697] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:03:49.064893  9172 consensus_queue.cc:237] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.069634  9093 raft_consensus.cc:359] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.072052  9093 raft_consensus.cc:385] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.072345  9093 raft_consensus.cc:740] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
W20260709 13:03:49.049614  8788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 107195us
I20260709 13:03:49.073582  9190 raft_consensus.cc:2804] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:49.073668  9192 raft_consensus.cc:2804] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:49.076462  9093 consensus_queue.cc:260] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.083961  9095 tablet_bootstrap.cc:654] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.086064  9094 raft_consensus.cc:359] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.088896  9094 raft_consensus.cc:385] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.089321  9094 raft_consensus.cc:740] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.071662  9191 leader_election.cc:290] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:49.091508  9093 ts_tablet_manager.cc:1434] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.002s
I20260709 13:03:49.090698  9094 consensus_queue.cc:260] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.092442  9092 tablet_bootstrap.cc:492] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:49.090395  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff17e11e1d8e4902ac9cfb17935d7de6" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:49.092835  9011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 44164.9us
W20260709 13:03:49.093932  9014 leader_election.cc:343] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.101799  9184 raft_consensus.cc:515] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.103711  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff17e11e1d8e4902ac9cfb17935d7de6" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:49.103896  9189 consensus_queue.cc:1048] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:49.104368  9093 tablet_bootstrap.cc:492] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:49.105720  9092 tablet_bootstrap.cc:654] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.104369  8825 raft_consensus.cc:2468] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:49.109148  9013 leader_election.cc:304] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:49.080231  9192 raft_consensus.cc:493] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.115595  9094 ts_tablet_manager.cc:1434] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 13:03:49.112962  9192 raft_consensus.cc:3060] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.129900  9193 raft_consensus.cc:2804] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:49.131641  9093 tablet_bootstrap.cc:654] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.132701  9094 tablet_bootstrap.cc:492] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:49.130309  9193 raft_consensus.cc:493] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.148546  9141 raft_consensus.cc:493] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.148940  9193 raft_consensus.cc:3060] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.149097  9141 raft_consensus.cc:515] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.136327  9102 raft_consensus.cc:493] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.136413  9189 raft_consensus.cc:493] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.153407  9189 raft_consensus.cc:515] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.141234  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:49.155769  8898 raft_consensus.cc:3060] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.146962  9126 consensus_queue.cc:1048] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:49.159813  9102 raft_consensus.cc:515] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.154464  8723 catalog_manager.cc:5697] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 0 to 1, leader changed from <none> to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.162989  9102 leader_election.cc:290] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:49.134267  9172 raft_consensus.cc:493] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.164064  9184 leader_election.cc:290] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:49.181537  9092 tablet_bootstrap.cc:492] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:49.182785  9092 ts_tablet_manager.cc:1403] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.093s	user 0.008s	sys 0.008s
W20260709 13:03:49.171663  9013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 57308us
I20260709 13:03:49.192566  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:49.199030  9141 leader_election.cc:290] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:49.202168  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:49.201236  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:49.203028  8974 raft_consensus.cc:2468] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:49.203334  8971 raft_consensus.cc:3060] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.204895  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b41045f959459f885308feb894963c" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:49.208173  8791 leader_election.cc:304] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:49.209213  9126 raft_consensus.cc:2804] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:49.209451  8790 leader_election.cc:343] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.209619  9126 raft_consensus.cc:493] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.209694  9189 leader_election.cc:290] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:49.210068  9126 raft_consensus.cc:3060] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.201081  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b41045f959459f885308feb894963c" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:49.212311  9092 raft_consensus.cc:359] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.212816  9092 raft_consensus.cc:385] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.213009  9092 raft_consensus.cc:740] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.177356  9172 raft_consensus.cc:515] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.214372  9092 consensus_queue.cc:260] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.187994  9190 raft_consensus.cc:697] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:49.216465  9190 consensus_queue.cc:237] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.218708  9172 leader_election.cc:290] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:49.223441  8971 raft_consensus.cc:2468] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:49.226017  9092 ts_tablet_manager.cc:1434] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 13:03:49.226926  9092 tablet_bootstrap.cc:492] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
W20260709 13:03:49.189054  9011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 91640.8us
I20260709 13:03:49.232519  8791 leader_election.cc:304] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:49.233400  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ede05852c17421192022144629e6a6b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
W20260709 13:03:49.233858  8791 leader_election.cc:343] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.237645  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:49.236613  9184 raft_consensus.cc:2804] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:49.238808  8791 leader_election.cc:304] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:49.242753  9047 raft_consensus.cc:2468] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:49.243140  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:49.244747  9141 raft_consensus.cc:2749] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:49.244608  9193 raft_consensus.cc:515] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.242293  9126 raft_consensus.cc:515] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.246753  9193 leader_election.cc:290] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
W20260709 13:03:49.247668  9194 log.cc:927] Time spent T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:03:49.248718  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff17e11e1d8e4902ac9cfb17935d7de6" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:49.248905  9126 leader_election.cc:290] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
W20260709 13:03:49.249400  9195 log.cc:927] Time spent T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:03:49.250233  9014 leader_election.cc:343] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.250277  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:49.250840  9184 raft_consensus.cc:697] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:49.251003  9047 raft_consensus.cc:3060] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.251703  9184 consensus_queue.cc:237] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.254892  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff17e11e1d8e4902ac9cfb17935d7de6" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:49.255746  8825 raft_consensus.cc:3060] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.256683  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:49.271344  9092 tablet_bootstrap.cc:654] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.308523  8898 raft_consensus.cc:2468] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:49.310431  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ede05852c17421192022144629e6a6b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:49.311239  9011 leader_election.cc:304] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:49.316715  9094 tablet_bootstrap.cc:654] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.261675  8971 raft_consensus.cc:3060] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.318406  9190 raft_consensus.cc:2749] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.321565  8865 leader_election.cc:304] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:49.323370  9172 raft_consensus.cc:2749] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:49.328831  9172 consensus_queue.cc:1048] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:49.330895  9095 tablet_bootstrap.cc:492] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:49.335969  9095 ts_tablet_manager.cc:1403] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.305s	user 0.030s	sys 0.044s
I20260709 13:03:49.337538  9093 tablet_bootstrap.cc:492] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:49.338032  9093 ts_tablet_manager.cc:1403] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.234s	user 0.021s	sys 0.020s
I20260709 13:03:49.340022  9095 raft_consensus.cc:359] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.340766  9095 raft_consensus.cc:385] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.341019  9095 raft_consensus.cc:740] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.341683  9095 consensus_queue.cc:260] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.342818  9093 raft_consensus.cc:359] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.343734  9095 ts_tablet_manager.cc:1434] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:49.344668  9192 raft_consensus.cc:515] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.351140  9093 raft_consensus.cc:385] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.351516  9093 raft_consensus.cc:740] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.352262  9093 consensus_queue.cc:260] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.353330  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237e06066ca940fb8dd923588f437acb" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:49.354578  9093 ts_tablet_manager.cc:1434] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:03:49.361574  9093 tablet_bootstrap.cc:492] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:49.350642  8825 raft_consensus.cc:2468] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
W20260709 13:03:49.355005  9011 leader_election.cc:343] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.345923  8721 catalog_manager.cc:5697] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.355621  8898 raft_consensus.cc:3060] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.356896  9095 tablet_bootstrap.cc:492] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:49.357723  9047 raft_consensus.cc:2468] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:49.376655  8790 leader_election.cc:304] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:49.377421  9095 tablet_bootstrap.cc:654] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.377667  9126 raft_consensus.cc:2804] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:49.378171  9126 raft_consensus.cc:697] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:49.379070  9126 consensus_queue.cc:237] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.381958  9092 tablet_bootstrap.cc:492] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:49.382453  9092 ts_tablet_manager.cc:1403] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.021s
I20260709 13:03:49.358918  8720 catalog_manager.cc:5697] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:49.360073  8971 raft_consensus.cc:2468] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:49.365628  9189 raft_consensus.cc:493] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.391393  9189 raft_consensus.cc:515] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.394464  9189 leader_election.cc:290] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:49.366268  9094 tablet_bootstrap.cc:492] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:49.395479  9094 ts_tablet_manager.cc:1403] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.264s	user 0.017s	sys 0.000s
I20260709 13:03:49.366520  9192 leader_election.cc:290] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:49.399044  9100 consensus_queue.cc:1048] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:49.369293  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237e06066ca940fb8dd923588f437acb" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:49.369731  9093 tablet_bootstrap.cc:654] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.400900  8974 raft_consensus.cc:3060] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.370561  9013 leader_election.cc:304] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:49.405596  9192 raft_consensus.cc:2804] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:49.406242  9192 raft_consensus.cc:697] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:49.407279  9192 consensus_queue.cc:237] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.415051  8972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddeae20846c4ef98e62e0666f4030b4" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:49.417044  8791 leader_election.cc:343] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.419793  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddeae20846c4ef98e62e0666f4030b4" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:49.419157  9093 tablet_bootstrap.cc:492] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
W20260709 13:03:49.421471  8790 leader_election.cc:343] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.422376  9093 ts_tablet_manager.cc:1403] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.061s	user 0.004s	sys 0.017s
I20260709 13:03:49.422466  8790 leader_election.cc:304] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:49.425612  9093 raft_consensus.cc:359] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.426342  9093 raft_consensus.cc:385] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.426796  9093 raft_consensus.cc:740] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.411281  9092 raft_consensus.cc:359] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.427772  9092 raft_consensus.cc:385] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.428289  9092 raft_consensus.cc:740] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.427656  9093 consensus_queue.cc:260] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.428392  9184 raft_consensus.cc:2749] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:49.430346  9093 ts_tablet_manager.cc:1434] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:49.430548  9092 consensus_queue.cc:260] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.431690  9093 tablet_bootstrap.cc:492] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:49.432554  9092 ts_tablet_manager.cc:1434] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:03:49.433450  9092 tablet_bootstrap.cc:492] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:49.434026  9141 consensus_queue.cc:1048] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:49.438169  9093 tablet_bootstrap.cc:654] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.438798  9092 tablet_bootstrap.cc:654] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.398958  9094 raft_consensus.cc:359] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.441296  9094 raft_consensus.cc:385] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.441682  9094 raft_consensus.cc:740] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.442451  9094 consensus_queue.cc:260] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.444474  9094 ts_tablet_manager.cc:1434] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:03:49.445499  9094 tablet_bootstrap.cc:492] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:49.449584  9095 tablet_bootstrap.cc:492] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:49.450078  9093 tablet_bootstrap.cc:492] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:49.450778  9093 ts_tablet_manager.cc:1403] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:03:49.450958  9094 tablet_bootstrap.cc:654] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.450095  9095 ts_tablet_manager.cc:1403] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.093s	user 0.031s	sys 0.033s
I20260709 13:03:49.453375  9092 tablet_bootstrap.cc:492] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:49.453842  9092 ts_tablet_manager.cc:1403] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.001s
I20260709 13:03:49.455072  9093 raft_consensus.cc:359] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.456607  9092 raft_consensus.cc:359] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.456944  9095 raft_consensus.cc:359] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.457680  9093 raft_consensus.cc:385] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.457682  9092 raft_consensus.cc:385] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.458171  9093 raft_consensus.cc:740] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.458456  9092 raft_consensus.cc:740] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.457801  9095 raft_consensus.cc:385] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.459148  9093 consensus_queue.cc:260] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.459339  9092 consensus_queue.cc:260] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.459148  9095 raft_consensus.cc:740] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.461108  9095 consensus_queue.cc:260] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.461573  9093 ts_tablet_manager.cc:1434] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:49.462546  9093 tablet_bootstrap.cc:492] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:49.463253  9094 tablet_bootstrap.cc:492] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:49.463301  9092 ts_tablet_manager.cc:1434] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:49.463901  9094 ts_tablet_manager.cc:1403] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:03:49.465664  9095 ts_tablet_manager.cc:1434] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.002s
I20260709 13:03:49.466611  9095 tablet_bootstrap.cc:492] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:49.466987  9094 raft_consensus.cc:359] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.468192  9093 tablet_bootstrap.cc:654] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.468516  9094 raft_consensus.cc:385] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.473755  9095 tablet_bootstrap.cc:654] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.468951  9094 raft_consensus.cc:740] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.478562  9094 consensus_queue.cc:260] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.479311  9092 tablet_bootstrap.cc:492] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:49.481068  9094 ts_tablet_manager.cc:1434] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:03:49.482533  9094 tablet_bootstrap.cc:492] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:49.487180  8974 raft_consensus.cc:2468] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:49.490489  9100 consensus_queue.cc:1048] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:49.493283  9014 leader_election.cc:304] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:49.494447  9192 raft_consensus.cc:2804] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:49.494972  9192 raft_consensus.cc:697] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:49.497843  9192 consensus_queue.cc:237] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.499835  9190 raft_consensus.cc:493] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.500350  9190 raft_consensus.cc:515] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.502375  9190 leader_election.cc:290] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:49.504320  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddeae20846c4ef98e62e0666f4030b4" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:49.505227  8823 raft_consensus.cc:2468] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:49.507063  9013 leader_election.cc:304] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:49.509357  9190 raft_consensus.cc:2804] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:49.509745  9190 raft_consensus.cc:493] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.510113  9190 raft_consensus.cc:3060] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.492434  8720 catalog_manager.cc:5697] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.515818  9092 tablet_bootstrap.cc:654] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:49.519881  8866 consensus_peers.cc:597] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c -> Peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Couldn't send request to peer 245d19d5c71647a9857ac68df13802d5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:49.530818  9184 consensus_queue.cc:1048] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:49.532056  9199 raft_consensus.cc:493] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.532573  9199 raft_consensus.cc:515] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.534601  9199 leader_election.cc:290] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:49.536296  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce2804142c04505bd469904f288178b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:49.536979  8898 raft_consensus.cc:2468] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:49.534490  8723 catalog_manager.cc:5697] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:49.538208  9011 leader_election.cc:304] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:49.542219  9199 raft_consensus.cc:2804] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:49.542975  9199 raft_consensus.cc:493] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.543583  9199 raft_consensus.cc:3060] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.544490  9193 raft_consensus.cc:493] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.545003  9193 raft_consensus.cc:515] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.547602  9200 raft_consensus.cc:493] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.548262  9200 raft_consensus.cc:515] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.549381  8723 catalog_manager.cc:5697] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.550822  9200 leader_election.cc:290] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:49.552348  9092 tablet_bootstrap.cc:492] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:49.553558  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:49.554572  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0a76f1a2b45df971cecac7ccb46b3" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:49.561056  8897 raft_consensus.cc:2468] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:49.555756  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:49.557876  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce2804142c04505bd469904f288178b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:49.564704  9011 leader_election.cc:343] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.565389  9011 leader_election.cc:304] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
W20260709 13:03:49.565775  9014 leader_election.cc:343] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:49.566803  9013 leader_election.cc:343] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.547175  9193 leader_election.cc:290] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:49.558583  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0a76f1a2b45df971cecac7ccb46b3" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:49.568329  9193 raft_consensus.cc:2804] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:49.568679  9193 raft_consensus.cc:493] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.569010  9193 raft_consensus.cc:3060] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.567956  9013 leader_election.cc:304] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
W20260709 13:03:49.570163  9013 leader_election.cc:343] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.570797  9200 raft_consensus.cc:2749] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:49.571979  9092 ts_tablet_manager.cc:1403] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.108s	user 0.017s	sys 0.001s
I20260709 13:03:49.574642  9092 raft_consensus.cc:359] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.575265  9092 raft_consensus.cc:385] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.575577  9092 raft_consensus.cc:740] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.576346  9092 consensus_queue.cc:260] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.579182  9092 ts_tablet_manager.cc:1434] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:03:49.579617  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddeae20846c4ef98e62e0666f4030b4" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:49.580140  9092 tablet_bootstrap.cc:492] T 237e06066ca940fb8dd923588f437acb P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:49.558233  9199 raft_consensus.cc:515] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.584126  9190 raft_consensus.cc:515] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.587462  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce2804142c04505bd469904f288178b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:49.588102  8897 raft_consensus.cc:3060] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.592533  9093 tablet_bootstrap.cc:492] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:49.593036  9095 tablet_bootstrap.cc:492] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:49.593359  9093 ts_tablet_manager.cc:1403] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.131s	user 0.012s	sys 0.044s
I20260709 13:03:49.593478  9095 ts_tablet_manager.cc:1403] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.127s	user 0.051s	sys 0.067s
I20260709 13:03:49.580255  8973 raft_consensus.cc:2468] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:49.595856  8897 raft_consensus.cc:2468] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:49.597052  9011 leader_election.cc:304] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:49.597159  8720 catalog_manager.cc:5697] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:49.597977  9192 raft_consensus.cc:2804] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:49.598780  9192 raft_consensus.cc:697] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:49.599702  9192 consensus_queue.cc:237] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.601389  9095 raft_consensus.cc:359] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.601924  9199 leader_election.cc:290] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:49.602136  9095 raft_consensus.cc:385] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.602452  9095 raft_consensus.cc:740] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.603976  9094 tablet_bootstrap.cc:654] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.603395  9095 consensus_queue.cc:260] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.607671  9092 tablet_bootstrap.cc:654] T 237e06066ca940fb8dd923588f437acb P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.609304  9095 ts_tablet_manager.cc:1434] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:03:49.609711  9193 raft_consensus.cc:515] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.610690  9095 tablet_bootstrap.cc:492] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:49.612104  9100 raft_consensus.cc:493] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.612581  9100 raft_consensus.cc:515] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.614270  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddeae20846c4ef98e62e0666f4030b4" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:49.614724  9100 leader_election.cc:290] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:49.614871  8823 raft_consensus.cc:3060] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.616956  9095 tablet_bootstrap.cc:654] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.616789  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce2804142c04505bd469904f288178b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
W20260709 13:03:49.618214  9014 leader_election.cc:343] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.618640  9133 raft_consensus.cc:493] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.619086  9133 raft_consensus.cc:515] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.620662  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bddeae20846c4ef98e62e0666f4030b4" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:49.620473  9093 raft_consensus.cc:359] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.621116  9133 leader_election.cc:290] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:49.621335  9093 raft_consensus.cc:385] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.621850  9093 raft_consensus.cc:740] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.622586  9093 consensus_queue.cc:260] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.623014  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b41045f959459f885308feb894963c" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:49.623589  8823 raft_consensus.cc:2468] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:49.623662  8825 raft_consensus.cc:2468] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 0.
I20260709 13:03:49.624930  9013 leader_election.cc:304] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:49.625137  9093 ts_tablet_manager.cc:1434] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:03:49.625180  8939 leader_election.cc:304] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:49.626243  9133 raft_consensus.cc:2804] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:49.626466  9093 tablet_bootstrap.cc:492] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:49.626612  9133 raft_consensus.cc:493] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.627065  9133 raft_consensus.cc:3060] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.628129  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977d385d3eeb49a799b9c161940c175a" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:49.628782  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0a76f1a2b45df971cecac7ccb46b3" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:49.628880  8973 raft_consensus.cc:2468] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:49.628966  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977d385d3eeb49a799b9c161940c175a" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:49.621318  8974 raft_consensus.cc:3060] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:49.630447  9013 leader_election.cc:343] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:49.630523  8865 leader_election.cc:343] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.628881  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b41045f959459f885308feb894963c" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:49.631306  8866 leader_election.cc:304] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:49.632396  9190 leader_election.cc:290] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
W20260709 13:03:49.632477  8939 leader_election.cc:343] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.633081  9190 raft_consensus.cc:2804] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:49.633577  9190 raft_consensus.cc:697] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:49.634387  9190 consensus_queue.cc:237] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.635505  9193 leader_election.cc:290] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:49.637430  8974 raft_consensus.cc:2468] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:49.639379  9100 raft_consensus.cc:2804] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:49.639943  9100 raft_consensus.cc:493] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.641220  9100 raft_consensus.cc:3060] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.639763  9133 raft_consensus.cc:515] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.643682  9093 tablet_bootstrap.cc:654] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.643854  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0a76f1a2b45df971cecac7ccb46b3" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:49.644728  8898 raft_consensus.cc:3060] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.656649  9093 tablet_bootstrap.cc:492] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:49.657228  9093 ts_tablet_manager.cc:1403] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.007s
I20260709 13:03:49.660418  9093 raft_consensus.cc:359] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.661244  9093 raft_consensus.cc:385] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.661620  9093 raft_consensus.cc:740] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.662497  9093 consensus_queue.cc:260] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.664381  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b41045f959459f885308feb894963c" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:49.665112  9093 ts_tablet_manager.cc:1434] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 13:03:49.666170  8939 leader_election.cc:343] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.666360  9093 tablet_bootstrap.cc:492] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:49.667542  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b41045f959459f885308feb894963c" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:49.668169  8823 raft_consensus.cc:3060] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.673319  9093 tablet_bootstrap.cc:654] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.678270  8823 raft_consensus.cc:2468] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:03:49.680557  8939 leader_election.cc:304] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:49.682441  9094 tablet_bootstrap.cc:492] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:49.682938  9094 ts_tablet_manager.cc:1403] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.201s	user 0.014s	sys 0.017s
I20260709 13:03:49.682641  9170 raft_consensus.cc:2804] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:49.683854  9170 raft_consensus.cc:697] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:03:49.684906  9170 consensus_queue.cc:237] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.685971  9094 raft_consensus.cc:359] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.686486  9093 tablet_bootstrap.cc:492] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:49.687476  9093 ts_tablet_manager.cc:1403] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.001s
I20260709 13:03:49.688870  8898 raft_consensus.cc:2468] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:49.690186  9011 leader_election.cc:304] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:03:49.686769  9094 raft_consensus.cc:385] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.690833  9094 raft_consensus.cc:740] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.691543  9192 raft_consensus.cc:2804] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:49.691963  9100 raft_consensus.cc:515] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.690284  9093 raft_consensus.cc:359] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.693537  9093 raft_consensus.cc:385] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.693928  9093 raft_consensus.cc:740] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.694051  9100 leader_election.cc:290] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:49.694747  9093 consensus_queue.cc:260] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.691707  9094 consensus_queue.cc:260] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.696245  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977d385d3eeb49a799b9c161940c175a" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:49.697480  9094 ts_tablet_manager.cc:1434] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
W20260709 13:03:49.697815  8865 leader_election.cc:343] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:49.699632  8771 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:49.692305  9192 raft_consensus.cc:697] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:49.700373  9093 ts_tablet_manager.cc:1434] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:03:49.701429  9192 consensus_queue.cc:237] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.703590  9094 tablet_bootstrap.cc:492] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:49.702250  9093 tablet_bootstrap.cc:492] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:49.705771  9092 tablet_bootstrap.cc:492] T 237e06066ca940fb8dd923588f437acb P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:49.706295  9092 ts_tablet_manager.cc:1403] T 237e06066ca940fb8dd923588f437acb P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.126s	user 0.007s	sys 0.005s
I20260709 13:03:49.709134  9092 raft_consensus.cc:359] T 237e06066ca940fb8dd923588f437acb P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.709708  9093 tablet_bootstrap.cc:654] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.706228  9126 raft_consensus.cc:493] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.709860  9092 raft_consensus.cc:385] T 237e06066ca940fb8dd923588f437acb P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.710397  9092 raft_consensus.cc:740] T 237e06066ca940fb8dd923588f437acb P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.701802  9095 tablet_bootstrap.cc:492] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:49.711198  9095 ts_tablet_manager.cc:1403] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.002s
I20260709 13:03:49.700605  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977d385d3eeb49a799b9c161940c175a" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:49.714421  9092 consensus_queue.cc:260] T 237e06066ca940fb8dd923588f437acb P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.711925  9126 raft_consensus.cc:515] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.716482  8974 raft_consensus.cc:3060] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.717962  9126 leader_election.cc:290] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:49.718230  8720 catalog_manager.cc:5697] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.719918  9092 ts_tablet_manager.cc:1434] T 237e06066ca940fb8dd923588f437acb P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:03:49.719976  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd20e59c4c5460cb2da30a82e188e4b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:49.721256  9092 tablet_bootstrap.cc:492] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:49.722002  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd20e59c4c5460cb2da30a82e188e4b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:49.724148  9126 raft_consensus.cc:493] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:49.724351  8788 leader_election.cc:343] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.724874  9126 raft_consensus.cc:515] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
W20260709 13:03:49.725492  8791 leader_election.cc:343] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.726016  8791 leader_election.cc:304] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:49.726791  9094 tablet_bootstrap.cc:654] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.727111  9141 raft_consensus.cc:2749] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:49.727986  8719 catalog_manager.cc:5697] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.729784  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a27cc447a248368bcf0475b54f0b3d" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:49.731673  9126 leader_election.cc:290] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:49.732198  9095 raft_consensus.cc:359] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.732782  9095 raft_consensus.cc:385] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.732960  9095 raft_consensus.cc:740] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
W20260709 13:03:49.733666  8788 leader_election.cc:343] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.729791  8719 catalog_manager.cc:5697] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:49.710323  9133 leader_election.cc:290] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:49.738185  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a27cc447a248368bcf0475b54f0b3d" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:49.738453  9202 consensus_queue.cc:1048] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:49.741855  9095 consensus_queue.cc:260] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
W20260709 13:03:49.743561  8791 leader_election.cc:343] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.744091  8791 leader_election.cc:304] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:49.744462  9092 tablet_bootstrap.cc:654] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.745163  9126 raft_consensus.cc:2749] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:49.748152  9095 ts_tablet_manager.cc:1434] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:03:49.748895  9095 tablet_bootstrap.cc:492] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:49.762491  9094 tablet_bootstrap.cc:492] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:49.763181  9094 ts_tablet_manager.cc:1403] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.002s
I20260709 13:03:49.763826  9170 raft_consensus.cc:493] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.764637  9170 raft_consensus.cc:515] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.766134  9133 raft_consensus.cc:493] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.766642  9133 raft_consensus.cc:515] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.767840  9170 leader_election.cc:290] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:49.768615  9133 leader_election.cc:290] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:49.769402  9093 tablet_bootstrap.cc:492] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:49.769852  9093 ts_tablet_manager.cc:1403] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.068s	user 0.006s	sys 0.019s
I20260709 13:03:49.770961  8974 raft_consensus.cc:2468] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:03:49.771224  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0986587761fb4f0387746bee54af0e5b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:49.772914  9094 raft_consensus.cc:359] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.773414  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0986587761fb4f0387746bee54af0e5b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:49.774307  8866 leader_election.cc:304] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: a6a0de662d36410c907287e73cb2e4db
W20260709 13:03:49.775031  8939 leader_election.cc:343] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.775432  9100 raft_consensus.cc:2804] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:49.775852  9094 raft_consensus.cc:385] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.775971  9100 raft_consensus.cc:697] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:03:49.776331  9094 raft_consensus.cc:740] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.776983  9100 consensus_queue.cc:237] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.777407  9094 consensus_queue.cc:260] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.779489  9126 consensus_queue.cc:1048] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:49.772840  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff17e11e1d8e4902ac9cfb17935d7de6" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:49.780253  9094 ts_tablet_manager.cc:1434] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:03:49.780705  8825 raft_consensus.cc:2393] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate a6a0de662d36410c907287e73cb2e4db in this term.
I20260709 13:03:49.781028  9192 raft_consensus.cc:493] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.781543  9094 tablet_bootstrap.cc:492] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:49.781474  9192 raft_consensus.cc:515] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:49.776180  9202 consensus_queue.cc:1048] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:03:49.785256  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff17e11e1d8e4902ac9cfb17935d7de6" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:49.785851  9192 leader_election.cc:290] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:49.792063  9093 raft_consensus.cc:359] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.793298  9093 raft_consensus.cc:385] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.793915  9093 raft_consensus.cc:740] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.790333  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefe5d3d0a64ae087a329b7c032225a" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:49.800184  9014 leader_election.cc:343] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.802124  9093 consensus_queue.cc:260] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.808064  9093 ts_tablet_manager.cc:1434] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.005s
I20260709 13:03:49.800843  9126 consensus_queue.cc:1048] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:03:49.792837  8939 leader_election.cc:343] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.811990  8939 leader_election.cc:304] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:49.813063  9133 raft_consensus.cc:2749] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:49.821373  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefe5d3d0a64ae087a329b7c032225a" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
W20260709 13:03:49.823515  9011 leader_election.cc:343] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.824139  9011 leader_election.cc:304] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:49.828434  9095 tablet_bootstrap.cc:654] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.830340  9192 raft_consensus.cc:2749] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:49.836719  9093 tablet_bootstrap.cc:492] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:49.837666  8974 raft_consensus.cc:3060] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.835916  8939 leader_election.cc:304] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:49.838567  9126 raft_consensus.cc:493] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.846279  9126 raft_consensus.cc:515] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.849642  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
W20260709 13:03:49.851169  8790 leader_election.cc:343] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.852216  9126 leader_election.cc:290] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:49.856280  9202 consensus_queue.cc:1048] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:49.859970  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:49.853354  9093 tablet_bootstrap.cc:654] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.863019  9092 tablet_bootstrap.cc:492] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:49.863515  9092 ts_tablet_manager.cc:1403] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.142s	user 0.022s	sys 0.011s
W20260709 13:03:49.865051  8788 leader_election.cc:343] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.865506  8788 leader_election.cc:304] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:49.866122  9092 raft_consensus.cc:359] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.866801  9092 raft_consensus.cc:385] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.867100  9092 raft_consensus.cc:740] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.868729  9126 raft_consensus.cc:2749] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:49.872031  9092 consensus_queue.cc:260] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:49.872189  8720 catalog_manager.cc:5697] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.874954  8721 catalog_manager.cc:5697] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 0 to 1, leader changed from <none> to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:49.889047  9141 consensus_queue.cc:1048] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:49.890746  9094 tablet_bootstrap.cc:654] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.892961  9092 ts_tablet_manager.cc:1434] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:03:49.894182  9092 tablet_bootstrap.cc:492] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:49.896872  9172 raft_consensus.cc:493] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.899432  9172 raft_consensus.cc:515] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.901496  9172 leader_election.cc:290] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:49.891407  9126 raft_consensus.cc:493] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.911083  9126 raft_consensus.cc:515] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:49.907783  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:49.908612  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:49.909691  9141 consensus_queue.cc:1048] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:49.920866  9095 tablet_bootstrap.cc:492] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:49.921555  9095 ts_tablet_manager.cc:1403] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.173s	user 0.021s	sys 0.004s
I20260709 13:03:49.922672  8898 raft_consensus.cc:3060] T 237e06066ca940fb8dd923588f437acb P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.928463  9095 raft_consensus.cc:359] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.929455  9095 raft_consensus.cc:385] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.929813  9095 raft_consensus.cc:740] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.931442  9193 raft_consensus.cc:493] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.923604  9047 raft_consensus.cc:2468] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:49.931939  9193 raft_consensus.cc:515] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.934084  9193 leader_election.cc:290] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:49.920290  8823 raft_consensus.cc:2468] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:49.935637  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b41045f959459f885308feb894963c" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:49.936977  8865 leader_election.cc:304] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:49.939282  9095 consensus_queue.cc:260] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.941016  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:49.942549  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b41045f959459f885308feb894963c" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:49.948791  9093 tablet_bootstrap.cc:492] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:49.951807  8823 raft_consensus.cc:2393] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6a0de662d36410c907287e73cb2e4db in current term 1: Already voted for candidate 245d19d5c71647a9857ac68df13802d5 in this term.
I20260709 13:03:49.952930  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:49.955896  9095 ts_tablet_manager.cc:1434] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.003s
I20260709 13:03:49.957155  9095 tablet_bootstrap.cc:492] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:49.957378  9093 ts_tablet_manager.cc:1403] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.113s	user 0.014s	sys 0.006s
I20260709 13:03:49.954619  9045 raft_consensus.cc:2468] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:49.954210  9126 leader_election.cc:290] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:49.962287  9170 raft_consensus.cc:493] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.962769  9170 raft_consensus.cc:515] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:49.964814  9170 leader_election.cc:290] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:49.965096  9133 raft_consensus.cc:2749] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:49.966403  9013 leader_election.cc:304] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:49.967197  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d979f18121e6477a8261596acbc4f58a" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:49.967568  9192 consensus_queue.cc:1048] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:49.968376  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d979f18121e6477a8261596acbc4f58a" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:49.968917  9192 raft_consensus.cc:3060] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:49.971297  8939 leader_election.cc:343] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.971577  9199 consensus_queue.cc:1048] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:49.972012  8939 leader_election.cc:343] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.972409  8939 leader_election.cc:304] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:49.972429  8790 leader_election.cc:304] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:49.980422  9170 raft_consensus.cc:2749] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:49.995986  9249 raft_consensus.cc:2804] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:49.996419  9249 raft_consensus.cc:493] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.996748  9249 raft_consensus.cc:3060] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:49.991904  9248 raft_consensus.cc:2804] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.015259  9093 raft_consensus.cc:359] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.016249  9093 raft_consensus.cc:385] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.016597  9093 raft_consensus.cc:740] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.017493  9093 consensus_queue.cc:260] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.008742  9184 raft_consensus.cc:493] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.020203  9184 raft_consensus.cc:515] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.010634  9248 raft_consensus.cc:493] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.021149  9248 raft_consensus.cc:3060] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.021507  9093 ts_tablet_manager.cc:1434] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.001s
I20260709 13:03:50.024025  9184 leader_election.cc:290] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:50.024745  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fad6c9b1a1948c6a7135330c5ed070b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:50.025310  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fad6c9b1a1948c6a7135330c5ed070b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:50.027489  8791 leader_election.cc:343] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:50.028221  8788 leader_election.cc:343] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.028673  8788 leader_election.cc:304] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:50.029968  9189 raft_consensus.cc:2749] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.031147  9192 raft_consensus.cc:2749] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.035604  9095 tablet_bootstrap.cc:654] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.040915  9092 tablet_bootstrap.cc:654] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.050429  9094 tablet_bootstrap.cc:492] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:50.051293  9094 ts_tablet_manager.cc:1403] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.270s	user 0.012s	sys 0.016s
I20260709 13:03:50.054191  9093 tablet_bootstrap.cc:492] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:50.063501  9094 raft_consensus.cc:359] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.064342  9094 raft_consensus.cc:385] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.064620  9094 raft_consensus.cc:740] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.067037  9249 raft_consensus.cc:515] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.071650  9249 leader_election.cc:290] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:50.072918  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:50.076345  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:50.077009  9048 raft_consensus.cc:3060] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.084106  9192 consensus_queue.cc:1048] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.084455  9094 consensus_queue.cc:260] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.084012  9095 tablet_bootstrap.cc:492] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:50.085723  9095 ts_tablet_manager.cc:1403] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.018s
I20260709 13:03:50.097539  9253 consensus_queue.cc:1048] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.100427  9048 raft_consensus.cc:2468] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:50.105032  9093 tablet_bootstrap.cc:654] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.109771  9095 raft_consensus.cc:359] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.110702  9095 raft_consensus.cc:385] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.110965  9095 raft_consensus.cc:740] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.111865  9141 raft_consensus.cc:493] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.112592  9141 raft_consensus.cc:515] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.112001  9248 raft_consensus.cc:515] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.115506  9141 leader_election.cc:290] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:50.115751  8790 leader_election.cc:304] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:50.116664  9189 raft_consensus.cc:2804] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.117148  8899 raft_consensus.cc:2393] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c955bfd0b9541f9860c5f84cb255b90 in current term 1: Already voted for candidate 60a19ab523e3468bb9aacada2c24362c in this term.
I20260709 13:03:50.117187  9189 raft_consensus.cc:697] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:50.118516  9189 consensus_queue.cc:237] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.119769  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:50.117494  9248 leader_election.cc:290] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:50.122198  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
W20260709 13:03:50.123785  8788 leader_election.cc:343] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.125468  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:50.126276  9046 raft_consensus.cc:2393] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 60a19ab523e3468bb9aacada2c24362c in current term 1: Already voted for candidate 0c955bfd0b9541f9860c5f84cb255b90 in this term.
I20260709 13:03:50.129168  9202 consensus_queue.cc:1048] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.131984  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:50.132525  8865 leader_election.cc:304] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:50.134132  9203 consensus_queue.cc:1048] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:50.135797  9248 raft_consensus.cc:2749] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.142251  9203 consensus_queue.cc:1048] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.132666  9048 raft_consensus.cc:2468] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:50.148231  8790 leader_election.cc:304] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 60a19ab523e3468bb9aacada2c24362c
W20260709 13:03:50.149598  9014 consensus_peers.cc:597] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db -> Peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Couldn't send request to peer 245d19d5c71647a9857ac68df13802d5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.149822  9141 raft_consensus.cc:2804] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.150389  9141 raft_consensus.cc:493] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.150802  9141 raft_consensus.cc:3060] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.164264  9141 raft_consensus.cc:515] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.165889  9248 consensus_queue.cc:1048] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:50.166916  9095 consensus_queue.cc:260] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.165019  9094 ts_tablet_manager.cc:1434] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.000s
I20260709 13:03:50.178785  9094 tablet_bootstrap.cc:492] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:50.184957  9141 leader_election.cc:290] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:50.188589  9094 tablet_bootstrap.cc:654] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.188866  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
W20260709 13:03:50.190235  8788 leader_election.cc:343] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:50.191306  9013 consensus_peers.cc:597] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.200311  9133 consensus_queue.cc:1048] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:50.200182  9092 tablet_bootstrap.cc:492] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:50.203547  9092 ts_tablet_manager.cc:1403] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.310s	user 0.021s	sys 0.013s
I20260709 13:03:50.206303  9092 raft_consensus.cc:359] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.206923  9092 raft_consensus.cc:385] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.207167  9092 raft_consensus.cc:740] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.203466  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:50.207895  9048 raft_consensus.cc:3060] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.208114  9092 consensus_queue.cc:260] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.210238  9092 ts_tablet_manager.cc:1434] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:50.211150  9092 tablet_bootstrap.cc:492] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:50.217190  9092 tablet_bootstrap.cc:654] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:50.227679  8865 consensus_peers.cc:597] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c -> Peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Couldn't send request to peer a6a0de662d36410c907287e73cb2e4db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.229809  9048 raft_consensus.cc:2468] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:50.230952  8790 leader_election.cc:304] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:50.231518  9092 tablet_bootstrap.cc:492] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:50.232048  9092 ts_tablet_manager.cc:1403] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.002s
I20260709 13:03:50.232124  9141 raft_consensus.cc:2804] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.232730  9141 raft_consensus.cc:697] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:50.233564  9141 consensus_queue.cc:237] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.238087  9203 consensus_queue.cc:1048] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:50.245105  9095 ts_tablet_manager.cc:1434] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.159s	user 0.006s	sys 0.000s
I20260709 13:03:50.245178  8719 catalog_manager.cc:5697] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.246649  9095 tablet_bootstrap.cc:492] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:50.244879  9092 raft_consensus.cc:359] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.247615  9092 raft_consensus.cc:385] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.248540  9092 raft_consensus.cc:740] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.250244  9092 consensus_queue.cc:260] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.255999  9092 ts_tablet_manager.cc:1434] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:03:50.257638  9092 tablet_bootstrap.cc:492] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
W20260709 13:03:50.255992  9260 log.cc:927] Time spent T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:03:50.272452  9092 tablet_bootstrap.cc:654] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.285909  9095 tablet_bootstrap.cc:654] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.295773  8721 catalog_manager.cc:5697] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.299729  9093 tablet_bootstrap.cc:492] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:50.300449  9093 ts_tablet_manager.cc:1403] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.246s	user 0.011s	sys 0.004s
I20260709 13:03:50.304349  9100 raft_consensus.cc:493] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.304849  9100 raft_consensus.cc:515] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.305774  9095 tablet_bootstrap.cc:492] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:50.306245  9095 ts_tablet_manager.cc:1403] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.008s
I20260709 13:03:50.306903  9100 leader_election.cc:290] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:50.307945  9093 raft_consensus.cc:359] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.308821  9095 raft_consensus.cc:359] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.309506  9095 raft_consensus.cc:385] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.309775  9095 raft_consensus.cc:740] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.310492  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a27cc447a248368bcf0475b54f0b3d" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:50.310809  9095 consensus_queue.cc:260] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.311239  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a27cc447a248368bcf0475b54f0b3d" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:50.311461  8825 raft_consensus.cc:2468] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
W20260709 13:03:50.312510  8866 leader_election.cc:343] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.313027  8865 leader_election.cc:304] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:50.313230  9095 ts_tablet_manager.cc:1434] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:50.313838  9100 raft_consensus.cc:2804] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.308843  9093 raft_consensus.cc:385] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.314324  9095 tablet_bootstrap.cc:492] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:50.314244  9100 raft_consensus.cc:493] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.315115  9100 raft_consensus.cc:3060] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.316435  9094 tablet_bootstrap.cc:492] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:50.316890  9094 ts_tablet_manager.cc:1403] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.138s	user 0.026s	sys 0.048s
I20260709 13:03:50.319523  9094 raft_consensus.cc:359] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.320161  9094 raft_consensus.cc:385] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.320438  9094 raft_consensus.cc:740] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.314786  9093 raft_consensus.cc:740] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.321517  9095 tablet_bootstrap.cc:654] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.321671  9093 consensus_queue.cc:260] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.323769  9093 ts_tablet_manager.cc:1434] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 13:03:50.324436  9093 tablet_bootstrap.cc:492] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:50.327458  9100 raft_consensus.cc:515] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.330854  9093 tablet_bootstrap.cc:654] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.329700  9092 tablet_bootstrap.cc:492] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:50.331619  9092 ts_tablet_manager.cc:1403] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.074s	user 0.024s	sys 0.018s
I20260709 13:03:50.331645  9094 consensus_queue.cc:260] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.333952  9094 ts_tablet_manager.cc:1434] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:03:50.334852  9094 tablet_bootstrap.cc:492] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:50.337024  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a27cc447a248368bcf0475b54f0b3d" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:50.337883  8825 raft_consensus.cc:3060] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.341302  9094 tablet_bootstrap.cc:654] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.349449  8825 raft_consensus.cc:2468] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:03:50.352799  8865 leader_election.cc:304] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:50.350543  9092 raft_consensus.cc:359] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.354125  9172 raft_consensus.cc:2804] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.354256  9092 raft_consensus.cc:385] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.351647  9100 leader_election.cc:290] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:50.354687  9172 raft_consensus.cc:697] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:03:50.354701  9092 raft_consensus.cc:740] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.355641  9172 consensus_queue.cc:237] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.356133  9092 consensus_queue.cc:260] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.358829  9092 ts_tablet_manager.cc:1434] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:03:50.360185  9092 tablet_bootstrap.cc:492] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:50.361653  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a27cc447a248368bcf0475b54f0b3d" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
W20260709 13:03:50.363575  8866 leader_election.cc:343] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.372628  9092 tablet_bootstrap.cc:654] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.384593  9092 tablet_bootstrap.cc:492] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:50.385284  9092 ts_tablet_manager.cc:1403] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.003s
I20260709 13:03:50.389309  9092 raft_consensus.cc:359] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.390295  9092 raft_consensus.cc:385] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.390717  9092 raft_consensus.cc:740] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.391810  9092 consensus_queue.cc:260] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.395025  9092 ts_tablet_manager.cc:1434] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:03:50.396324  9092 tablet_bootstrap.cc:492] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:50.402048  9092 tablet_bootstrap.cc:654] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.402464  8721 catalog_manager.cc:5697] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 0 to 1, leader changed from <none> to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.412998  9092 tablet_bootstrap.cc:492] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:50.413479  9092 ts_tablet_manager.cc:1403] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 13:03:50.417795  9092 raft_consensus.cc:359] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.418823  9092 raft_consensus.cc:385] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.419214  9092 raft_consensus.cc:740] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.420970  9172 raft_consensus.cc:493] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.421924  9172 raft_consensus.cc:515] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.421931  9093 tablet_bootstrap.cc:492] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:50.424057  9093 ts_tablet_manager.cc:1403] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.100s	user 0.024s	sys 0.014s
I20260709 13:03:50.426051  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fad6c9b1a1948c6a7135330c5ed070b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:50.427448  8825 raft_consensus.cc:2468] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:50.427664  9093 raft_consensus.cc:359] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:50.428583  9093 raft_consensus.cc:385] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.428915  9093 raft_consensus.cc:740] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.429092  8865 leader_election.cc:304] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:50.429818  9093 consensus_queue.cc:260] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:50.430301  9100 raft_consensus.cc:2804] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.430765  9100 raft_consensus.cc:493] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.431085  9100 raft_consensus.cc:3060] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.423363  9094 tablet_bootstrap.cc:492] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:50.431885  9094 ts_tablet_manager.cc:1403] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.097s	user 0.024s	sys 0.012s
I20260709 13:03:50.435047  9094 raft_consensus.cc:359] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:50.435840  9094 raft_consensus.cc:385] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.436113  9094 raft_consensus.cc:740] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.436898  9094 consensus_queue.cc:260] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:50.437646  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fad6c9b1a1948c6a7135330c5ed070b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:50.439777  8866 leader_election.cc:343] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.441381  9192 raft_consensus.cc:493] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.442102  9192 raft_consensus.cc:515] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:50.446246  9095 tablet_bootstrap.cc:492] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:50.446807  9095 ts_tablet_manager.cc:1403] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.133s	user 0.039s	sys 0.055s
I20260709 13:03:50.447546  9172 leader_election.cc:290] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:50.420303  9092 consensus_queue.cc:260] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.448457  9100 raft_consensus.cc:515] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.451216  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fad6c9b1a1948c6a7135330c5ed070b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:50.452533  9092 ts_tablet_manager.cc:1434] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:03:50.452315  9093 ts_tablet_manager.cc:1434] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:03:50.455446  8823 raft_consensus.cc:3060] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.456741  9092 tablet_bootstrap.cc:492] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:50.457165  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:50.451325  9095 raft_consensus.cc:359] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.457957  9095 raft_consensus.cc:385] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.458245  9095 raft_consensus.cc:740] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.458485  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:50.458931  9095 consensus_queue.cc:260] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
W20260709 13:03:50.459641  9014 leader_election.cc:343] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.460393  9192 leader_election.cc:290] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:50.461295  9095 ts_tablet_manager.cc:1434] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:03:50.453210  9094 ts_tablet_manager.cc:1434] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
W20260709 13:03:50.461756  9013 leader_election.cc:343] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.457175  9093 tablet_bootstrap.cc:492] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:50.462527  9094 tablet_bootstrap.cc:492] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:50.464325  9092 tablet_bootstrap.cc:654] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.470142  9094 tablet_bootstrap.cc:654] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.474402  9170 raft_consensus.cc:493] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.476020  9092 tablet_bootstrap.cc:492] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:50.476594  9092 ts_tablet_manager.cc:1403] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.001s
I20260709 13:03:50.478591  9095 tablet_bootstrap.cc:492] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:50.474916  9170 raft_consensus.cc:515] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.479470  9092 raft_consensus.cc:359] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.480270  9092 raft_consensus.cc:385] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.480592  9092 raft_consensus.cc:740] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.481190  9170 leader_election.cc:290] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:50.481451  9093 tablet_bootstrap.cc:654] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.481453  9172 raft_consensus.cc:493] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.482218  9172 raft_consensus.cc:515] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.482795  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefe5d3d0a64ae087a329b7c032225a" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:50.483431  8899 raft_consensus.cc:2468] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 0.
I20260709 13:03:50.484159  9172 leader_election.cc:290] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:50.485044  8937 leader_election.cc:304] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:50.485345  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefe5d3d0a64ae087a329b7c032225a" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:50.485968  9048 raft_consensus.cc:2468] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 0.
I20260709 13:03:50.487129  9095 tablet_bootstrap.cc:654] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.488230  9092 consensus_queue.cc:260] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.490310  9092 ts_tablet_manager.cc:1434] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:03:50.490603  9189 raft_consensus.cc:493] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.491333  9092 tablet_bootstrap.cc:492] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:50.491072  9189 raft_consensus.cc:515] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.493170  9189 leader_election.cc:290] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:50.496306  9095 tablet_bootstrap.cc:492] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:50.496785  9095 ts_tablet_manager.cc:1403] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 13:03:50.497707  9094 tablet_bootstrap.cc:492] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:50.498144  9094 ts_tablet_manager.cc:1403] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.009s
I20260709 13:03:50.498857  9092 tablet_bootstrap.cc:654] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.499372  9095 raft_consensus.cc:359] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.500061  9095 raft_consensus.cc:385] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.500317  9095 raft_consensus.cc:740] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.500682  9094 raft_consensus.cc:359] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:50.500965  9095 consensus_queue.cc:260] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.501330  9094 raft_consensus.cc:385] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.501678  9094 raft_consensus.cc:740] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.502285  9094 consensus_queue.cc:260] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:50.503070  9095 ts_tablet_manager.cc:1434] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:50.503509  9133 raft_consensus.cc:2804] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.504045  9133 raft_consensus.cc:493] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.504437  9133 raft_consensus.cc:3060] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.505244  9094 ts_tablet_manager.cc:1434] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:03:50.506924  9094 tablet_bootstrap.cc:492] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:50.508875  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8666482fd746c1bc9d0c3c1bc30613" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:50.512336  9095 tablet_bootstrap.cc:492] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:50.513271  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:50.514909  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8666482fd746c1bc9d0c3c1bc30613" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:50.513047  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:50.516155  9048 raft_consensus.cc:2393] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 60a19ab523e3468bb9aacada2c24362c in current term 1: Already voted for candidate 0c955bfd0b9541f9860c5f84cb255b90 in this term.
W20260709 13:03:50.516304  8788 leader_election.cc:343] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.463824  9013 leader_election.cc:304] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:50.535760  9192 raft_consensus.cc:2749] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.561659  9094 tablet_bootstrap.cc:654] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:50.564340  9013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 104345us
I20260709 13:03:50.565383  9192 raft_consensus.cc:493] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.565754  9092 tablet_bootstrap.cc:492] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:50.565860  9192 raft_consensus.cc:515] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.566493  9092 ts_tablet_manager.cc:1403] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.003s
I20260709 13:03:50.561692  9095 tablet_bootstrap.cc:654] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.569445  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977d385d3eeb49a799b9c161940c175a" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:50.569703  9092 raft_consensus.cc:359] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.570389  9092 raft_consensus.cc:385] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.570674  9092 raft_consensus.cc:740] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.571336  9092 consensus_queue.cc:260] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.572124  9192 leader_election.cc:290] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:50.572749  9141 raft_consensus.cc:493] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.573593  9092 ts_tablet_manager.cc:1434] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:50.573262  9141 raft_consensus.cc:515] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.574520  9092 tablet_bootstrap.cc:492] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:50.574661  9094 tablet_bootstrap.cc:492] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:50.575260  9094 ts_tablet_manager.cc:1403] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.069s	user 0.031s	sys 0.017s
I20260709 13:03:50.578222  8865 leader_election.cc:304] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:50.578500  9094 raft_consensus.cc:359] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.579276  9172 raft_consensus.cc:3060] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.579363  9094 raft_consensus.cc:385] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.581360  9092 tablet_bootstrap.cc:654] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.581295  9094 raft_consensus.cc:740] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.582305  9095 tablet_bootstrap.cc:492] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:50.582123  9094 consensus_queue.cc:260] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.583089  9095 ts_tablet_manager.cc:1403] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.018s
I20260709 13:03:50.585651  9094 ts_tablet_manager.cc:1434] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:03:50.587145  9095 raft_consensus.cc:359] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.587805  9095 raft_consensus.cc:385] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.588027  9095 raft_consensus.cc:740] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.588567  9095 consensus_queue.cc:260] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.590581  9095 ts_tablet_manager.cc:1434] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:03:50.592800  9092 tablet_bootstrap.cc:492] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:50.593451  9092 ts_tablet_manager.cc:1403] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
W20260709 13:03:50.597227  8790 leader_election.cc:343] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.591420  9095 tablet_bootstrap.cc:492] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:50.597766  8790 leader_election.cc:304] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:50.602370  9249 raft_consensus.cc:2749] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.609103  9094 tablet_bootstrap.cc:492] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:50.614127  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977d385d3eeb49a799b9c161940c175a" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:50.616453  9141 leader_election.cc:290] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:50.618747  9253 raft_consensus.cc:493] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.619310  9092 raft_consensus.cc:359] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.620606  9253 raft_consensus.cc:515] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.622548  9094 tablet_bootstrap.cc:654] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.625469  9253 leader_election.cc:290] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:50.626504  9092 raft_consensus.cc:385] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.626963  9092 raft_consensus.cc:740] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.614527  9170 raft_consensus.cc:493] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.628334  9092 consensus_queue.cc:260] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.629079  9170 raft_consensus.cc:515] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.633790  9172 raft_consensus.cc:2749] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.634842  9133 raft_consensus.cc:515] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.635332  9014 leader_election.cc:304] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:50.636945  9133 leader_election.cc:290] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:50.637037  9092 ts_tablet_manager.cc:1434] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 13:03:50.638841  9092 tablet_bootstrap.cc:492] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:50.639456  9192 raft_consensus.cc:2749] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.639801  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce2804142c04505bd469904f288178b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:50.638696  9170 leader_election.cc:290] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
W20260709 13:03:50.695914  8790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:45733, user_credentials={real_user=slave}} blocked reactor thread for 96625.7us
I20260709 13:03:50.704921  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a27cc447a248368bcf0475b54f0b3d" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:50.711172  8974 raft_consensus.cc:3060] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.712090  9093 tablet_bootstrap.cc:492] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:50.713366  9093 ts_tablet_manager.cc:1403] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.257s	user 0.038s	sys 0.056s
I20260709 13:03:50.716770  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a27cc447a248368bcf0475b54f0b3d" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:50.717792  9092 tablet_bootstrap.cc:654] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.718938  8897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce2804142c04505bd469904f288178b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:50.719770  9093 raft_consensus.cc:359] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:50.721431  9093 raft_consensus.cc:385] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.721971  9093 raft_consensus.cc:740] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.723742  9093 consensus_queue.cc:260] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:50.727276  9095 tablet_bootstrap.cc:654] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.728027  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefe5d3d0a64ae087a329b7c032225a" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:50.728936  9045 raft_consensus.cc:3060] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.736724  9171 raft_consensus.cc:493] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.737731  9171 raft_consensus.cc:515] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.742264  8825 raft_consensus.cc:2393] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate 60a19ab523e3468bb9aacada2c24362c in this term.
I20260709 13:03:50.750025  9094 tablet_bootstrap.cc:492] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:50.751119  9094 ts_tablet_manager.cc:1403] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.146s	user 0.008s	sys 0.015s
I20260709 13:03:50.751827  9189 consensus_queue.cc:1048] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:50.753094  9171 leader_election.cc:290] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:50.759696  9172 raft_consensus.cc:493] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:50.766297  8790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:45733, user_credentials={real_user=slave}} blocked reactor thread for 66883.7us
I20260709 13:03:50.731829  9100 leader_election.cc:290] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:50.719842  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0a76f1a2b45df971cecac7ccb46b3" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:50.767158  9172 raft_consensus.cc:515] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.772550  9095 tablet_bootstrap.cc:492] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:50.775480  9179 raft_consensus.cc:493] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.775712  9095 ts_tablet_manager.cc:1403] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.184s	user 0.016s	sys 0.010s
I20260709 13:03:50.776489  9179 raft_consensus.cc:515] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
W20260709 13:03:50.785633  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:33479, user_credentials={real_user=slave}} blocked reactor thread for 48687.1us
I20260709 13:03:50.787993  9095 raft_consensus.cc:359] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.789108  9095 raft_consensus.cc:385] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.789455  9095 raft_consensus.cc:740] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.791725  9192 raft_consensus.cc:493] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.792541  9192 raft_consensus.cc:515] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.800289  9179 leader_election.cc:290] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:50.800488  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76d0a76f1a2b45df971cecac7ccb46b3" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:50.795241  9192 leader_election.cc:290] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:50.733366  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebefe5d3d0a64ae087a329b7c032225a" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:50.815802  9141 consensus_queue.cc:1048] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:50.816915  8898 raft_consensus.cc:3060] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.818379  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa59e81ed8e4c0ca2890a10befbf996" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:50.818516  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa59e81ed8e4c0ca2890a10befbf996" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:50.819325  8899 raft_consensus.cc:2468] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:50.821082  9172 leader_election.cc:290] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:50.821384  9011 leader_election.cc:304] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:50.811283  9295 consensus_queue.cc:1048] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:03:50.822582  9192 raft_consensus.cc:2804] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.823341  9192 raft_consensus.cc:493] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:50.821934  8771 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:50.823889  9192 raft_consensus.cc:3060] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.826496  9095 consensus_queue.cc:260] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.822674  9289 raft_consensus.cc:493] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:50.832471  9014 leader_election.cc:343] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.838342  9095 ts_tablet_manager.cc:1434] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.001s
I20260709 13:03:50.840746  8823 raft_consensus.cc:2468] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:03:50.838526  9171 raft_consensus.cc:493] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.841449  9289 raft_consensus.cc:515] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:50.843750  9093 ts_tablet_manager.cc:1434] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.130s	user 0.024s	sys 0.040s
I20260709 13:03:50.845827  8822 raft_consensus.cc:3060] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.848826  8937 leader_election.cc:304] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:50.852797  9297 raft_consensus.cc:493] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.846714  9171 raft_consensus.cc:515] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.861167  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fad6c9b1a1948c6a7135330c5ed070b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:50.861676  9289 leader_election.cc:290] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:50.862814  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d979f18121e6477a8261596acbc4f58a" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:50.863369  9095 tablet_bootstrap.cc:492] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:50.863600  8972 raft_consensus.cc:3060] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.865159  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d979f18121e6477a8261596acbc4f58a" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:50.865675  8970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd20e59c4c5460cb2da30a82e188e4b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:50.867795  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8666482fd746c1bc9d0c3c1bc30613" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:50.887603  8824 raft_consensus.cc:2468] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:50.868075  8969 raft_consensus.cc:3060] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.889701  9171 leader_election.cc:290] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:50.890172  9203 raft_consensus.cc:493] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.891822  8973 raft_consensus.cc:2468] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:50.892977  9093 tablet_bootstrap.cc:492] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:50.893298  9092 tablet_bootstrap.cc:492] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:50.868950  9094 raft_consensus.cc:359] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:50.893814  9094 raft_consensus.cc:385] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.893975  9092 ts_tablet_manager.cc:1403] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.256s	user 0.016s	sys 0.025s
I20260709 13:03:50.894179  9094 raft_consensus.cc:740] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.895089  9094 consensus_queue.cc:260] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:50.895928  8791 leader_election.cc:304] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:50.896934  9094 ts_tablet_manager.cc:1434] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.000s
I20260709 13:03:50.869885  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd20e59c4c5460cb2da30a82e188e4b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:50.897842  8823 raft_consensus.cc:2468] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:50.897989  9092 raft_consensus.cc:359] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.898973  9092 raft_consensus.cc:385] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.884766  8971 raft_consensus.cc:3060] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.899833  9092 raft_consensus.cc:740] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.901163  9092 consensus_queue.cc:260] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.903808  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7455286aa620402d980c0923537d619a" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:50.877552  9045 raft_consensus.cc:2468] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:03:50.905336  8970 raft_consensus.cc:2468] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:50.898800  9295 raft_consensus.cc:2804] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.907840  9295 raft_consensus.cc:493] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.908257  9295 raft_consensus.cc:3060] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.908648  8939 leader_election.cc:304] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:50.909399  9047 raft_consensus.cc:2468] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:50.910352  9092 ts_tablet_manager.cc:1434] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:03:50.912225  9092 tablet_bootstrap.cc:492] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:50.890864  9203 raft_consensus.cc:515] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:50.914412  8866 leader_election.cc:304] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:50.930056  9248 raft_consensus.cc:493] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.930346  9294 raft_consensus.cc:2804] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.930830  9294 raft_consensus.cc:493] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.931021  9248 raft_consensus.cc:515] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:50.933130  9171 raft_consensus.cc:2804] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.933692  9171 raft_consensus.cc:697] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:03:50.934098  9248 leader_election.cc:290] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
W20260709 13:03:50.922745  8788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 65990.6us
I20260709 13:03:50.931205  9294 raft_consensus.cc:3060] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.934864  9171 consensus_queue.cc:237] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:50.924383  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8666482fd746c1bc9d0c3c1bc30613" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:50.942253  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0986587761fb4f0387746bee54af0e5b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:50.921928  9297 raft_consensus.cc:515] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.964644  9092 tablet_bootstrap.cc:654] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.968029  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0986587761fb4f0387746bee54af0e5b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:50.968866  8825 raft_consensus.cc:2468] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:50.973698  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd20e59c4c5460cb2da30a82e188e4b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:50.976394  8824 raft_consensus.cc:2468] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 0.
I20260709 13:03:50.977186  9013 leader_election.cc:304] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:50.978911  9190 raft_consensus.cc:2804] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.979346  9190 raft_consensus.cc:493] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.979707  9190 raft_consensus.cc:3060] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.980125  9248 raft_consensus.cc:493] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.980603  9248 raft_consensus.cc:515] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:50.983503  8939 leader_election.cc:304] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:50.983990  8970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598391aa086d4cd684b11636fb4c788b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:50.964532  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7455286aa620402d980c0923537d619a" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
W20260709 13:03:50.985689  8866 leader_election.cc:343] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.957520  9203 leader_election.cc:290] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:50.965118  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd20e59c4c5460cb2da30a82e188e4b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:50.997833  9094 tablet_bootstrap.cc:492] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:50.998651  9170 raft_consensus.cc:2749] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.999204  8865 leader_election.cc:304] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:51.000098  8788 leader_election.cc:304] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:51.000468  8865 leader_election.cc:304] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:51.001605  9179 raft_consensus.cc:2804] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.002106  9179 raft_consensus.cc:697] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:03:51.003320  9172 raft_consensus.cc:2804] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.003105  9179 consensus_queue.cc:237] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.003938  9172 raft_consensus.cc:493] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.004401  9172 raft_consensus.cc:3060] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.009384  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598391aa086d4cd684b11636fb4c788b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:50.988397  9248 leader_election.cc:290] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:51.020176  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:51.021371  8823 raft_consensus.cc:2468] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:51.026064  9295 raft_consensus.cc:515] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.039105  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d979f18121e6477a8261596acbc4f58a" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:51.040211  8974 raft_consensus.cc:3060] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.044550  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:51.050225  9043 raft_consensus.cc:3060] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.053186  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d979f18121e6477a8261596acbc4f58a" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:51.054117  9044 raft_consensus.cc:3060] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.013082  8973 raft_consensus.cc:2468] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:51.057075  9295 leader_election.cc:290] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:51.042495  9294 raft_consensus.cc:515] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.072598  9289 raft_consensus.cc:2749] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.083202  8899 raft_consensus.cc:2393] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate 60a19ab523e3468bb9aacada2c24362c in this term.
I20260709 13:03:51.083545  9253 raft_consensus.cc:2749] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.094187  9179 consensus_queue.cc:1048] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.095530  8898 raft_consensus.cc:2468] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:03:51.089848  8971 raft_consensus.cc:2468] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:03:51.108217  9093 tablet_bootstrap.cc:654] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:51.101468  8939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 97285.6us
I20260709 13:03:51.109319  8939 leader_election.cc:304] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:51.110255  9170 raft_consensus.cc:2804] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.110607  9170 raft_consensus.cc:493] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.110924  9170 raft_consensus.cc:3060] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.119294  9092 tablet_bootstrap.cc:492] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:51.120165  8939 leader_election.cc:304] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:51.120294  9092 ts_tablet_manager.cc:1403] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.208s	user 0.021s	sys 0.007s
I20260709 13:03:51.126005  9092 raft_consensus.cc:359] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.129117  9092 raft_consensus.cc:385] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:51.102542  9301 log.cc:927] Time spent T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:03:51.131778  9095 tablet_bootstrap.cc:654] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.131726  9297 leader_election.cc:290] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:51.081153  9190 raft_consensus.cc:515] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.133590  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2b10a48f9d4bd0988ff98f6bf66e66" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:51.153736  9190 leader_election.cc:290] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
W20260709 13:03:51.154557  8866 leader_election.cc:343] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.155362  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0986587761fb4f0387746bee54af0e5b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:51.151877  9092 raft_consensus.cc:740] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.157146  9092 consensus_queue.cc:260] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.121417  9170 raft_consensus.cc:515] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.156054  8824 raft_consensus.cc:3060] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.161398  9092 ts_tablet_manager.cc:1434] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260709 13:03:51.165278  9297 raft_consensus.cc:493] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.166018  9297 raft_consensus.cc:515] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.169694  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec23c2e3be3416a84d3d12becfa90fa" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:51.144531  9192 raft_consensus.cc:515] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.172174  9092 tablet_bootstrap.cc:492] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
W20260709 13:03:51.171303  8866 leader_election.cc:343] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.174360  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd20e59c4c5460cb2da30a82e188e4b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:51.184803  9094 tablet_bootstrap.cc:654] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.174571  9170 leader_election.cc:290] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:51.194393  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd20e59c4c5460cb2da30a82e188e4b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:51.194796  8898 raft_consensus.cc:2393] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate 60a19ab523e3468bb9aacada2c24362c in this term.
I20260709 13:03:51.195124  8822 raft_consensus.cc:3060] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:51.188107  8865 leader_election.cc:343] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.188939  8974 raft_consensus.cc:2468] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:51.193324  9172 raft_consensus.cc:515] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.212555  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0986587761fb4f0387746bee54af0e5b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:51.212648  8791 leader_election.cc:304] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:51.213300  8971 raft_consensus.cc:3060] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.215022  9249 raft_consensus.cc:2804] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.209256  9253 raft_consensus.cc:2749] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.215610  9249 raft_consensus.cc:697] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:51.218925  9249 consensus_queue.cc:237] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.236922  9095 tablet_bootstrap.cc:492] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:51.237567  9095 ts_tablet_manager.cc:1403] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.375s	user 0.010s	sys 0.019s
I20260709 13:03:51.218925  9192 leader_election.cc:290] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
W20260709 13:03:51.220429  8865 leader_election.cc:343] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.225936  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa59e81ed8e4c0ca2890a10befbf996" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:51.232192  8970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa59e81ed8e4c0ca2890a10befbf996" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:51.228200  9297 leader_election.cc:290] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:51.246142  9092 tablet_bootstrap.cc:654] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.230576  8971 raft_consensus.cc:2468] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:51.222525  9044 raft_consensus.cc:2468] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:51.258448  9172 leader_election.cc:290] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:51.259859  9294 leader_election.cc:290] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:51.249358  8898 raft_consensus.cc:3060] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.277279  9093 tablet_bootstrap.cc:492] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:51.277935  9093 ts_tablet_manager.cc:1403] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.385s	user 0.016s	sys 0.010s
I20260709 13:03:51.273468  8972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd20e59c4c5460cb2da30a82e188e4b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:51.281672  8822 raft_consensus.cc:2468] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:03:51.272295  9014 leader_election.cc:304] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:51.302032  9192 raft_consensus.cc:2804] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.298861  8972 raft_consensus.cc:2393] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 60a19ab523e3468bb9aacada2c24362c in current term 1: Already voted for candidate 245d19d5c71647a9857ac68df13802d5 in this term.
I20260709 13:03:51.305101  9192 raft_consensus.cc:697] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:51.307202  9093 raft_consensus.cc:359] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.308013  9093 raft_consensus.cc:385] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.308455  9093 raft_consensus.cc:740] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.311319  9093 consensus_queue.cc:260] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.314522  9094 tablet_bootstrap.cc:492] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:51.315198  9094 ts_tablet_manager.cc:1403] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.339s	user 0.013s	sys 0.015s
I20260709 13:03:51.307060  9192 consensus_queue.cc:237] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.317899  9092 tablet_bootstrap.cc:492] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:51.318432  9092 ts_tablet_manager.cc:1403] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.155s	user 0.010s	sys 0.023s
I20260709 13:03:51.300377  8939 leader_election.cc:304] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:51.333312  9092 raft_consensus.cc:359] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.334503  9092 raft_consensus.cc:385] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.322372  9171 raft_consensus.cc:2804] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.334892  8824 raft_consensus.cc:2468] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:51.336370  9092 raft_consensus.cc:740] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.341374  9171 raft_consensus.cc:697] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:03:51.341069  9092 consensus_queue.cc:260] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.342386  9171 consensus_queue.cc:237] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.344781  9092 ts_tablet_manager.cc:1434] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.003s
I20260709 13:03:51.347328  9092 tablet_bootstrap.cc:492] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
W20260709 13:03:51.348793  9014 leader_election.cc:343] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:51.348351  8865 leader_election.cc:343] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.348945  9295 consensus_queue.cc:1048] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.349406  8865 leader_election.cc:304] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:51.350880  8865 leader_election.cc:304] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:51.351577  9093 ts_tablet_manager.cc:1434] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:03:51.352658  9093 tablet_bootstrap.cc:492] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:51.353384  8823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd20e59c4c5460cb2da30a82e188e4b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:51.354187  8823 raft_consensus.cc:2393] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 60a19ab523e3468bb9aacada2c24362c in current term 1: Already voted for candidate 245d19d5c71647a9857ac68df13802d5 in this term.
I20260709 13:03:51.356148  8821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8666482fd746c1bc9d0c3c1bc30613" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:51.356777  8821 raft_consensus.cc:3060] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.360142  9092 tablet_bootstrap.cc:654] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.359251  8717 catalog_manager.cc:5697] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 0 to 1, leader changed from <none> to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.360780  9294 raft_consensus.cc:2749] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.361411  9294 raft_consensus.cc:2804] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.361707  9294 raft_consensus.cc:493] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.362048  9294 raft_consensus.cc:3060] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.366500  9094 raft_consensus.cc:359] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.367208  9094 raft_consensus.cc:385] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.360602  9095 raft_consensus.cc:359] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.370543  9095 raft_consensus.cc:385] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.368412  9094 raft_consensus.cc:740] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.370895  9095 raft_consensus.cc:740] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.394198  8721 catalog_manager.cc:5697] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:51.395953  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2b10a48f9d4bd0988ff98f6bf66e66" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:51.400822  9094 consensus_queue.cc:260] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.405917  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec23c2e3be3416a84d3d12becfa90fa" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:51.409773  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b8666482fd746c1bc9d0c3c1bc30613" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:51.378743  8898 raft_consensus.cc:2468] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:51.412690  9095 consensus_queue.cc:260] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.370005  8865 leader_election.cc:304] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:51.423866  9248 raft_consensus.cc:2749] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.427981  9172 consensus_queue.cc:1048] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:51.423784  8865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 53900.2us
I20260709 13:03:51.432097  9095 ts_tablet_manager.cc:1434] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.193s	user 0.006s	sys 0.002s
I20260709 13:03:51.433153  9095 tablet_bootstrap.cc:492] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
W20260709 13:03:51.435274  8865 leader_election.cc:343] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.408792  8822 raft_consensus.cc:2468] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:51.422864  8821 raft_consensus.cc:2468] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:03:51.437321  9093 tablet_bootstrap.cc:654] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.441979  9094 ts_tablet_manager.cc:1434] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.126s	user 0.007s	sys 0.000s
I20260709 13:03:51.438158  8865 leader_election.cc:304] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:51.447573  9011 leader_election.cc:304] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:51.451862  9172 raft_consensus.cc:2749] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:51.453406  8865 leader_election.cc:343] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.453918  9192 raft_consensus.cc:2804] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.454769  9192 raft_consensus.cc:697] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:51.455905  9094 tablet_bootstrap.cc:492] T 5b8666482fd746c1bc9d0c3c1bc30613 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:51.455788  9192 consensus_queue.cc:237] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.457203  9172 consensus_queue.cc:1048] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.457360  8865 leader_election.cc:304] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:51.458570  9190 raft_consensus.cc:493] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.464448  9190 raft_consensus.cc:515] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.467005  9190 leader_election.cc:290] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:51.445429  9294 raft_consensus.cc:515] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.467658  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:51.468392  8822 raft_consensus.cc:2468] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:51.468787  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:51.471048  8898 raft_consensus.cc:2393] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6a0de662d36410c907287e73cb2e4db in current term 1: Already voted for candidate 60a19ab523e3468bb9aacada2c24362c in this term.
I20260709 13:03:51.461169  9092 tablet_bootstrap.cc:492] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:51.469830  9013 leader_election.cc:304] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:51.469231  9294 leader_election.cc:290] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:51.474763  9172 raft_consensus.cc:2804] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.475965  8865 leader_election.cc:304] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:51.486462  9172 raft_consensus.cc:493] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.480782  9202 raft_consensus.cc:2804] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.487620  9202 raft_consensus.cc:493] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.487141  9172 raft_consensus.cc:3060] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.488260  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:51.488137  9202 raft_consensus.cc:3060] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.491441  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:51.492103  8824 raft_consensus.cc:3060] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.483743  9094 tablet_bootstrap.cc:654] T 5b8666482fd746c1bc9d0c3c1bc30613 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.477252  9092 ts_tablet_manager.cc:1403] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.130s	user 0.017s	sys 0.006s
I20260709 13:03:51.487149  9308 raft_consensus.cc:2804] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.501262  9171 consensus_queue.cc:1048] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.504520  9308 raft_consensus.cc:697] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:03:51.506774  9308 consensus_queue.cc:237] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.512125  9092 raft_consensus.cc:359] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.514410  9092 raft_consensus.cc:385] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.514755  9092 raft_consensus.cc:740] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.515692  9092 consensus_queue.cc:260] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.518887  9092 ts_tablet_manager.cc:1434] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:03:51.513585  9202 raft_consensus.cc:515] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.533915  9171 consensus_queue.cc:1048] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:51.555311  9095 tablet_bootstrap.cc:654] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.560604  8824 raft_consensus.cc:2468] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:03:51.585357  9046 raft_consensus.cc:2393] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 60a19ab523e3468bb9aacada2c24362c in current term 1: Already voted for candidate a6a0de662d36410c907287e73cb2e4db in this term.
I20260709 13:03:51.591943  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:51.592780  8822 raft_consensus.cc:2393] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a6a0de662d36410c907287e73cb2e4db in current term 1: Already voted for candidate 60a19ab523e3468bb9aacada2c24362c in this term.
I20260709 13:03:51.595546  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:51.596320  8898 raft_consensus.cc:2393] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a6a0de662d36410c907287e73cb2e4db in current term 1: Already voted for candidate 60a19ab523e3468bb9aacada2c24362c in this term.
I20260709 13:03:51.594959  9202 leader_election.cc:290] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:51.597501  9011 leader_election.cc:304] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:51.597456  9092 tablet_bootstrap.cc:492] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:51.597832  9308 consensus_queue.cc:1048] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.599184  9202 raft_consensus.cc:2749] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.602828  9172 raft_consensus.cc:515] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.604888  8865 leader_election.cc:304] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:51.605685  9248 raft_consensus.cc:2804] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.606140  9248 raft_consensus.cc:697] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:03:51.607090  9248 consensus_queue.cc:237] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.607589  9179 raft_consensus.cc:493] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.609108  9179 raft_consensus.cc:515] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.611186  9179 leader_election.cc:290] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:51.613073  8969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2b10a48f9d4bd0988ff98f6bf66e66" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:51.611215  9093 tablet_bootstrap.cc:492] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:51.616039  9092 tablet_bootstrap.cc:654] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:51.616739  8866 leader_election.cc:343] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.617862  9093 ts_tablet_manager.cc:1403] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.265s	user 0.012s	sys 0.010s
I20260709 13:03:51.612669  8970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203428dde6c042b096205916d590b4d5" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:51.606735  9172 leader_election.cc:290] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
W20260709 13:03:51.623291  8866 leader_election.cc:343] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.625903  9095 tablet_bootstrap.cc:492] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:51.626399  9095 ts_tablet_manager.cc:1403] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.193s	user 0.010s	sys 0.003s
I20260709 13:03:51.628281  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2b10a48f9d4bd0988ff98f6bf66e66" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:51.628935  8822 raft_consensus.cc:3060] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.629343  9095 raft_consensus.cc:359] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.629954  9095 raft_consensus.cc:385] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.631138  9094 tablet_bootstrap.cc:492] T 5b8666482fd746c1bc9d0c3c1bc30613 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:51.631618  9094 ts_tablet_manager.cc:1403] T 5b8666482fd746c1bc9d0c3c1bc30613 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.176s	user 0.027s	sys 0.033s
I20260709 13:03:51.631816  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203428dde6c042b096205916d590b4d5" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:51.631956  9172 raft_consensus.cc:493] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.632475  9172 raft_consensus.cc:515] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
W20260709 13:03:51.633270  8865 leader_election.cc:343] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.633741  8865 leader_election.cc:304] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:51.634534  9172 leader_election.cc:290] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:51.634440  9094 raft_consensus.cc:359] T 5b8666482fd746c1bc9d0c3c1bc30613 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.635162  9094 raft_consensus.cc:385] T 5b8666482fd746c1bc9d0c3c1bc30613 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.635593  9094 raft_consensus.cc:740] T 5b8666482fd746c1bc9d0c3c1bc30613 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.635875  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6221e3a375814ae5ba834de940d071af" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:51.636225  9094 consensus_queue.cc:260] T 5b8666482fd746c1bc9d0c3c1bc30613 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.630126  9095 raft_consensus.cc:740] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.635115  9172 raft_consensus.cc:2749] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.646472  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6221e3a375814ae5ba834de940d071af" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:51.647583  9093 raft_consensus.cc:359] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.648444  9093 raft_consensus.cc:385] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.648732  9093 raft_consensus.cc:740] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.653206  9296 consensus_queue.cc:1048] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.653487  8822 raft_consensus.cc:2468] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
W20260709 13:03:51.644181  8865 leader_election.cc:343] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.656241  9093 consensus_queue.cc:260] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.661991  9095 consensus_queue.cc:260] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.664992  9170 raft_consensus.cc:493] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:51.656682  8865 leader_election.cc:343] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.681087  9296 raft_consensus.cc:493] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.681856  9296 raft_consensus.cc:515] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.683563  8865 leader_election.cc:304] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:51.685285  8865 leader_election.cc:304] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:51.686937  9093 ts_tablet_manager.cc:1434] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.001s
I20260709 13:03:51.687899  9170 raft_consensus.cc:515] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.690238  9307 raft_consensus.cc:493] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.690867  9307 raft_consensus.cc:515] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.699172  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2b10a48f9d4bd0988ff98f6bf66e66" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:51.700296  8898 raft_consensus.cc:2393] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate 60a19ab523e3468bb9aacada2c24362c in this term.
I20260709 13:03:51.701804  8969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:51.702250  9296 leader_election.cc:290] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:51.703151  9179 raft_consensus.cc:2749] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.701815  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa59e81ed8e4c0ca2890a10befbf996" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:51.704340  9179 raft_consensus.cc:2804] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.705037  9179 raft_consensus.cc:697] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
W20260709 13:03:51.708328  8791 leader_election.cc:343] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.710372  8894 raft_consensus.cc:2393] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate a6a0de662d36410c907287e73cb2e4db in this term.
I20260709 13:03:51.706467  9179 consensus_queue.cc:237] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:51.690999  9170 leader_election.cc:290] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:51.688771  9093 tablet_bootstrap.cc:492] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:51.722566  9094 ts_tablet_manager.cc:1434] T 5b8666482fd746c1bc9d0c3c1bc30613 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.000s
I20260709 13:03:51.725427  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa59e81ed8e4c0ca2890a10befbf996" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:51.719965  9307 leader_election.cc:290] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:51.728789  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:51.731186  9048 raft_consensus.cc:2468] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:51.730994  8939 leader_election.cc:304] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:51.732789  9307 raft_consensus.cc:3060] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.736982  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2b10a48f9d4bd0988ff98f6bf66e66" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:51.738416  8822 raft_consensus.cc:2393] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate 60a19ab523e3468bb9aacada2c24362c in this term.
I20260709 13:03:51.739909  9192 consensus_queue.cc:1048] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:51.740051  8939 leader_election.cc:304] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:51.745558  9170 raft_consensus.cc:3060] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.744323  9095 ts_tablet_manager.cc:1434] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.002s
I20260709 13:03:51.754637  9094 tablet_bootstrap.cc:492] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:51.756855  9307 raft_consensus.cc:2749] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.759341  8790 leader_election.cc:304] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:51.760540  9189 raft_consensus.cc:2804] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:51.761005  9189 raft_consensus.cc:493] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.761412  9189 raft_consensus.cc:3060] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.766126  9095 tablet_bootstrap.cc:492] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:51.794687  9094 tablet_bootstrap.cc:654] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.789731  9296 consensus_queue.cc:1048] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:03:51.796666  9093 tablet_bootstrap.cc:654] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.796587  9170 raft_consensus.cc:2749] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:51.800591  9189 raft_consensus.cc:515] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.815371  9095 tablet_bootstrap.cc:654] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.811299  9190 consensus_queue.cc:1048] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:51.818779  8718 catalog_manager.cc:5697] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.827526  9092 tablet_bootstrap.cc:492] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:51.828052  9092 ts_tablet_manager.cc:1403] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.247s	user 0.022s	sys 0.014s
I20260709 13:03:51.831089  9092 raft_consensus.cc:359] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.831784  9092 raft_consensus.cc:385] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.832036  9092 raft_consensus.cc:740] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.832841  9092 consensus_queue.cc:260] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.836773  9092 ts_tablet_manager.cc:1434] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:51.837795  9092 tablet_bootstrap.cc:492] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:51.841868  8970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
W20260709 13:03:51.843228  8791 leader_election.cc:343] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:51.847517  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:51.847144  9189 leader_election.cc:290] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:51.848490  9048 raft_consensus.cc:3060] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:51.860088  9092 tablet_bootstrap.cc:654] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:51.868903  8771 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:51.871793  8723 catalog_manager.cc:5697] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.879269  9095 tablet_bootstrap.cc:492] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:51.879792  9095 ts_tablet_manager.cc:1403] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.114s	user 0.028s	sys 0.008s
I20260709 13:03:51.891572  9095 raft_consensus.cc:359] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.892184  9170 consensus_queue.cc:1048] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.892591  9095 raft_consensus.cc:385] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.892892  9095 raft_consensus.cc:740] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.893741  9095 consensus_queue.cc:260] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.894743  9093 tablet_bootstrap.cc:492] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:51.895898  9095 ts_tablet_manager.cc:1434] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:03:51.904800  9095 tablet_bootstrap.cc:492] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:51.906059  9171 consensus_queue.cc:1048] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.911674  9095 tablet_bootstrap.cc:654] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.901122  9092 tablet_bootstrap.cc:492] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:51.914453  9092 ts_tablet_manager.cc:1403] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.013s
I20260709 13:03:51.916008  8722 catalog_manager.cc:5697] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 0 to 1, leader changed from <none> to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:51.917320  9092 raft_consensus.cc:359] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.918104  9092 raft_consensus.cc:385] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.918380  9092 raft_consensus.cc:740] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.919626  9092 consensus_queue.cc:260] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:51.912367  9093 ts_tablet_manager.cc:1403] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.224s	user 0.009s	sys 0.007s
I20260709 13:03:51.898406  9048 raft_consensus.cc:2468] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:51.921753  8790 leader_election.cc:304] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:51.920037  8722 catalog_manager.cc:5697] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 0 to 1, leader changed from <none> to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.923329  9189 raft_consensus.cc:2804] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:51.926030  9189 raft_consensus.cc:697] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:51.926450  9093 raft_consensus.cc:359] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.927151  9093 raft_consensus.cc:385] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.926853  9189 consensus_queue.cc:237] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.927431  9093 raft_consensus.cc:740] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.928205  9093 consensus_queue.cc:260] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.924628  9094 tablet_bootstrap.cc:492] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:51.930353  9093 ts_tablet_manager.cc:1434] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:03:51.930696  9094 ts_tablet_manager.cc:1403] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.179s	user 0.010s	sys 0.007s
I20260709 13:03:51.931440  9093 tablet_bootstrap.cc:492] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:51.924821  9092 ts_tablet_manager.cc:1434] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:51.932597  9092 tablet_bootstrap.cc:492] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:51.937915  9093 tablet_bootstrap.cc:654] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.938460  9095 tablet_bootstrap.cc:492] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:51.939085  9095 ts_tablet_manager.cc:1403] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.016s
I20260709 13:03:51.940330  9094 raft_consensus.cc:359] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.942185  9095 raft_consensus.cc:359] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.942926  9095 raft_consensus.cc:385] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.943233  9095 raft_consensus.cc:740] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.945775  9095 consensus_queue.cc:260] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.945554  8722 catalog_manager.cc:5697] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 0 to 1, leader changed from <none> to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:51.947947  9095 ts_tablet_manager.cc:1434] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:51.942292  9094 raft_consensus.cc:385] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.948505  9094 raft_consensus.cc:740] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.949187  9094 consensus_queue.cc:260] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.951269  9095 tablet_bootstrap.cc:492] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:51.951985  9094 ts_tablet_manager.cc:1434] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:03:51.948047  9092 tablet_bootstrap.cc:654] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.957264  9193 consensus_queue.cc:1048] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:51.960183  9095 tablet_bootstrap.cc:654] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.969071  9094 tablet_bootstrap.cc:492] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:51.980154  9092 tablet_bootstrap.cc:492] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:51.980829  9092 ts_tablet_manager.cc:1403] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.003s
I20260709 13:03:51.969376  9095 tablet_bootstrap.cc:492] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:51.976912  9193 consensus_queue.cc:1048] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.982569  9095 ts_tablet_manager.cc:1403] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.008s
I20260709 13:03:51.983898  8718 catalog_manager.cc:5697] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:51.985599  9095 raft_consensus.cc:359] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.986303  9095 raft_consensus.cc:385] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.986565  9095 raft_consensus.cc:740] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.993705  9094 tablet_bootstrap.cc:654] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:51.994086  9092 raft_consensus.cc:359] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:51.994766  9092 raft_consensus.cc:385] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:51.987308  9095 consensus_queue.cc:260] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:51.995031  9092 raft_consensus.cc:740] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:51.995818  9179 consensus_queue.cc:1048] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.003064  9093 tablet_bootstrap.cc:492] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:52.003585  9093 ts_tablet_manager.cc:1403] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.073s	user 0.021s	sys 0.007s
I20260709 13:03:51.996660  9095 ts_tablet_manager.cc:1434] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 13:03:52.004634  9095 tablet_bootstrap.cc:492] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:52.005759  8723 catalog_manager.cc:5697] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.012595  9095 tablet_bootstrap.cc:654] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.013121  9093 raft_consensus.cc:359] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.014008  9093 raft_consensus.cc:385] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.014276  9093 raft_consensus.cc:740] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.014588  9189 raft_consensus.cc:493] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.015120  9189 raft_consensus.cc:515] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.015705  9092 consensus_queue.cc:260] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.017338  9093 consensus_queue.cc:260] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.019230  9092 ts_tablet_manager.cc:1434] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:03:52.020763  9092 tablet_bootstrap.cc:492] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:52.024513  9048 raft_consensus.cc:3060] T 5b8666482fd746c1bc9d0c3c1bc30613 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.027006  9092 tablet_bootstrap.cc:654] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.032426  8969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6de9e2aaa341cfb862ee9073bab6dd" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:52.033097  8969 raft_consensus.cc:2468] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:52.034210  9248 raft_consensus.cc:493] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.034705  9248 raft_consensus.cc:515] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.039255  9093 ts_tablet_manager.cc:1434] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:03:52.040897  9093 tablet_bootstrap.cc:492] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:52.042901  9179 consensus_queue.cc:1048] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.048272  8791 leader_election.cc:304] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:52.049275  9296 raft_consensus.cc:2804] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.049772  9296 raft_consensus.cc:493] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.050168  9296 raft_consensus.cc:3060] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.050375  9179 consensus_queue.cc:1048] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.059444  9094 tablet_bootstrap.cc:492] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:52.059273  8969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a1a88fae5d41d0abb4bd9ee1898658" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:52.060134  9094 ts_tablet_manager.cc:1403] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.004s
W20260709 13:03:52.062018  8866 leader_election.cc:343] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.064277  9248 leader_election.cc:290] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:52.071031  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a1a88fae5d41d0abb4bd9ee1898658" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:52.073449  9094 raft_consensus.cc:359] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.074450  9094 raft_consensus.cc:385] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.074739  9094 raft_consensus.cc:740] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.076148  9296 raft_consensus.cc:515] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.078691  9296 leader_election.cc:290] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:52.080106  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6de9e2aaa341cfb862ee9073bab6dd" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:52.088339  9094 consensus_queue.cc:260] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.100445  9095 tablet_bootstrap.cc:492] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:52.100997  9095 ts_tablet_manager.cc:1403] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.031s
I20260709 13:03:52.105700  9094 ts_tablet_manager.cc:1434] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.003s
I20260709 13:03:52.105819  8970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6de9e2aaa341cfb862ee9073bab6dd" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:52.106634  8970 raft_consensus.cc:3060] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.107170  9094 tablet_bootstrap.cc:492] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
W20260709 13:03:52.113968  8865 leader_election.cc:343] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.121361  8865 leader_election.cc:304] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:52.122457  8723 catalog_manager.cc:5697] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.125174  9172 raft_consensus.cc:2749] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:52.108033  8790 leader_election.cc:343] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.114431  9189 leader_election.cc:290] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:52.129832  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6de9e2aaa341cfb862ee9073bab6dd" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
W20260709 13:03:52.131778  8790 leader_election.cc:343] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.133939  8970 raft_consensus.cc:2468] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:52.136924  9093 tablet_bootstrap.cc:654] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.139997  9092 tablet_bootstrap.cc:492] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:52.140483  9092 ts_tablet_manager.cc:1403] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.120s	user 0.025s	sys 0.015s
I20260709 13:03:52.143254  9179 consensus_queue.cc:1048] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.143191  9092 raft_consensus.cc:359] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.147225  9092 raft_consensus.cc:385] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.147534  8791 leader_election.cc:304] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:52.149085  9295 raft_consensus.cc:2804] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.149705  9295 raft_consensus.cc:697] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:52.150739  9295 consensus_queue.cc:237] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.154089  9094 tablet_bootstrap.cc:654] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.147526  9092 raft_consensus.cc:740] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.157920  9092 consensus_queue.cc:260] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.160282  9092 ts_tablet_manager.cc:1434] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:03:52.161259  9092 tablet_bootstrap.cc:492] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:52.168630  9192 raft_consensus.cc:493] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.169548  9192 raft_consensus.cc:515] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.170740  9092 tablet_bootstrap.cc:654] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.176407  9192 leader_election.cc:290] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:52.178546  8970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec23c2e3be3416a84d3d12becfa90fa" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:52.179302  8970 raft_consensus.cc:2468] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:52.180855  9014 leader_election.cc:304] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:52.181438  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec23c2e3be3416a84d3d12becfa90fa" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:52.181766  9192 raft_consensus.cc:2804] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.182087  8898 raft_consensus.cc:2468] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:52.182281  9192 raft_consensus.cc:493] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.182785  9192 raft_consensus.cc:3060] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.213460  9296 raft_consensus.cc:493] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.214131  9296 raft_consensus.cc:515] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.217834  9192 raft_consensus.cc:515] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.220355  9192 leader_election.cc:290] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:52.222213  8970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec23c2e3be3416a84d3d12becfa90fa" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:52.223104  8970 raft_consensus.cc:3060] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.225703  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec23c2e3be3416a84d3d12becfa90fa" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:52.229662  8898 raft_consensus.cc:3060] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.232573  8970 raft_consensus.cc:2468] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:52.233845  9014 leader_election.cc:304] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:52.235350  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6221e3a375814ae5ba834de940d071af" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:52.236037  9046 raft_consensus.cc:2468] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:52.236199  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6221e3a375814ae5ba834de940d071af" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:52.236871  9193 raft_consensus.cc:2804] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.241031  9193 raft_consensus.cc:697] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:52.242129  9193 consensus_queue.cc:237] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.240970  8894 raft_consensus.cc:2468] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:52.244364  9296 leader_election.cc:290] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:52.247819  8788 leader_election.cc:304] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:52.248589  9094 tablet_bootstrap.cc:492] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:52.249069  9094 ts_tablet_manager.cc:1403] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.142s	user 0.006s	sys 0.013s
I20260709 13:03:52.218482  9095 raft_consensus.cc:359] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.259688  9095 raft_consensus.cc:385] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.259766  9092 tablet_bootstrap.cc:492] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:52.260042  9095 raft_consensus.cc:740] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.260497  9092 ts_tablet_manager.cc:1403] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.006s
I20260709 13:03:52.261312  9095 consensus_queue.cc:260] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.259169  9295 raft_consensus.cc:2804] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.269497  9295 raft_consensus.cc:493] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.269860  9295 raft_consensus.cc:3060] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.273013  8721 catalog_manager.cc:5697] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.276544  9094 raft_consensus.cc:359] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.278591  9094 raft_consensus.cc:385] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.278856  9094 raft_consensus.cc:740] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.279461  9095 ts_tablet_manager.cc:1434] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.178s	user 0.007s	sys 0.002s
I20260709 13:03:52.279517  9094 consensus_queue.cc:260] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.280551  9095 tablet_bootstrap.cc:492] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:52.280953  9092 raft_consensus.cc:359] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.281675  9094 ts_tablet_manager.cc:1434] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:03:52.282310  9092 raft_consensus.cc:385] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.282933  9092 raft_consensus.cc:740] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.283910  9092 consensus_queue.cc:260] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.289399  8898 raft_consensus.cc:2468] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:52.290717  9093 tablet_bootstrap.cc:492] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:52.291196  9093 ts_tablet_manager.cc:1403] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.251s	user 0.013s	sys 0.000s
I20260709 13:03:52.293172  9295 raft_consensus.cc:515] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.293864  9093 raft_consensus.cc:359] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.294559  9093 raft_consensus.cc:385] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.294821  9093 raft_consensus.cc:740] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.295362  9295 leader_election.cc:290] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:52.298314  9092 ts_tablet_manager.cc:1434] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.004s
I20260709 13:03:52.298970  9094 tablet_bootstrap.cc:492] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:52.299497  9092 tablet_bootstrap.cc:492] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:52.295390  9093 consensus_queue.cc:260] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.303987  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6221e3a375814ae5ba834de940d071af" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:52.304581  9046 raft_consensus.cc:3060] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.306161  9094 tablet_bootstrap.cc:654] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.306542  9172 raft_consensus.cc:493] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.307047  9172 raft_consensus.cc:515] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.309162  9172 leader_election.cc:290] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:52.311651  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448e990629c04a25945e8b2f7c71d414" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:52.314554  9095 tablet_bootstrap.cc:654] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.315315  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448e990629c04a25945e8b2f7c71d414" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:52.317891  9093 ts_tablet_manager.cc:1434] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
W20260709 13:03:52.318140  8865 leader_election.cc:343] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:52.319146  8865 leader_election.cc:343] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.319577  8865 leader_election.cc:304] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:52.320333  9179 raft_consensus.cc:2749] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.319682  9172 consensus_queue.cc:1048] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.328110  9093 tablet_bootstrap.cc:492] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:52.328320  9094 tablet_bootstrap.cc:492] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:52.329187  9094 ts_tablet_manager.cc:1403] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.008s
I20260709 13:03:52.335855  9092 tablet_bootstrap.cc:654] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.341921  8721 catalog_manager.cc:5697] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.345749  9095 tablet_bootstrap.cc:492] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:52.346243  9095 ts_tablet_manager.cc:1403] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.003s
I20260709 13:03:52.335224  9093 tablet_bootstrap.cc:654] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.349148  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6221e3a375814ae5ba834de940d071af" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:52.349768  9171 raft_consensus.cc:493] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.349623  9095 raft_consensus.cc:359] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.346504  9172 consensus_queue.cc:1048] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:52.350350  9171 raft_consensus.cc:515] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.352360  9171 leader_election.cc:290] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:52.350356  9095 raft_consensus.cc:385] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.354790  9095 raft_consensus.cc:740] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.359750  9094 raft_consensus.cc:359] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.360431  9094 raft_consensus.cc:385] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.360687  9094 raft_consensus.cc:740] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.361518  9092 tablet_bootstrap.cc:492] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:52.361328  9094 consensus_queue.cc:260] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.362123  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:52.362548  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:52.362900  9043 raft_consensus.cc:2393] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate 0c955bfd0b9541f9860c5f84cb255b90 in this term.
I20260709 13:03:52.349807  8898 raft_consensus.cc:3060] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.363966  9094 ts_tablet_manager.cc:1434] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:03:52.364953  9094 tablet_bootstrap.cc:492] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:52.366839  8939 leader_election.cc:304] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:52.368436  9170 raft_consensus.cc:3060] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.369022  9095 consensus_queue.cc:260] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.371345  9094 tablet_bootstrap.cc:654] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.371428  9095 ts_tablet_manager.cc:1434] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:03:52.362044  9092 ts_tablet_manager.cc:1403] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.001s
I20260709 13:03:52.374869  9171 raft_consensus.cc:493] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.375361  9171 raft_consensus.cc:515] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.376446  9092 raft_consensus.cc:359] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.377347  9092 raft_consensus.cc:385] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.377643  9171 leader_election.cc:290] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:52.377698  9092 raft_consensus.cc:740] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.378589  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598391aa086d4cd684b11636fb4c788b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:52.379238  8822 raft_consensus.cc:2468] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 0.
I20260709 13:03:52.378890  9092 consensus_queue.cc:260] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.379619  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598391aa086d4cd684b11636fb4c788b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:52.380280  8894 raft_consensus.cc:2468] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 0.
I20260709 13:03:52.380630  8939 leader_election.cc:304] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:52.381825  9171 raft_consensus.cc:2804] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.381796  9092 ts_tablet_manager.cc:1434] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:52.382905  9171 raft_consensus.cc:493] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.383335  9171 raft_consensus.cc:3060] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.386349  9170 raft_consensus.cc:2749] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.390962  9095 tablet_bootstrap.cc:492] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:52.392124  9092 tablet_bootstrap.cc:492] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:52.371935  9046 raft_consensus.cc:2468] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:52.405004  9179 raft_consensus.cc:493] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.408169  9179 raft_consensus.cc:515] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.410208  9179 leader_election.cc:290] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:52.411970  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7449c44d44a30a7de276d3d6a9c25" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
W20260709 13:03:52.414201  8865 leader_election.cc:343] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.415532  8972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7449c44d44a30a7de276d3d6a9c25" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:52.416908  8866 leader_election.cc:343] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.417385  8866 leader_election.cc:304] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:52.412009  8790 leader_election.cc:304] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:52.421065  9179 raft_consensus.cc:2749] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.422662  9295 raft_consensus.cc:2804] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.423735  9295 raft_consensus.cc:697] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:52.425136  9295 consensus_queue.cc:237] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.429003  9095 tablet_bootstrap.cc:654] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.431146  9171 raft_consensus.cc:515] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.436924  9093 tablet_bootstrap.cc:492] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:52.437408  9093 ts_tablet_manager.cc:1403] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.031s
I20260709 13:03:52.439183  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598391aa086d4cd684b11636fb4c788b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:52.439881  8822 raft_consensus.cc:3060] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.422787  8898 raft_consensus.cc:2468] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:52.446668  9296 consensus_queue.cc:1048] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.453190  9092 tablet_bootstrap.cc:654] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.446944  9093 raft_consensus.cc:359] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.455749  9093 raft_consensus.cc:385] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.456127  9093 raft_consensus.cc:740] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.457067  9093 consensus_queue.cc:260] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.460353  9171 leader_election.cc:290] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:52.463994  9248 raft_consensus.cc:493] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.464745  9248 raft_consensus.cc:515] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.470894  9093 ts_tablet_manager.cc:1434] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:03:52.473639  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598391aa086d4cd684b11636fb4c788b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:52.474215  8894 raft_consensus.cc:3060] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.476457  9093 tablet_bootstrap.cc:492] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:52.476816  9189 consensus_queue.cc:1048] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.471089  9248 leader_election.cc:290] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:52.476888  8972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de518c02ce8d4d278d359e001b96db41" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:52.481779  8972 raft_consensus.cc:2468] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:52.483464  8866 leader_election.cc:304] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:52.491317  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de518c02ce8d4d278d359e001b96db41" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
W20260709 13:03:52.494916  8865 leader_election.cc:343] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.486701  9172 raft_consensus.cc:2804] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.493028  9094 tablet_bootstrap.cc:492] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:52.497726  9094 ts_tablet_manager.cc:1403] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.133s	user 0.018s	sys 0.001s
I20260709 13:03:52.496235  9172 raft_consensus.cc:493] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.529884  9172 raft_consensus.cc:3060] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.548314  8894 raft_consensus.cc:2468] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:03:52.549693  8937 leader_election.cc:304] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:52.547398  9093 tablet_bootstrap.cc:654] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.569763  8822 raft_consensus.cc:2468] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:03:52.555536  9387 raft_consensus.cc:2804] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.576644  9179 raft_consensus.cc:493] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.577035  9095 tablet_bootstrap.cc:492] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:52.577510  9095 ts_tablet_manager.cc:1403] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.187s	user 0.010s	sys 0.021s
I20260709 13:03:52.577169  9179 raft_consensus.cc:515] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.579270  9179 leader_election.cc:290] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:52.582651  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4408002b8e4e67a7bf17118232afd5" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:52.584339  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4408002b8e4e67a7bf17118232afd5" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
W20260709 13:03:52.585785  8865 leader_election.cc:343] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:52.591185  8866 leader_election.cc:343] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.591655  8866 leader_election.cc:304] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:52.592782  9179 raft_consensus.cc:2749] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.592777  9095 raft_consensus.cc:359] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.593811  9095 raft_consensus.cc:385] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.599169  9095 raft_consensus.cc:740] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.605180  9387 raft_consensus.cc:697] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:03:52.608592  9095 consensus_queue.cc:260] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.613788  9094 raft_consensus.cc:359] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.616545  9092 tablet_bootstrap.cc:492] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:52.616181  9387 consensus_queue.cc:237] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.618533  9092 ts_tablet_manager.cc:1403] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.227s	user 0.022s	sys 0.031s
I20260709 13:03:52.618837  9094 raft_consensus.cc:385] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.619531  9094 raft_consensus.cc:740] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.620594  9094 consensus_queue.cc:260] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.621479  9092 raft_consensus.cc:359] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.625885  9092 raft_consensus.cc:385] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.626179  9092 raft_consensus.cc:740] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.621804  9289 raft_consensus.cc:493] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.626601  9094 ts_tablet_manager.cc:1434] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.000s
I20260709 13:03:52.622716  9193 raft_consensus.cc:493] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.627770  9094 tablet_bootstrap.cc:492] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:52.627663  9193 raft_consensus.cc:515] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.628211  9172 raft_consensus.cc:515] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.629761  9193 leader_election.cc:290] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:52.630316  9095 ts_tablet_manager.cc:1434] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 13:03:52.626950  9289 raft_consensus.cc:515] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.631304  9092 consensus_queue.cc:260] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.632702  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6de9e2aaa341cfb862ee9073bab6dd" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:52.644930  8974 raft_consensus.cc:2393] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6a0de662d36410c907287e73cb2e4db in current term 1: Already voted for candidate 0c955bfd0b9541f9860c5f84cb255b90 in this term.
I20260709 13:03:52.633044  9179 raft_consensus.cc:493] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.645763  9179 raft_consensus.cc:515] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.646523  9095 tablet_bootstrap.cc:492] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:52.647007  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203428dde6c042b096205916d590b4d5" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:52.647677  8894 raft_consensus.cc:2468] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:52.647778  9179 leader_election.cc:290] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:52.649436  8788 leader_election.cc:304] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:52.650113  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b04160c71b417c9a4db4e3f6692906" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:52.650447  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203428dde6c042b096205916d590b4d5" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:52.650779  9296 raft_consensus.cc:2804] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.651156  9296 raft_consensus.cc:493] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.636163  9295 consensus_queue.cc:1048] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.651540  9296 raft_consensus.cc:3060] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:52.651968  8791 leader_election.cc:343] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.652508  9172 leader_election.cc:290] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
W20260709 13:03:52.654100  8865 leader_election.cc:343] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.654498  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de518c02ce8d4d278d359e001b96db41" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:52.655084  8974 raft_consensus.cc:3060] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.661309  9092 ts_tablet_manager.cc:1434] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:03:52.661446  9289 leader_election.cc:290] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:52.661610  9296 raft_consensus.cc:515] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.639074  9094 tablet_bootstrap.cc:654] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.639359  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6de9e2aaa341cfb862ee9073bab6dd" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:52.665249  9092 tablet_bootstrap.cc:492] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:52.666638  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de518c02ce8d4d278d359e001b96db41" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:52.666888  9013 leader_election.cc:304] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:52.624168  9093 tablet_bootstrap.cc:492] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:52.667872  9093 ts_tablet_manager.cc:1403] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.192s	user 0.042s	sys 0.002s
W20260709 13:03:52.671984  8865 leader_election.cc:343] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.649416  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b04160c71b417c9a4db4e3f6692906" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:52.674078  9092 tablet_bootstrap.cc:654] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:52.674391  8865 leader_election.cc:343] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.674937  8865 leader_election.cc:304] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:52.675743  9172 raft_consensus.cc:2749] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.678360  9093 raft_consensus.cc:359] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.679096  9093 raft_consensus.cc:385] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.679440  9093 raft_consensus.cc:740] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.681882  9093 consensus_queue.cc:260] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.685467  9093 ts_tablet_manager.cc:1434] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:03:52.696853  8974 raft_consensus.cc:2468] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:03:52.698345  8866 leader_election.cc:304] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:52.699596  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203428dde6c042b096205916d590b4d5" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:52.699891  8970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203428dde6c042b096205916d590b4d5" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:52.700235  8894 raft_consensus.cc:3060] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:52.701226  8791 leader_election.cc:343] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.699898  9179 raft_consensus.cc:2804] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.702203  9179 raft_consensus.cc:697] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:03:52.703017  9179 consensus_queue.cc:237] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.665145  9095 tablet_bootstrap.cc:654] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.668054  9193 raft_consensus.cc:3060] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.707228  9192 raft_consensus.cc:493] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.707787  9192 raft_consensus.cc:515] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.709779  9192 leader_election.cc:290] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:52.706458  9296 leader_election.cc:290] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:52.669149  8722 catalog_manager.cc:5697] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:52.641255  8721 catalog_manager.cc:5697] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.711782  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75657aca6e034936ba57c704cedb5563" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:52.712433  8894 raft_consensus.cc:2468] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
W20260709 13:03:52.713172  9013 leader_election.cc:343] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.713467  8788 leader_election.cc:304] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:52.714329  9093 tablet_bootstrap.cc:492] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:52.714363  9289 raft_consensus.cc:2804] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.715054  9289 raft_consensus.cc:697] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:52.715827  9289 consensus_queue.cc:237] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.717334  9193 raft_consensus.cc:2749] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.721868  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75657aca6e034936ba57c704cedb5563" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:52.723368  9014 leader_election.cc:343] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.723856  9014 leader_election.cc:304] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:52.725241  9093 tablet_bootstrap.cc:654] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.725237  9295 consensus_queue.cc:1048] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.731871  9192 raft_consensus.cc:2749] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.751019  9095 tablet_bootstrap.cc:492] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:52.751526  9095 ts_tablet_manager.cc:1403] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.000s
I20260709 13:03:52.757519  8722 catalog_manager.cc:5697] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 0 to 1, leader changed from <none> to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.770753  9192 consensus_queue.cc:1048] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:52.777370  9094 tablet_bootstrap.cc:492] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:52.778059  9094 ts_tablet_manager.cc:1403] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.151s	user 0.018s	sys 0.010s
I20260709 13:03:52.781253  8717 catalog_manager.cc:5697] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:52.786278  9092 tablet_bootstrap.cc:492] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:52.787380  9095 raft_consensus.cc:359] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.788071  9095 raft_consensus.cc:385] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.788502  9095 raft_consensus.cc:740] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.788946  9094 raft_consensus.cc:359] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.788125  9092 ts_tablet_manager.cc:1403] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.123s	user 0.031s	sys 0.028s
I20260709 13:03:52.795544  9094 raft_consensus.cc:385] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.795871  9094 raft_consensus.cc:740] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.796093  9092 raft_consensus.cc:359] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.796536  9094 consensus_queue.cc:260] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.797122  9092 raft_consensus.cc:385] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.797688  9092 raft_consensus.cc:740] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.799022  9092 consensus_queue.cc:260] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.800408  9094 ts_tablet_manager.cc:1434] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:03:52.801559  9094 tablet_bootstrap.cc:492] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:52.802397  9092 ts_tablet_manager.cc:1434] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:03:52.789294  9095 consensus_queue.cc:260] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.809021  9092 tablet_bootstrap.cc:492] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:52.806950  9094 tablet_bootstrap.cc:654] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.809151  9095 ts_tablet_manager.cc:1434] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:03:52.811239  9095 tablet_bootstrap.cc:492] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:52.803864  9093 tablet_bootstrap.cc:492] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:52.815274  9093 ts_tablet_manager.cc:1403] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.101s	user 0.022s	sys 0.008s
I20260709 13:03:52.816021  9092 tablet_bootstrap.cc:654] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.816213  9192 raft_consensus.cc:493] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.816735  9192 raft_consensus.cc:515] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.817801  9381 raft_consensus.cc:493] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.818279  9381 raft_consensus.cc:515] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.818897  9192 leader_election.cc:290] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:52.820350  9381 leader_election.cc:290] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:52.820429  8970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a1a88fae5d41d0abb4bd9ee1898658" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:52.822017  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a1a88fae5d41d0abb4bd9ee1898658" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:52.822638  8894 raft_consensus.cc:2468] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
W20260709 13:03:52.822815  9014 leader_election.cc:343] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.828081  9011 leader_election.cc:304] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:52.830864  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17c73a16b7141ef885babed8fb13dc6" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:52.831547  9387 raft_consensus.cc:493] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.832269  9095 tablet_bootstrap.cc:654] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.832001  9387 raft_consensus.cc:515] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.834394  9192 raft_consensus.cc:2804] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.834815  9192 raft_consensus.cc:493] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.835152  9192 raft_consensus.cc:3060] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.818708  9093 raft_consensus.cc:359] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.835621  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203428dde6c042b096205916d590b4d5" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:52.837332  9093 raft_consensus.cc:385] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.837249  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203428dde6c042b096205916d590b4d5" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:52.837936  9093 raft_consensus.cc:740] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.838479  8894 raft_consensus.cc:2393] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate 0c955bfd0b9541f9860c5f84cb255b90 in this term.
I20260709 13:03:52.839985  8937 leader_election.cc:304] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:52.840970  9171 raft_consensus.cc:3060] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.841096  9093 consensus_queue.cc:260] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.834444  9387 leader_election.cc:290] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:52.846421  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17c73a16b7141ef885babed8fb13dc6" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:52.847818  8865 leader_election.cc:343] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:52.849933  8866 leader_election.cc:343] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.850363  8866 leader_election.cc:304] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:52.851037  9093 ts_tablet_manager.cc:1434] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:03:52.852188  9093 tablet_bootstrap.cc:492] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:52.854223  9381 raft_consensus.cc:2749] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.862540  9094 tablet_bootstrap.cc:492] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:52.863193  9094 ts_tablet_manager.cc:1403] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.020s
I20260709 13:03:52.865202  9093 tablet_bootstrap.cc:654] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:52.845674  9192 raft_consensus.cc:515] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.865731  9094 raft_consensus.cc:359] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.866478  9094 raft_consensus.cc:385] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:52.866735  9094 raft_consensus.cc:740] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:52.868716  9192 leader_election.cc:290] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:52.869235  9192 consensus_queue.cc:1048] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.869964  9289 consensus_queue.cc:1048] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:52.872889  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a1a88fae5d41d0abb4bd9ee1898658" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:52.873492  8899 raft_consensus.cc:3060] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.874116  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a1a88fae5d41d0abb4bd9ee1898658" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
W20260709 13:03:52.876025  9014 leader_election.cc:343] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.896957  8899 raft_consensus.cc:2468] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:52.897936  9171 raft_consensus.cc:2749] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:52.901070  9094 consensus_queue.cc:260] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:52.911652  9094 ts_tablet_manager.cc:1434] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.001s
I20260709 13:03:52.912642  9094 tablet_bootstrap.cc:492] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:52.907692  9289 raft_consensus.cc:493] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.914758  9289 raft_consensus.cc:515] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:52.917002  9289 leader_election.cc:290] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:52.918543  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7449c44d44a30a7de276d3d6a9c25" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:52.922329  9094 tablet_bootstrap.cc:654] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:52.922703  8791 leader_election.cc:343] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:52.923944  9192 raft_consensus.cc:493] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.924566  9192 raft_consensus.cc:515] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.927872  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448e990629c04a25945e8b2f7c71d414" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:52.928450  9192 leader_election.cc:290] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:52.928862  8825 raft_consensus.cc:2468] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:52.930760  9013 leader_election.cc:304] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:52.909993  9092 tablet_bootstrap.cc:492] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:52.931973  9092 ts_tablet_manager.cc:1403] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.123s	user 0.009s	sys 0.003s
I20260709 13:03:52.933998  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448e990629c04a25945e8b2f7c71d414" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:52.934324  9011 leader_election.cc:304] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:52.935742  9403 raft_consensus.cc:2804] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.936031  9190 raft_consensus.cc:2804] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:52.936197  9403 raft_consensus.cc:493] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.936579  9190 raft_consensus.cc:697] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:52.937662  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7449c44d44a30a7de276d3d6a9c25" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:52.937443  9190 consensus_queue.cc:237] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:52.938262  8894 raft_consensus.cc:2468] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:52.936579  9403 raft_consensus.cc:3060] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.939201  9289 consensus_queue.cc:1048] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:03:52.935256  8899 raft_consensus.cc:2468] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:52.945393  8788 leader_election.cc:304] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:52.959585  9296 raft_consensus.cc:2804] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:52.959987  9296 raft_consensus.cc:493] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.960319  9296 raft_consensus.cc:3060] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:52.968708  9403 raft_consensus.cc:515] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:52.997538  9094 tablet_bootstrap.cc:492] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:52.998128  9094 ts_tablet_manager.cc:1403] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.002s
I20260709 13:03:53.000238  9095 tablet_bootstrap.cc:492] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:53.000721  9095 ts_tablet_manager.cc:1403] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.190s	user 0.019s	sys 0.036s
I20260709 13:03:53.002616  9381 raft_consensus.cc:493] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.019613  9092 raft_consensus.cc:359] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:53.021572  9092 raft_consensus.cc:385] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.021821  9092 raft_consensus.cc:740] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.022846  9092 consensus_queue.cc:260] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:53.026216  9092 ts_tablet_manager.cc:1434] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 13:03:53.016916  9386 raft_consensus.cc:493] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.027925  9386 raft_consensus.cc:515] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:53.029987  9386 leader_election.cc:290] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:53.016533  9403 leader_election.cc:290] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:53.033157  9093 tablet_bootstrap.cc:492] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:53.033676  9093 ts_tablet_manager.cc:1403] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.182s	user 0.031s	sys 0.028s
I20260709 13:03:53.033676  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a097a815a3194dc7a54ca93a122cfed8" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:53.036791  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448e990629c04a25945e8b2f7c71d414" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:53.037348  8899 raft_consensus.cc:3060] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:53.038192  8939 leader_election.cc:343] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.039053  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a097a815a3194dc7a54ca93a122cfed8" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:53.039759  9048 raft_consensus.cc:2468] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 0.
I20260709 13:03:53.015386  9381 raft_consensus.cc:515] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:53.062000  9094 raft_consensus.cc:359] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:53.063072  9094 raft_consensus.cc:385] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.044041  9193 raft_consensus.cc:493] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.063325  9094 raft_consensus.cc:740] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.052637  9296 raft_consensus.cc:515] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:53.078831  9193 raft_consensus.cc:515] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:53.054376  8939 leader_election.cc:304] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:03:53.080709  9387 raft_consensus.cc:2804] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.081118  9387 raft_consensus.cc:493] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.081436  9387 raft_consensus.cc:3060] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.081804  9094 consensus_queue.cc:260] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:53.082265  9193 leader_election.cc:290] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
W20260709 13:03:53.089596  8771 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:53.089416  9387 raft_consensus.cc:515] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:53.089979  9093 raft_consensus.cc:359] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:53.096249  9093 raft_consensus.cc:385] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.096544  9093 raft_consensus.cc:740] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.097177  9093 consensus_queue.cc:260] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:53.098291  9095 raft_consensus.cc:359] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:53.098945  9095 raft_consensus.cc:385] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.092536  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7449c44d44a30a7de276d3d6a9c25" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:53.099660  8894 raft_consensus.cc:3060] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.100834  8970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7449c44d44a30a7de276d3d6a9c25" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:53.093511  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448e990629c04a25945e8b2f7c71d414" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:53.103899  8824 raft_consensus.cc:3060] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.099238  9093 ts_tablet_manager.cc:1434] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.001s
I20260709 13:03:53.110544  9386 consensus_queue.cc:1048] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.112421  8824 raft_consensus.cc:2468] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:53.119614  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de61bcc226d7496e80bec49c06bd35f0" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:53.120466  8825 raft_consensus.cc:2468] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:53.122162  9092 tablet_bootstrap.cc:492] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:53.124653  8865 leader_election.cc:304] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:53.095551  8972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a097a815a3194dc7a54ca93a122cfed8" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:53.126109  8972 raft_consensus.cc:2393] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6a0de662d36410c907287e73cb2e4db in current term 1: Already voted for candidate 245d19d5c71647a9857ac68df13802d5 in this term.
I20260709 13:03:53.115796  9387 leader_election.cc:290] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:53.116746  9093 tablet_bootstrap.cc:492] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:53.130869  9092 tablet_bootstrap.cc:654] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.131450  8723 catalog_manager.cc:5697] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.118736  8894 raft_consensus.cc:2468] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:53.093861  9296 leader_election.cc:290] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:53.132323  9179 raft_consensus.cc:2804] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.134462  9179 raft_consensus.cc:493] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.134989  9179 raft_consensus.cc:3060] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.139881  8788 leader_election.cc:304] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:53.099180  9095 raft_consensus.cc:740] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.118170  9381 leader_election.cc:290] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:53.143698  9095 consensus_queue.cc:260] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
W20260709 13:03:53.142283  8939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:45733, user_credentials={real_user=slave}} blocked reactor thread for 61020.7us
I20260709 13:03:53.159180  9013 leader_election.cc:304] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:53.159771  9095 ts_tablet_manager.cc:1434] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.159s	user 0.008s	sys 0.000s
I20260709 13:03:53.160002  9192 raft_consensus.cc:2804] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.160493  9192 raft_consensus.cc:697] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:53.160732  9095 tablet_bootstrap.cc:492] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:53.161217  9192 consensus_queue.cc:237] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:53.162724  9093 tablet_bootstrap.cc:654] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.145514  9296 raft_consensus.cc:2804] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.148125  8970 raft_consensus.cc:3060] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.174378  8899 raft_consensus.cc:2468] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:53.176225  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a097a815a3194dc7a54ca93a122cfed8" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:53.163724  9296 raft_consensus.cc:697] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:53.180109  9296 consensus_queue.cc:237] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
W20260709 13:03:53.185863  9013 leader_election.cc:343] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:53.188508  9405 log.cc:927] Time spent T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 13:03:53.151883  8866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:33479, user_credentials={real_user=slave}} blocked reactor thread for 121051us
I20260709 13:03:53.208321  9095 tablet_bootstrap.cc:654] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.217154  9094 ts_tablet_manager.cc:1434] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.219s	user 0.029s	sys 0.023s
I20260709 13:03:53.226670  9094 tablet_bootstrap.cc:492] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
W20260709 13:03:53.222358  8937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 113991us
I20260709 13:03:53.252360  8972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de61bcc226d7496e80bec49c06bd35f0" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:53.256484  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a097a815a3194dc7a54ca93a122cfed8" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:53.265280  8723 catalog_manager.cc:5697] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.287917  8970 raft_consensus.cc:2468] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:53.292680  9093 tablet_bootstrap.cc:492] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:53.293227  9093 ts_tablet_manager.cc:1403] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.177s	user 0.013s	sys 0.006s
I20260709 13:03:53.298166  9092 tablet_bootstrap.cc:492] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:53.323115  9092 ts_tablet_manager.cc:1403] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.271s	user 0.014s	sys 0.010s
I20260709 13:03:53.316712  9093 raft_consensus.cc:359] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:53.366786  9093 raft_consensus.cc:385] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.367292  9093 raft_consensus.cc:740] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.259670  9014 leader_election.cc:304] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:53.371117  9093 consensus_queue.cc:260] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:53.304530  9179 raft_consensus.cc:515] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:53.377810  9192 raft_consensus.cc:3060] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.384150  9093 ts_tablet_manager.cc:1434] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 13:03:53.385185  9193 raft_consensus.cc:493] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.385679  9193 raft_consensus.cc:515] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
W20260709 13:03:53.383606  8791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:33479, user_credentials={real_user=slave}} blocked reactor thread for 127651us
W20260709 13:03:53.383994  8788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 137377us
I20260709 13:03:53.396523  9179 leader_election.cc:290] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:53.400839  9093 tablet_bootstrap.cc:492] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
W20260709 13:03:53.389148  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.131:33479, user_credentials={real_user=slave}} blocked reactor thread for 151264us
I20260709 13:03:53.403502  9192 raft_consensus.cc:2749] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:53.407531  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a097a815a3194dc7a54ca93a122cfed8" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:53.409284  9413 consensus_queue.cc:1048] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.413941  9094 tablet_bootstrap.cc:654] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:53.414685  8939 leader_election.cc:343] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.417938  9193 leader_election.cc:290] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:53.418421  9095 tablet_bootstrap.cc:492] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:53.418952  9095 ts_tablet_manager.cc:1403] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.258s	user 0.024s	sys 0.041s
W20260709 13:03:53.422051  8865 consensus_peers.cc:597] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c -> Peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Couldn't send request to peer a6a0de662d36410c907287e73cb2e4db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:53.423893  8866 leader_election.cc:343] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.425436  9381 consensus_queue.cc:1048] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.431510  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de61bcc226d7496e80bec49c06bd35f0" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:53.433487  9046 raft_consensus.cc:2468] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:03:53.437000  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4408002b8e4e67a7bf17118232afd5" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:53.437222  9092 raft_consensus.cc:359] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:53.438416  9092 raft_consensus.cc:385] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.438699  9092 raft_consensus.cc:740] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.439332  9092 consensus_queue.cc:260] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:53.449400  9092 ts_tablet_manager.cc:1434] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.126s	user 0.010s	sys 0.005s
I20260709 13:03:53.438165  8899 raft_consensus.cc:2468] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:53.460568  9179 raft_consensus.cc:493] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:53.461050  8866 leader_election.cc:343] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.461119  9179 raft_consensus.cc:515] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:53.463261  9179 leader_election.cc:290] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:53.465042  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4408002b8e4e67a7bf17118232afd5" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:53.475147  9095 raft_consensus.cc:359] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:53.475842  9095 raft_consensus.cc:385] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.476095  9095 raft_consensus.cc:740] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.476712  9095 consensus_queue.cc:260] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:53.478330  9092 tablet_bootstrap.cc:492] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:53.478956  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de61bcc226d7496e80bec49c06bd35f0" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:53.479893  9093 tablet_bootstrap.cc:654] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.484236  9095 ts_tablet_manager.cc:1434] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 13:03:53.492033  8822 raft_consensus.cc:3060] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:53.493067  9014 leader_election.cc:343] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.493928  9092 tablet_bootstrap.cc:654] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.480556  8722 catalog_manager.cc:5697] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.503334  9095 tablet_bootstrap.cc:492] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:53.512624  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3411c58e61642e499aafe48daae38e0" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:53.515978  8939 leader_election.cc:304] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:03:53.517437  9011 leader_election.cc:304] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:53.517963  9413 raft_consensus.cc:2804] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.518483  9413 raft_consensus.cc:697] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:03:53.519977  9193 raft_consensus.cc:2804] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.520421  9193 raft_consensus.cc:493] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.520673  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3411c58e61642e499aafe48daae38e0" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:53.520768  9193 raft_consensus.cc:3060] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.519356  9426 consensus_queue.cc:1048] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:03:53.520645  9413 consensus_queue.cc:237] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
W20260709 13:03:53.540035  8865 leader_election.cc:343] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.550930  9427 consensus_queue.cc:1048] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:53.572968  9094 tablet_bootstrap.cc:492] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:53.573464  9094 ts_tablet_manager.cc:1403] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.348s	user 0.026s	sys 0.009s
I20260709 13:03:53.573767  8822 raft_consensus.cc:2468] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:03:53.575632  9192 consensus_queue.cc:1048] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:53.580212  9014 consensus_peers.cc:597] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db -> Peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Couldn't send request to peer 245d19d5c71647a9857ac68df13802d5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:53.576170  9094 raft_consensus.cc:359] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:53.582062  9094 raft_consensus.cc:385] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.582314  9094 raft_consensus.cc:740] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.582854  9094 consensus_queue.cc:260] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:53.593143  9094 ts_tablet_manager.cc:1434] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:03:53.595387  8865 leader_election.cc:304] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5
W20260709 13:03:53.596525  8865 leader_election.cc:343] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.596916  8865 leader_election.cc:304] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:53.597899  9415 raft_consensus.cc:2804] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.606930  9415 raft_consensus.cc:697] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:03:53.607801  9415 consensus_queue.cc:237] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:53.610541  9172 raft_consensus.cc:2749] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:53.616693  9434 log.cc:927] Time spent T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:03:53.623240  9095 tablet_bootstrap.cc:654] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.619622  9094 tablet_bootstrap.cc:492] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:53.617213  8717 catalog_manager.cc:5697] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.631208  9092 tablet_bootstrap.cc:492] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:53.632143  9092 ts_tablet_manager.cc:1403] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.154s	user 0.029s	sys 0.012s
W20260709 13:03:53.667435  9433 log.cc:927] Time spent T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:03:53.699126  9193 raft_consensus.cc:515] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:53.701297  9193 leader_election.cc:290] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:53.704053  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4408002b8e4e67a7bf17118232afd5" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:53.704953  8973 raft_consensus.cc:3060] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.707687  9092 raft_consensus.cc:359] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:53.708370  9092 raft_consensus.cc:385] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.708631  9092 raft_consensus.cc:740] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.713160  9094 tablet_bootstrap.cc:654] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.714841  9093 tablet_bootstrap.cc:492] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:53.715369  9093 ts_tablet_manager.cc:1403] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.315s	user 0.004s	sys 0.020s
I20260709 13:03:53.715956  8973 raft_consensus.cc:2468] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:53.717312  9014 leader_election.cc:304] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:53.718238  9193 raft_consensus.cc:2804] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.718173  9093 raft_consensus.cc:359] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:53.718837  9193 raft_consensus.cc:697] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:53.718986  9093 raft_consensus.cc:385] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.719581  9093 raft_consensus.cc:740] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.719694  9193 consensus_queue.cc:237] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
W20260709 13:03:53.720937  9439 log.cc:927] Time spent T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:03:53.720697  9093 consensus_queue.cc:260] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:53.724191  9092 consensus_queue.cc:260] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:53.726580  9093 ts_tablet_manager.cc:1434] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:03:53.732731  9092 ts_tablet_manager.cc:1434] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.000s
I20260709 13:03:53.735116  9093 tablet_bootstrap.cc:492] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:53.739321  9425 raft_consensus.cc:493] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.739919  9425 raft_consensus.cc:515] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
W20260709 13:03:53.741483  9438 log.cc:927] Time spent T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 13:03:53.749017  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a097a815a3194dc7a54ca93a122cfed8" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:53.749842  9048 raft_consensus.cc:2393] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c955bfd0b9541f9860c5f84cb255b90 in current term 1: Already voted for candidate 245d19d5c71647a9857ac68df13802d5 in this term.
I20260709 13:03:53.750970  8969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a097a815a3194dc7a54ca93a122cfed8" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:53.759895  9403 raft_consensus.cc:493] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.765602  9189 consensus_queue.cc:1048] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:03:53.770979  9403 raft_consensus.cc:515] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:53.762642  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4408002b8e4e67a7bf17118232afd5" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:53.772540  8900 raft_consensus.cc:3060] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.756873  9425 leader_election.cc:290] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:53.783433  8791 leader_election.cc:304] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:53.785475  9429 raft_consensus.cc:3060] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.787578  9403 leader_election.cc:290] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:53.790308  8821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b04160c71b417c9a4db4e3f6692906" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:53.791198  9411 consensus_queue.cc:1048] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:53.792662  9093 tablet_bootstrap.cc:654] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:53.793684  9013 leader_election.cc:343] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:53.796548  9440 log.cc:927] Time spent T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:03:53.798988  9092 tablet_bootstrap.cc:492] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:53.801855  9429 raft_consensus.cc:2749] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:53.804458  8722 catalog_manager.cc:5697] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.822286  9092 tablet_bootstrap.cc:654] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.827608  8721 catalog_manager.cc:5697] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 0 to 1, leader changed from <none> to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:53.842643  9095 tablet_bootstrap.cc:492] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:53.843546  9095 ts_tablet_manager.cc:1403] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.340s	user 0.016s	sys 0.005s
I20260709 13:03:53.844151  8900 raft_consensus.cc:2468] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:53.860432  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b04160c71b417c9a4db4e3f6692906" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:53.861155  8895 raft_consensus.cc:2468] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:53.862972  9094 tablet_bootstrap.cc:492] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:53.855371  9425 consensus_queue.cc:1048] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:03:53.864080  9094 ts_tablet_manager.cc:1403] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.253s	user 0.012s	sys 0.010s
I20260709 13:03:53.866751  9094 raft_consensus.cc:359] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:53.867506  9094 raft_consensus.cc:385] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.854933  9095 raft_consensus.cc:359] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:53.869256  9095 raft_consensus.cc:385] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.869529  9095 raft_consensus.cc:740] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.867878  9094 raft_consensus.cc:740] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.872530  9095 consensus_queue.cc:260] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:53.872922  9094 consensus_queue.cc:260] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:53.879235  9095 ts_tablet_manager.cc:1434] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.003s
I20260709 13:03:53.880467  9095 tablet_bootstrap.cc:492] T de61bcc226d7496e80bec49c06bd35f0 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:53.886221  9095 tablet_bootstrap.cc:654] T de61bcc226d7496e80bec49c06bd35f0 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.903275  9094 ts_tablet_manager.cc:1434] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:03:53.913100  9092 tablet_bootstrap.cc:492] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:53.913524  9092 ts_tablet_manager.cc:1403] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.140s	user 0.013s	sys 0.005s
I20260709 13:03:53.917755  9094 tablet_bootstrap.cc:492] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:53.922780  9093 tablet_bootstrap.cc:492] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:53.926786  9093 ts_tablet_manager.cc:1403] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.193s	user 0.021s	sys 0.025s
I20260709 13:03:53.930500  9444 raft_consensus.cc:493] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.931012  9444 raft_consensus.cc:515] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:53.933609  9444 leader_election.cc:290] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:53.934265  8969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5624f032fa846eebb830e2ea2bb857b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:53.936038  8866 leader_election.cc:343] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.904394  9011 leader_election.cc:304] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:03:53.938184  9419 raft_consensus.cc:2804] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.938578  9419 raft_consensus.cc:493] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.938915  9419 raft_consensus.cc:3060] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.939810  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5624f032fa846eebb830e2ea2bb857b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:53.941567  9414 consensus_queue.cc:1048] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:53.943001  9092 raft_consensus.cc:359] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:53.949649  9094 tablet_bootstrap.cc:654] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:53.944741  8865 leader_election.cc:343] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.952487  9092 raft_consensus.cc:385] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.952859  9092 raft_consensus.cc:740] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.952728  8865 leader_election.cc:304] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:53.956907  9444 raft_consensus.cc:2749] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:53.963179  9426 raft_consensus.cc:493] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.963814  9426 raft_consensus.cc:515] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:53.967873  9179 raft_consensus.cc:493] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.968698  9179 raft_consensus.cc:515] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:53.972728  9093 raft_consensus.cc:359] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:53.973438  9093 raft_consensus.cc:385] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.973716  9093 raft_consensus.cc:740] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.974466  9093 consensus_queue.cc:260] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:53.953594  9092 consensus_queue.cc:260] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:53.977836  9426 leader_election.cc:290] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:53.978152  9092 ts_tablet_manager.cc:1434] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:03:53.979156  9092 tablet_bootstrap.cc:492] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:53.978950  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75657aca6e034936ba57c704cedb5563" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:53.979369  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75657aca6e034936ba57c704cedb5563" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:53.980005  9043 raft_consensus.cc:2468] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:53.979939  8973 raft_consensus.cc:2468] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:53.981612  8790 leader_election.cc:304] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:53.982623  9426 raft_consensus.cc:2804] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.983027  9426 raft_consensus.cc:493] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.983364  9426 raft_consensus.cc:3060] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.990819  9419 raft_consensus.cc:515] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:53.993186  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c21ca1a09148199552cd054209efd1" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:53.994015  8824 raft_consensus.cc:2468] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 0.
I20260709 13:03:53.994957  9093 ts_tablet_manager.cc:1434] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.068s	user 0.001s	sys 0.005s
I20260709 13:03:53.995035  8865 leader_election.cc:304] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:53.995676  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b04160c71b417c9a4db4e3f6692906" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:53.996058  9442 raft_consensus.cc:2804] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:53.996594  9442 raft_consensus.cc:493] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:53.996775  9013 leader_election.cc:343] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:53.997067  9442 raft_consensus.cc:3060] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.991448  9179 leader_election.cc:290] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:54.001112  9419 leader_election.cc:290] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:54.001658  9093 tablet_bootstrap.cc:492] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:54.001819  9095 tablet_bootstrap.cc:492] T de61bcc226d7496e80bec49c06bd35f0 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:54.002307  9095 ts_tablet_manager.cc:1403] T de61bcc226d7496e80bec49c06bd35f0 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.000s
I20260709 13:03:54.010219  9092 tablet_bootstrap.cc:654] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.010340  9095 raft_consensus.cc:359] T de61bcc226d7496e80bec49c06bd35f0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.011072  9095 raft_consensus.cc:385] T de61bcc226d7496e80bec49c06bd35f0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.011363  9095 raft_consensus.cc:740] T de61bcc226d7496e80bec49c06bd35f0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.012127  9095 consensus_queue.cc:260] T de61bcc226d7496e80bec49c06bd35f0 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.014513  9095 ts_tablet_manager.cc:1434] T de61bcc226d7496e80bec49c06bd35f0 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:03:54.014853  9093 tablet_bootstrap.cc:654] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.023473  9095 tablet_bootstrap.cc:492] T e7a1a88fae5d41d0abb4bd9ee1898658 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:54.016410  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c21ca1a09148199552cd054209efd1" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:54.017109  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b04160c71b417c9a4db4e3f6692906" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:54.025082  9442 raft_consensus.cc:515] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.025691  8896 raft_consensus.cc:3060] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.030463  9095 tablet_bootstrap.cc:654] T e7a1a88fae5d41d0abb4bd9ee1898658 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.033545  9442 leader_election.cc:290] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:54.034153  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c21ca1a09148199552cd054209efd1" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:54.036958  8825 raft_consensus.cc:3060] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:54.041527  8865 leader_election.cc:343] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.035256  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c21ca1a09148199552cd054209efd1" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:54.039083  8896 raft_consensus.cc:2468] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
W20260709 13:03:54.045349  8865 leader_election.cc:343] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.019470  9426 raft_consensus.cc:515] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.047317  9011 leader_election.cc:304] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:03:54.048400  9419 raft_consensus.cc:2804] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.048918  9419 raft_consensus.cc:697] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:54.049750  9419 consensus_queue.cc:237] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.054804  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75657aca6e034936ba57c704cedb5563" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:54.055624  9094 tablet_bootstrap.cc:492] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:54.056201  9094 ts_tablet_manager.cc:1403] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.140s	user 0.020s	sys 0.014s
I20260709 13:03:54.060142  8825 raft_consensus.cc:2468] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:03:54.064733  8865 leader_election.cc:304] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:54.055591  9043 raft_consensus.cc:3060] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.070319  9442 raft_consensus.cc:2804] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.071008  9442 raft_consensus.cc:697] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:03:54.071985  9094 raft_consensus.cc:359] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.072880  8969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75657aca6e034936ba57c704cedb5563" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:54.074738  9094 raft_consensus.cc:385] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.075003  9094 raft_consensus.cc:740] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.076442  9094 consensus_queue.cc:260] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.053532  9426 leader_election.cc:290] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:54.096931  8969 raft_consensus.cc:3060] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.107293  9094 ts_tablet_manager.cc:1434] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:03:54.072067  9442 consensus_queue.cc:237] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.115319  9413 consensus_queue.cc:1048] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.117913  9093 tablet_bootstrap.cc:492] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:54.118347  9093 ts_tablet_manager.cc:1403] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.013s
I20260709 13:03:54.132373  9179 raft_consensus.cc:493] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.132933  9179 raft_consensus.cc:515] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.134987  9179 leader_election.cc:290] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:54.136878  8972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6933846b78c4c4cbeb23a2bedaff18b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:54.137236  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6933846b78c4c4cbeb23a2bedaff18b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
W20260709 13:03:54.138381  8866 leader_election.cc:343] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.140352  8972 raft_consensus.cc:3060] T de61bcc226d7496e80bec49c06bd35f0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.146162  9094 tablet_bootstrap.cc:492] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:54.152323  9444 consensus_queue.cc:1048] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.161522  9092 tablet_bootstrap.cc:492] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:54.162170  9092 ts_tablet_manager.cc:1403] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.183s	user 0.024s	sys 0.012s
I20260709 13:03:54.162784  9419 consensus_queue.cc:1048] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.165493  9193 raft_consensus.cc:493] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.165926  9092 raft_consensus.cc:359] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.166057  9193 raft_consensus.cc:515] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.166762  9092 raft_consensus.cc:385] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.167111  9092 raft_consensus.cc:740] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.168179  9193 leader_election.cc:290] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:54.165522  9444 consensus_queue.cc:1048] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:03:54.170089  8865 leader_election.cc:343] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.171913  8865 leader_election.cc:304] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:54.173128  9095 tablet_bootstrap.cc:492] T e7a1a88fae5d41d0abb4bd9ee1898658 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:54.173224  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3411c58e61642e499aafe48daae38e0" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:54.173727  9095 ts_tablet_manager.cc:1403] T e7a1a88fae5d41d0abb4bd9ee1898658 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.150s	user 0.016s	sys 0.012s
I20260709 13:03:54.174324  9093 raft_consensus.cc:359] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.174945  9093 raft_consensus.cc:385] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.167932  9092 consensus_queue.cc:260] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.175191  9093 raft_consensus.cc:740] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.176980  9412 raft_consensus.cc:2749] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.174420  8896 raft_consensus.cc:2468] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:54.178802  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3411c58e61642e499aafe48daae38e0" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:54.185160  9048 raft_consensus.cc:3060] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.185498  9011 leader_election.cc:304] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:54.188025  9094 tablet_bootstrap.cc:654] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.189060  9092 ts_tablet_manager.cc:1434] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:03:54.197880  9093 consensus_queue.cc:260] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.190297  9193 raft_consensus.cc:2804] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.191851  8722 catalog_manager.cc:5697] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 0 to 1, leader changed from <none> to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.186726  9413 consensus_queue.cc:1048] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:03:54.201679  9193 raft_consensus.cc:493] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.212278  9193 raft_consensus.cc:3060] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.212426  8717 catalog_manager.cc:5697] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.223448  9092 tablet_bootstrap.cc:492] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:54.227985  9093 ts_tablet_manager.cc:1434] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.109s	user 0.005s	sys 0.004s
W20260709 13:03:54.228451  8771 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:03:54.232486  9013 leader_election.cc:343] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.249567  9092 tablet_bootstrap.cc:654] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.225682  9043 raft_consensus.cc:2468] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:54.266395  9093 tablet_bootstrap.cc:492] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:54.267437  9419 consensus_queue.cc:1048] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.279768  9094 tablet_bootstrap.cc:492] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:54.280347  9094 ts_tablet_manager.cc:1403] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.152s	user 0.018s	sys 0.004s
I20260709 13:03:54.286877  8790 leader_election.cc:304] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:54.289239  9429 raft_consensus.cc:2804] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.290308  9429 raft_consensus.cc:697] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:54.291074  9429 consensus_queue.cc:237] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.283272  9094 raft_consensus.cc:359] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.294790  8969 raft_consensus.cc:2468] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:54.294763  9094 raft_consensus.cc:385] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.295756  9094 raft_consensus.cc:740] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.296090  9193 raft_consensus.cc:515] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.296511  9094 consensus_queue.cc:260] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.298882  8821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3411c58e61642e499aafe48daae38e0" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
W20260709 13:03:54.300282  9013 leader_election.cc:343] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.302438  9094 ts_tablet_manager.cc:1434] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:03:54.312243  9094 tablet_bootstrap.cc:492] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:54.318320  9193 leader_election.cc:290] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:54.319284  9093 tablet_bootstrap.cc:654] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.331342  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3411c58e61642e499aafe48daae38e0" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:54.332018  8894 raft_consensus.cc:3060] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:54.322595  9462 log.cc:927] Time spent T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:03:54.353029  9092 tablet_bootstrap.cc:492] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:54.353507  9092 ts_tablet_manager.cc:1403] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.143s	user 0.025s	sys 0.017s
I20260709 13:03:54.356345  9092 raft_consensus.cc:359] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.356995  9092 raft_consensus.cc:385] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.357223  9092 raft_consensus.cc:740] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.357678  9094 tablet_bootstrap.cc:654] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.364734  9092 consensus_queue.cc:260] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.373834  9179 raft_consensus.cc:493] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.374302  9179 raft_consensus.cc:515] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.376370  9179 leader_election.cc:290] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:54.377592  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828b8a5a081e4a93812c8523ddc2dd56" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:54.379014  8866 leader_election.cc:343] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.382249  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828b8a5a081e4a93812c8523ddc2dd56" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
W20260709 13:03:54.396298  8865 leader_election.cc:343] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.397035  8865 leader_election.cc:304] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:54.390856  8721 catalog_manager.cc:5697] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.400804  9095 raft_consensus.cc:359] T e7a1a88fae5d41d0abb4bd9ee1898658 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.401746  9095 raft_consensus.cc:385] T e7a1a88fae5d41d0abb4bd9ee1898658 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.402031  9095 raft_consensus.cc:740] T e7a1a88fae5d41d0abb4bd9ee1898658 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.402698  9092 ts_tablet_manager.cc:1434] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:03:54.407717  9092 tablet_bootstrap.cc:492] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:54.408082  8894 raft_consensus.cc:2468] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:54.415442  9095 consensus_queue.cc:260] T e7a1a88fae5d41d0abb4bd9ee1898658 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.392671  9429 raft_consensus.cc:493] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.417699  9429 raft_consensus.cc:515] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.419075  9095 ts_tablet_manager.cc:1434] T e7a1a88fae5d41d0abb4bd9ee1898658 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.245s	user 0.007s	sys 0.002s
I20260709 13:03:54.419847  9429 leader_election.cc:290] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:54.420707  9095 tablet_bootstrap.cc:492] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:54.423249  9011 leader_election.cc:304] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:03:54.403172  9445 raft_consensus.cc:2749] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.425568  9192 raft_consensus.cc:2804] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.426018  9192 raft_consensus.cc:697] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:54.426751  9192 consensus_queue.cc:237] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.433422  9095 tablet_bootstrap.cc:654] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.459543  9094 tablet_bootstrap.cc:492] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:54.460175  9094 ts_tablet_manager.cc:1403] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.148s	user 0.020s	sys 0.010s
I20260709 13:03:54.469813  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6933846b78c4c4cbeb23a2bedaff18b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:54.470407  8973 raft_consensus.cc:3060] T e7a1a88fae5d41d0abb4bd9ee1898658 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.473718  9092 tablet_bootstrap.cc:654] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:54.475277  8791 leader_election.cc:343] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.465200  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6933846b78c4c4cbeb23a2bedaff18b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:54.480860  8899 raft_consensus.cc:2468] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:54.481699  9093 tablet_bootstrap.cc:492] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:54.482172  9093 ts_tablet_manager.cc:1403] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.222s	user 0.021s	sys 0.021s
I20260709 13:03:54.484720  9093 raft_consensus.cc:359] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.485333  9093 raft_consensus.cc:385] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.485591  9093 raft_consensus.cc:740] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.486236  9093 consensus_queue.cc:260] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.488355  8788 leader_election.cc:304] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:54.494499  9426 raft_consensus.cc:2804] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.494995  9426 raft_consensus.cc:493] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.495405  9426 raft_consensus.cc:3060] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.502692  9095 tablet_bootstrap.cc:492] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:54.498804  9094 raft_consensus.cc:359] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.503204  9095 ts_tablet_manager.cc:1403] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.083s	user 0.021s	sys 0.024s
I20260709 13:03:54.503296  9094 raft_consensus.cc:385] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.503782  9094 raft_consensus.cc:740] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.504959  9093 ts_tablet_manager.cc:1434] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:03:54.504809  9094 consensus_queue.cc:260] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.509517  9093 tablet_bootstrap.cc:492] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:54.512056  9095 raft_consensus.cc:359] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.512710  9095 raft_consensus.cc:385] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.512859  9094 ts_tablet_manager.cc:1434] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
W20260709 13:03:54.513943  8865 consensus_peers.cc:597] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c -> Peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Couldn't send request to peer a6a0de662d36410c907287e73cb2e4db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:54.514848  9094 tablet_bootstrap.cc:492] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:54.522068  9094 tablet_bootstrap.cc:654] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.524626  9093 tablet_bootstrap.cc:654] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.533910  9426 raft_consensus.cc:515] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.536157  9179 raft_consensus.cc:493] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.536404  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6933846b78c4c4cbeb23a2bedaff18b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:54.536655  9179 raft_consensus.cc:515] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.537045  8898 raft_consensus.cc:3060] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.538691  9179 leader_election.cc:290] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:54.540095  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17c73a16b7141ef885babed8fb13dc6" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:54.542660  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17c73a16b7141ef885babed8fb13dc6" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:54.543134  9092 tablet_bootstrap.cc:492] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:54.543697  9092 ts_tablet_manager.cc:1403] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.137s	user 0.018s	sys 0.000s
W20260709 13:03:54.543617  8866 leader_election.cc:343] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:54.544509  8865 leader_election.cc:343] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.545044  8865 leader_election.cc:304] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:54.546252  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6933846b78c4c4cbeb23a2bedaff18b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:54.546427  9092 raft_consensus.cc:359] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.547138  9092 raft_consensus.cc:385] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.547477  9095 raft_consensus.cc:740] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
W20260709 13:03:54.547574  8791 leader_election.cc:343] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.546294  9179 raft_consensus.cc:2749] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.545272  9426 leader_election.cc:290] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:54.547755  8717 catalog_manager.cc:5697] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.548288  9095 consensus_queue.cc:260] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.550839  9095 ts_tablet_manager.cc:1434] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.002s
I20260709 13:03:54.547405  9092 raft_consensus.cc:740] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.553692  8898 raft_consensus.cc:2468] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:54.554481  9092 consensus_queue.cc:260] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.554085  9095 tablet_bootstrap.cc:492] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:54.555107  8788 leader_election.cc:304] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:54.556882  9426 raft_consensus.cc:2804] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.564924  9092 ts_tablet_manager.cc:1434] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:03:54.572558  9095 tablet_bootstrap.cc:654] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.573853  9094 tablet_bootstrap.cc:492] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:54.575004  9094 ts_tablet_manager.cc:1403] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.060s	user 0.029s	sys 0.009s
I20260709 13:03:54.575459  9179 raft_consensus.cc:493] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.576110  9179 raft_consensus.cc:515] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.578260  9179 leader_election.cc:290] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:54.579378  9093 tablet_bootstrap.cc:492] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:54.579888  9093 ts_tablet_manager.cc:1403] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.000s
I20260709 13:03:54.579811  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72811528754f96a5b00504f8d032e0" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:54.581760  8866 leader_election.cc:343] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.583107  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72811528754f96a5b00504f8d032e0" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:54.586925  9093 raft_consensus.cc:359] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.592648  9092 tablet_bootstrap.cc:492] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
W20260709 13:03:54.596004  8865 leader_election.cc:343] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.596623  8865 leader_election.cc:304] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:54.596248  9095 tablet_bootstrap.cc:492] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:54.597599  9095 ts_tablet_manager.cc:1403] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.004s
I20260709 13:03:54.599612  9179 raft_consensus.cc:2749] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.600569  9095 raft_consensus.cc:359] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.601339  9095 raft_consensus.cc:385] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.601646  9095 raft_consensus.cc:740] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.602017  9093 raft_consensus.cc:385] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.602365  9093 raft_consensus.cc:740] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.602517  9095 consensus_queue.cc:260] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.605890  9095 ts_tablet_manager.cc:1434] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:03:54.607595  9095 tablet_bootstrap.cc:492] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
W20260709 13:03:54.609654  9013 consensus_peers.cc:597] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:54.610632  9093 consensus_queue.cc:260] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.604274  9426 raft_consensus.cc:697] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:54.612927  9426 consensus_queue.cc:237] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.611804  9094 raft_consensus.cc:359] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.616434  9094 raft_consensus.cc:385] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.616740  9094 raft_consensus.cc:740] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.617425  9092 tablet_bootstrap.cc:654] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.617578  9094 consensus_queue.cc:260] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.618976  9093 ts_tablet_manager.cc:1434] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:03:54.620223  9093 tablet_bootstrap.cc:492] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:54.622079  9179 consensus_queue.cc:1048] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.625790  9093 tablet_bootstrap.cc:654] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.632030  9095 tablet_bootstrap.cc:654] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.635093  9193 consensus_queue.cc:1048] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.639603  9289 raft_consensus.cc:493] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.640141  9289 raft_consensus.cc:515] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.640784  9094 ts_tablet_manager.cc:1434] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.001s
I20260709 13:03:54.641721  9094 tablet_bootstrap.cc:492] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:54.643050  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb43858b9264896af25d56cdbb44d80" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:54.646111  8973 raft_consensus.cc:2468] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:54.648288  8791 leader_election.cc:304] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:54.649221  9189 raft_consensus.cc:2804] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.649734  9189 raft_consensus.cc:493] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.650127  9189 raft_consensus.cc:3060] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.649364  9094 tablet_bootstrap.cc:654] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.653332  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb43858b9264896af25d56cdbb44d80" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:54.653978  9048 raft_consensus.cc:2468] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:54.655526  9289 leader_election.cc:290] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:54.655690  9093 tablet_bootstrap.cc:492] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:54.674244  9093 ts_tablet_manager.cc:1403] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.000s
I20260709 13:03:54.678128  9426 raft_consensus.cc:493] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.680087  9426 raft_consensus.cc:515] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.680296  9189 raft_consensus.cc:515] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.683470  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb43858b9264896af25d56cdbb44d80" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:54.683777  9189 leader_election.cc:290] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:54.686167  9445 raft_consensus.cc:493] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.686673  9445 raft_consensus.cc:515] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.687678  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb43858b9264896af25d56cdbb44d80" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:54.688330  9048 raft_consensus.cc:3060] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.688864  9445 leader_election.cc:290] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:54.692257  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:54.693239  9093 raft_consensus.cc:359] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.693779  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:54.693881  9093 raft_consensus.cc:385] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.694403  9093 raft_consensus.cc:740] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.694519  8717 catalog_manager.cc:5697] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:54.695307  8865 leader_election.cc:343] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:54.696996  8865 leader_election.cc:343] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.697176  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105ca1309d4c495293d5da6c6b316b04" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:54.697391  8865 leader_election.cc:304] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:54.698146  9442 raft_consensus.cc:2749] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:54.698844  8791 leader_election.cc:343] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.684130  8973 raft_consensus.cc:3060] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.699441  9093 consensus_queue.cc:260] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.702265  9093 ts_tablet_manager.cc:1434] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:03:54.703279  9093 tablet_bootstrap.cc:492] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:54.707791  8973 raft_consensus.cc:2468] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:54.699396  9095 tablet_bootstrap.cc:492] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:54.708729  9095 ts_tablet_manager.cc:1403] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.101s	user 0.017s	sys 0.003s
I20260709 13:03:54.709369  8791 leader_election.cc:304] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:54.710409  9189 raft_consensus.cc:2804] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.711110  9189 raft_consensus.cc:697] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:54.711936  9189 consensus_queue.cc:237] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.711539  9095 raft_consensus.cc:359] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.712953  9095 raft_consensus.cc:385] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.713238  9095 raft_consensus.cc:740] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.713919  9094 tablet_bootstrap.cc:492] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:54.713950  9095 consensus_queue.cc:260] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.714547  9094 ts_tablet_manager.cc:1403] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.000s
I20260709 13:03:54.717200  9094 raft_consensus.cc:359] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.717795  9094 raft_consensus.cc:385] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.718037  9094 raft_consensus.cc:740] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.718791  9094 consensus_queue.cc:260] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.721418  9094 ts_tablet_manager.cc:1434] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:54.722347  9094 tablet_bootstrap.cc:492] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:54.722627  9095 ts_tablet_manager.cc:1434] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:03:54.724488  9093 tablet_bootstrap.cc:654] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.727566  9095 tablet_bootstrap.cc:492] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:54.728134  9094 tablet_bootstrap.cc:654] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.735513  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105ca1309d4c495293d5da6c6b316b04" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:54.733698  9426 leader_election.cc:290] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
W20260709 13:03:54.737594  8790 leader_election.cc:343] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.738025  8790 leader_election.cc:304] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:54.739074  9289 raft_consensus.cc:2749] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.743525  9094 tablet_bootstrap.cc:492] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:54.744058  9094 ts_tablet_manager.cc:1403] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:03:54.745944  9092 tablet_bootstrap.cc:492] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:54.747947  9092 ts_tablet_manager.cc:1403] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.166s	user 0.010s	sys 0.006s
I20260709 13:03:54.749344  9094 raft_consensus.cc:359] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.750151  9094 raft_consensus.cc:385] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.750382  9426 raft_consensus.cc:493] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.750677  9094 raft_consensus.cc:740] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.751209  9426 raft_consensus.cc:515] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.751835  9094 consensus_queue.cc:260] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.754035  9048 raft_consensus.cc:2468] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:54.764233  9386 raft_consensus.cc:493] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.764770  9386 raft_consensus.cc:515] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.765460  9095 tablet_bootstrap.cc:654] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.767611  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17c73a16b7141ef885babed8fb13dc6" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:54.767671  9092 raft_consensus.cc:359] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.768401  9092 raft_consensus.cc:385] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.768795  9092 raft_consensus.cc:740] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.769923  9093 tablet_bootstrap.cc:492] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:54.770391  9093 ts_tablet_manager.cc:1403] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.000s
I20260709 13:03:54.770727  9426 leader_election.cc:290] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:54.771113  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828b8a5a081e4a93812c8523ddc2dd56" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:54.771772  8896 raft_consensus.cc:2468] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:54.771486  9092 consensus_queue.cc:260] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.773597  8788 leader_election.cc:304] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:54.774111  9092 ts_tablet_manager.cc:1434] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:03:54.775089  9092 tablet_bootstrap.cc:492] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c: Bootstrap starting.
I20260709 13:03:54.775728  9189 raft_consensus.cc:2804] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.776108  9189 raft_consensus.cc:493] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.776403  9189 raft_consensus.cc:3060] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.777139  8722 catalog_manager.cc:5697] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.768353  8898 raft_consensus.cc:2468] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 0.
I20260709 13:03:54.781504  9095 tablet_bootstrap.cc:492] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:54.771826  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828b8a5a081e4a93812c8523ddc2dd56" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:54.781970  9095 ts_tablet_manager.cc:1403] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.008s
W20260709 13:03:54.783624  8791 leader_election.cc:343] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.781962  8937 leader_election.cc:304] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:54.785275  9467 raft_consensus.cc:2804] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.785625  9467 raft_consensus.cc:493] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.785956  9467 raft_consensus.cc:3060] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.786412  9094 ts_tablet_manager.cc:1434] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.011s
I20260709 13:03:54.787731  9094 tablet_bootstrap.cc:492] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:54.789368  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17c73a16b7141ef885babed8fb13dc6" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:54.789999  9045 raft_consensus.cc:2468] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 0.
I20260709 13:03:54.790042  9093 raft_consensus.cc:359] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.790918  9093 raft_consensus.cc:385] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.792164  9412 raft_consensus.cc:493] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.792634  9412 raft_consensus.cc:515] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.794615  9412 leader_election.cc:290] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:54.795945  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c1944d902340e79c6e9648cad9d681" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:54.796641  9094 tablet_bootstrap.cc:654] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.796813  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c1944d902340e79c6e9648cad9d681" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:54.797292  8865 leader_election.cc:343] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:54.798127  8866 leader_election.cc:343] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.798507  8866 leader_election.cc:304] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:54.801446  9095 raft_consensus.cc:359] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.802096  9095 raft_consensus.cc:385] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.802388  9095 raft_consensus.cc:740] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.803028  9095 consensus_queue.cc:260] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.805114  9412 raft_consensus.cc:2749] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.805240  9095 ts_tablet_manager.cc:1434] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.002s
I20260709 13:03:54.807267  9095 tablet_bootstrap.cc:492] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:54.791292  9093 raft_consensus.cc:740] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.785629  9386 leader_election.cc:290] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:54.812103  9093 consensus_queue.cc:260] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.817062  9467 raft_consensus.cc:515] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.819810  9093 ts_tablet_manager.cc:1434] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:03:54.819679  9189 raft_consensus.cc:515] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.820842  9093 tablet_bootstrap.cc:492] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:54.821530  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17c73a16b7141ef885babed8fb13dc6" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:54.821792  9189 leader_election.cc:290] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:54.822088  8898 raft_consensus.cc:3060] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.823901  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828b8a5a081e4a93812c8523ddc2dd56" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:54.824709  8896 raft_consensus.cc:3060] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.826601  9094 tablet_bootstrap.cc:492] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:54.827061  9094 ts_tablet_manager.cc:1403] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.001s
I20260709 13:03:54.832798  9467 leader_election.cc:290] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:54.833421  9092 tablet_bootstrap.cc:654] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.833698  9094 raft_consensus.cc:359] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.835760  9094 raft_consensus.cc:385] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.836401  9094 raft_consensus.cc:740] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.836622  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b17c73a16b7141ef885babed8fb13dc6" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:54.837318  9043 raft_consensus.cc:3060] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.837154  9094 consensus_queue.cc:260] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.838675  9094 ts_tablet_manager.cc:1434] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:03:54.839586  9094 tablet_bootstrap.cc:492] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:54.839723  9095 tablet_bootstrap.cc:654] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.843808  9093 tablet_bootstrap.cc:654] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.851017  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828b8a5a081e4a93812c8523ddc2dd56" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:54.851519  9094 tablet_bootstrap.cc:654] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:54.852376  8791 leader_election.cc:343] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.857291  9093 tablet_bootstrap.cc:492] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:54.857877  9093 ts_tablet_manager.cc:1403] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 13:03:54.860561  9094 tablet_bootstrap.cc:492] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:54.861034  9094 ts_tablet_manager.cc:1403] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.000s
W20260709 13:03:54.862089  9013 consensus_peers.cc:597] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:54.863700  9094 raft_consensus.cc:359] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.864344  9094 raft_consensus.cc:385] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.864593  9094 raft_consensus.cc:740] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.865324  9094 consensus_queue.cc:260] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.873162  9094 ts_tablet_manager.cc:1434] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:03:54.874612  9094 tablet_bootstrap.cc:492] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:54.877308  9095 tablet_bootstrap.cc:492] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:54.877979  9095 ts_tablet_manager.cc:1403] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.005s
I20260709 13:03:54.880529  9419 raft_consensus.cc:493] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.881173  9095 raft_consensus.cc:359] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.881351  9094 tablet_bootstrap.cc:654] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.881873  9095 raft_consensus.cc:385] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.882165  9095 raft_consensus.cc:740] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.881301  9419 raft_consensus.cc:515] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.883960  9419 leader_election.cc:290] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:54.884789  9095 consensus_queue.cc:260] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.885119  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5624f032fa846eebb830e2ea2bb857b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:54.886009  8899 raft_consensus.cc:2468] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:54.885890  9093 raft_consensus.cc:359] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.887956  9093 raft_consensus.cc:385] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.888255  9093 raft_consensus.cc:740] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.888351  9011 leader_election.cc:304] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:54.889617  9419 raft_consensus.cc:2804] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.890399  9419 raft_consensus.cc:493] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.890585  9095 ts_tablet_manager.cc:1434] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:03:54.891301  9419 raft_consensus.cc:3060] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.891708  9093 consensus_queue.cc:260] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.904837  9093 ts_tablet_manager.cc:1434] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.047s	user 0.003s	sys 0.006s
I20260709 13:03:54.929054  9093 tablet_bootstrap.cc:492] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:54.933885  9414 raft_consensus.cc:493] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.934435  9414 raft_consensus.cc:515] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:54.905510  9095 tablet_bootstrap.cc:492] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:54.907897  9094 tablet_bootstrap.cc:492] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:54.915700  9403 raft_consensus.cc:493] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.939849  9093 tablet_bootstrap.cc:654] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.944856  9094 ts_tablet_manager.cc:1403] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.071s	user 0.022s	sys 0.008s
I20260709 13:03:54.948166  9094 raft_consensus.cc:359] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.949189  9094 raft_consensus.cc:385] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.949483  9094 raft_consensus.cc:740] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.949275  9403 raft_consensus.cc:515] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:54.953003  9095 tablet_bootstrap.cc:654] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.954648  8821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105ca1309d4c495293d5da6c6b316b04" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:54.955377  8821 raft_consensus.cc:2468] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:54.956302  9094 consensus_queue.cc:260] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.953085  9403 leader_election.cc:290] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:54.925311  8898 raft_consensus.cc:2468] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:03:54.915467  9429 consensus_queue.cc:1048] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:03:54.926312  9419 raft_consensus.cc:515] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.910784  8973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5624f032fa846eebb830e2ea2bb857b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:54.959964  9189 consensus_queue.cc:1048] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.961048  8937 leader_election.cc:304] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:54.961990  9467 raft_consensus.cc:2804] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.962739  9467 raft_consensus.cc:697] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
W20260709 13:03:54.964285  9014 leader_election.cc:343] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.956744  9013 leader_election.cc:304] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:54.968762  9419 leader_election.cc:290] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:54.971060  9193 raft_consensus.cc:2804] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.972172  9193 raft_consensus.cc:493] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.972903  9193 raft_consensus.cc:3060] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.937597  9416 raft_consensus.cc:493] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.963896  9467 consensus_queue.cc:237] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:54.974887  9416 raft_consensus.cc:515] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:54.979075  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c21ca1a09148199552cd054209efd1" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:54.981178  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21c21ca1a09148199552cd054209efd1" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:54.944193  9414 leader_election.cc:290] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:54.919402  8896 raft_consensus.cc:2468] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:54.990038  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5624f032fa846eebb830e2ea2bb857b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:54.994473  8898 raft_consensus.cc:3060] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.995134  9013 leader_election.cc:304] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:54.996270  9414 raft_consensus.cc:2749] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.001760  8898 raft_consensus.cc:2468] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:54.958876  9094 ts_tablet_manager.cc:1434] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:03:55.006078  8967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5624f032fa846eebb830e2ea2bb857b" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:55.011299  8970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105ca1309d4c495293d5da6c6b316b04" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:55.017761  9094 tablet_bootstrap.cc:492] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:55.017854  9193 raft_consensus.cc:515] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:55.016767  9011 leader_election.cc:304] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:55.024319  8970 raft_consensus.cc:2468] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:55.042523  9092 tablet_bootstrap.cc:492] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c: No bootstrap required, opened a new log
I20260709 13:03:55.044713  9092 ts_tablet_manager.cc:1403] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c: Time spent bootstrapping tablet: real 0.269s	user 0.021s	sys 0.046s
I20260709 13:03:55.045928  9193 leader_election.cc:290] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:54.903008  9043 raft_consensus.cc:2468] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:03:55.027885  9414 raft_consensus.cc:2804] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.060070  9414 raft_consensus.cc:697] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:55.060966  9414 consensus_queue.cc:237] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:55.061870  9416 leader_election.cc:290] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
W20260709 13:03:55.063663  9014 leader_election.cc:343] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.064592  8968 raft_consensus.cc:3060] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.065376  8788 leader_election.cc:304] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:55.066416  9189 raft_consensus.cc:2804] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.066874  9189 raft_consensus.cc:697] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:55.067039  9092 raft_consensus.cc:359] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:55.067600  8967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105ca1309d4c495293d5da6c6b316b04" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:55.068248  9092 raft_consensus.cc:385] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.068488  8967 raft_consensus.cc:3060] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.068574  9092 raft_consensus.cc:740] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.067737  9189 consensus_queue.cc:237] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:55.076812  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6933846b78c4c4cbeb23a2bedaff18b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:55.080778  8899 raft_consensus.cc:2393] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate 0c955bfd0b9541f9860c5f84cb255b90 in this term.
I20260709 13:03:55.077804  9092 consensus_queue.cc:260] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:55.083575  9095 tablet_bootstrap.cc:492] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:55.084030  9095 ts_tablet_manager.cc:1403] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.179s	user 0.032s	sys 0.044s
I20260709 13:03:55.086792  9092 ts_tablet_manager.cc:1434] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 13:03:55.068826  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6933846b78c4c4cbeb23a2bedaff18b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:55.105701  9095 raft_consensus.cc:359] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:55.106477  9095 raft_consensus.cc:385] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.106745  9095 raft_consensus.cc:740] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.111220  8937 leader_election.cc:304] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:55.111608  8824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105ca1309d4c495293d5da6c6b316b04" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:55.116151  8824 raft_consensus.cc:3060] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.108934  8717 catalog_manager.cc:5697] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.107395  9095 consensus_queue.cc:260] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:55.122537  8825 raft_consensus.cc:3060] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.125054  9094 tablet_bootstrap.cc:654] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.135816  9095 ts_tablet_manager.cc:1434] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.003s
I20260709 13:03:55.121799  9046 raft_consensus.cc:3060] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.145838  9192 raft_consensus.cc:493] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.146322  9192 raft_consensus.cc:515] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:55.154209  9093 tablet_bootstrap.cc:492] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:55.154867  9093 ts_tablet_manager.cc:1403] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.226s	user 0.025s	sys 0.015s
I20260709 13:03:55.155745  8824 raft_consensus.cc:2468] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:55.157541  9412 raft_consensus.cc:493] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.158053  9412 raft_consensus.cc:515] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:55.162180  9095 tablet_bootstrap.cc:492] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:55.124379  9505 consensus_queue.cc:1048] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:03:55.170362  9192 leader_election.cc:290] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:55.172641  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ed6c910f234c96ad999ea23411bc89" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:55.173862  8899 raft_consensus.cc:2468] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:55.181212  9011 leader_election.cc:304] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:55.194725  9403 raft_consensus.cc:2804] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.183320  9412 leader_election.cc:290] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:55.194041  8967 raft_consensus.cc:2468] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:55.219091  9403 raft_consensus.cc:493] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.218731  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ed6c910f234c96ad999ea23411bc89" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:55.254256  8722 catalog_manager.cc:5697] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.230429  9013 leader_election.cc:304] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:55.220286  9289 consensus_queue.cc:1048] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 13:03:55.252543  9403 raft_consensus.cc:3060] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:55.280818  9013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 50461.7us
W20260709 13:03:55.281353  8788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 104750us
I20260709 13:03:55.280866  9192 raft_consensus.cc:2804] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.267558  8821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ed6c910f234c96ad999ea23411bc89" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:55.297749  9192 raft_consensus.cc:697] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:55.298651  9192 consensus_queue.cc:237] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:55.288522  9505 raft_consensus.cc:493] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.304220  9416 raft_consensus.cc:493] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:55.318197  9013 leader_election.cc:343] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.322887  9093 raft_consensus.cc:359] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:55.323696  9093 raft_consensus.cc:385] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.323990  9093 raft_consensus.cc:740] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.329692  9094 tablet_bootstrap.cc:492] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:55.330184  9094 ts_tablet_manager.cc:1403] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.313s	user 0.010s	sys 0.009s
I20260709 13:03:55.330732  9093 consensus_queue.cc:260] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
W20260709 13:03:55.333528  9510 log.cc:927] Time spent T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:03:55.325515  9386 raft_consensus.cc:493] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:55.340379  8771 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:55.312465  9416 raft_consensus.cc:515] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:55.350700  9416 leader_election.cc:290] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:55.321403  9426 consensus_queue.cc:1048] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:03:55.315735  9505 raft_consensus.cc:515] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:55.357966  9093 ts_tablet_manager.cc:1434] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.203s	user 0.009s	sys 0.000s
W20260709 13:03:55.344986  9512 log.cc:927] Time spent T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
I20260709 13:03:55.344753  9386 raft_consensus.cc:515] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:55.362960  9386 leader_election.cc:290] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:55.369582  8723 catalog_manager.cc:5697] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.370605  9095 tablet_bootstrap.cc:654] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.372900  9505 leader_election.cc:290] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:55.380709  9467 raft_consensus.cc:2749] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.396618  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828b8a5a081e4a93812c8523ddc2dd56" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:55.397117  8822 raft_consensus.cc:3060] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.397540  8894 raft_consensus.cc:2393] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate 0c955bfd0b9541f9860c5f84cb255b90 in this term.
I20260709 13:03:55.397985  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3d7a987863451999601c9a8735d401" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:55.398752  8825 raft_consensus.cc:2468] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:55.400059  9093 tablet_bootstrap.cc:492] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:55.401511  9013 leader_election.cc:304] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:55.427740  9192 raft_consensus.cc:493] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.416644  9507 raft_consensus.cc:2804] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.405427  9289 consensus_queue.cc:1048] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:03:55.429181  9192 raft_consensus.cc:515] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:55.424731  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5624f032fa846eebb830e2ea2bb857b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:55.449188  9192 leader_election.cc:290] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:55.433329  9507 raft_consensus.cc:493] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.433183  9513 consensus_queue.cc:1048] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:03:55.452242  9507 raft_consensus.cc:3060] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.463913  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ed6c910f234c96ad999ea23411bc89" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:55.468492  9403 raft_consensus.cc:515] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:55.470582  9403 leader_election.cc:290] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:55.472077  9043 raft_consensus.cc:2393] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 60a19ab523e3468bb9aacada2c24362c in current term 1: Already voted for candidate a6a0de662d36410c907287e73cb2e4db in this term.
I20260709 13:03:55.473860  8818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828b8a5a081e4a93812c8523ddc2dd56" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:55.458793  9094 raft_consensus.cc:359] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:55.490623  9094 raft_consensus.cc:385] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.490908  9094 raft_consensus.cc:740] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.458823  8899 raft_consensus.cc:2393] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate a6a0de662d36410c907287e73cb2e4db in this term.
W20260709 13:03:55.446951  8937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 69392.8us
I20260709 13:03:55.502622  8969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3d7a987863451999601c9a8735d401" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:55.504452  8972 raft_consensus.cc:3060] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.507761  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c1944d902340e79c6e9648cad9d681" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:55.509788  8820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ed6c910f234c96ad999ea23411bc89" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:55.515947  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5624f032fa846eebb830e2ea2bb857b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:55.521204  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c1944d902340e79c6e9648cad9d681" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:55.529281  8894 raft_consensus.cc:2468] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
W20260709 13:03:55.534360  9013 leader_election.cc:343] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.535326  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ed6c910f234c96ad999ea23411bc89" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:55.535954  8894 raft_consensus.cc:3060] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.542546  9094 consensus_queue.cc:260] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:55.545265  9094 ts_tablet_manager.cc:1434] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.215s	user 0.007s	sys 0.004s
I20260709 13:03:55.549836  9093 tablet_bootstrap.cc:654] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:55.566581  9014 leader_election.cc:343] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.587342  9014 leader_election.cc:304] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5
W20260709 13:03:55.594944  9014 leader_election.cc:343] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.597427  9193 raft_consensus.cc:2804] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:55.598170  9193 raft_consensus.cc:493] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.598628  9193 raft_consensus.cc:3060] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.608227  9094 tablet_bootstrap.cc:492] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db: Bootstrap starting.
I20260709 13:03:55.613708  8717 catalog_manager.cc:5697] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:55.620666  8865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 149688us
I20260709 13:03:55.602757  8939 leader_election.cc:304] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
W20260709 13:03:55.625710  8865 leader_election.cc:343] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:55.641216  8939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:45733, user_credentials={real_user=slave}} blocked reactor thread for 57582.1us
I20260709 13:03:55.643512  9193 raft_consensus.cc:515] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:55.652070  8969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c1944d902340e79c6e9648cad9d681" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
W20260709 13:03:55.653839  9014 leader_election.cc:343] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.659825  9193 leader_election.cc:290] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
W20260709 13:03:55.660619  9011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 92175.4us
I20260709 13:03:55.666463  8939 leader_election.cc:304] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:55.681452  9095 tablet_bootstrap.cc:492] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:55.682101  9095 ts_tablet_manager.cc:1403] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.535s	user 0.018s	sys 0.016s
I20260709 13:03:55.662616  9429 raft_consensus.cc:493] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a6a0de662d36410c907287e73cb2e4db)
W20260709 13:03:55.709306  8865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 82768.1us
I20260709 13:03:55.666821  9525 raft_consensus.cc:2749] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.671799  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c1944d902340e79c6e9648cad9d681" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:55.691375  9522 raft_consensus.cc:3060] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.717561  8865 leader_election.cc:304] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:55.722457  9095 raft_consensus.cc:359] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:55.723227  9095 raft_consensus.cc:385] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.723640  9095 raft_consensus.cc:740] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
W20260709 13:03:55.726295  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:33479, user_credentials={real_user=slave}} blocked reactor thread for 55034.3us
I20260709 13:03:55.674248  9514 consensus_queue.cc:1048] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 13:03:55.724345  9095 consensus_queue.cc:260] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:55.745878  9193 consensus_queue.cc:1048] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:55.753219  9095 ts_tablet_manager.cc:1434] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.002s
I20260709 13:03:55.722887  8896 raft_consensus.cc:3060] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:55.761171  9011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 87793.2us
I20260709 13:03:55.718568  9429 raft_consensus.cc:515] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:55.794508  9094 tablet_bootstrap.cc:654] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.815711  9507 raft_consensus.cc:515] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:55.819515  9093 tablet_bootstrap.cc:492] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:55.820084  9093 ts_tablet_manager.cc:1403] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.427s	user 0.018s	sys 0.010s
I20260709 13:03:55.816588  9095 tablet_bootstrap.cc:492] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
W20260709 13:03:55.761502  8866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:33479, user_credentials={real_user=slave}} blocked reactor thread for 97014.6us
I20260709 13:03:55.822095  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3411c58e61642e499aafe48daae38e0" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:55.776765  8894 raft_consensus.cc:2468] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:55.831228  9445 raft_consensus.cc:2749] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.839365  9429 leader_election.cc:290] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:55.827334  9525 consensus_queue.cc:1048] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:03:55.841531  9093 raft_consensus.cc:359] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:55.859755  9093 raft_consensus.cc:385] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:55.860082  9093 raft_consensus.cc:740] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:55.864187  9522 raft_consensus.cc:2749] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:55.866396  9011 leader_election.cc:304] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:03:55.868599  9414 raft_consensus.cc:2804] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.869751  9414 raft_consensus.cc:697] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:55.870899  9414 consensus_queue.cc:237] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
W20260709 13:03:55.899780  9013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 92585.6us
I20260709 13:03:55.875325  9093 consensus_queue.cc:260] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:55.911827  9193 consensus_queue.cc:1048] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:55.916253  8939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 224541us
W20260709 13:03:55.918416  8865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:45733, user_credentials={real_user=slave}} blocked reactor thread for 201097us
I20260709 13:03:55.906462  9518 raft_consensus.cc:493] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.930540  8968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3d7a987863451999601c9a8735d401" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:55.933466  9095 tablet_bootstrap.cc:654] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:55.939636  8896 raft_consensus.cc:2468] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:55.941458  9192 consensus_queue.cc:1048] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.917771  9507 leader_election.cc:290] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
W20260709 13:03:55.942976  9014 leader_election.cc:343] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:55.956231  8821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3d7a987863451999601c9a8735d401" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:55.957134  8821 raft_consensus.cc:3060] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:55.927820  9525 consensus_queue.cc:1048] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 13:03:56.003363  9193 raft_consensus.cc:493] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.004029  9193 raft_consensus.cc:515] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:56.008993  9011 leader_election.cc:304] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:56.010411  9414 raft_consensus.cc:2804] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:55.940639  9508 consensus_queue.cc:1048] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.063s
I20260709 13:03:56.024310  9193 leader_election.cc:290] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:55.928233  9518 raft_consensus.cc:515] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:56.016605  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3411c58e61642e499aafe48daae38e0" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:56.050894  9518 leader_election.cc:290] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:56.031793  8817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:56.051631  8817 raft_consensus.cc:2468] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:56.060388  9513 consensus_queue.cc:1048] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.064644  9013 leader_election.cc:304] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:56.066723  9192 raft_consensus.cc:2804] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.067623  9192 raft_consensus.cc:493] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.067934  9192 raft_consensus.cc:3060] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.072279  9094 tablet_bootstrap.cc:492] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db: No bootstrap required, opened a new log
I20260709 13:03:56.078703  9094 ts_tablet_manager.cc:1403] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db: Time spent bootstrapping tablet: real 0.484s	user 0.013s	sys 0.009s
I20260709 13:03:56.080600  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:56.088440  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:56.089095  8896 raft_consensus.cc:2468] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:56.091184  9525 raft_consensus.cc:493] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.091792  9525 raft_consensus.cc:515] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:56.086607  8723 catalog_manager.cc:5697] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.023176  9414 raft_consensus.cc:697] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:03:56.093937  9525 leader_election.cc:290] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:56.122723  9093 ts_tablet_manager.cc:1434] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.302s	user 0.011s	sys 0.000s
W20260709 13:03:56.084044  8937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 53309.8us
I20260709 13:03:56.146461  9093 tablet_bootstrap.cc:492] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:56.128043  8821 raft_consensus.cc:2468] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:03:56.163892  8788 leader_election.cc:304] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:56.166376  8788 leader_election.cc:304] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:56.166916  9189 raft_consensus.cc:2749] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:56.167709  9189 raft_consensus.cc:2804] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.168042  9189 raft_consensus.cc:493] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.168346  9189 raft_consensus.cc:3060] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.174069  9192 raft_consensus.cc:515] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:56.181200  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:56.164417  9414 consensus_queue.cc:237] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:56.181900  8895 raft_consensus.cc:2468] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 0.
I20260709 13:03:56.182320  8822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72811528754f96a5b00504f8d032e0" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
W20260709 13:03:56.185339  8939 leader_election.cc:343] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.188265  9095 tablet_bootstrap.cc:492] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:56.188783  9095 ts_tablet_manager.cc:1403] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.372s	user 0.013s	sys 0.017s
I20260709 13:03:56.199993  9045 raft_consensus.cc:2393] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c955bfd0b9541f9860c5f84cb255b90 in current term 1: Already voted for candidate a6a0de662d36410c907287e73cb2e4db in this term.
I20260709 13:03:56.215194  9192 leader_election.cc:290] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:56.212177  9189 raft_consensus.cc:515] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:56.227357  9095 raft_consensus.cc:359] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:56.228919  9189 leader_election.cc:290] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
W20260709 13:03:56.232293  9546 log.cc:927] Time spent T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:03:56.228945  9095 raft_consensus.cc:385] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.238226  9095 raft_consensus.cc:740] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.244765  9095 consensus_queue.cc:260] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:56.248966  9094 raft_consensus.cc:359] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:56.249853  9094 raft_consensus.cc:385] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.250124  9094 raft_consensus.cc:740] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.252355  9095 ts_tablet_manager.cc:1434] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:03:56.253659  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:56.254392  8900 raft_consensus.cc:3060] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.256685  9093 tablet_bootstrap.cc:654] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.259573  8893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72811528754f96a5b00504f8d032e0" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:56.260314  8893 raft_consensus.cc:2468] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 0.
I20260709 13:03:56.265586  9094 consensus_queue.cc:260] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:56.275075  8937 leader_election.cc:304] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:03:56.282079  9522 raft_consensus.cc:2804] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.282742  9522 raft_consensus.cc:493] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.283105  9522 raft_consensus.cc:3060] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.286319  9094 ts_tablet_manager.cc:1434] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db: Time spent starting tablet: real 0.207s	user 0.008s	sys 0.000s
I20260709 13:03:56.288983  9507 raft_consensus.cc:493] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.298411  9095 tablet_bootstrap.cc:492] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:56.289736  9507 raft_consensus.cc:515] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:56.301923  9522 raft_consensus.cc:515] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:56.304033  9507 leader_election.cc:290] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:56.313776  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d68cd517ce44baf88aa239a275ce8d0" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:56.318845  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:56.319759  8818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72811528754f96a5b00504f8d032e0" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:56.305691  9522 leader_election.cc:290] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
W20260709 13:03:56.326472  8939 leader_election.cc:343] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.328419  9095 tablet_bootstrap.cc:654] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.364686  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:56.365588  9047 raft_consensus.cc:2393] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c955bfd0b9541f9860c5f84cb255b90 in current term 1: Already voted for candidate a6a0de662d36410c907287e73cb2e4db in this term.
I20260709 13:03:56.375106  8818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:03:56.376364  8818 raft_consensus.cc:2393] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a6a0de662d36410c907287e73cb2e4db in current term 1: Already voted for candidate 0c955bfd0b9541f9860c5f84cb255b90 in this term.
I20260709 13:03:56.376785  8900 raft_consensus.cc:2468] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:56.377914  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72811528754f96a5b00504f8d032e0" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:03:56.378509  8896 raft_consensus.cc:3060] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.378721  9095 tablet_bootstrap.cc:492] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:56.379180  9095 ts_tablet_manager.cc:1403] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.000s
I20260709 13:03:56.380505  8788 leader_election.cc:304] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:03:56.381940  9095 raft_consensus.cc:359] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:56.382627  9095 raft_consensus.cc:385] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.382874  9095 raft_consensus.cc:740] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
W20260709 13:03:56.392318  9013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 60687.9us
I20260709 13:03:56.393019  9013 leader_election.cc:304] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:56.395387  9095 consensus_queue.cc:260] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
W20260709 13:03:56.402770  9014 leader_election.cc:343] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.410753  8821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d68cd517ce44baf88aa239a275ce8d0" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:56.401048  9520 raft_consensus.cc:493] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.413594  9520 raft_consensus.cc:515] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:03:56.415299  8896 raft_consensus.cc:2468] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:03:56.415588  9520 leader_election.cc:290] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:56.418548  9095 ts_tablet_manager.cc:1434] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:03:56.397472  9522 raft_consensus.cc:493] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.420192  9522 raft_consensus.cc:515] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:56.423005  9522 leader_election.cc:290] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:56.397728  9540 raft_consensus.cc:2804] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.425809  9095 tablet_bootstrap.cc:492] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5: Bootstrap starting.
I20260709 13:03:56.431061  8937 leader_election.cc:304] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:03:56.432118  9467 raft_consensus.cc:2804] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.432771  9467 raft_consensus.cc:697] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:03:56.433609  9467 consensus_queue.cc:237] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:56.435319  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c1944d902340e79c6e9648cad9d681" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:56.436388  8900 raft_consensus.cc:2393] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate a6a0de662d36410c907287e73cb2e4db in this term.
I20260709 13:03:56.400297  9513 raft_consensus.cc:2804] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.437371  9513 raft_consensus.cc:697] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:56.438161  9513 consensus_queue.cc:237] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
W20260709 13:03:56.443069  9556 log.cc:927] Time spent T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5: Append to log took a long time: real 0.247s	user 0.002s	sys 0.004s
I20260709 13:03:56.451990  8825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3d7a987863451999601c9a8735d401" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:03:56.452747  8825 raft_consensus.cc:2393] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 1: Already voted for candidate a6a0de662d36410c907287e73cb2e4db in this term.
I20260709 13:03:56.454236  9093 tablet_bootstrap.cc:492] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:56.460996  9093 ts_tablet_manager.cc:1403] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.325s	user 0.032s	sys 0.003s
W20260709 13:03:56.468793  9011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 108059us
I20260709 13:03:56.475337  9540 raft_consensus.cc:697] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
W20260709 13:03:56.503254  9013 leader_election.cc:343] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:56.503793  9013 leader_election.cc:304] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:56.471868  9011 leader_election.cc:304] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:56.525146  9192 raft_consensus.cc:2749] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.557796  9540 consensus_queue.cc:237] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
W20260709 13:03:56.569006  9011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 97218.5us
I20260709 13:03:56.573056  9568 raft_consensus.cc:2749] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.586228  9095 tablet_bootstrap.cc:654] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.599668  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3d7a987863451999601c9a8735d401" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:56.601046  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c1944d902340e79c6e9648cad9d681" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:56.605821  8939 leader_election.cc:304] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:56.608021  9522 raft_consensus.cc:3060] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.613299  8939 leader_election.cc:304] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
W20260709 13:03:56.631083  9571 log.cc:927] Time spent T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:03:56.625377  9093 raft_consensus.cc:359] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:56.633745  9093 raft_consensus.cc:385] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.634130  9093 raft_consensus.cc:740] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.639503  9093 consensus_queue.cc:260] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:56.648305  9093 ts_tablet_manager.cc:1434] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.187s	user 0.007s	sys 0.001s
I20260709 13:03:56.643172  9520 raft_consensus.cc:3060] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:56.674322  8771 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:56.679865  9541 consensus_queue.cc:1048] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:03:56.678591  8791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:33479, user_credentials={real_user=slave}} blocked reactor thread for 196458us
I20260709 13:03:56.706380  9522 raft_consensus.cc:2749] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.719247  9520 raft_consensus.cc:2749] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.731673  9093 tablet_bootstrap.cc:492] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
W20260709 13:03:56.748963  9013 consensus_peers.cc:597] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:56.755049  9575 consensus_queue.cc:1048] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:56.756747  9574 log.cc:927] Time spent T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90: Append to log took a long time: real 0.077s	user 0.001s	sys 0.003s
I20260709 13:03:56.814311  9095 tablet_bootstrap.cc:492] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5: No bootstrap required, opened a new log
I20260709 13:03:56.815021  9095 ts_tablet_manager.cc:1403] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5: Time spent bootstrapping tablet: real 0.396s	user 0.021s	sys 0.030s
I20260709 13:03:56.822925  9095 raft_consensus.cc:359] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:56.824452  9095 raft_consensus.cc:385] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.824764  9095 raft_consensus.cc:740] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.826489  9095 consensus_queue.cc:260] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:56.828915  9095 ts_tablet_manager.cc:1434] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 13:03:56.833309  9540 consensus_queue.cc:1048] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.834839  9093 tablet_bootstrap.cc:654] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.844894  8723 catalog_manager.cc:5697] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.848917  8723 catalog_manager.cc:5697] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 1 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.850406  9509 raft_consensus.cc:493] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.851439  9509 raft_consensus.cc:515] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:56.853627  9509 leader_election.cc:290] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:56.854761  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d68cd517ce44baf88aa239a275ce8d0" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:56.855113  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d68cd517ce44baf88aa239a275ce8d0" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:56.855527  8971 raft_consensus.cc:2468] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:56.855875  9045 raft_consensus.cc:2468] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 0.
I20260709 13:03:56.856698  8791 leader_election.cc:304] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:03:56.857436  9509 raft_consensus.cc:2804] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:56.857841  9509 raft_consensus.cc:493] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.867965  9509 raft_consensus.cc:3060] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.870702  9093 tablet_bootstrap.cc:492] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:56.871227  9093 ts_tablet_manager.cc:1403] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.140s	user 0.011s	sys 0.007s
I20260709 13:03:56.873867  9093 raft_consensus.cc:359] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:56.874514  9093 raft_consensus.cc:385] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:56.874770  9093 raft_consensus.cc:740] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:56.878077  9509 raft_consensus.cc:515] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:56.881232  9509 leader_election.cc:290] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:03:56.883014  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d68cd517ce44baf88aa239a275ce8d0" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:03:56.883738  9045 raft_consensus.cc:3060] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.886339  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d68cd517ce44baf88aa239a275ce8d0" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:03:56.887138  8974 raft_consensus.cc:3060] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.895082  9045 raft_consensus.cc:2468] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:56.894584  8722 catalog_manager.cc:5697] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.896417  8790 leader_election.cc:304] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:03:56.900811  9508 raft_consensus.cc:2804] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:56.902133  9508 raft_consensus.cc:697] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:03:56.902328  8974 raft_consensus.cc:2468] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 1.
I20260709 13:03:56.902946  9508 consensus_queue.cc:237] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:56.875365  9093 consensus_queue.cc:260] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:56.908399  9429 raft_consensus.cc:493] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.908991  9429 raft_consensus.cc:515] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:56.909801  9093 ts_tablet_manager.cc:1434] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:03:56.916003  9093 tablet_bootstrap.cc:492] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:56.912707  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72811528754f96a5b00504f8d032e0" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:56.918653  8894 raft_consensus.cc:2393] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c955bfd0b9541f9860c5f84cb255b90 in current term 1: Already voted for candidate 245d19d5c71647a9857ac68df13802d5 in this term.
I20260709 13:03:56.921940  9513 consensus_queue.cc:1048] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.927696  9525 consensus_queue.cc:1048] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:56.913105  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a72811528754f96a5b00504f8d032e0" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:56.912675  9429 leader_election.cc:290] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:03:56.932655  8791 leader_election.cc:304] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:03:56.933861  9429 raft_consensus.cc:3060] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:56.935566  9093 tablet_bootstrap.cc:654] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:56.944087  9429 raft_consensus.cc:2749] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:56.949553  8717 catalog_manager.cc:5697] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.958851  9429 consensus_queue.cc:1048] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:56.978251  9520 consensus_queue.cc:1048] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.006757  9093 tablet_bootstrap.cc:492] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90: No bootstrap required, opened a new log
I20260709 13:03:57.007241  9093 ts_tablet_manager.cc:1403] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.007s
I20260709 13:03:57.010548  9093 raft_consensus.cc:359] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:57.011288  9093 raft_consensus.cc:385] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:57.011603  9093 raft_consensus.cc:740] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:57.012322  9093 consensus_queue.cc:260] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:57.014619  9093 ts_tablet_manager.cc:1434] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:57.032794  9507 consensus_queue.cc:1048] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.034781  8717 catalog_manager.cc:5697] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:57.072417  9193 consensus_queue.cc:1048] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.142570  9572 raft_consensus.cc:493] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.143187  9572 raft_consensus.cc:515] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:57.146176  9572 leader_election.cc:290] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:57.146641  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ed6c910f234c96ad999ea23411bc89" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:57.146950  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ed6c910f234c96ad999ea23411bc89" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:57.148962  8788 leader_election.cc:304] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:57.149664  9572 raft_consensus.cc:2749] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:57.276160  8821 raft_consensus.cc:3060] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:57.430792  9572 consensus_queue.cc:1048] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:57.470687  9429 consensus_queue.cc:1048] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:58.804665   430 tablet_server.cc:179] TabletServer@127.0.107.129:0 shutting down...
W20260709 13:03:58.817538  9013 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 535 similar messages]
W20260709 13:03:58.832866  9013 consensus_peers.cc:597] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:58.846060  8865 consensus_peers.cc:597] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:58.852998  9013 consensus_peers.cc:597] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:58.874943   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:58.876019   430 tablet_replica.cc:333] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.876942   430 raft_consensus.cc:2243] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:58.877508   430 raft_consensus.cc:2272] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.879709   430 tablet_replica.cc:333] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.880321   430 raft_consensus.cc:2243] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:58.881111   430 raft_consensus.cc:2272] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.883173   430 tablet_replica.cc:333] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.884052   430 raft_consensus.cc:2243] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:58.884500  8865 consensus_peers.cc:597] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:58.884553   430 raft_consensus.cc:2272] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.887673   430 tablet_replica.cc:333] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.888669   430 raft_consensus.cc:2243] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:58.889264   430 raft_consensus.cc:2272] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.891908   430 tablet_replica.cc:333] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.892596   430 raft_consensus.cc:2243] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:58.893486   430 raft_consensus.cc:2272] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.896085   430 tablet_replica.cc:333] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.896811   430 raft_consensus.cc:2243] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:58.897910   430 raft_consensus.cc:2272] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.900449   430 tablet_replica.cc:333] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.901126   430 raft_consensus.cc:2243] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:58.901597   430 raft_consensus.cc:2272] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.904112   430 tablet_replica.cc:333] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.904876   430 raft_consensus.cc:2243] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:58.905928   430 raft_consensus.cc:2272] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:58.905964  8939 consensus_peers.cc:597] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:58.909539   430 tablet_replica.cc:333] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.910465   430 raft_consensus.cc:2243] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:58.911499   430 raft_consensus.cc:2272] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.914314   430 tablet_replica.cc:333] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.915103   430 raft_consensus.cc:2243] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:58.915779   430 raft_consensus.cc:2272] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.920038   430 tablet_replica.cc:333] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.920871   430 raft_consensus.cc:2243] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:58.921904   430 raft_consensus.cc:2272] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.924332   430 tablet_replica.cc:333] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.925100   430 raft_consensus.cc:2243] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:58.926223   430 raft_consensus.cc:2272] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.937950   430 tablet_replica.cc:333] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.938846   430 raft_consensus.cc:2243] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:58.939316  8865 consensus_peers.cc:597] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:58.939432   430 raft_consensus.cc:2272] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.942799   430 tablet_replica.cc:333] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.943745   430 raft_consensus.cc:2243] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:03:58.944429  8865 consensus_peers.cc:597] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:58.944970   430 raft_consensus.cc:2272] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.948112   430 tablet_replica.cc:333] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.948921   430 raft_consensus.cc:2243] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:58.949890   430 raft_consensus.cc:2272] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.952589   430 tablet_replica.cc:333] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.953166   430 raft_consensus.cc:2243] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:58.953604   430 raft_consensus.cc:2272] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.955646   430 tablet_replica.cc:333] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.956349   430 raft_consensus.cc:2243] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:58.957382   430 raft_consensus.cc:2272] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.959527   430 tablet_replica.cc:333] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.960090   430 raft_consensus.cc:2243] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:58.960500   430 raft_consensus.cc:2272] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.962253   430 tablet_replica.cc:333] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.962884   430 raft_consensus.cc:2243] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:58.963352   430 raft_consensus.cc:2272] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.965350   430 tablet_replica.cc:333] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.965924   430 raft_consensus.cc:2243] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:58.966773   430 raft_consensus.cc:2272] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.968566   430 tablet_replica.cc:333] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.969156   430 raft_consensus.cc:2243] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:58.969914   430 raft_consensus.cc:2272] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.972011   430 tablet_replica.cc:333] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.972633   430 raft_consensus.cc:2243] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:58.973483   430 raft_consensus.cc:2272] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.975430   430 tablet_replica.cc:333] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.976115   430 raft_consensus.cc:2243] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:58.976959   430 raft_consensus.cc:2272] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.979336   430 tablet_replica.cc:333] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.980129   430 raft_consensus.cc:2243] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:58.980636   430 raft_consensus.cc:2272] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.983393   430 tablet_replica.cc:333] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.984108   430 raft_consensus.cc:2243] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:58.984606   430 raft_consensus.cc:2272] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:58.985984  8939 consensus_peers.cc:597] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:58.986984   430 tablet_replica.cc:333] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.987948   430 raft_consensus.cc:2243] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:58.988924   430 raft_consensus.cc:2272] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.991283   430 tablet_replica.cc:333] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.992295   430 raft_consensus.cc:2243] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:58.993016   430 raft_consensus.cc:2272] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.995551   430 tablet_replica.cc:333] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:58.996219   430 raft_consensus.cc:2243] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:58.996685   430 raft_consensus.cc:2272] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:58.999639   430 tablet_replica.cc:333] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.000399   430 raft_consensus.cc:2243] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.001348   430 raft_consensus.cc:2272] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.003289   430 tablet_replica.cc:333] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.003924   430 raft_consensus.cc:2243] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.004345   430 raft_consensus.cc:2272] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.006426   430 tablet_replica.cc:333] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.007143   430 raft_consensus.cc:2243] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.007586   430 raft_consensus.cc:2272] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.009665   430 tablet_replica.cc:333] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.010211   430 raft_consensus.cc:2243] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.010685   430 raft_consensus.cc:2272] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.012770   430 tablet_replica.cc:333] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.013329   430 raft_consensus.cc:2243] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.013832   430 raft_consensus.cc:2272] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.017405   430 tablet_replica.cc:333] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.018543   430 raft_consensus.cc:2243] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.019654   430 raft_consensus.cc:2272] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.021863   430 tablet_replica.cc:333] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.022440   430 raft_consensus.cc:2243] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.022863   430 raft_consensus.cc:2272] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.025074   430 tablet_replica.cc:333] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.025823   430 raft_consensus.cc:2243] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.026337   430 raft_consensus.cc:2272] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.027872  9013 consensus_peers.cc:597] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.028734   430 tablet_replica.cc:333] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.029342   430 raft_consensus.cc:2243] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.029780   430 raft_consensus.cc:2272] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.032084   430 tablet_replica.cc:333] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.032810   430 raft_consensus.cc:2243] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.033408   430 raft_consensus.cc:2272] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.035887   430 tablet_replica.cc:333] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.036866   430 raft_consensus.cc:2243] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.037933   430 raft_consensus.cc:2272] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.040709   430 tablet_replica.cc:333] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.041447   430 raft_consensus.cc:2243] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.042342   430 raft_consensus.cc:2272] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.043569  8865 consensus_peers.cc:597] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.044745   430 tablet_replica.cc:333] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.045323   430 raft_consensus.cc:2243] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.045779   430 raft_consensus.cc:2272] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.049356   430 tablet_replica.cc:333] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.050096   430 raft_consensus.cc:2243] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.050966   430 raft_consensus.cc:2272] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.054214   430 tablet_replica.cc:333] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.054901   430 raft_consensus.cc:2243] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.055392   430 raft_consensus.cc:2272] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.057315   430 tablet_replica.cc:333] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.057952   430 raft_consensus.cc:2243] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.058900   430 raft_consensus.cc:2272] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.061100   430 tablet_replica.cc:333] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90: stopping tablet replica
I20260709 13:03:59.061568   430 raft_consensus.cc:2243] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.062008   430 raft_consensus.cc:2272] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.083954  8939 consensus_peers.cc:597] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.109334  9013 consensus_peers.cc:597] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.126634  8939 consensus_peers.cc:597] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.135612   430 tablet_server.cc:196] TabletServer@127.0.107.129:0 shutdown complete.
W20260709 13:03:59.138273  9013 consensus_peers.cc:597] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.182161  9013 consensus_peers.cc:597] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.208290   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:59.217262  9013 consensus_peers.cc:597] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.217878  9604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:59.220446  9605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:59.221786  9607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:59.223763   430 server_base.cc:1061] running on GCE node
I20260709 13:03:59.226701   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:59.226927   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:59.227114   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602239227083 us; error 0 us; skew 500 ppm
I20260709 13:03:59.227703   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:59.230356   430 webserver.cc:533] Webserver started at http://127.0.107.129:46085/ using document root <none> and password file <none>
I20260709 13:03:59.230835   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:59.231019   430 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:03:59.234493   430 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:03:59.243691  9613 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20260709 13:03:59.244380  8939 consensus_peers.cc:597] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.245366   430 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:03:59.245770   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-0-root
uuid: "0c955bfd0b9541f9860c5f84cb255b90"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-th5x"
I20260709 13:03:59.246408   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601969268282-430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:03:59.246984  8865 consensus_peers.cc:597] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.255170  9013 consensus_peers.cc:597] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.269395   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
W20260709 13:03:59.269915  8865 consensus_peers.cc:597] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.270381  8865 consensus_peers.cc:597] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.271138   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:59.273561   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:59.279199  9620 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:03:59.282548  9013 consensus_peers.cc:597] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.283007  9013 consensus_peers.cc:597] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.297142  8939 consensus_peers.cc:597] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.320719  9013 consensus_peers.cc:597] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.323127  9013 consensus_peers.cc:597] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.539623   430 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:03:59.540014   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.262s	user 0.010s	sys 0.000s
I20260709 13:03:59.540275   430 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:03:59.544459  9620 tablet_bootstrap.cc:492] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:59.557034  9620 tablet_bootstrap.cc:492] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:59.557917  9620 tablet_bootstrap.cc:492] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:03:59.558425  9620 ts_tablet_manager.cc:1403] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:03:59.560243  9620 raft_consensus.cc:359] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:59.560712  9620 raft_consensus.cc:740] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.561314  9620 consensus_queue.cc:260] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:59.563241  9620 ts_tablet_manager.cc:1434] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:03:59.563889  9620 tablet_bootstrap.cc:492] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:59.575692  9620 tablet_bootstrap.cc:492] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:59.576500  9620 tablet_bootstrap.cc:492] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:03:59.577126  9620 ts_tablet_manager.cc:1403] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:03:59.578686  9620 raft_consensus.cc:359] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:59.579218  9620 raft_consensus.cc:740] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.579907  9620 consensus_queue.cc:260] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:59.581527  9620 ts_tablet_manager.cc:1434] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:59.582223  9620 tablet_bootstrap.cc:492] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:59.603127  9620 tablet_bootstrap.cc:492] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:59.604020  9620 tablet_bootstrap.cc:492] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:03:59.604614  9620 ts_tablet_manager.cc:1403] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 13:03:59.606906  9620 raft_consensus.cc:359] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:59.607555  9620 raft_consensus.cc:740] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.608198  9620 consensus_queue.cc:260] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:59.609965  9620 ts_tablet_manager.cc:1434] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:59.611028  9620 tablet_bootstrap.cc:492] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:59.630592  9620 tablet_bootstrap.cc:492] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:59.631346  9620 tablet_bootstrap.cc:492] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:03:59.631897  9620 ts_tablet_manager.cc:1403] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.007s
I20260709 13:03:59.633459  9620 raft_consensus.cc:359] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:59.633939  9620 raft_consensus.cc:740] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.634476  9620 consensus_queue.cc:260] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:59.635840  9620 ts_tablet_manager.cc:1434] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:59.636468  9620 tablet_bootstrap.cc:492] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:59.646807  9620 tablet_bootstrap.cc:492] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:59.648562  9620 tablet_bootstrap.cc:492] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:03:59.649111  9620 ts_tablet_manager.cc:1403] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:03:59.651314  9620 raft_consensus.cc:359] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:59.651983  9620 raft_consensus.cc:740] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.652608  9620 consensus_queue.cc:260] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:59.654738  9620 ts_tablet_manager.cc:1434] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:03:59.655551  9620 tablet_bootstrap.cc:492] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:59.670002  9620 tablet_bootstrap.cc:492] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:59.670756  9620 tablet_bootstrap.cc:492] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:03:59.671239  9620 ts_tablet_manager.cc:1403] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:03:59.672844  9620 raft_consensus.cc:359] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:59.673308  9620 raft_consensus.cc:740] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.673942  9620 consensus_queue.cc:260] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:59.675194  9620 ts_tablet_manager.cc:1434] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.000s
I20260709 13:03:59.675818  9620 tablet_bootstrap.cc:492] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:59.685962  9620 tablet_bootstrap.cc:492] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:59.686666  9620 tablet_bootstrap.cc:492] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:03:59.687160  9620 ts_tablet_manager.cc:1403] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:59.688949  9620 raft_consensus.cc:359] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:59.689441  9620 raft_consensus.cc:740] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.689998  9620 consensus_queue.cc:260] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:59.691290  9620 ts_tablet_manager.cc:1434] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:59.691900  9620 tablet_bootstrap.cc:492] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:59.715188  9620 tablet_bootstrap.cc:492] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:59.716101  9620 tablet_bootstrap.cc:492] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:03:59.716765  9620 ts_tablet_manager.cc:1403] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:03:59.719022  9620 raft_consensus.cc:359] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:59.719714  9620 raft_consensus.cc:740] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.720466  9620 consensus_queue.cc:260] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:59.722157  9620 ts_tablet_manager.cc:1434] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:03:59.722754  9620 tablet_bootstrap.cc:492] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:59.732501  9620 tablet_bootstrap.cc:492] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:59.733345  9620 tablet_bootstrap.cc:492] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:03:59.733887  9620 ts_tablet_manager.cc:1403] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:03:59.736117  9620 raft_consensus.cc:359] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:59.736737  9620 raft_consensus.cc:740] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.737450  9620 consensus_queue.cc:260] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:59.739276  9620 ts_tablet_manager.cc:1434] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:03:59.740026  9620 tablet_bootstrap.cc:492] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:59.744205   430 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:03:59.744647   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.204s	user 0.183s	sys 0.011s
I20260709 13:03:59.754724  9620 tablet_bootstrap.cc:492] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:59.755786  9620 tablet_bootstrap.cc:492] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:03:59.756379  9620 ts_tablet_manager.cc:1403] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:03:59.758939  9620 raft_consensus.cc:359] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:59.759872  9620 raft_consensus.cc:740] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.760782  9620 consensus_queue.cc:260] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:59.762821  9620 ts_tablet_manager.cc:1434] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:03:59.763651  9620 tablet_bootstrap.cc:492] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:59.784948  9620 tablet_bootstrap.cc:492] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:59.785856  9620 tablet_bootstrap.cc:492] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:03:59.786460  9620 ts_tablet_manager.cc:1403] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.010s
I20260709 13:03:59.789453  9620 raft_consensus.cc:359] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:59.790303  9620 raft_consensus.cc:740] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.791358  9620 consensus_queue.cc:260] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:59.793699  9620 ts_tablet_manager.cc:1434] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.002s
I20260709 13:03:59.794549  9620 tablet_bootstrap.cc:492] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:03:59.897360  9621 raft_consensus.cc:493] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:03:59.898180  9621 raft_consensus.cc:515] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:59.903935  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:59.923099  9445 raft_consensus.cc:493] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:03:59.923946  9445 raft_consensus.cc:515] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:59.900951  9621 leader_election.cc:290] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:59.926486  9445 leader_election.cc:290] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:59.930812  9597 raft_consensus.cc:493] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:03:59.942689  9597 raft_consensus.cc:515] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:59.944974  9597 leader_election.cc:290] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:59.953713  9445 raft_consensus.cc:493] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:03:59.954342  9445 raft_consensus.cc:515] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:03:59.955338  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:59.956825  9445 leader_election.cc:290] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:03:59.962889  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d68cd517ce44baf88aa239a275ce8d0" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:03:59.966974  9623 raft_consensus.cc:493] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:03:59.967530  9623 raft_consensus.cc:515] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:59.968465  9620 tablet_bootstrap.cc:492] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:59.969425  9620 tablet_bootstrap.cc:492] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:03:59.969599  9623 leader_election.cc:290] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:03:59.970261  9620 ts_tablet_manager.cc:1403] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.176s	user 0.075s	sys 0.066s
I20260709 13:03:59.970718  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:03:59.973232  9620 raft_consensus.cc:359] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:59.974080  9620 raft_consensus.cc:740] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:03:59.974920  9620 consensus_queue.cc:260] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:03:59.977237  9620 ts_tablet_manager.cc:1434] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:59.978031  9620 tablet_bootstrap.cc:492] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
W20260709 13:03:59.978395  8865 leader_election.cc:336] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:03:59.978837  8865 leader_election.cc:304] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:59.980268  9596 raft_consensus.cc:2749] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:59.980758  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:03:59.982841  9596 raft_consensus.cc:493] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:03:59.983603  9596 raft_consensus.cc:515] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:03:59.985792  9596 leader_election.cc:290] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
W20260709 13:03:59.992674  8865 leader_election.cc:336] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:03:59.993161  8865 leader_election.cc:304] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:03:59.993937  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:03:59.994194  9013 leader_election.cc:336] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:03:59.994695  8966 raft_consensus.cc:2468] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:03:59.994762  9667 raft_consensus.cc:2749] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:59.994908  9013 leader_election.cc:304] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:03:59.996714  9193 raft_consensus.cc:2749] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:59.997440  8866 leader_election.cc:304] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:00.000591  9596 raft_consensus.cc:2804] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.000993  9596 raft_consensus.cc:493] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
W20260709 13:04:00.001257  8939 leader_election.cc:336] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.001456  9596 raft_consensus.cc:3060] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.001747  8939 leader_election.cc:304] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:00.002612  9622 raft_consensus.cc:2749] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.010149  9596 raft_consensus.cc:515] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.011294  9620 tablet_bootstrap.cc:492] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:00.012244  9620 tablet_bootstrap.cc:492] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:00.012292  9596 leader_election.cc:290] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:00.012912  9620 ts_tablet_manager.cc:1403] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.008s
I20260709 13:04:00.013507  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:00.014199  8966 raft_consensus.cc:3060] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.015578  9620 raft_consensus.cc:359] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.016260  9620 raft_consensus.cc:740] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
W20260709 13:04:00.015829  8865 leader_election.cc:336] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.016947  9620 consensus_queue.cc:260] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.017225  8865 leader_election.cc:304] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:04:00.018800  9620 ts_tablet_manager.cc:1434] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:00.018829  9621 raft_consensus.cc:2749] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.019747  9620 tablet_bootstrap.cc:492] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:00.020107  9621 raft_consensus.cc:493] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.020665  9621 raft_consensus.cc:515] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.022686  9621 leader_election.cc:290] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.025174  9193 raft_consensus.cc:493] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.025666  9193 raft_consensus.cc:515] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.027514  9193 leader_election.cc:290] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.028880  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75657aca6e034936ba57c704cedb5563" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:00.031106  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6221e3a375814ae5ba834de940d071af" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
W20260709 13:04:00.031584  8865 leader_election.cc:336] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
W20260709 13:04:00.039337  8865 leader_election.cc:336] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
W20260709 13:04:00.039840  8865 leader_election.cc:336] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.040199  8865 leader_election.cc:304] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:04:00.040910  9621 raft_consensus.cc:2749] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.041041  8966 raft_consensus.cc:2468] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 2.
I20260709 13:04:00.044530  8866 leader_election.cc:304] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:00.045508  9621 raft_consensus.cc:2804] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.045990  9621 raft_consensus.cc:697] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:04:00.046820  9621 consensus_queue.cc:237] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
W20260709 13:04:00.050845  9013 leader_election.cc:336] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.051373  9013 leader_election.cc:304] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:00.052079  9193 raft_consensus.cc:2749] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.063532  9601 raft_consensus.cc:493] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.064021  9601 raft_consensus.cc:515] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.065991  9601 leader_election.cc:290] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:00.068245  8722 catalog_manager.cc:5697] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 2 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.068918  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
W20260709 13:04:00.077797  9013 leader_election.cc:336] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.078418  9013 leader_election.cc:304] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:00.079114  9601 raft_consensus.cc:2749] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.089107  9620 tablet_bootstrap.cc:492] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:00.090106  9620 tablet_bootstrap.cc:492] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:00.090271  9622 raft_consensus.cc:493] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.090737  9620 ts_tablet_manager.cc:1403] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.071s	user 0.031s	sys 0.037s
I20260709 13:04:00.090760  9622 raft_consensus.cc:515] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.092873  9601 raft_consensus.cc:493] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.093358  9601 raft_consensus.cc:515] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.093632  9620 raft_consensus.cc:359] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.094264  9620 raft_consensus.cc:740] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.094937  9620 consensus_queue.cc:260] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.096855  9620 ts_tablet_manager.cc:1434] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:04:00.097246  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6de9e2aaa341cfb862ee9073bab6dd" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:00.097533  9620 tablet_bootstrap.cc:492] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:00.103237  9622 leader_election.cc:290] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:00.099915  9601 leader_election.cc:290] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.105643  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6933846b78c4c4cbeb23a2bedaff18b" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:04:00.108098  9601 raft_consensus.cc:493] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.108799  9601 raft_consensus.cc:515] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
W20260709 13:04:00.112471  8939 leader_election.cc:336] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.113132  8939 leader_election.cc:304] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:00.112524  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb43858b9264896af25d56cdbb44d80" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:00.114202  9601 leader_election.cc:290] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.114751  9623 raft_consensus.cc:493] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.118319  9623 raft_consensus.cc:515] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.117928  9622 raft_consensus.cc:2749] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.121021  9623 leader_election.cc:290] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
W20260709 13:04:00.122733  9013 leader_election.cc:336] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.122869  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7449c44d44a30a7de276d3d6a9c25" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:04:00.123230  9013 leader_election.cc:304] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:00.123940  9601 raft_consensus.cc:2749] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:00.129282  8939 leader_election.cc:336] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.132069  8939 leader_election.cc:304] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:00.131315  9621 raft_consensus.cc:493] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.133633  9622 raft_consensus.cc:2749] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.134034  9621 raft_consensus.cc:515] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
W20260709 13:04:00.138705  9013 leader_election.cc:336] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.139173  9013 leader_election.cc:304] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:00.139870  9601 raft_consensus.cc:2749] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.139988  9621 leader_election.cc:290] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:00.141584  9620 tablet_bootstrap.cc:492] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:00.142529  9620 tablet_bootstrap.cc:492] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:00.142777  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7449c44d44a30a7de276d3d6a9c25" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:00.144156  9620 ts_tablet_manager.cc:1403] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.023s
I20260709 13:04:00.144353  8966 raft_consensus.cc:2468] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:04:00.147496  8866 leader_election.cc:304] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:00.147578  9620 raft_consensus.cc:359] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.148680  9620 raft_consensus.cc:740] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.148811  9622 raft_consensus.cc:493] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
W20260709 13:04:00.149493  8865 leader_election.cc:336] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.149494  9620 consensus_queue.cc:260] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.150234  9596 raft_consensus.cc:2804] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.150835  9596 raft_consensus.cc:493] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.151381  9596 raft_consensus.cc:3060] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.152087  9620 ts_tablet_manager.cc:1434] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:00.152967  9620 tablet_bootstrap.cc:492] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:00.149636  9622 raft_consensus.cc:515] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.159943  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:00.167171  9597 raft_consensus.cc:493] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.167728  9597 raft_consensus.cc:515] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.169879  9597 leader_election.cc:290] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.172745  9623 raft_consensus.cc:493] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.173501  9623 raft_consensus.cc:515] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.173353  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:00.179065  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203428dde6c042b096205916d590b4d5" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:04:00.180573  9620 tablet_bootstrap.cc:492] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:00.181584  9620 tablet_bootstrap.cc:492] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
W20260709 13:04:00.181609  8939 leader_election.cc:336] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.182495  9620 ts_tablet_manager.cc:1403] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.008s
I20260709 13:04:00.182317  8939 leader_election.cc:304] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
W20260709 13:04:00.182808  9013 leader_election.cc:336] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.182880  9623 leader_election.cc:290] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:00.183252  9525 raft_consensus.cc:2749] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.183290  9013 leader_election.cc:304] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:00.184253  9597 raft_consensus.cc:2749] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.183840  9622 leader_election.cc:290] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
W20260709 13:04:00.189736  8939 leader_election.cc:336] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.190315  8939 leader_election.cc:304] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:00.192929  9622 raft_consensus.cc:2749] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.193974  9620 raft_consensus.cc:359] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.194763  9620 raft_consensus.cc:740] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.195528  9620 consensus_queue.cc:260] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.196273  9601 raft_consensus.cc:493] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.196784  9601 raft_consensus.cc:515] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.197350  9620 ts_tablet_manager.cc:1434] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:00.198149  9620 tablet_bootstrap.cc:492] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:00.199748  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:04:00.200031  9596 raft_consensus.cc:515] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.200243  9601 leader_election.cc:290] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:00.200855  8896 raft_consensus.cc:2468] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:04:00.202090  9622 raft_consensus.cc:493] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.202764  9622 raft_consensus.cc:515] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.205344  9622 leader_election.cc:290] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:00.208343  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de975aeaa3f4271942a80c6f15c6c98" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:04:00.202780  9011 leader_election.cc:304] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.210574  9621 raft_consensus.cc:493] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.211154  9621 raft_consensus.cc:515] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
W20260709 13:04:00.213083  8939 leader_election.cc:336] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.213413  9622 raft_consensus.cc:493] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.213529  8939 leader_election.cc:304] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:00.213959  9622 raft_consensus.cc:515] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.214639  9525 raft_consensus.cc:2749] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.214709  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de975aeaa3f4271942a80c6f15c6c98" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:00.214934  9601 raft_consensus.cc:2804] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.215396  9601 raft_consensus.cc:493] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.215473  8966 raft_consensus.cc:2468] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:04:00.217278  9622 leader_election.cc:290] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.217792  9597 raft_consensus.cc:493] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.217962  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6de9e2aaa341cfb862ee9073bab6dd" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:00.218335  9597 raft_consensus.cc:515] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.218581  9044 raft_consensus.cc:2468] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:04:00.218951  8866 leader_election.cc:304] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:00.220368  9597 leader_election.cc:290] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.221040  9667 raft_consensus.cc:2804] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:00.219667  9013 leader_election.cc:336] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.221458  9667 raft_consensus.cc:493] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.221832  9667 raft_consensus.cc:3060] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:00.223059  8865 leader_election.cc:336] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.224014  9621 leader_election.cc:290] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:00.224979  9596 leader_election.cc:290] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:00.226439  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7449c44d44a30a7de276d3d6a9c25" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:00.221676  8939 leader_election.cc:304] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.227288  8971 raft_consensus.cc:3060] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.220929  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:00.228092  9525 raft_consensus.cc:2804] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.228451  9525 raft_consensus.cc:493] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.228802  9525 raft_consensus.cc:3060] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.230218  9667 raft_consensus.cc:515] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
W20260709 13:04:00.230757  8939 leader_election.cc:336] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.236289  9667 leader_election.cc:290] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:00.236366  9622 raft_consensus.cc:493] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.236946  9622 raft_consensus.cc:515] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.238270  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de975aeaa3f4271942a80c6f15c6c98" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:00.239130  8966 raft_consensus.cc:3060] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.239311  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d68cd517ce44baf88aa239a275ce8d0" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:00.240005  9044 raft_consensus.cc:2468] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:04:00.244642  8939 leader_election.cc:304] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.245719  9623 raft_consensus.cc:2804] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.246173  9623 raft_consensus.cc:493] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.246622  9623 raft_consensus.cc:3060] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.254118  8971 raft_consensus.cc:2468] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 2.
I20260709 13:04:00.254915  9525 raft_consensus.cc:515] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.255625  8866 leader_election.cc:304] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:00.215830  9601 raft_consensus.cc:3060] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:00.261708  8939 leader_election.cc:336] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.262228  9622 leader_election.cc:290] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.263226  9622 raft_consensus.cc:493] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.263659  9621 raft_consensus.cc:2804] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:00.264144  8865 leader_election.cc:336] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.265252  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6de9e2aaa341cfb862ee9073bab6dd" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:00.261838  9623 raft_consensus.cc:515] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.271348  8966 raft_consensus.cc:2468] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 2.
W20260709 13:04:00.272224  8939 leader_election.cc:336] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.292742  9601 raft_consensus.cc:515] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.297834  9690 raft_consensus.cc:493] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.275502  9622 raft_consensus.cc:515] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.298455  9690 raft_consensus.cc:515] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.299571  9601 leader_election.cc:290] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:00.300035  9622 leader_election.cc:290] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.300398  9690 leader_election.cc:290] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.301669  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d68cd517ce44baf88aa239a275ce8d0" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:00.302251  9045 raft_consensus.cc:3060] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.275758  9525 leader_election.cc:290] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.304744  9620 tablet_bootstrap.cc:492] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:00.275945  9621 raft_consensus.cc:697] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:04:00.276391  9044 raft_consensus.cc:3060] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.305619  9621 consensus_queue.cc:237] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.278995  9623 leader_election.cc:290] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
W20260709 13:04:00.284053  8865 leader_election.cc:336] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.308593  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:00.309263  8896 raft_consensus.cc:3060] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.284037  9445 raft_consensus.cc:493] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.311340  9620 tablet_bootstrap.cc:492] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:00.312106  9445 raft_consensus.cc:515] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.312914  9620 ts_tablet_manager.cc:1403] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.115s	user 0.035s	sys 0.046s
I20260709 13:04:00.314101  9445 leader_election.cc:290] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
W20260709 13:04:00.291648  8937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 45758.7us
I20260709 13:04:00.317870  8866 leader_election.cc:304] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:00.318759  9620 raft_consensus.cc:359] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.319437  9620 raft_consensus.cc:740] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.321374  9620 consensus_queue.cc:260] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.321938  9596 raft_consensus.cc:2804] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.322548  9596 raft_consensus.cc:697] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:04:00.324221  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:00.324818  9048 raft_consensus.cc:2468] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:04:00.325728  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb43858b9264896af25d56cdbb44d80" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:00.326344  9047 raft_consensus.cc:2468] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:04:00.323437  9596 consensus_queue.cc:237] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
W20260709 13:04:00.291884  9013 leader_election.cc:336] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.328502  9013 leader_election.cc:304] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:00.331363  9660 raft_consensus.cc:2749] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:00.335721  9193 raft_consensus.cc:493] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.336306  9193 raft_consensus.cc:515] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.338714  9193 leader_election.cc:290] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
W20260709 13:04:00.335974  8865 leader_election.cc:336] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
W20260709 13:04:00.341679  9013 leader_election.cc:336] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:00.343386  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:00.344107  9047 raft_consensus.cc:2468] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:04:00.344259  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6221e3a375814ae5ba834de940d071af" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:04:00.344924  9045 raft_consensus.cc:2468] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:00.345156  8894 raft_consensus.cc:2468] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:04:00.327070  9620 ts_tablet_manager.cc:1434] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:04:00.346648  9620 tablet_bootstrap.cc:492] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:00.349571  9709 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.129:45051 every 8 connection(s)
I20260709 13:04:00.349689  9525 raft_consensus.cc:493] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.350239  9525 raft_consensus.cc:515] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.352494  9525 leader_election.cc:290] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.356272  9011 leader_election.cc:304] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.357045  9660 raft_consensus.cc:2804] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.356225   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.129:45051
I20260709 13:04:00.357421  9660 raft_consensus.cc:493] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.358014  9660 raft_consensus.cc:3060] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.362331  8722 catalog_manager.cc:5697] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 2 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.363684  9597 raft_consensus.cc:493] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.364153  9597 raft_consensus.cc:515] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.366056  9597 leader_election.cc:290] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:00.367192  9525 raft_consensus.cc:493] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.367792  9525 raft_consensus.cc:515] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.368232  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:04:00.368913  8894 raft_consensus.cc:2468] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:04:00.370332  9011 leader_election.cc:304] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.370985  9525 leader_election.cc:290] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.372009  9193 raft_consensus.cc:2804] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.372483  9193 raft_consensus.cc:493] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.372918  9193 raft_consensus.cc:3060] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.375787  9660 raft_consensus.cc:515] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.378244  9660 leader_election.cc:290] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:00.381950  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6221e3a375814ae5ba834de940d071af" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:00.382768  9676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6221e3a375814ae5ba834de940d071af" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:04:00.407660  8896 raft_consensus.cc:2468] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 2.
I20260709 13:04:00.408018  8895 raft_consensus.cc:3060] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.408124  9676 raft_consensus.cc:2468] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:04:00.384075  9672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:04:00.385478  9670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6221e3a375814ae5ba834de940d071af" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:04:00.391589  9445 raft_consensus.cc:493] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.409336  9670 raft_consensus.cc:3060] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.409406  9445 raft_consensus.cc:515] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.411439  9011 leader_election.cc:304] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:00.393491  9623 raft_consensus.cc:493] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.412163  9623 raft_consensus.cc:515] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.413422  9712 raft_consensus.cc:2804] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.413897  9712 raft_consensus.cc:697] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:00.414113  9623 leader_election.cc:290] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.415701  9660 raft_consensus.cc:493] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.416296  9660 raft_consensus.cc:515] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.417536  9445 leader_election.cc:290] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:00.396028  9597 raft_consensus.cc:493] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.420112  9597 raft_consensus.cc:515] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.422223  9597 leader_election.cc:290] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:00.402907  9044 raft_consensus.cc:2468] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:00.406718  9193 raft_consensus.cc:515] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.418123  9670 raft_consensus.cc:2468] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 2.
I20260709 13:04:00.417829  9712 consensus_queue.cc:237] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.428828  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:00.429349  8894 raft_consensus.cc:3060] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.429409  9193 leader_election.cc:290] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:00.418402  9660 leader_election.cc:290] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.430266  8722 catalog_manager.cc:5697] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 2 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.437727  9660 raft_consensus.cc:493] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.438287  9660 raft_consensus.cc:515] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.440253  8894 raft_consensus.cc:2468] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 2.
I20260709 13:04:00.415267  8895 raft_consensus.cc:2468] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 2.
I20260709 13:04:00.419061  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d979f18121e6477a8261596acbc4f58a" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:04:00.395224  8939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 53052.1us
I20260709 13:04:00.441262  8969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:00.390906  8865 leader_election.cc:304] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:00.441792  8966 raft_consensus.cc:2468] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:04:00.441876  9011 leader_election.cc:304] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.441916  8969 raft_consensus.cc:2468] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
W20260709 13:04:00.442589  8865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:45733, user_credentials={real_user=slave}} blocked reactor thread for 51809.7us
I20260709 13:04:00.443387  9014 leader_election.cc:304] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.443564  9193 raft_consensus.cc:2804] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.444228  9193 raft_consensus.cc:697] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:00.444335  9014 leader_election.cc:304] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.422955  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203428dde6c042b096205916d590b4d5" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:00.445144  9601 raft_consensus.cc:2804] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.444985  9193 consensus_queue.cc:237] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.445569  8971 raft_consensus.cc:2468] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:04:00.445609  9601 raft_consensus.cc:493] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.446192  9601 raft_consensus.cc:3060] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.424502  8896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:04:00.447906  8896 raft_consensus.cc:2468] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:04:00.448730  9717 raft_consensus.cc:2804] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.449162  9717 raft_consensus.cc:493] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.449373  9011 leader_election.cc:304] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.449558  9717 raft_consensus.cc:3060] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.449865  8866 leader_election.cc:304] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:00.450244  9011 leader_election.cc:304] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.451499  9718 raft_consensus.cc:2804] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.443642  9445 raft_consensus.cc:2804] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.452519  9445 raft_consensus.cc:493] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.453060  9445 raft_consensus.cc:3060] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.454281  9621 raft_consensus.cc:2804] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.454717  9621 raft_consensus.cc:493] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.455057  9621 raft_consensus.cc:3060] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:00.442039  8939 leader_election.cc:336] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
W20260709 13:04:00.462163  8939 leader_election.cc:336] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
W20260709 13:04:00.462779  8939 leader_election.cc:336] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
W20260709 13:04:00.463675  9013 leader_election.cc:343] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.464403  8939 leader_election.cc:304] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:00.470521  8722 catalog_manager.cc:5697] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 2 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.455133  9667 raft_consensus.cc:493] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.479391  9667 raft_consensus.cc:515] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.463469  9597 raft_consensus.cc:2804] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.482754  9597 raft_consensus.cc:493] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.484508  9597 raft_consensus.cc:3060] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.482383  9623 raft_consensus.cc:2804] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.487847  9623 raft_consensus.cc:493] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.488339  9623 raft_consensus.cc:3060] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.492079  9667 leader_election.cc:290] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:00.493183  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6933846b78c4c4cbeb23a2bedaff18b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:00.493425  9717 raft_consensus.cc:515] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.493870  8971 raft_consensus.cc:2468] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:04:00.495076  8866 leader_election.cc:304] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:00.495867  9667 raft_consensus.cc:2804] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.491209  9601 raft_consensus.cc:515] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.496222  9667 raft_consensus.cc:493] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.496814  9667 raft_consensus.cc:3060] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.497749  9601 leader_election.cc:290] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.498189  9445 raft_consensus.cc:515] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.476158  9660 leader_election.cc:290] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.499933  9445 leader_election.cc:290] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.500974  8939 leader_election.cc:304] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:00.501262  9717 leader_election.cc:290] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.501796  9525 raft_consensus.cc:2804] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.502187  9525 raft_consensus.cc:493] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.502583  9525 raft_consensus.cc:3060] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.502362  8939 leader_election.cc:304] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:00.503599  8939 leader_election.cc:304] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:00.505300  9622 raft_consensus.cc:2804] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.505498  9690 raft_consensus.cc:2804] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.505790  9622 raft_consensus.cc:697] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
W20260709 13:04:00.513710  9011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 55668us
I20260709 13:04:00.508159  9596 raft_consensus.cc:493] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.521507  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75657aca6e034936ba57c704cedb5563" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:00.522019  9048 raft_consensus.cc:2468] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:04:00.482432  9718 raft_consensus.cc:697] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:00.496212  9621 raft_consensus.cc:515] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.529945  9622 consensus_queue.cc:237] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.531822  9718 consensus_queue.cc:237] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.523772  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d979f18121e6477a8261596acbc4f58a" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:00.527341  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:00.522354  9596 raft_consensus.cc:515] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.557106  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:00.557726  9048 raft_consensus.cc:3060] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.559610  9621 leader_election.cc:290] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:00.555081  9047 raft_consensus.cc:2468] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:04:00.560339  9672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d979f18121e6477a8261596acbc4f58a" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:04:00.561060  9672 raft_consensus.cc:2468] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 1.
I20260709 13:04:00.563282  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203428dde6c042b096205916d590b4d5" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:00.563905  8971 raft_consensus.cc:3060] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.555474  9044 raft_consensus.cc:2393] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 245d19d5c71647a9857ac68df13802d5 in current term 2: Already voted for candidate a6a0de662d36410c907287e73cb2e4db in this term.
I20260709 13:04:00.565374  9596 leader_election.cc:290] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:00.568712  9667 raft_consensus.cc:515] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.570806  9667 leader_election.cc:290] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:00.572876  9620 tablet_bootstrap.cc:492] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:00.572875  8971 raft_consensus.cc:2468] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 2.
I20260709 13:04:00.574204  9620 tablet_bootstrap.cc:492] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:00.574954  9620 ts_tablet_manager.cc:1403] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.229s	user 0.012s	sys 0.021s
I20260709 13:04:00.576701  8866 leader_election.cc:304] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:00.577603  9445 raft_consensus.cc:2804] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.578100  9445 raft_consensus.cc:697] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:04:00.578459  8969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6933846b78c4c4cbeb23a2bedaff18b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:00.579152  8969 raft_consensus.cc:3060] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.578855  9445 consensus_queue.cc:237] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.578389  9525 raft_consensus.cc:515] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.584697  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828b8a5a081e4a93812c8523ddc2dd56" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:00.584322  9620 raft_consensus.cc:359] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.585278  8971 raft_consensus.cc:2468] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 1.
I20260709 13:04:00.585525  9620 raft_consensus.cc:740] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.586804  9048 raft_consensus.cc:2468] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 2.
I20260709 13:04:00.586670  9620 consensus_queue.cc:260] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.586258  8866 leader_election.cc:304] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:00.592854  9620 ts_tablet_manager.cc:1434] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:04:00.583671  9525 leader_election.cc:290] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.545943  9690 raft_consensus.cc:697] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:04:00.593886  9667 raft_consensus.cc:2804] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.604979  9620 tablet_bootstrap.cc:492] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:00.608548  8971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:00.609454  8971 raft_consensus.cc:3060] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.563169  9623 raft_consensus.cc:515] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.622815  8969 raft_consensus.cc:2468] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 2.
I20260709 13:04:00.629319  8971 raft_consensus.cc:2468] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 2.
I20260709 13:04:00.631616  8865 leader_election.cc:304] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.632962  9445 raft_consensus.cc:2804] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.606680  9667 raft_consensus.cc:493] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.639262  9670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:04:00.640038  8974 raft_consensus.cc:1275] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Refusing update from remote peer 60a19ab523e3468bb9aacada2c24362c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:00.639003  9667 raft_consensus.cc:3060] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.647488  9014 leader_election.cc:304] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.651404  9717 raft_consensus.cc:2804] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.651891  9717 raft_consensus.cc:697] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:00.652726  9717 consensus_queue.cc:237] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.633697  9445 raft_consensus.cc:697] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:04:00.635854  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d979f18121e6477a8261596acbc4f58a" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:00.636420  9690 consensus_queue.cc:237] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.654956  9445 consensus_queue.cc:237] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.663635  8722 catalog_manager.cc:5697] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 2 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.669281  8866 leader_election.cc:304] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:00.662565  8966 raft_consensus.cc:3060] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.679641  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb43858b9264896af25d56cdbb44d80" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:00.681994  9048 raft_consensus.cc:3060] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.686852  9596 raft_consensus.cc:2804] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.687407  9596 raft_consensus.cc:697] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:04:00.691668  9726 consensus_queue.cc:1048] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:04:00.692169  9596 consensus_queue.cc:237] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.692567  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:00.693174  9044 raft_consensus.cc:3060] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.693729  9623 leader_election.cc:290] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.694747  9597 raft_consensus.cc:515] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.688859  9670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:04:00.689309  8939 leader_election.cc:304] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.701139  9048 raft_consensus.cc:2468] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
W20260709 13:04:00.703576  8865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:45733, user_credentials={real_user=slave}} blocked reactor thread for 72027.2us
I20260709 13:04:00.703022  8939 leader_election.cc:304] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.705294  9623 raft_consensus.cc:2804] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.705865  9623 raft_consensus.cc:493] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.706148  9691 raft_consensus.cc:2804] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:00.706796  9691 raft_consensus.cc:493] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:00.707180  9691 raft_consensus.cc:3060] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.705215  9670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:04:00.706211  9623 raft_consensus.cc:3060] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.709524  9597 leader_election.cc:290] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:00.711530  9667 raft_consensus.cc:515] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.727514  8717 catalog_manager.cc:5697] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 2 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:00.734956  8866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:33479, user_credentials={real_user=slave}} blocked reactor thread for 61262.8us
I20260709 13:04:00.737555  8721 catalog_manager.cc:5697] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 2 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.741677  9670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:04:00.741904  9044 raft_consensus.cc:2468] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:00.742389  9672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d979f18121e6477a8261596acbc4f58a" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:04:00.745275  8721 catalog_manager.cc:5697] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 2 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.748358  9676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:04:00.753672  9672 raft_consensus.cc:3060] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.750602  9666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75657aca6e034936ba57c704cedb5563" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:04:00.754490  9676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfb43858b9264896af25d56cdbb44d80" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:04:00.754930  9666 raft_consensus.cc:2468] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 1.
I20260709 13:04:00.755144  9676 raft_consensus.cc:3060] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.764902  9669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d979f18121e6477a8261596acbc4f58a" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:04:00.764950  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:00.766268  8894 raft_consensus.cc:3060] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.757967  9662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:04:00.768119  9663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:04:00.768713  9663 raft_consensus.cc:3060] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.774732  9672 raft_consensus.cc:2468] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 2.
I20260709 13:04:00.759196  9667 leader_election.cc:290] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Requested vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:00.790570  8894 raft_consensus.cc:2468] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 2.
I20260709 13:04:00.791517  8722 catalog_manager.cc:5697] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 2 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.794184  9011 leader_election.cc:304] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.776386  9676 raft_consensus.cc:2468] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:00.812736  9712 raft_consensus.cc:2804] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:00.817306  9013 leader_election.cc:343] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:00.818293  9013 leader_election.cc:343] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:00.819085  9013 leader_election.cc:343] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.809805  8972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828b8a5a081e4a93812c8523ddc2dd56" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:00.796430  8966 raft_consensus.cc:2468] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a0de662d36410c907287e73cb2e4db in term 2.
W20260709 13:04:00.826635  9731 log.cc:927] Time spent T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:04:00.827358  9014 leader_election.cc:304] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.828466  9597 raft_consensus.cc:2804] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.828872  9597 raft_consensus.cc:697] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:00.829473  9597 consensus_queue.cc:237] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.836196  9620 tablet_bootstrap.cc:492] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:00.839000  9620 tablet_bootstrap.cc:492] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:00.840004  9620 ts_tablet_manager.cc:1403] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.245s	user 0.019s	sys 0.011s
W20260709 13:04:00.842501  8939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 63890.1us
I20260709 13:04:00.844383  8939 leader_election.cc:304] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db
I20260709 13:04:00.844169  9623 raft_consensus.cc:515] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.845149  9690 raft_consensus.cc:2749] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:00.845521  8939 leader_election.cc:343] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.846282  8939 leader_election.cc:304] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:04:00.846349  9623 leader_election.cc:290] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.846899  9690 raft_consensus.cc:2804] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.847386  9690 raft_consensus.cc:697] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:04:00.850921  9690 consensus_queue.cc:237] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.852430  9670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203428dde6c042b096205916d590b4d5" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:04:00.854066  9662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6933846b78c4c4cbeb23a2bedaff18b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:04:00.848449  8939 leader_election.cc:304] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:00.855027  9669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca29694da91044f28b09dc349794ab78" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:04:00.824566  9712 raft_consensus.cc:697] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Becoming Leader. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:00.856138  9626 raft_consensus.cc:493] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.856911  9661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203428dde6c042b096205916d590b4d5" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:04:00.856681  9626 raft_consensus.cc:515] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:00.857031  9712 consensus_queue.cc:237] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.857906  9727 raft_consensus.cc:2804] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:00.858397  9727 raft_consensus.cc:697] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:04:00.834383  8972 raft_consensus.cc:3060] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.824769  9691 raft_consensus.cc:515] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.863008  9626 leader_election.cc:290] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:00.860991  9676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6933846b78c4c4cbeb23a2bedaff18b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:04:00.858438  9620 raft_consensus.cc:359] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.864383  9620 raft_consensus.cc:740] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.864710  9691 leader_election.cc:290] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:00.862795  9661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828b8a5a081e4a93812c8523ddc2dd56" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:04:00.859254  9727 consensus_queue.cc:237] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:00.865094  9620 consensus_queue.cc:260] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:00.867074  9663 raft_consensus.cc:2468] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:00.856370  9669 raft_consensus.cc:3060] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.872984  9665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "828b8a5a081e4a93812c8523ddc2dd56" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:04:00.873492  8972 raft_consensus.cc:2468] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 2.
I20260709 13:04:00.867627  9620 ts_tablet_manager.cc:1434] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:04:00.868342  9662 raft_consensus.cc:3060] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:00.875083  9013 leader_election.cc:343] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:00.877079  9013 leader_election.cc:343] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.878806  9669 raft_consensus.cc:2468] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 2.
I20260709 13:04:00.883889  9662 raft_consensus.cc:1275] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Refusing update from remote peer 60a19ab523e3468bb9aacada2c24362c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:00.885345  9620 tablet_bootstrap.cc:492] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
W20260709 13:04:00.937072  8865 leader_election.cc:343] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:00.947710  8865 leader_election.cc:343] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:00.951121  8865 leader_election.cc:343] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.952708  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75657aca6e034936ba57c704cedb5563" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
W20260709 13:04:00.954463  8865 leader_election.cc:343] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.954535  9044 raft_consensus.cc:3060] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.972092  9669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
W20260709 13:04:00.980906  8865 leader_election.cc:343] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:00.982230  9746 raft_consensus.cc:493] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.983350  9746 raft_consensus.cc:515] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
W20260709 13:04:00.986922  8865 consensus_peers.cc:597] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:00.987017  8722 catalog_manager.cc:5697] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 2 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:00.980990  8972 raft_consensus.cc:1275] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Refusing update from remote peer 60a19ab523e3468bb9aacada2c24362c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:00.964589  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:01.010996  9045 raft_consensus.cc:3060] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:00.977037  9676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75657aca6e034936ba57c704cedb5563" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
I20260709 13:04:01.028085  9676 raft_consensus.cc:3060] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:01.033195  9013 consensus_peers.cc:597] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.038516  8969 raft_consensus.cc:1275] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Refusing update from remote peer 60a19ab523e3468bb9aacada2c24362c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.039986  8866 leader_election.cc:304] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:00.999150  9746 leader_election.cc:290] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:01.042317  9621 raft_consensus.cc:2804] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:01.043000  9621 raft_consensus.cc:697] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:04:01.043582  9445 consensus_queue.cc:1048] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:01.044857  9621 consensus_queue.cc:237] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:01.045938  9445 consensus_queue.cc:1048] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:01.048368  8865 leader_election.cc:343] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.062098  8895 raft_consensus.cc:1275] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Refusing update from remote peer a6a0de662d36410c907287e73cb2e4db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.062788  9711 heartbeater.cc:344] Connected to a master server at 127.0.107.190:46327
I20260709 13:04:01.063390  9711 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:01.065091  9711 heartbeater.cc:507] Master 127.0.107.190:46327 requested a full tablet report, sending...
W20260709 13:04:01.065611  8865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 59288.5us
I20260709 13:04:01.004134  8722 catalog_manager.cc:5697] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 2 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:01.075822  8865 consensus_peers.cc:597] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.082793  8896 raft_consensus.cc:1275] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Refusing update from remote peer a6a0de662d36410c907287e73cb2e4db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:01.087109  8939 leader_election.cc:343] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.089759  9726 consensus_queue.cc:1048] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:04:01.100833  8966 raft_consensus.cc:1275] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Refusing update from remote peer 60a19ab523e3468bb9aacada2c24362c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.113420  9660 consensus_queue.cc:1048] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:01.117532  9601 consensus_queue.cc:1048] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:01.124454  9669 raft_consensus.cc:3060] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.125866  9045 raft_consensus.cc:2468] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:01.190068  9047 raft_consensus.cc:1275] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.243050  9749 consensus_queue.cc:1048] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:04:01.259553  9044 raft_consensus.cc:2468] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:01.264292  8894 raft_consensus.cc:1275] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Refusing update from remote peer a6a0de662d36410c907287e73cb2e4db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.267933  9620 tablet_bootstrap.cc:492] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.280658  9620 tablet_bootstrap.cc:492] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:01.279821  8939 leader_election.cc:304] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:01.269588  8722 catalog_manager.cc:5697] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 2 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.291517  8972 raft_consensus.cc:1275] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Refusing update from remote peer 60a19ab523e3468bb9aacada2c24362c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.294611  9718 consensus_queue.cc:1048] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:04:01.296252  9661 raft_consensus.cc:1275] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Refusing update from remote peer a6a0de662d36410c907287e73cb2e4db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.299526  8722 catalog_manager.cc:5697] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 2 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.305974  9718 consensus_queue.cc:1048] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:01.306376  9762 log.cc:927] Time spent T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:04:01.279655  9669 raft_consensus.cc:1275] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Refusing update from remote peer a6a0de662d36410c907287e73cb2e4db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.275243  9676 raft_consensus.cc:2468] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
W20260709 13:04:01.318214  8939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.132:45733, user_credentials={real_user=slave}} blocked reactor thread for 52749.5us
I20260709 13:04:01.319391  8939 leader_election.cc:304] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 
W20260709 13:04:01.309894  8865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:45733, user_credentials={real_user=slave}} blocked reactor thread for 118248us
I20260709 13:04:01.337785  9620 ts_tablet_manager.cc:1403] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.453s	user 0.036s	sys 0.001s
I20260709 13:04:01.340143  9047 raft_consensus.cc:1275] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.340466  9044 raft_consensus.cc:1275] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.341127  9620 raft_consensus.cc:359] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:01.341945  9620 raft_consensus.cc:740] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.342715  9620 consensus_queue.cc:260] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:01.344497  9620 ts_tablet_manager.cc:1434] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:04:01.347586  9691 raft_consensus.cc:2804] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:01.354444  9661 raft_consensus.cc:1275] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.354821  9676 raft_consensus.cc:3060] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.355553  9622 raft_consensus.cc:2804] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:01.356153  9622 raft_consensus.cc:697] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:04:01.356536  9690 consensus_queue.cc:1048] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:04:01.357151  9622 consensus_queue.cc:237] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:01.359215  9667 consensus_queue.cc:1048] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 13:04:01.363484  8939 consensus_peers.cc:597] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.361809  9691 raft_consensus.cc:697] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:04:01.389387  9691 consensus_queue.cc:237] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:01.409322  9727 consensus_queue.cc:1048] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:01.410058  9724 consensus_queue.cc:1048] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:01.413501  9662 raft_consensus.cc:1275] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.422441  9623 consensus_queue.cc:1048] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:04:01.423151  9047 raft_consensus.cc:1275] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 60a19ab523e3468bb9aacada2c24362c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.428561  9663 raft_consensus.cc:1275] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Refusing update from remote peer 60a19ab523e3468bb9aacada2c24362c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.431495  9758 consensus_queue.cc:1048] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:01.432196  9725 consensus_queue.cc:1048] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:04:01.443058  9045 raft_consensus.cc:1275] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.442539  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd20e59c4c5460cb2da30a82e188e4b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:04:01.449812  9620 tablet_bootstrap.cc:492] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:01.456475  8969 raft_consensus.cc:1275] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Refusing update from remote peer a6a0de662d36410c907287e73cb2e4db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.458824  8971 raft_consensus.cc:1275] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Refusing update from remote peer a6a0de662d36410c907287e73cb2e4db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.462566  8722 catalog_manager.cc:5697] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 2 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.464355  8722 catalog_manager.cc:5697] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 2 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.447302  9676 raft_consensus.cc:1275] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.470683  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:04:01.471892  9746 raft_consensus.cc:493] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.474735  9746 raft_consensus.cc:515] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:01.465854  8722 catalog_manager.cc:5697] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to a6a0de662d36410c907287e73cb2e4db (127.0.107.132). New cstate: current_term: 2 leader_uuid: "a6a0de662d36410c907287e73cb2e4db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.502966  9727 consensus_queue.cc:1048] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:01.503692  8973 raft_consensus.cc:1275] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Refusing update from remote peer 60a19ab523e3468bb9aacada2c24362c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.506485  9665 raft_consensus.cc:1275] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Refusing update from remote peer a6a0de662d36410c907287e73cb2e4db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.510058  9766 consensus_queue.cc:1048] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:01.517063  9770 consensus_queue.cc:1048] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:04:01.519858  9746 leader_election.cc:290] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:01.557785  8721 catalog_manager.cc:5697] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 2 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.561512  8900 raft_consensus.cc:1275] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Refusing update from remote peer a6a0de662d36410c907287e73cb2e4db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.563892  9718 consensus_queue.cc:1048] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:01.606446  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:01.609861  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6de9e2aaa341cfb862ee9073bab6dd" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:01.612036  9712 consensus_queue.cc:1048] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:01.621284  8865 consensus_peers.cc:597] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:01.627774  8939 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.132:45733, user_credentials={real_user=slave}} blocked reactor thread for 139470us
I20260709 13:04:01.632416  9766 consensus_queue.cc:1048] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:01.627193  8717 catalog_manager.cc:5697] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 2 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.636047  8717 catalog_manager.cc:5697] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 1 to 2, leader changed from 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129) to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 2 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.646884  9525 consensus_queue.cc:1048] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:04:01.623201  9718 consensus_queue.cc:1048] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:04:01.654824  8865 consensus_peers.cc:597] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.674926  9616 leader_election.cc:304] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 60a19ab523e3468bb9aacada2c24362c, a6a0de662d36410c907287e73cb2e4db
I20260709 13:04:01.676187  9746 raft_consensus.cc:2749] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:01.704386  9620 tablet_bootstrap.cc:492] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.705533  9620 tablet_bootstrap.cc:492] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:01.706125  9660 consensus_queue.cc:1048] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:01.707506  9620 ts_tablet_manager.cc:1403] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.258s	user 0.028s	sys 0.011s
W20260709 13:04:01.731024  9013 consensus_peers.cc:597] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:01.728909  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd20e59c4c5460cb2da30a82e188e4b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:01.729241  8965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6de9e2aaa341cfb862ee9073bab6dd" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
W20260709 13:04:01.732160  9013 consensus_peers.cc:597] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:01.727376  8717 ts_manager.cc:194] Re-registered known tserver with Master: 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:01.734874  9620 raft_consensus.cc:359] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:01.735592  9620 raft_consensus.cc:740] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.736238  9620 consensus_queue.cc:260] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:01.738405  9620 ts_tablet_manager.cc:1434] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:04:01.739207  9620 tablet_bootstrap.cc:492] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
W20260709 13:04:01.744226  9013 consensus_peers.cc:597] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:01.745186  9013 consensus_peers.cc:597] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:01.780772  9013 consensus_peers.cc:597] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.788718  8865 consensus_peers.cc:597] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:01.790910  8865 consensus_peers.cc:597] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:01.806953  9617 leader_election.cc:304] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:04:01.807857  9746 raft_consensus.cc:2749] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:01.809204  9617 leader_election.cc:304] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:01.810066  9746 raft_consensus.cc:2749] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:01.817534  9043 raft_consensus.cc:1275] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:01.819495  9013 consensus_peers.cc:597] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.822144  8865 consensus_peers.cc:597] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.823633  9013 consensus_peers.cc:597] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:01.827677  9623 consensus_queue.cc:1048] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:01.830713  9620 tablet_bootstrap.cc:492] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.846094  9620 tablet_bootstrap.cc:492] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:01.846735  9620 ts_tablet_manager.cc:1403] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.108s	user 0.017s	sys 0.000s
W20260709 13:04:01.852650  8865 consensus_peers.cc:597] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:01.855876  9043 raft_consensus.cc:1275] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.850615  9620 raft_consensus.cc:359] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
W20260709 13:04:01.856559  8939 consensus_peers.cc:597] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.856637  9620 raft_consensus.cc:740] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.857432  9620 consensus_queue.cc:260] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:01.857462  9725 consensus_queue.cc:1048] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:01.859629  9620 ts_tablet_manager.cc:1434] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:04:01.860631  9620 tablet_bootstrap.cc:492] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
W20260709 13:04:01.861564  9013 consensus_peers.cc:597] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:01.871064  9665 raft_consensus.cc:1275] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:01.872982  9525 consensus_queue.cc:1048] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:01.902536  9620 tablet_bootstrap.cc:492] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.903503  9620 tablet_bootstrap.cc:492] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:01.904109  9620 ts_tablet_manager.cc:1403] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.000s
I20260709 13:04:01.906522  9620 raft_consensus.cc:359] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:01.907212  9620 raft_consensus.cc:740] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.907858  9620 consensus_queue.cc:260] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:01.912308  9620 ts_tablet_manager.cc:1434] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:01.913062  9620 tablet_bootstrap.cc:492] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:01.921252  8717 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60932
I20260709 13:04:01.930590  9711 heartbeater.cc:499] Master 127.0.107.190:46327 was elected leader, sending a full tablet report...
I20260709 13:04:01.931097  9620 tablet_bootstrap.cc:492] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:01.934161  8865 consensus_peers.cc:597] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:01.934826  9620 tablet_bootstrap.cc:492] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:01.935593  9620 ts_tablet_manager.cc:1403] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 13:04:01.938302  9620 raft_consensus.cc:359] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:01.938939  9620 raft_consensus.cc:740] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.939920  9620 consensus_queue.cc:260] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:01.942252  9620 ts_tablet_manager.cc:1434] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:01.943910  9620 tablet_bootstrap.cc:492] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:01.958323  9620 tablet_bootstrap.cc:492] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.959230  9620 tablet_bootstrap.cc:492] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:01.959861  9620 ts_tablet_manager.cc:1403] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:04:01.962311  9620 raft_consensus.cc:359] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:01.962954  9620 raft_consensus.cc:740] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.963610  9620 consensus_queue.cc:260] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:01.965688  9620 ts_tablet_manager.cc:1434] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:04:01.966429  9620 tablet_bootstrap.cc:492] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:01.983598  9620 tablet_bootstrap.cc:492] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.984505  9620 tablet_bootstrap.cc:492] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:01.985118  9620 ts_tablet_manager.cc:1403] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.011s
I20260709 13:04:01.987560  9620 raft_consensus.cc:359] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:01.988240  9620 raft_consensus.cc:740] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.989071  9620 consensus_queue.cc:260] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:01.991089  9620 ts_tablet_manager.cc:1434] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:01.991824  9620 tablet_bootstrap.cc:492] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.007920  9620 tablet_bootstrap.cc:492] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.008872  9620 tablet_bootstrap.cc:492] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.009505  9620 ts_tablet_manager.cc:1403] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:04:02.012074  9620 raft_consensus.cc:359] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.012761  9620 raft_consensus.cc:740] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.013427  9620 consensus_queue.cc:260] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.015535  9620 ts_tablet_manager.cc:1434] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:02.016673  9620 tablet_bootstrap.cc:492] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.033174  9620 tablet_bootstrap.cc:492] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.034112  9620 tablet_bootstrap.cc:492] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.034755  9620 ts_tablet_manager.cc:1403] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:04:02.037005  9620 raft_consensus.cc:359] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:02.037662  9620 raft_consensus.cc:740] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.038290  9620 consensus_queue.cc:260] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:02.040186  9620 ts_tablet_manager.cc:1434] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:04:02.041240  9620 tablet_bootstrap.cc:492] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
W20260709 13:04:02.050117  8865 consensus_peers.cc:597] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.055843  9620 tablet_bootstrap.cc:492] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.056636  9620 tablet_bootstrap.cc:492] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.057231  9620 ts_tablet_manager.cc:1403] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:04:02.059178  9620 raft_consensus.cc:359] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:02.059705  9620 raft_consensus.cc:740] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.060288  9620 consensus_queue.cc:260] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:02.062155  9620 ts_tablet_manager.cc:1434] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:02.063155  9620 tablet_bootstrap.cc:492] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
W20260709 13:04:02.069453  8865 consensus_peers.cc:597] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.080685  9620 tablet_bootstrap.cc:492] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.081847  9620 tablet_bootstrap.cc:492] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.082669  9620 ts_tablet_manager.cc:1403] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.001s
I20260709 13:04:02.087648  9620 raft_consensus.cc:359] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:02.088410  9620 raft_consensus.cc:740] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.089156  9620 consensus_queue.cc:260] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:02.091297  9620 ts_tablet_manager.cc:1434] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:02.092458  9620 tablet_bootstrap.cc:492] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.107781  9620 tablet_bootstrap.cc:492] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.108676  9620 tablet_bootstrap.cc:492] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.109267  9620 ts_tablet_manager.cc:1403] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:04:02.112187  9620 raft_consensus.cc:359] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:02.112833  9620 raft_consensus.cc:740] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.113490  9620 consensus_queue.cc:260] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:02.115895  9669 raft_consensus.cc:3060] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.116690  9620 ts_tablet_manager.cc:1434] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:02.118081  9620 tablet_bootstrap.cc:492] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.137647  9620 tablet_bootstrap.cc:492] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:02.138355  9013 consensus_peers.cc:597] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:02.139070  9620 tablet_bootstrap.cc:492] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.141855  9620 ts_tablet_manager.cc:1403] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 13:04:02.144737  9620 raft_consensus.cc:359] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.145356  9620 raft_consensus.cc:740] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.146107  9620 consensus_queue.cc:260] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.155087  9620 ts_tablet_manager.cc:1434] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:04:02.155936  9620 tablet_bootstrap.cc:492] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.170024  9620 tablet_bootstrap.cc:492] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.171018  9620 tablet_bootstrap.cc:492] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.171643  9620 ts_tablet_manager.cc:1403] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 13:04:02.173964  9620 raft_consensus.cc:359] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:02.174511  9620 raft_consensus.cc:740] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.175829  9620 consensus_queue.cc:260] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:02.178056  9620 ts_tablet_manager.cc:1434] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:02.179028  9620 tablet_bootstrap.cc:492] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.203047  9620 tablet_bootstrap.cc:492] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.204021  9620 tablet_bootstrap.cc:492] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.204632  9620 ts_tablet_manager.cc:1403] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.005s
I20260709 13:04:02.207814  9620 raft_consensus.cc:359] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:02.208496  9620 raft_consensus.cc:740] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.209161  9620 consensus_queue.cc:260] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:02.212296  9620 ts_tablet_manager.cc:1434] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:02.213100  9620 tablet_bootstrap.cc:492] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.218532  9669 raft_consensus.cc:3060] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.229542  9620 tablet_bootstrap.cc:492] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.230639  9620 tablet_bootstrap.cc:492] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.231370  9620 ts_tablet_manager.cc:1403] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:04:02.233352  9620 raft_consensus.cc:359] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:02.233914  9620 raft_consensus.cc:740] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.234556  9620 consensus_queue.cc:260] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:02.236842  9620 ts_tablet_manager.cc:1434] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:02.237934  9620 tablet_bootstrap.cc:492] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.252949  9620 tablet_bootstrap.cc:492] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.253916  9620 tablet_bootstrap.cc:492] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.254504  9620 ts_tablet_manager.cc:1403] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:04:02.256763  9620 raft_consensus.cc:359] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:02.257222  9620 raft_consensus.cc:740] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.257934  9620 consensus_queue.cc:260] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:02.259620  9620 ts_tablet_manager.cc:1434] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.002s
I20260709 13:04:02.260478  9620 tablet_bootstrap.cc:492] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.276149  9669 raft_consensus.cc:3060] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.290957  9620 tablet_bootstrap.cc:492] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.291872  9620 tablet_bootstrap.cc:492] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.292510  9620 ts_tablet_manager.cc:1403] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.017s
I20260709 13:04:02.294874  9620 raft_consensus.cc:359] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.295575  9620 raft_consensus.cc:740] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.296176  9620 consensus_queue.cc:260] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.298197  9620 ts_tablet_manager.cc:1434] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:02.298943  9620 tablet_bootstrap.cc:492] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.316735  9620 tablet_bootstrap.cc:492] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.317692  9620 tablet_bootstrap.cc:492] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.318334  9620 ts_tablet_manager.cc:1403] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 13:04:02.320760  9620 raft_consensus.cc:359] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:02.321416  9620 raft_consensus.cc:740] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.322055  9620 consensus_queue.cc:260] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:02.324234  9620 ts_tablet_manager.cc:1434] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:02.325562  9620 tablet_bootstrap.cc:492] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.338755  9620 tablet_bootstrap.cc:492] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.339892  9620 tablet_bootstrap.cc:492] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.340490  9620 ts_tablet_manager.cc:1403] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:04:02.342783  9620 raft_consensus.cc:359] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:02.343228  9620 raft_consensus.cc:740] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.343732  9620 consensus_queue.cc:260] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:02.345413  9620 ts_tablet_manager.cc:1434] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:02.346477  9620 tablet_bootstrap.cc:492] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.361660  9620 tablet_bootstrap.cc:492] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.362520  9620 tablet_bootstrap.cc:492] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.363106  9620 ts_tablet_manager.cc:1403] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.001s
I20260709 13:04:02.365502  9620 raft_consensus.cc:359] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.366318  9620 raft_consensus.cc:740] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.366914  9620 consensus_queue.cc:260] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.368835  9620 ts_tablet_manager.cc:1434] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:04:02.369563  9620 tablet_bootstrap.cc:492] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.372107  9669 raft_consensus.cc:3060] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.375187  9676 raft_consensus.cc:3060] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.400103  9665 raft_consensus.cc:3060] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.422899  9620 tablet_bootstrap.cc:492] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.424387  9620 tablet_bootstrap.cc:492] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.429071  9620 ts_tablet_manager.cc:1403] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.060s	user 0.031s	sys 0.009s
I20260709 13:04:02.432591  9620 raft_consensus.cc:359] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.433408  9620 raft_consensus.cc:740] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.434113  9620 consensus_queue.cc:260] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.436782  9620 ts_tablet_manager.cc:1434] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:02.437672  9620 tablet_bootstrap.cc:492] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.452862  9620 tablet_bootstrap.cc:492] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.453722  9620 tablet_bootstrap.cc:492] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.454299  9620 ts_tablet_manager.cc:1403] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:04:02.456350  9620 raft_consensus.cc:359] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:02.457024  9620 raft_consensus.cc:740] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.457659  9620 consensus_queue.cc:260] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:02.459179  9620 ts_tablet_manager.cc:1434] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:02.459995  9620 tablet_bootstrap.cc:492] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.483237  9620 tablet_bootstrap.cc:492] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.484128  9620 tablet_bootstrap.cc:492] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.484786  9620 ts_tablet_manager.cc:1403] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.011s
I20260709 13:04:02.486819  9620 raft_consensus.cc:359] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.487248  9620 raft_consensus.cc:740] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.487850  9620 consensus_queue.cc:260] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.489302  9620 ts_tablet_manager.cc:1434] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:02.490265  9620 tablet_bootstrap.cc:492] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.502660  9620 tablet_bootstrap.cc:492] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.504518  9620 tablet_bootstrap.cc:492] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.505069  9620 ts_tablet_manager.cc:1403] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:04:02.507754  9620 raft_consensus.cc:359] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.508401  9620 raft_consensus.cc:740] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.509248  9620 consensus_queue.cc:260] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.511513  9620 ts_tablet_manager.cc:1434] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:02.512180  9665 raft_consensus.cc:3060] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.514550  9620 tablet_bootstrap.cc:492] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap starting.
I20260709 13:04:02.533854  9620 tablet_bootstrap.cc:492] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:02.534758  9620 tablet_bootstrap.cc:492] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90: Bootstrap complete.
I20260709 13:04:02.535399  9620 ts_tablet_manager.cc:1403] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 13:04:02.537501  9620 raft_consensus.cc:359] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.538146  9620 raft_consensus.cc:740] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.538743  9620 consensus_queue.cc:260] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:02.540710  9620 ts_tablet_manager.cc:1434] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:02.570421  9665 raft_consensus.cc:3060] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.580674  9665 raft_consensus.cc:3060] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.037566  9665 raft_consensus.cc:3060] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.426363   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:10.473206  8900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897"
dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:38736
I20260709 13:04:10.473827  8900 raft_consensus.cc:606] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:10.486002  9044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5"
dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:36834
I20260709 13:04:10.486460  9044 raft_consensus.cc:606] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:10.488783  8900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de518c02ce8d4d278d359e001b96db41"
dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
mode: GRACEFUL
new_leader_uuid: "245d19d5c71647a9857ac68df13802d5"
 from {username='slave'} at 127.0.0.1:38736
I20260709 13:04:10.489228  8900 raft_consensus.cc:606] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Received request to transfer leadership to TS 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:10.491242  8900 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de61bcc226d7496e80bec49c06bd35f0"
dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:38736
I20260709 13:04:10.491667  8900 raft_consensus.cc:606] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:10.493752  9044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12"
dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:36834
I20260709 13:04:10.494186  9044 raft_consensus.cc:606] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:10.495210   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:10.496604   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:10.522696  9837 raft_consensus.cc:993] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:10.523211  9837 raft_consensus.cc:1081] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:10.524636  9669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35790
I20260709 13:04:10.525190  9669 raft_consensus.cc:493] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:10.525528  9669 raft_consensus.cc:3060] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.534601  9669 raft_consensus.cc:515] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:10.538172  9669 leader_election.cc:290] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:10.538904  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:10.539291  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572cae6a298d45448d43956a1842ecc5" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:10.540949  9596 raft_consensus.cc:993] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:10.539523  9044 raft_consensus.cc:3055] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:10.541464  9044 raft_consensus.cc:740] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:10.541572  9596 raft_consensus.cc:1081] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:10.542250  9044 consensus_queue.cc:260] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:10.543663  9044 raft_consensus.cc:3060] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.541009  8900 raft_consensus.cc:3060] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.551044  9676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35800
I20260709 13:04:10.551600  9676 raft_consensus.cc:493] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:10.551944  9676 raft_consensus.cc:3060] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.552608  8900 raft_consensus.cc:2468] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:10.553872  9614 leader_election.cc:304] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:10.554425  9044 raft_consensus.cc:2468] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:10.556339  9852 raft_consensus.cc:2804] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:10.558032  9676 raft_consensus.cc:515] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:10.559393  9676 leader_election.cc:290] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:10.560348  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:10.560678  8900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ec2f73ef1f1465cb94938ff88587897" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:10.560909  9044 raft_consensus.cc:3060] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.561241  8900 raft_consensus.cc:3055] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:10.561547  8900 raft_consensus.cc:740] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:04:10.562189  8900 consensus_queue.cc:260] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:10.563020  8900 raft_consensus.cc:3060] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:10.563516  9852 raft_consensus.cc:697] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:10.564810  9852 consensus_queue.cc:237] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:10.566283  9044 raft_consensus.cc:2468] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 2.
I20260709 13:04:10.567399  9616 leader_election.cc:304] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:10.568255  9853 raft_consensus.cc:2804] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:10.568348  8900 raft_consensus.cc:2468] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 2.
I20260709 13:04:10.571523  9853 raft_consensus.cc:697] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:10.572274  9853 consensus_queue.cc:237] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:10.576881  8721 catalog_manager.cc:5697] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 2 to 3, leader changed from a6a0de662d36410c907287e73cb2e4db (127.0.107.132) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 3 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.587160  9837 raft_consensus.cc:993] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:10.587636  9837 raft_consensus.cc:1081] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:10.588972  9669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35790
I20260709 13:04:10.589578  9669 raft_consensus.cc:493] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:10.589845  9669 raft_consensus.cc:3060] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.596259  9669 raft_consensus.cc:515] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:10.598663  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:10.598882  9669 leader_election.cc:290] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:10.599241  9044 raft_consensus.cc:3055] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:10.599609  9044 raft_consensus.cc:740] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:10.599879  8894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5eae864d4cf4f2ea2d5b52e7ffc1c12" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:10.600499  8894 raft_consensus.cc:3060] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.600273  9044 consensus_queue.cc:260] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:10.602736  9044 raft_consensus.cc:3060] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.603682  8721 catalog_manager.cc:5697] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 1 to 2, leader changed from 60a19ab523e3468bb9aacada2c24362c (127.0.107.130) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:10.606707  8894 raft_consensus.cc:2468] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:10.607829  9614 leader_election.cc:304] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:10.608682  9853 raft_consensus.cc:2804] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:10.609161  9853 raft_consensus.cc:697] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:10.609217  9044 raft_consensus.cc:2468] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:10.610049  9853 consensus_queue.cc:237] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:10.619659  8721 catalog_manager.cc:5697] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 2 to 3, leader changed from a6a0de662d36410c907287e73cb2e4db (127.0.107.132) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 3 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.165376  9043 raft_consensus.cc:1275] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:11.167158  9044 raft_consensus.cc:1275] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:11.181236  9044 raft_consensus.cc:1275] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:11.183634  9853 consensus_queue.cc:1048] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:11.199772  9855 consensus_queue.cc:1048] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:11.202064  9855 consensus_queue.cc:1048] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:11.438310  8894 raft_consensus.cc:1275] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:11.442919  9853 consensus_queue.cc:1048] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:04:11.448580  8896 raft_consensus.cc:1275] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:11.451597  8900 raft_consensus.cc:1275] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:11.460750  9855 consensus_queue.cc:1048] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:11.459623  9853 consensus_queue.cc:1048] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:04:11.646632  9875 raft_consensus.cc:493] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 60a19ab523e3468bb9aacada2c24362c)
I20260709 13:04:11.647399  9875 raft_consensus.cc:515] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:11.660866  9851 raft_consensus.cc:493] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 60a19ab523e3468bb9aacada2c24362c)
I20260709 13:04:11.661751  9851 raft_consensus.cc:515] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:04:11.667514  8898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:04:11.683822  9851 leader_election.cc:290] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:11.700796  9875 leader_election.cc:290] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:11.709197  9887 raft_consensus.cc:993] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c: : Instructing follower 245d19d5c71647a9857ac68df13802d5 to start an election
I20260709 13:04:11.715127  9888 raft_consensus.cc:1081] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Signalling peer 245d19d5c71647a9857ac68df13802d5 to start an election
I20260709 13:04:11.702877  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977d385d3eeb49a799b9c161940c175a" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "60a19ab523e3468bb9aacada2c24362c" is_pre_election: true
I20260709 13:04:11.738125  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "977d385d3eeb49a799b9c161940c175a" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:11.741007  8974 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de518c02ce8d4d278d359e001b96db41"
dest_uuid: "245d19d5c71647a9857ac68df13802d5"
 from {username='slave'} at 127.0.0.1:45554
I20260709 13:04:11.741797  8974 raft_consensus.cc:493] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.742208  8974 raft_consensus.cc:3060] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.745586  9853 raft_consensus.cc:493] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 245d19d5c71647a9857ac68df13802d5)
I20260709 13:04:11.746309  9853 raft_consensus.cc:515] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:11.748674  9853 leader_election.cc:290] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:11.754030  8967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6de9e2aaa341cfb862ee9073bab6dd" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:11.754379  9853 raft_consensus.cc:493] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 245d19d5c71647a9857ac68df13802d5)
I20260709 13:04:11.757871  9839 raft_consensus.cc:493] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 245d19d5c71647a9857ac68df13802d5)
I20260709 13:04:11.758551  9839 raft_consensus.cc:515] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:11.758594  9853 raft_consensus.cc:515] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:11.763075  9839 leader_election.cc:290] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:11.763492  9853 leader_election.cc:290] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:11.763842  8967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:11.765581  9853 raft_consensus.cc:493] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 245d19d5c71647a9857ac68df13802d5)
I20260709 13:04:11.766202  9853 raft_consensus.cc:515] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:11.789425  8970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75657aca6e034936ba57c704cedb5563" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:11.792686  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6de9e2aaa341cfb862ee9073bab6dd" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:11.795284  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e29794ffb24d7c898647fbcf5e0d77" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:11.797137  9663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75657aca6e034936ba57c704cedb5563" candidate_uuid: "a6a0de662d36410c907287e73cb2e4db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:04:11.811525  9853 leader_election.cc:290] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:11.786583  8974 raft_consensus.cc:515] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:04:11.819782  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de518c02ce8d4d278d359e001b96db41" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:11.820400  8895 raft_consensus.cc:3055] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:11.820575  9669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90" is_pre_election: true
I20260709 13:04:11.820695  8895 raft_consensus.cc:740] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:04:11.821815  8895 consensus_queue.cc:260] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:04:11.822878  8895 raft_consensus.cc:3060] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.820669  9011 leader_election.cc:304] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:11.825585  9013 leader_election.cc:304] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:11.827461  9849 raft_consensus.cc:2749] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:11.829864  9853 raft_consensus.cc:493] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 245d19d5c71647a9857ac68df13802d5)
I20260709 13:04:11.832831  9853 raft_consensus.cc:515] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:11.829109  9616 leader_election.cc:304] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:04:11.835041  9853 leader_election.cc:290] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:11.840902  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d68cd517ce44baf88aa239a275ce8d0" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:11.843681  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "245d19d5c71647a9857ac68df13802d5" is_pre_election: true
I20260709 13:04:11.843998  9864 raft_consensus.cc:2749] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:11.847652  8974 leader_election.cc:290] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:11.848374  9616 leader_election.cc:304] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:04:11.849018  9853 raft_consensus.cc:2749] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:11.849126  8895 raft_consensus.cc:2468] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:11.849721  9853 raft_consensus.cc:2749] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:11.850431  8937 leader_election.cc:304] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:11.851835  9889 raft_consensus.cc:2804] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:11.852322  9889 raft_consensus.cc:697] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:04:11.853351  9889 consensus_queue.cc:237] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:04:11.858062  8939 leader_election.cc:304] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:11.862387  9872 raft_consensus.cc:2749] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:11.869485  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de518c02ce8d4d278d359e001b96db41" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:11.870276  9045 raft_consensus.cc:3060] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:11.870811  9614 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:43707, user_credentials={real_user=slave}} blocked reactor thread for 74867.1us
I20260709 13:04:11.887698  9045 raft_consensus.cc:2468] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:11.890961  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d68cd517ce44baf88aa239a275ce8d0" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:11.895671  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:11.906780  9616 leader_election.cc:304] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:04:11.909452  9892 raft_consensus.cc:2749] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:11.909240  8722 catalog_manager.cc:5697] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 1 to 2, leader changed from 60a19ab523e3468bb9aacada2c24362c (127.0.107.130) to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 2 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.910974  9616 leader_election.cc:304] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90; no voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db
I20260709 13:04:11.915295  9892 raft_consensus.cc:2749] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:12.250733  9045 raft_consensus.cc:1275] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.252077  9889 consensus_queue.cc:1048] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.258520   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:12.263666  8899 raft_consensus.cc:1275] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.265272  9875 consensus_queue.cc:1048] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.318086   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:12.354341  9045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0986587761fb4f0387746bee54af0e5b"
dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:36834
I20260709 13:04:12.354933  9045 raft_consensus.cc:606] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:12.357388  9045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27"
dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:36834
I20260709 13:04:12.357808  9045 raft_consensus.cc:606] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:12.359952  9045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "448e990629c04a25945e8b2f7c71d414"
dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:36834
I20260709 13:04:12.360381  9045 raft_consensus.cc:606] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:12.364514  9045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99a4989c61c249ebab0dfa6b8990d350"
dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
mode: GRACEFUL
new_leader_uuid: "245d19d5c71647a9857ac68df13802d5"
 from {username='slave'} at 127.0.0.1:36834
I20260709 13:04:12.365064  9045 raft_consensus.cc:606] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Received request to transfer leadership to TS 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:12.367595  8899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb"
dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:38736
I20260709 13:04:12.368041  8899 raft_consensus.cc:606] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:12.369650   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:12.371364   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:12.372989  9837 raft_consensus.cc:993] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db: : Instructing follower 245d19d5c71647a9857ac68df13802d5 to start an election
I20260709 13:04:12.373484  9849 raft_consensus.cc:1081] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Signalling peer 245d19d5c71647a9857ac68df13802d5 to start an election
I20260709 13:04:12.374773  8974 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99a4989c61c249ebab0dfa6b8990d350"
dest_uuid: "245d19d5c71647a9857ac68df13802d5"
 from {username='slave'} at 127.0.0.1:45570
I20260709 13:04:12.375137  8974 raft_consensus.cc:493] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.375380  8974 raft_consensus.cc:3060] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.380200  8974 raft_consensus.cc:515] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:04:12.381619  8974 leader_election.cc:290] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:12.382313  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a4989c61c249ebab0dfa6b8990d350" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:12.382498  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a4989c61c249ebab0dfa6b8990d350" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:12.382892  8899 raft_consensus.cc:3060] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.383082  9045 raft_consensus.cc:3055] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.383505  9045 raft_consensus.cc:740] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:12.384204  9045 consensus_queue.cc:260] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:04:12.386294  9045 raft_consensus.cc:3060] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.388331  8899 raft_consensus.cc:2468] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:12.389449  8937 leader_election.cc:304] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:12.390241  9879 raft_consensus.cc:2804] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.390695  9879 raft_consensus.cc:697] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:04:12.391558  9879 consensus_queue.cc:237] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:04:12.392019  9837 raft_consensus.cc:993] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:12.392099  9045 raft_consensus.cc:2468] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:12.392721  9849 raft_consensus.cc:1081] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:12.394299  9662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "448e990629c04a25945e8b2f7c71d414"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35790
I20260709 13:04:12.394876  9662 raft_consensus.cc:493] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.395200  9662 raft_consensus.cc:3060] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.402361  9662 raft_consensus.cc:515] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:12.403332  8722 catalog_manager.cc:5697] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 1 to 2, leader changed from a6a0de662d36410c907287e73cb2e4db (127.0.107.132) to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 2 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.406515  9662 leader_election.cc:290] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:12.409209  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448e990629c04a25945e8b2f7c71d414" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:12.409888  8899 raft_consensus.cc:3060] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.410961  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448e990629c04a25945e8b2f7c71d414" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:12.411550  9045 raft_consensus.cc:3055] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.411834  9045 raft_consensus.cc:740] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:12.412561  9045 consensus_queue.cc:260] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:12.413764  9045 raft_consensus.cc:3060] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.420835  8899 raft_consensus.cc:2468] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 2.
I20260709 13:04:12.421883  9614 leader_election.cc:304] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:12.422674  9901 raft_consensus.cc:2804] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.423125  9901 raft_consensus.cc:697] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:12.424046  9901 consensus_queue.cc:237] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:12.429384  9045 raft_consensus.cc:2468] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 2.
I20260709 13:04:12.438349  8722 catalog_manager.cc:5697] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 1 to 2, leader changed from a6a0de662d36410c907287e73cb2e4db (127.0.107.132) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.448094  9837 raft_consensus.cc:993] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:12.448496  9849 raft_consensus.cc:1081] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:12.449796  9662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35790
I20260709 13:04:12.450292  9662 raft_consensus.cc:493] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.450619  9662 raft_consensus.cc:3060] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:12.456391  9662 raft_consensus.cc:515] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:12.458178  9662 leader_election.cc:290] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:12.458619  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:12.459056  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350fc78f6e2a42ce8ec15f7a6d7a7a27" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:12.459263  8974 raft_consensus.cc:3060] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:12.459630  9045 raft_consensus.cc:3055] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:12.459975  9045 raft_consensus.cc:740] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:12.460569  9045 consensus_queue.cc:260] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:12.461443  9045 raft_consensus.cc:3060] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:12.464679  8974 raft_consensus.cc:2468] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:12.465828  9617 leader_election.cc:304] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:04:12.466665  9045 raft_consensus.cc:2468] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:12.466882  9901 raft_consensus.cc:2804] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:12.467774  9901 raft_consensus.cc:697] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:12.468761  9901 consensus_queue.cc:237] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:12.477993  8722 catalog_manager.cc:5697] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 2 to 3, leader changed from a6a0de662d36410c907287e73cb2e4db (127.0.107.132) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 3 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.513999  9885 raft_consensus.cc:993] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:12.514458  9886 raft_consensus.cc:1081] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:12.515960  9662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35800
I20260709 13:04:12.516449  9662 raft_consensus.cc:493] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.516759  9662 raft_consensus.cc:3060] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:12.519870  8995 debug-util.cc:398] Leaking SignalData structure 0x7b08002385a0 after lost signal to thread 433
W20260709 13:04:12.521073  8995 debug-util.cc:398] Leaking SignalData structure 0x7b080029dec0 after lost signal to thread 8757
W20260709 13:04:12.522357  8995 debug-util.cc:398] Leaking SignalData structure 0x7b0800215200 after lost signal to thread 8924
W20260709 13:04:12.523536  8995 debug-util.cc:398] Leaking SignalData structure 0x7b08002153a0 after lost signal to thread 8998
I20260709 13:04:12.523404  9662 raft_consensus.cc:515] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
W20260709 13:04:12.524806  8995 debug-util.cc:398] Leaking SignalData structure 0x7b08000a9ae0 after lost signal to thread 9072
I20260709 13:04:12.525355  9662 leader_election.cc:290] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:12.525939  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
W20260709 13:04:12.526139  8995 debug-util.cc:398] Leaking SignalData structure 0x7b0800264dc0 after lost signal to thread 9709
I20260709 13:04:12.526605  8899 raft_consensus.cc:3055] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:12.526726  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74beae5607c4a46be83e22d48744dcb" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:12.527030  8899 raft_consensus.cc:740] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:04:12.527465  8966 raft_consensus.cc:3060] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:12.527895  8899 consensus_queue.cc:260] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:12.528738  8899 raft_consensus.cc:3060] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:12.535580  8966 raft_consensus.cc:2468] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:12.536814  8899 raft_consensus.cc:2468] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:12.536962  9617 leader_election.cc:304] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:04:12.538046  9901 raft_consensus.cc:2804] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:12.538591  9901 raft_consensus.cc:697] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:12.539639  9901 consensus_queue.cc:237] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:12.556759  8722 catalog_manager.cc:5697] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 2 to 3, leader changed from 60a19ab523e3468bb9aacada2c24362c (127.0.107.130) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 3 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.781538  9837 raft_consensus.cc:993] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:12.782019  9895 raft_consensus.cc:1081] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:12.783715  9663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0986587761fb4f0387746bee54af0e5b"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35790
I20260709 13:04:12.784420  9663 raft_consensus.cc:493] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.784976  9663 raft_consensus.cc:3060] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.795468  9663 raft_consensus.cc:515] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:12.798933  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0986587761fb4f0387746bee54af0e5b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:12.799202  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0986587761fb4f0387746bee54af0e5b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:12.799683  9045 raft_consensus.cc:3055] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.799810  8966 raft_consensus.cc:3060] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.800040  9045 raft_consensus.cc:740] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:12.800853  9045 consensus_queue.cc:260] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:12.801854  9045 raft_consensus.cc:3060] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.803536  9663 leader_election.cc:290] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:12.807047  8966 raft_consensus.cc:2468] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 2.
I20260709 13:04:12.808233  9617 leader_election.cc:304] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:04:12.808971  9901 raft_consensus.cc:2804] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.809398  9901 raft_consensus.cc:697] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:12.810230  9901 consensus_queue.cc:237] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:12.810696  9045 raft_consensus.cc:2468] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 2.
I20260709 13:04:12.823361  8722 catalog_manager.cc:5697] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 1 to 2, leader changed from a6a0de662d36410c907287e73cb2e4db (127.0.107.132) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.828907  8899 raft_consensus.cc:1275] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.830442  9901 consensus_queue.cc:1048] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.856321  9045 raft_consensus.cc:1275] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.861351  9901 consensus_queue.cc:1048] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.872205  8966 raft_consensus.cc:1275] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:12.873332  9893 consensus_queue.cc:1048] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:12.891588  9045 raft_consensus.cc:1275] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:12.901190  9901 consensus_queue.cc:1048] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:12.919026  9045 raft_consensus.cc:1275] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.922364  9913 consensus_queue.cc:1048] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.944356  8895 raft_consensus.cc:1275] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.945892  9879 consensus_queue.cc:1048] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.072844  8974 raft_consensus.cc:1275] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:13.074374  9893 consensus_queue.cc:1048] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:13.090586  8899 raft_consensus.cc:1275] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:13.093395  9893 consensus_queue.cc:1048] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:13.251269  9044 raft_consensus.cc:1275] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.252511  9893 consensus_queue.cc:1048] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.279721  8966 raft_consensus.cc:1275] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:13.281698  9926 consensus_queue.cc:1048] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.372259   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:13.423947   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:13.474562  9044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "105ca1309d4c495293d5da6c6b316b04"
dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:36834
I20260709 13:04:13.475159  9044 raft_consensus.cc:606] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:13.477594  9044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ede05852c17421192022144629e6a6b"
dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:36834
I20260709 13:04:13.478075  9044 raft_consensus.cc:606] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:13.480630  9044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c4408002b8e4e67a7bf17118232afd5"
dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
mode: GRACEFUL
new_leader_uuid: "245d19d5c71647a9857ac68df13802d5"
 from {username='slave'} at 127.0.0.1:36834
I20260709 13:04:13.481204  9044 raft_consensus.cc:606] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Received request to transfer leadership to TS 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:13.511816  9837 raft_consensus.cc:993] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:13.512290  9837 raft_consensus.cc:1081] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:13.514377  9663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "105ca1309d4c495293d5da6c6b316b04"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35790
I20260709 13:04:13.514902  9663 raft_consensus.cc:493] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.515287  9663 raft_consensus.cc:3060] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.535444  8974 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171"
dest_uuid: "245d19d5c71647a9857ac68df13802d5"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:59838
I20260709 13:04:13.536108  8974 raft_consensus.cc:606] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:13.537576  9663 raft_consensus.cc:515] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:13.540608  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105ca1309d4c495293d5da6c6b316b04" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:13.540673  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105ca1309d4c495293d5da6c6b316b04" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:13.541231  9045 raft_consensus.cc:3055] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.541416  8974 raft_consensus.cc:3060] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.542060  9663 leader_election.cc:290] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:13.541581  9045 raft_consensus.cc:740] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:13.546154  9045 consensus_queue.cc:260] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:13.546417  9044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5624f032fa846eebb830e2ea2bb857b"
dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
mode: GRACEFUL
new_leader_uuid: "60a19ab523e3468bb9aacada2c24362c"
 from {username='slave'} at 127.0.0.1:36834
I20260709 13:04:13.547112  9044 raft_consensus.cc:606] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Received request to transfer leadership to TS 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:13.549672   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:13.550310  9045 raft_consensus.cc:3060] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.551913   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:13.561622  8974 raft_consensus.cc:2468] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 2.
I20260709 13:04:13.563184  9617 leader_election.cc:304] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:04:13.563997  9893 raft_consensus.cc:2804] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.564476  9893 raft_consensus.cc:697] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:13.565320  9893 consensus_queue.cc:237] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:13.575596  9045 raft_consensus.cc:2468] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 2.
I20260709 13:04:13.588676  8721 catalog_manager.cc:5697] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 1 to 2, leader changed from a6a0de662d36410c907287e73cb2e4db (127.0.107.132) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.595997  9879 raft_consensus.cc:993] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:13.596715  9879 raft_consensus.cc:1081] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:13.598613  9663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35802
I20260709 13:04:13.599262  9663 raft_consensus.cc:493] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.599717  9663 raft_consensus.cc:3060] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:13.613336  9663 raft_consensus.cc:515] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:13.616119  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:13.616708  8974 raft_consensus.cc:3055] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:13.617177  8974 raft_consensus.cc:740] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:04:13.617411  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fcaea8afc7941f0aaaa6b3b2c0d1171" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:13.617957  9045 raft_consensus.cc:3060] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:13.617903  8974 consensus_queue.cc:260] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:13.619154  8974 raft_consensus.cc:3060] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:13.629941  9045 raft_consensus.cc:2468] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:13.616142  9663 leader_election.cc:290] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:13.631443  9616 leader_election.cc:304] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:13.632483  9893 raft_consensus.cc:2804] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:13.632570  8974 raft_consensus.cc:2468] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:13.633080  9893 raft_consensus.cc:697] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:13.634074  9893 consensus_queue.cc:237] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:13.647900  8721 catalog_manager.cc:5697] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 2 to 3, leader changed from 245d19d5c71647a9857ac68df13802d5 (127.0.107.131) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 3 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.661623  9895 raft_consensus.cc:993] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db: : Instructing follower 245d19d5c71647a9857ac68df13802d5 to start an election
I20260709 13:04:13.662127  9895 raft_consensus.cc:1081] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Signalling peer 245d19d5c71647a9857ac68df13802d5 to start an election
I20260709 13:04:13.663733  8966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c4408002b8e4e67a7bf17118232afd5"
dest_uuid: "245d19d5c71647a9857ac68df13802d5"
 from {username='slave'} at 127.0.0.1:45570
I20260709 13:04:13.664260  8966 raft_consensus.cc:493] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.664575  8966 raft_consensus.cc:3060] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.672211  8966 raft_consensus.cc:515] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:04:13.675606  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4408002b8e4e67a7bf17118232afd5" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:13.675966  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c4408002b8e4e67a7bf17118232afd5" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:13.676180  8899 raft_consensus.cc:3060] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.676610  9045 raft_consensus.cc:3055] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.676936  9045 raft_consensus.cc:740] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:13.677604  9045 consensus_queue.cc:260] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:04:13.678426  9045 raft_consensus.cc:3060] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.683980  8899 raft_consensus.cc:2468] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:13.685087  8966 leader_election.cc:290] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:13.685354  8937 leader_election.cc:304] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:13.686448  9875 raft_consensus.cc:2804] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.686975  9875 raft_consensus.cc:697] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Becoming Leader. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:04:13.687835  9875 consensus_queue.cc:237] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:04:13.688519  9045 raft_consensus.cc:2468] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:13.696488  9849 raft_consensus.cc:993] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db: : Instructing follower 60a19ab523e3468bb9aacada2c24362c to start an election
I20260709 13:04:13.696964  9895 raft_consensus.cc:1081] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Signalling peer 60a19ab523e3468bb9aacada2c24362c to start an election
I20260709 13:04:13.697798  8721 catalog_manager.cc:5697] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 reported cstate change: term changed from 1 to 2, leader changed from a6a0de662d36410c907287e73cb2e4db (127.0.107.132) to 245d19d5c71647a9857ac68df13802d5 (127.0.107.131). New cstate: current_term: 2 leader_uuid: "245d19d5c71647a9857ac68df13802d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.698523  8899 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5624f032fa846eebb830e2ea2bb857b"
dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
 from {username='slave'} at 127.0.0.1:53060
I20260709 13:04:13.699076  8899 raft_consensus.cc:493] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.699441  8899 raft_consensus.cc:3060] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.704381  8899 raft_consensus.cc:515] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:04:13.711474  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5624f032fa846eebb830e2ea2bb857b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:13.711764  8966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5624f032fa846eebb830e2ea2bb857b" candidate_uuid: "60a19ab523e3468bb9aacada2c24362c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:13.712069  9045 raft_consensus.cc:3055] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.712277  8966 raft_consensus.cc:3060] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.712414  9045 raft_consensus.cc:740] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:13.713248  9045 consensus_queue.cc:260] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:04:13.714278  9045 raft_consensus.cc:3060] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.710664  8899 leader_election.cc:290] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:13.719014  8966 raft_consensus.cc:2468] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 2.
I20260709 13:04:13.720165  8866 leader_election.cc:304] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:13.720930  9911 raft_consensus.cc:2804] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.721400  9911 raft_consensus.cc:697] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Becoming Leader. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:04:13.721441  9045 raft_consensus.cc:2468] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60a19ab523e3468bb9aacada2c24362c in term 2.
I20260709 13:04:13.722357  9911 consensus_queue.cc:237] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } }
I20260709 13:04:13.734018  8721 catalog_manager.cc:5697] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c reported cstate change: term changed from 1 to 2, leader changed from a6a0de662d36410c907287e73cb2e4db (127.0.107.132) to 60a19ab523e3468bb9aacada2c24362c (127.0.107.130). New cstate: current_term: 2 leader_uuid: "60a19ab523e3468bb9aacada2c24362c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.928035  9837 raft_consensus.cc:993] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:13.928520  9837 raft_consensus.cc:1081] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:13.930431  9669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ede05852c17421192022144629e6a6b"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35790
I20260709 13:04:13.930943  9669 raft_consensus.cc:493] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:13.931274  9669 raft_consensus.cc:3060] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.936729  9669 raft_consensus.cc:515] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:13.938455  9669 leader_election.cc:290] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:13.939664  8895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ede05852c17421192022144629e6a6b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:13.940837  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ede05852c17421192022144629e6a6b" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:13.941500  9045 raft_consensus.cc:3055] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:13.941784  9045 raft_consensus.cc:740] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:13.942528  9045 consensus_queue.cc:260] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:13.943573  9045 raft_consensus.cc:3060] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.949347  9045 raft_consensus.cc:2468] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 2.
I20260709 13:04:13.950362  9616 leader_election.cc:304] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:13.951788  9893 raft_consensus.cc:2804] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.952536  9893 raft_consensus.cc:697] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:13.953400  9893 consensus_queue.cc:237] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:13.978402  8721 catalog_manager.cc:5697] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 1 to 2, leader changed from a6a0de662d36410c907287e73cb2e4db (127.0.107.132) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.042485  9045 raft_consensus.cc:1275] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:14.045137  9926 consensus_queue.cc:1048] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:14.062083  8974 raft_consensus.cc:1275] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.066425  8974 raft_consensus.cc:1275] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:14.068612  9901 consensus_queue.cc:1048] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.070164  9901 consensus_queue.cc:1048] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:14.076646  9044 raft_consensus.cc:1275] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.078199  9901 consensus_queue.cc:1048] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.134867  8970 raft_consensus.cc:1275] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Refusing update from remote peer 60a19ab523e3468bb9aacada2c24362c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.150888  9886 consensus_queue.cc:1048] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:14.190200  8865 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:45051, user_credentials={real_user=slave}} blocked reactor thread for 55308.1us
W20260709 13:04:14.233641  8866 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:33479, user_credentials={real_user=slave}} blocked reactor thread for 62764.6us
I20260709 13:04:14.249665  9044 raft_consensus.cc:1275] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 60a19ab523e3468bb9aacada2c24362c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.251909  9911 consensus_queue.cc:1048] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.259130  8899 raft_consensus.cc:1275] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.262033  9879 consensus_queue.cc:1048] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.306627  9045 raft_consensus.cc:1275] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 245d19d5c71647a9857ac68df13802d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.308320  9875 consensus_queue.cc:1048] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.368336  8893 raft_consensus.cc:3060] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.374742  8893 raft_consensus.cc:1275] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.376614  9901 consensus_queue.cc:1048] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.394533  9045 raft_consensus.cc:1275] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:14.395933  9901 consensus_queue.cc:1048] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.552924   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:14.618844   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:14.670905  9045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930"
dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:36834
I20260709 13:04:14.671610  9045 raft_consensus.cc:606] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:14.674304  8899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26c7449c44d44a30a7de276d3d6a9c25"
dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:38736
I20260709 13:04:14.674806  8899 raft_consensus.cc:606] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:14.677454  8974 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a097a815a3194dc7a54ca93a122cfed8"
dest_uuid: "245d19d5c71647a9857ac68df13802d5"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:59838
I20260709 13:04:14.677901  8974 raft_consensus.cc:606] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:14.680598  9045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff17e11e1d8e4902ac9cfb17935d7de6"
dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
mode: GRACEFUL
new_leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:36834
I20260709 13:04:14.681200  9045 raft_consensus.cc:606] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Received request to transfer leadership to TS 0c955bfd0b9541f9860c5f84cb255b90
I20260709 13:04:14.682312   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:04:14.684087   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:14.917811  9895 raft_consensus.cc:993] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:14.918411  9849 raft_consensus.cc:1081] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:14.921036  9663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35790
I20260709 13:04:14.921537  9663 raft_consensus.cc:493] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:14.921895  9663 raft_consensus.cc:3060] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.923985  9879 raft_consensus.cc:993] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:14.924527  9875 raft_consensus.cc:1081] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:14.926096  9669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a097a815a3194dc7a54ca93a122cfed8"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35802
I20260709 13:04:14.926646  9669 raft_consensus.cc:493] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:14.926995  9669 raft_consensus.cc:3060] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.928578  9663 raft_consensus.cc:515] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:14.931437  9663 leader_election.cc:290] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Requested vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:14.932717  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:14.933389  8899 raft_consensus.cc:3060] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.947000  9669 raft_consensus.cc:515] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:14.949791  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a097a815a3194dc7a54ca93a122cfed8" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:14.950457  8974 raft_consensus.cc:3055] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:14.950802  8974 raft_consensus.cc:740] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 245d19d5c71647a9857ac68df13802d5, State: Running, Role: LEADER
I20260709 13:04:14.949700  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bb6a61d8f4ea4aa9d7c5844d05930" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:14.951671  9045 raft_consensus.cc:3055] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:14.952553  9045 raft_consensus.cc:740] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:14.952768  9669 leader_election.cc:290] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:14.951634  8974 consensus_queue.cc:260] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:14.953758  8974 raft_consensus.cc:3060] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.955497  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a097a815a3194dc7a54ca93a122cfed8" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:14.956084  9047 raft_consensus.cc:3060] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.958213  9045 consensus_queue.cc:260] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:14.959897  9045 raft_consensus.cc:3060] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.965602  8974 raft_consensus.cc:2468] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 2.
I20260709 13:04:14.966614  9047 raft_consensus.cc:2468] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 2.
I20260709 13:04:14.966946  9617 leader_election.cc:304] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:04:14.968508  9926 raft_consensus.cc:2804] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:14.967546  8899 raft_consensus.cc:2468] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:14.968997  9926 raft_consensus.cc:697] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:14.969898  9614 leader_election.cc:304] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c; no voters: 
I20260709 13:04:14.969982  9926 consensus_queue.cc:237] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:14.970965  9901 raft_consensus.cc:2804] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:14.973126  9045 raft_consensus.cc:2468] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:14.994455  9901 raft_consensus.cc:697] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:14.995610  9901 consensus_queue.cc:237] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:15.018966  9911 raft_consensus.cc:993] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:15.019532  9911 raft_consensus.cc:1081] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:15.021170  9662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26c7449c44d44a30a7de276d3d6a9c25"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35800
I20260709 13:04:15.021725  9662 raft_consensus.cc:493] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:15.022135  9662 raft_consensus.cc:3060] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:15.007159  8721 catalog_manager.cc:5697] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 1 to 2, leader changed from 245d19d5c71647a9857ac68df13802d5 (127.0.107.131) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.030207  9662 raft_consensus.cc:515] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:15.032871  9662 leader_election.cc:290] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Requested vote from peers 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707), 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479)
I20260709 13:04:15.033528  8899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7449c44d44a30a7de276d3d6a9c25" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "60a19ab523e3468bb9aacada2c24362c"
I20260709 13:04:15.034165  8899 raft_consensus.cc:3055] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:15.034487  8899 raft_consensus.cc:740] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 60a19ab523e3468bb9aacada2c24362c, State: Running, Role: LEADER
I20260709 13:04:15.035311  8899 consensus_queue.cc:260] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:15.036850  8899 raft_consensus.cc:3060] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:15.034498  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c7449c44d44a30a7de276d3d6a9c25" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:15.038940  8974 raft_consensus.cc:3060] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:15.057662  8974 raft_consensus.cc:2468] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:15.057761  8899 raft_consensus.cc:2468] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 3.
I20260709 13:04:15.058928  9617 leader_election.cc:304] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5; no voters: 
I20260709 13:04:15.059945  9901 raft_consensus.cc:2804] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:15.060387  9901 raft_consensus.cc:697] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:15.061192  9901 consensus_queue.cc:237] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } }
I20260709 13:04:15.078012  8721 catalog_manager.cc:5697] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 2 to 3, leader changed from a6a0de662d36410c907287e73cb2e4db (127.0.107.132) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 3 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.080049  8721 catalog_manager.cc:5697] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 2 to 3, leader changed from 60a19ab523e3468bb9aacada2c24362c (127.0.107.130) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 3 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.260812  9895 raft_consensus.cc:993] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db: : Instructing follower 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:15.261304  9849 raft_consensus.cc:1081] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Signalling peer 0c955bfd0b9541f9860c5f84cb255b90 to start an election
I20260709 13:04:15.262631  9669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff17e11e1d8e4902ac9cfb17935d7de6"
dest_uuid: "0c955bfd0b9541f9860c5f84cb255b90"
 from {username='slave'} at 127.0.0.1:35790
I20260709 13:04:15.263149  9669 raft_consensus.cc:493] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:15.263484  9669 raft_consensus.cc:3060] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.268349  9669 raft_consensus.cc:515] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:15.271180  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff17e11e1d8e4902ac9cfb17935d7de6" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a0de662d36410c907287e73cb2e4db"
I20260709 13:04:15.271338  9669 leader_election.cc:290] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Requested vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733)
I20260709 13:04:15.271919  9047 raft_consensus.cc:3055] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:15.272359  9047 raft_consensus.cc:740] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a0de662d36410c907287e73cb2e4db, State: Running, Role: LEADER
I20260709 13:04:15.272424  8974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff17e11e1d8e4902ac9cfb17935d7de6" candidate_uuid: "0c955bfd0b9541f9860c5f84cb255b90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "245d19d5c71647a9857ac68df13802d5"
I20260709 13:04:15.273128  8974 raft_consensus.cc:3060] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.273240  9047 consensus_queue.cc:260] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:15.274458  9047 raft_consensus.cc:3060] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.281144  9047 raft_consensus.cc:2468] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 2.
I20260709 13:04:15.283033  9616 leader_election.cc:304] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c955bfd0b9541f9860c5f84cb255b90, a6a0de662d36410c907287e73cb2e4db; no voters: 
I20260709 13:04:15.285305  9901 raft_consensus.cc:2804] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.286062  9901 raft_consensus.cc:697] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Becoming Leader. State: Replica: 0c955bfd0b9541f9860c5f84cb255b90, State: Running, Role: LEADER
I20260709 13:04:15.289141  9901 consensus_queue.cc:237] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:15.287281  8974 raft_consensus.cc:2468] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c955bfd0b9541f9860c5f84cb255b90 in term 2.
I20260709 13:04:15.306591  8721 catalog_manager.cc:5697] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 reported cstate change: term changed from 1 to 2, leader changed from a6a0de662d36410c907287e73cb2e4db (127.0.107.132) to 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "0c955bfd0b9541f9860c5f84cb255b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.397013  9045 raft_consensus.cc:1275] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:15.398483  9901 consensus_queue.cc:1048] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:15.439617  8974 raft_consensus.cc:1275] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:15.444147  9901 consensus_queue.cc:1048] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:15.445060  8893 raft_consensus.cc:1275] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:15.446825  9901 consensus_queue.cc:1048] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:15.475548  8899 raft_consensus.cc:1275] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:15.477300  9926 consensus_queue.cc:1048] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:15.483496  8966 raft_consensus.cc:1275] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:15.483834  9047 raft_consensus.cc:1275] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Refusing update from remote peer 0c955bfd0b9541f9860c5f84cb255b90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:15.486727  9893 consensus_queue.cc:1048] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:15.488600  9893 consensus_queue.cc:1048] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:15.685042   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:15.721073   430 tablet_server.cc:179] TabletServer@127.0.107.129:45051 shutting down...
W20260709 13:04:15.729266  8939 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 111 similar messages]
W20260709 13:04:15.733304  8939 consensus_peers.cc:597] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.739854  9013 consensus_peers.cc:597] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.749092  8865 consensus_peers.cc:597] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.759029  8865 consensus_peers.cc:597] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.774144   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:15.777496   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.778439   430 raft_consensus.cc:2243] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.778918   430 raft_consensus.cc:2272] T de61bcc226d7496e80bec49c06bd35f0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.782196   430 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:15.782799  9013 consensus_peers.cc:597] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.783192   430 raft_consensus.cc:2243] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.783949   430 pending_rounds.cc:70] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90: Trying to abort 1 pending ops.
I20260709 13:04:15.784178   430 pending_rounds.cc:77] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634837677105152 op_type: NO_OP noop_request { }
I20260709 13:04:15.784585   430 raft_consensus.cc:2889] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:15.784878   430 raft_consensus.cc:2272] T ff17e11e1d8e4902ac9cfb17935d7de6 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.791950   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.792901   430 raft_consensus.cc:2243] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.793454   430 raft_consensus.cc:2272] T 8de975aeaa3f4271942a80c6f15c6c98 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.796572   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.797559   430 raft_consensus.cc:2243] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.798575   430 raft_consensus.cc:2272] T 1ec2f73ef1f1465cb94938ff88587897 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.801420   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.802349   430 raft_consensus.cc:2243] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.802920   430 raft_consensus.cc:2272] T 2b608c0e2df74b2a898f03761cfc1813 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.805855   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.806602   430 raft_consensus.cc:2243] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.807571   430 raft_consensus.cc:2272] T 1ede05852c17421192022144629e6a6b P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.810377   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.811354   430 raft_consensus.cc:2243] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.812443   430 raft_consensus.cc:2272] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.817960  9013 consensus_peers.cc:597] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.818439  9013 consensus_peers.cc:597] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.818989   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.820063   430 raft_consensus.cc:2243] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.821449   430 raft_consensus.cc:2272] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.833434   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.835249   430 raft_consensus.cc:2243] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.836573   430 raft_consensus.cc:2272] T a097a815a3194dc7a54ca93a122cfed8 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.840534   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.841492   430 raft_consensus.cc:2243] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.842489   430 raft_consensus.cc:2272] T 26c7449c44d44a30a7de276d3d6a9c25 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.846019   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.846881   430 raft_consensus.cc:2243] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.847388   430 raft_consensus.cc:2272] T 27ed6c910f234c96ad999ea23411bc89 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.850366   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.851116   430 raft_consensus.cc:2243] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.852391   430 raft_consensus.cc:2272] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.855898   430 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:15.855795  8939 consensus_peers.cc:597] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.856688   430 raft_consensus.cc:2243] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.857188   430 raft_consensus.cc:2272] T 203428dde6c042b096205916d590b4d5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.859377   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.860105   430 raft_consensus.cc:2243] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.860518   430 raft_consensus.cc:2272] T 828b8a5a081e4a93812c8523ddc2dd56 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.862658   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.863227   430 raft_consensus.cc:2243] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.863622   430 raft_consensus.cc:2272] T 7455286aa620402d980c0923537d619a P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.865658   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.866255   430 raft_consensus.cc:2243] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.866775   430 raft_consensus.cc:2272] T cfb43858b9264896af25d56cdbb44d80 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.869339   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.870028   430 raft_consensus.cc:2243] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.870424   430 raft_consensus.cc:2272] T 64b41045f959459f885308feb894963c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.874045   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.874882   430 raft_consensus.cc:2243] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.875427   430 raft_consensus.cc:2272] T 84a27cc447a248368bcf0475b54f0b3d P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.878711   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.879998   430 raft_consensus.cc:2243] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.880831   430 raft_consensus.cc:2272] T 8d68cd517ce44baf88aa239a275ce8d0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.884373   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.885426   430 raft_consensus.cc:2243] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:15.889271  8865 consensus_peers.cc:597] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.913141  8865 consensus_peers.cc:597] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.913779  8865 consensus_peers.cc:597] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.914644   430 raft_consensus.cc:2272] T 4a72811528754f96a5b00504f8d032e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.917837  9013 consensus_peers.cc:597] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.918040   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.922101   430 raft_consensus.cc:2243] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.922888   430 raft_consensus.cc:2272] T 448e990629c04a25945e8b2f7c71d414 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.925498   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.926282   430 raft_consensus.cc:2243] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.929715   430 raft_consensus.cc:2272] T 598391aa086d4cd684b11636fb4c788b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.930413  8865 consensus_peers.cc:597] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.932631   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.935024   430 raft_consensus.cc:2243] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.935631   430 raft_consensus.cc:2272] T 1d3d7a987863451999601c9a8735d401 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.938738   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.939711   430 raft_consensus.cc:2243] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.940337   430 raft_consensus.cc:2272] T ca29694da91044f28b09dc349794ab78 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.941619  8865 consensus_peers.cc:597] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.945286   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.946290   430 raft_consensus.cc:2243] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.946903   430 raft_consensus.cc:2272] T e6933846b78c4c4cbeb23a2bedaff18b P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.949963  9013 consensus_peers.cc:597] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.950237   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.951048   430 raft_consensus.cc:2243] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.951941   430 raft_consensus.cc:2272] T 0986587761fb4f0387746bee54af0e5b P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.954407   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.955231   430 raft_consensus.cc:2243] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.955799   430 raft_consensus.cc:2272] T bddeae20846c4ef98e62e0666f4030b4 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.958806   430 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:15.958866  8939 consensus_peers.cc:597] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.959697   430 raft_consensus.cc:2243] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.960139   430 raft_consensus.cc:2272] T e3411c58e61642e499aafe48daae38e0 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.962286   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.962855   430 raft_consensus.cc:2243] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.963285   430 raft_consensus.cc:2272] T 5b8666482fd746c1bc9d0c3c1bc30613 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.966815   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.967614   430 raft_consensus.cc:2243] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.969535   430 raft_consensus.cc:2272] T 572cae6a298d45448d43956a1842ecc5 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.972048  8865 consensus_peers.cc:597] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.972453   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.973169   430 raft_consensus.cc:2243] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.973649   430 raft_consensus.cc:2272] T d9b04160c71b417c9a4db4e3f6692906 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.976128   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.976708   430 raft_consensus.cc:2243] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.977170   430 raft_consensus.cc:2272] T 92e29794ffb24d7c898647fbcf5e0d77 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.979771   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.980333   430 raft_consensus.cc:2243] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.981169   430 raft_consensus.cc:2272] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.983952   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.984658   430 raft_consensus.cc:2243] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.985119   430 raft_consensus.cc:2272] T d979f18121e6477a8261596acbc4f58a P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.987716   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.988461   430 raft_consensus.cc:2243] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.988837   430 raft_consensus.cc:2272] T 76d0a76f1a2b45df971cecac7ccb46b3 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.991639   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.992199   430 raft_consensus.cc:2243] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.992899   430 raft_consensus.cc:2272] T 105ca1309d4c495293d5da6c6b316b04 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.994733   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.995251   430 raft_consensus.cc:2243] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.996022   430 raft_consensus.cc:2272] T b74beae5607c4a46be83e22d48744dcb P 0c955bfd0b9541f9860c5f84cb255b90 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.998080   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:15.998783   430 raft_consensus.cc:2243] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.999219   430 raft_consensus.cc:2272] T 3fad6c9b1a1948c6a7135330c5ed070b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.001946   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:16.002499   430 raft_consensus.cc:2243] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.002935   430 raft_consensus.cc:2272] T 75657aca6e034936ba57c704cedb5563 P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.005450   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:16.005990   430 raft_consensus.cc:2243] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.006438   430 raft_consensus.cc:2272] T 21c21ca1a09148199552cd054209efd1 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.009109   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:16.009644   430 raft_consensus.cc:2243] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.010124   430 raft_consensus.cc:2272] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.013824   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:16.014590   430 raft_consensus.cc:2243] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.015075   430 raft_consensus.cc:2272] T 08168b90c9574205bcbca774c321f66c P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.016919  8939 consensus_peers.cc:597] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.017606  8939 consensus_peers.cc:597] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.018164   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:16.018946   430 raft_consensus.cc:2243] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.019500   430 raft_consensus.cc:2272] T 6221e3a375814ae5ba834de940d071af P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.022297   430 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:16.022745  8865 consensus_peers.cc:597] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.022867   430 raft_consensus.cc:2243] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.024256   430 raft_consensus.cc:2272] T aa6de9e2aaa341cfb862ee9073bab6dd P 0c955bfd0b9541f9860c5f84cb255b90 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.026646  9013 consensus_peers.cc:597] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.027576   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:16.028321   430 raft_consensus.cc:2243] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.028831   430 raft_consensus.cc:2272] T 9bd20e59c4c5460cb2da30a82e188e4b P 0c955bfd0b9541f9860c5f84cb255b90 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.074718  8865 consensus_peers.cc:597] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.097432  8939 consensus_peers.cc:597] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.099454  8939 consensus_peers.cc:597] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.164316  8865 consensus_peers.cc:597] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.188845  8939 consensus_peers.cc:597] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.191346  8939 consensus_peers.cc:597] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.202591  8939 consensus_peers.cc:597] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.204800   430 tablet_server.cc:196] TabletServer@127.0.107.129:45051 shutdown complete.
W20260709 13:04:16.266783  9013 consensus_peers.cc:597] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.273125  9013 consensus_peers.cc:597] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.282398  8865 consensus_peers.cc:597] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c -> Peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Couldn't send request to peer 0c955bfd0b9541f9860c5f84cb255b90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.315056   430 tablet_server.cc:179] TabletServer@127.0.107.130:0 shutting down...
W20260709 13:04:16.353526  8937 consensus_peers.cc:597] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.360858  8937 consensus_peers.cc:597] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.361502  8937 consensus_peers.cc:597] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.385048  8937 consensus_peers.cc:597] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.385761  8937 consensus_peers.cc:597] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.394289  9011 consensus_peers.cc:597] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.395062  9011 consensus_peers.cc:597] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.395696  9011 consensus_peers.cc:597] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.398141  9011 consensus_peers.cc:597] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.402870   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:04:16.403663  8937 consensus_peers.cc:597] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.404031   430 tablet_replica.cc:333] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.405164   430 raft_consensus.cc:2243] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.405854   430 raft_consensus.cc:2272] T 27ed6c910f234c96ad999ea23411bc89 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.409158   430 tablet_replica.cc:333] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.410156   430 raft_consensus.cc:2243] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:04:16.405901  9011 consensus_peers.cc:597] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.411351   430 raft_consensus.cc:2272] T ca29694da91044f28b09dc349794ab78 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.418315   430 tablet_replica.cc:333] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.419171   430 raft_consensus.cc:2243] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.420008   430 raft_consensus.cc:2272] T e6933846b78c4c4cbeb23a2bedaff18b P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.422399   430 tablet_replica.cc:333] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.423002   430 raft_consensus.cc:2243] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.423787   430 raft_consensus.cc:2272] T 21c21ca1a09148199552cd054209efd1 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.425755   430 tablet_replica.cc:333] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.426314   430 raft_consensus.cc:2243] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.426996   430 raft_consensus.cc:2272] T f5624f032fa846eebb830e2ea2bb857b P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.428844   430 tablet_replica.cc:333] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.429451   430 raft_consensus.cc:2243] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.429877   430 raft_consensus.cc:2272] T b17c73a16b7141ef885babed8fb13dc6 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.431977   430 tablet_replica.cc:333] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.432588   430 raft_consensus.cc:2243] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.433350   430 raft_consensus.cc:2272] T de61bcc226d7496e80bec49c06bd35f0 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.436127   430 tablet_replica.cc:333] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.437145   430 raft_consensus.cc:2243] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.437734   430 raft_consensus.cc:2272] T d9b04160c71b417c9a4db4e3f6692906 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.440418   430 tablet_replica.cc:333] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.441190   430 raft_consensus.cc:2243] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.441813   430 raft_consensus.cc:2272] T de518c02ce8d4d278d359e001b96db41 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.441780  9011 consensus_peers.cc:597] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.444482   430 tablet_replica.cc:333] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.445153   430 raft_consensus.cc:2243] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.445649   430 raft_consensus.cc:2272] T 41c1944d902340e79c6e9648cad9d681 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.448411   430 tablet_replica.cc:333] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.449173   430 raft_consensus.cc:2243] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.449743   430 raft_consensus.cc:2272] T e7a1a88fae5d41d0abb4bd9ee1898658 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.452472   430 tablet_replica.cc:333] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.453306   430 raft_consensus.cc:2243] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.454282   430 raft_consensus.cc:2272] T 203428dde6c042b096205916d590b4d5 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.456863   430 tablet_replica.cc:333] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.457603   430 raft_consensus.cc:2243] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.458094   430 raft_consensus.cc:2272] T 6221e3a375814ae5ba834de940d071af P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.460587   430 tablet_replica.cc:333] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.461324   430 raft_consensus.cc:2243] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.461862   430 raft_consensus.cc:2272] T 598391aa086d4cd684b11636fb4c788b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.464085  9011 consensus_peers.cc:597] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.464310   430 tablet_replica.cc:333] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.464980   430 raft_consensus.cc:2243] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.465433   430 raft_consensus.cc:2272] T e3411c58e61642e499aafe48daae38e0 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.467392   430 tablet_replica.cc:333] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.468148   430 raft_consensus.cc:2243] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.469000   430 raft_consensus.cc:2272] T 5b8666482fd746c1bc9d0c3c1bc30613 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.471596   430 tablet_replica.cc:333] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.472303   430 raft_consensus.cc:2243] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.473344   430 raft_consensus.cc:2272] T e40b1dd371c548b58e6454e560a04271 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.475312   430 tablet_replica.cc:333] T 237e06066ca940fb8dd923588f437acb P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.475966   430 raft_consensus.cc:2243] T 237e06066ca940fb8dd923588f437acb P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.476399   430 raft_consensus.cc:2272] T 237e06066ca940fb8dd923588f437acb P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.483301   430 tablet_replica.cc:333] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.484058   430 raft_consensus.cc:2243] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.484575   430 raft_consensus.cc:2272] T 1ec2f73ef1f1465cb94938ff88587897 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.486971   430 tablet_replica.cc:333] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.488153   430 raft_consensus.cc:2243] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.488620   430 raft_consensus.cc:2272] T 26c7449c44d44a30a7de276d3d6a9c25 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.493912   430 tablet_replica.cc:333] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.494678   430 raft_consensus.cc:2243] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.495203   430 raft_consensus.cc:2272] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.497968   430 tablet_replica.cc:333] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.498792   430 raft_consensus.cc:2243] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.499296   430 raft_consensus.cc:2272] T 8fa59e81ed8e4c0ca2890a10befbf996 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.501817   430 tablet_replica.cc:333] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.502516   430 raft_consensus.cc:2243] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.502974   430 raft_consensus.cc:2272] T 08168b90c9574205bcbca774c321f66c P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.505538   430 tablet_replica.cc:333] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.506238   430 raft_consensus.cc:2243] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.507231   430 raft_consensus.cc:2272] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.510069   430 tablet_replica.cc:333] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.510771   430 raft_consensus.cc:2243] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.511235   430 raft_consensus.cc:2272] T 5c4408002b8e4e67a7bf17118232afd5 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.514485   430 tablet_replica.cc:333] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.515239   430 raft_consensus.cc:2243] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.515761   430 raft_consensus.cc:2272] T ebefe5d3d0a64ae087a329b7c032225a P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.518195  8937 consensus_peers.cc:597] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.518404   430 tablet_replica.cc:333] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.519217   430 raft_consensus.cc:2243] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.519730   430 raft_consensus.cc:2272] T 205bb6a61d8f4ea4aa9d7c5844d05930 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.522142   430 tablet_replica.cc:333] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.522887   430 raft_consensus.cc:2243] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.523682   430 raft_consensus.cc:2272] T 3fad6c9b1a1948c6a7135330c5ed070b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.525705   430 tablet_replica.cc:333] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.526327   430 raft_consensus.cc:2243] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.526803   430 raft_consensus.cc:2272] T dec23c2e3be3416a84d3d12becfa90fa P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.529388   430 tablet_replica.cc:333] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.530117   430 raft_consensus.cc:2243] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.530604   430 raft_consensus.cc:2272] T 99a4989c61c249ebab0dfa6b8990d350 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.532932   430 tablet_replica.cc:333] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.533659   430 raft_consensus.cc:2243] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.534607   430 raft_consensus.cc:2272] T 828b8a5a081e4a93812c8523ddc2dd56 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.537000   430 tablet_replica.cc:333] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.537698   430 raft_consensus.cc:2243] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.538561   430 raft_consensus.cc:2272] T 7455286aa620402d980c0923537d619a P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.541165   430 tablet_replica.cc:333] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.541843   430 raft_consensus.cc:2243] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.542764   430 raft_consensus.cc:2272] T 977d385d3eeb49a799b9c161940c175a P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.545616   430 tablet_replica.cc:333] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.546341   430 raft_consensus.cc:2243] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.547281   430 raft_consensus.cc:2272] T 8de975aeaa3f4271942a80c6f15c6c98 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.549780   430 tablet_replica.cc:333] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.550283   430 raft_consensus.cc:2243] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.550668   430 raft_consensus.cc:2272] T b74beae5607c4a46be83e22d48744dcb P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.552536   430 tablet_replica.cc:333] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.553020   430 raft_consensus.cc:2243] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.553412   430 raft_consensus.cc:2272] T 76d0a76f1a2b45df971cecac7ccb46b3 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.555337   430 tablet_replica.cc:333] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.555917   430 raft_consensus.cc:2243] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.556367   430 raft_consensus.cc:2272] T dce2804142c04505bd469904f288178b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.558527   430 tablet_replica.cc:333] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.559249   430 raft_consensus.cc:2243] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.559782   430 raft_consensus.cc:2272] T 1ede05852c17421192022144629e6a6b P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.562063   430 tablet_replica.cc:333] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.562743   430 raft_consensus.cc:2243] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.563261   430 raft_consensus.cc:2272] T 572cae6a298d45448d43956a1842ecc5 P 60a19ab523e3468bb9aacada2c24362c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.565688   430 tablet_replica.cc:333] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.566344   430 raft_consensus.cc:2243] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.566834   430 raft_consensus.cc:2272] T 4a72811528754f96a5b00504f8d032e0 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.569224   430 tablet_replica.cc:333] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.569868   430 raft_consensus.cc:2243] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.570379   430 raft_consensus.cc:2272] T 448e990629c04a25945e8b2f7c71d414 P 60a19ab523e3468bb9aacada2c24362c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.572194   430 tablet_replica.cc:333] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.572638   430 raft_consensus.cc:2243] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.573477   430 raft_consensus.cc:2272] T 84a27cc447a248368bcf0475b54f0b3d P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.575187   430 tablet_replica.cc:333] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.575739   430 raft_consensus.cc:2243] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.576125   430 raft_consensus.cc:2272] T 9bd20e59c4c5460cb2da30a82e188e4b P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.577800   430 tablet_replica.cc:333] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c: stopping tablet replica
I20260709 13:04:16.578243   430 raft_consensus.cc:2243] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.578625   430 raft_consensus.cc:2272] T 2b608c0e2df74b2a898f03761cfc1813 P 60a19ab523e3468bb9aacada2c24362c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.637069  9011 consensus_peers.cc:597] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.645473  9011 consensus_peers.cc:597] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.652251   430 tablet_server.cc:196] TabletServer@127.0.107.130:0 shutdown complete.
I20260709 13:04:16.743571   430 tablet_server.cc:179] TabletServer@127.0.107.131:0 shutting down...
W20260709 13:04:16.745980  8937 consensus_peers.cc:597] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.758303  8937 consensus_peers.cc:597] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.761773  9011 consensus_peers.cc:597] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.774573  9014 consensus_peers.cc:597] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db -> Peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Couldn't send request to peer 245d19d5c71647a9857ac68df13802d5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.786288  9014 consensus_peers.cc:597] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db -> Peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Couldn't send request to peer 245d19d5c71647a9857ac68df13802d5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.806540   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:16.807600   430 tablet_replica.cc:333] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.808511   430 raft_consensus.cc:2243] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.809120   430 raft_consensus.cc:2272] T f5624f032fa846eebb830e2ea2bb857b P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.811841   430 tablet_replica.cc:333] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.812690   430 raft_consensus.cc:2243] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.813215   430 raft_consensus.cc:2272] T 1d3d7a987863451999601c9a8735d401 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.817126   430 tablet_replica.cc:333] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.818006   430 raft_consensus.cc:2243] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.819157   430 raft_consensus.cc:2272] T b17c73a16b7141ef885babed8fb13dc6 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.821617  9011 consensus_peers.cc:597] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.822017   430 tablet_replica.cc:333] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.823029   430 raft_consensus.cc:2243] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.823624   430 raft_consensus.cc:2272] T 41c1944d902340e79c6e9648cad9d681 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.825327  9982 raft_consensus.cc:493] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:16.825815  9982 raft_consensus.cc:515] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:16.826346   430 tablet_replica.cc:333] T e7a1a88fae5d41d0abb4bd9ee1898658 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.827316   430 raft_consensus.cc:2243] T e7a1a88fae5d41d0abb4bd9ee1898658 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.827795  9982 leader_election.cc:290] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:16.827944   430 raft_consensus.cc:2272] T e7a1a88fae5d41d0abb4bd9ee1898658 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.830895   430 tablet_replica.cc:333] T de61bcc226d7496e80bec49c06bd35f0 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.831753   430 raft_consensus.cc:2243] T de61bcc226d7496e80bec49c06bd35f0 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.832346   430 raft_consensus.cc:2272] T de61bcc226d7496e80bec49c06bd35f0 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.832563  9013 leader_election.cc:336] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
W20260709 13:04:16.834154  9011 leader_election.cc:336] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111)
I20260709 13:04:16.834542  9982 raft_consensus.cc:493] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:16.834679  9011 leader_election.cc:304] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:16.835132   430 tablet_replica.cc:333] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.835670  9895 raft_consensus.cc:2749] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:16.835183  9982 raft_consensus.cc:515] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:16.836382   430 raft_consensus.cc:2243] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.837045   430 raft_consensus.cc:2272] T 203428dde6c042b096205916d590b4d5 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.838866  9982 leader_election.cc:290] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:16.839893   430 tablet_replica.cc:333] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.840801   430 raft_consensus.cc:2243] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.841835   430 raft_consensus.cc:2272] T 598391aa086d4cd684b11636fb4c788b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.842156  9013 leader_election.cc:336] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:16.844913   430 tablet_replica.cc:333] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.845860   430 raft_consensus.cc:2243] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.846992   430 raft_consensus.cc:2272] T aa6de9e2aaa341cfb862ee9073bab6dd P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.847538  9011 leader_election.cc:336] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111)
I20260709 13:04:16.848126  9011 leader_election.cc:304] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:16.849308  9982 raft_consensus.cc:2749] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:16.850423   430 tablet_replica.cc:333] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.851382   430 raft_consensus.cc:2243] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.852023   430 raft_consensus.cc:2272] T dce2804142c04505bd469904f288178b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.855229   430 tablet_replica.cc:333] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.856091   430 raft_consensus.cc:2243] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.857256   430 raft_consensus.cc:2272] T 9bd20e59c4c5460cb2da30a82e188e4b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.859923   430 tablet_replica.cc:333] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.860682   430 raft_consensus.cc:2243] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.861204   430 raft_consensus.cc:2272] T 828b8a5a081e4a93812c8523ddc2dd56 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.863754   430 tablet_replica.cc:333] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.864471   430 raft_consensus.cc:2243] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.864964   430 raft_consensus.cc:2272] T 7455286aa620402d980c0923537d619a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.867611   430 tablet_replica.cc:333] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.868387   430 raft_consensus.cc:2243] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.869379   430 raft_consensus.cc:2272] T 08168b90c9574205bcbca774c321f66c P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.872170   430 tablet_replica.cc:333] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.873063   430 raft_consensus.cc:2243] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.873605   430 raft_consensus.cc:2272] T ac2b10a48f9d4bd0988ff98f6bf66e66 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.876436   430 tablet_replica.cc:333] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.877179   430 raft_consensus.cc:2243] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.877734   430 raft_consensus.cc:2272] T 8fa59e81ed8e4c0ca2890a10befbf996 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.880554   430 tablet_replica.cc:333] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.881412   430 raft_consensus.cc:2243] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.882388   430 raft_consensus.cc:2272] T 5c4408002b8e4e67a7bf17118232afd5 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.884923   430 tablet_replica.cc:333] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.885666   430 raft_consensus.cc:2243] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.886204   430 raft_consensus.cc:2272] T bddeae20846c4ef98e62e0666f4030b4 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.888979   430 tablet_replica.cc:333] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.889817   430 raft_consensus.cc:2243] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:16.890666  9011 consensus_peers.cc:597] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db -> Peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Couldn't send request to peer 60a19ab523e3468bb9aacada2c24362c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.890844   430 raft_consensus.cc:2272] T ebefe5d3d0a64ae087a329b7c032225a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.893664   430 tablet_replica.cc:333] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.894443   430 raft_consensus.cc:2243] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.895469   430 raft_consensus.cc:2272] T 92e29794ffb24d7c898647fbcf5e0d77 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.898146   430 tablet_replica.cc:333] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.898994   430 raft_consensus.cc:2243] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.900012   430 raft_consensus.cc:2272] T de518c02ce8d4d278d359e001b96db41 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.902773   430 tablet_replica.cc:333] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.903656   430 raft_consensus.cc:2243] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.904225   430 raft_consensus.cc:2272] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.906946   430 tablet_replica.cc:333] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.907789   430 raft_consensus.cc:2243] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.908766   430 raft_consensus.cc:2272] T d979f18121e6477a8261596acbc4f58a P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.911504   430 tablet_replica.cc:333] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.912281   430 raft_consensus.cc:2243] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.913246   430 raft_consensus.cc:2272] T cfb43858b9264896af25d56cdbb44d80 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.917940   430 tablet_replica.cc:333] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.917838  9849 raft_consensus.cc:493] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:16.918550  9849 raft_consensus.cc:515] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:16.918974   430 raft_consensus.cc:2243] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.920092   430 raft_consensus.cc:2272] T 64b41045f959459f885308feb894963c P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.920373  9849 leader_election.cc:290] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:16.922837   430 tablet_replica.cc:333] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.924090   430 raft_consensus.cc:2243] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.924661   430 raft_consensus.cc:2272] T 977d385d3eeb49a799b9c161940c175a P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.925318  9013 leader_election.cc:336] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:16.927739   430 tablet_replica.cc:333] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.928668   430 raft_consensus.cc:2243] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.929271   430 raft_consensus.cc:2272] T 8de975aeaa3f4271942a80c6f15c6c98 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.932196   430 tablet_replica.cc:333] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.933000   430 raft_consensus.cc:2243] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.933525   430 raft_consensus.cc:2272] T ff17e11e1d8e4902ac9cfb17935d7de6 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.936174   430 tablet_replica.cc:333] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.936944   430 raft_consensus.cc:2243] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.937954   430 raft_consensus.cc:2272] T 75657aca6e034936ba57c704cedb5563 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.940676   430 tablet_replica.cc:333] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
W20260709 13:04:16.941329  9011 leader_election.cc:336] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111)
I20260709 13:04:16.941500   430 raft_consensus.cc:2243] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.941895  9011 leader_election.cc:304] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:16.942193   430 raft_consensus.cc:2272] T 3fad6c9b1a1948c6a7135330c5ed070b P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.942719  9849 raft_consensus.cc:2749] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:16.945091   430 tablet_replica.cc:333] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.945982   430 raft_consensus.cc:2243] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.946527   430 raft_consensus.cc:2272] T dec23c2e3be3416a84d3d12becfa90fa P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.949278   430 tablet_replica.cc:333] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.950065   430 raft_consensus.cc:2243] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.951033   430 raft_consensus.cc:2272] T 99a4989c61c249ebab0dfa6b8990d350 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.953823   430 tablet_replica.cc:333] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.954612   430 raft_consensus.cc:2243] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.955181   430 raft_consensus.cc:2272] T e6933846b78c4c4cbeb23a2bedaff18b P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.957906   430 tablet_replica.cc:333] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.958660   430 raft_consensus.cc:2243] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.959158   430 raft_consensus.cc:2272] T 0986587761fb4f0387746bee54af0e5b P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.961602   430 tablet_replica.cc:333] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.962364   430 raft_consensus.cc:2243] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.962888   430 raft_consensus.cc:2272] T e40b1dd371c548b58e6454e560a04271 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.965597   430 tablet_replica.cc:333] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.966367   430 raft_consensus.cc:2243] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.966852   430 raft_consensus.cc:2272] T 237e06066ca940fb8dd923588f437acb P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.969518   430 tablet_replica.cc:333] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.970335   430 raft_consensus.cc:2243] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.970902   430 raft_consensus.cc:2272] T 105ca1309d4c495293d5da6c6b316b04 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.973367   430 tablet_replica.cc:333] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.974105   430 raft_consensus.cc:2243] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.974691   430 raft_consensus.cc:2272] T b74beae5607c4a46be83e22d48744dcb P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.977175   430 tablet_replica.cc:333] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.977941   430 raft_consensus.cc:2243] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:04:16.978495  9014 consensus_peers.cc:597] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db -> Peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Couldn't send request to peer 245d19d5c71647a9857ac68df13802d5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.978966   430 raft_consensus.cc:2272] T 8d68cd517ce44baf88aa239a275ce8d0 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.981904   430 tablet_replica.cc:333] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.982630   430 raft_consensus.cc:2243] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:16.983665   430 raft_consensus.cc:2272] T 4a72811528754f96a5b00504f8d032e0 P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.986343   430 tablet_replica.cc:333] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.987052   430 raft_consensus.cc:2243] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.987586   430 raft_consensus.cc:2272] T 84a27cc447a248368bcf0475b54f0b3d P 245d19d5c71647a9857ac68df13802d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.988723  9879 raft_consensus.cc:493] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:16.989163  9879 raft_consensus.cc:515] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:16.990060   430 tablet_replica.cc:333] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.990855   430 raft_consensus.cc:2243] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.990991  9879 leader_election.cc:290] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a6a0de662d36410c907287e73cb2e4db (127.0.107.132:45733), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:16.991379   430 raft_consensus.cc:2272] T 26c7449c44d44a30a7de276d3d6a9c25 P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.994149  9981 raft_consensus.cc:493] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:16.994290   430 tablet_replica.cc:333] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:16.994781  9981 raft_consensus.cc:515] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:16.995321   430 raft_consensus.cc:2243] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:16.996138   430 raft_consensus.cc:2272] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:16.996974  9981 leader_election.cc:290] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:16.999145   430 tablet_replica.cc:333] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5: stopping tablet replica
I20260709 13:04:17.000231   430 raft_consensus.cc:2243] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.000850   430 raft_consensus.cc:2272] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P 245d19d5c71647a9857ac68df13802d5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:16.999191  8939 leader_election.cc:336] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
W20260709 13:04:17.003014  9013 leader_election.cc:336] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
W20260709 13:04:17.005349  9014 leader_election.cc:336] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:17.006165  9014 leader_election.cc:304] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:17.007246  9981 raft_consensus.cc:2749] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:17.007848  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a097a815a3194dc7a54ca93a122cfed8" candidate_uuid: "245d19d5c71647a9857ac68df13802d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a6a0de662d36410c907287e73cb2e4db" is_pre_election: true
I20260709 13:04:17.008540  9045 raft_consensus.cc:2468] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245d19d5c71647a9857ac68df13802d5 in term 2.
I20260709 13:04:17.011672  8939 leader_election.cc:304] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 245d19d5c71647a9857ac68df13802d5, a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90
W20260709 13:04:17.012362  8939 raft_consensus.cc:2686] T a097a815a3194dc7a54ca93a122cfed8 P 245d19d5c71647a9857ac68df13802d5: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:04:17.030442  9014 consensus_peers.cc:597] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db -> Peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Couldn't send request to peer 245d19d5c71647a9857ac68df13802d5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.031061  9981 raft_consensus.cc:493] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:17.032016  9981 raft_consensus.cc:515] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:17.036571  9981 leader_election.cc:290] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
W20260709 13:04:17.042693  9013 leader_election.cc:336] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
W20260709 13:04:17.045610  9014 consensus_peers.cc:597] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db -> Peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Couldn't send request to peer 245d19d5c71647a9857ac68df13802d5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:17.048002  9011 leader_election.cc:336] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111)
I20260709 13:04:17.048580  9011 leader_election.cc:304] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:17.049945  9981 raft_consensus.cc:2749] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:17.074055  9981 raft_consensus.cc:493] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:17.074771  9981 raft_consensus.cc:515] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:17.077288  9981 leader_election.cc:290] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
W20260709 13:04:17.081701  9014 leader_election.cc:336] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:17.083540  9981 raft_consensus.cc:493] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.084029  9981 raft_consensus.cc:515] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:17.086242  9981 leader_election.cc:290] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
W20260709 13:04:17.095299  9013 leader_election.cc:336] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:17.095831  9013 leader_election.cc:304] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:17.096626  9982 raft_consensus.cc:2749] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:17.098538  9014 leader_election.cc:336] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Network error: Client connection negotiation failed: client connection to 127.0.107.131:33479: connect: Connection refused (error 111)
W20260709 13:04:17.101392  9013 leader_election.cc:336] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:17.101841  9013 leader_election.cc:304] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:17.102605  9981 raft_consensus.cc:2749] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:17.110796  9014 consensus_peers.cc:597] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db -> Peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Couldn't send request to peer 245d19d5c71647a9857ac68df13802d5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.131:33479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.117192  9981 raft_consensus.cc:493] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:17.117811  9981 raft_consensus.cc:515] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:17.119670  9981 leader_election.cc:290] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
W20260709 13:04:17.125680  9011 leader_election.cc:336] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111)
W20260709 13:04:17.128026  9013 leader_election.cc:336] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
W20260709 13:04:17.128041  9014 consensus_peers.cc:597] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db -> Peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Couldn't send request to peer 245d19d5c71647a9857ac68df13802d5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.131:33479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.128980  9981 raft_consensus.cc:493] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:17.129427  9981 raft_consensus.cc:515] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:17.131348  9981 leader_election.cc:290] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:17.128589  9013 leader_election.cc:304] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:17.133251  9981 raft_consensus.cc:2749] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:17.139091  9014 leader_election.cc:336] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Network error: Client connection negotiation failed: client connection to 127.0.107.131:33479: connect: Connection refused (error 111)
W20260709 13:04:17.141309  9013 leader_election.cc:336] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:17.141774  9013 leader_election.cc:304] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:17.142518  9981 raft_consensus.cc:2749] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:04:17.186247  9014 consensus_peers.cc:597] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db -> Peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Couldn't send request to peer 245d19d5c71647a9857ac68df13802d5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.131:33479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.225278   430 tablet_server.cc:196] TabletServer@127.0.107.131:0 shutdown complete.
W20260709 13:04:17.228761  9014 consensus_peers.cc:597] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db -> Peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Couldn't send request to peer 245d19d5c71647a9857ac68df13802d5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.131:33479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.296609   430 tablet_server.cc:179] TabletServer@127.0.107.132:0 shutting down...
I20260709 13:04:17.334023  9849 raft_consensus.cc:493] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:17.334575  9849 raft_consensus.cc:515] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
I20260709 13:04:17.336272  9849 leader_election.cc:290] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
I20260709 13:04:17.339134  9895 raft_consensus.cc:493] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:17.339687  9895 raft_consensus.cc:515] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
W20260709 13:04:17.340988  9011 leader_election.cc:336] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111)
I20260709 13:04:17.341670  9895 leader_election.cc:290] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:17.344399  9895 raft_consensus.cc:493] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 60a19ab523e3468bb9aacada2c24362c)
I20260709 13:04:17.344882  9895 raft_consensus.cc:515] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } } peers { permanent_uuid: "60a19ab523e3468bb9aacada2c24362c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 43707 } }
W20260709 13:04:17.347035  9014 leader_election.cc:336] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Network error: Client connection negotiation failed: client connection to 127.0.107.131:33479: connect: Connection refused (error 111)
I20260709 13:04:17.347121  9895 leader_election.cc:290] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051), 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707)
W20260709 13:04:17.346817  9013 leader_election.cc:336] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:17.348906   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:17.348948  9013 leader_election.cc:304] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:17.349977   430 tablet_replica.cc:333] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.350334  9895 raft_consensus.cc:2749] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:17.350943   430 raft_consensus.cc:2243] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.351625   430 raft_consensus.cc:2272] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:17.352931  9013 leader_election.cc:336] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:17.353374  9013 leader_election.cc:304] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
W20260709 13:04:17.353605  9011 leader_election.cc:336] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 60a19ab523e3468bb9aacada2c24362c (127.0.107.130:43707): Network error: Client connection negotiation failed: client connection to 127.0.107.130:43707: connect: Connection refused (error 111)
I20260709 13:04:17.354079  9895 raft_consensus.cc:2749] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:17.354576   430 tablet_replica.cc:333] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.355310   430 raft_consensus.cc:2243] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:17.355799  9013 leader_election.cc:336] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:17.356190  9013 leader_election.cc:304] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 60a19ab523e3468bb9aacada2c24362c
I20260709 13:04:17.356333   430 raft_consensus.cc:2272] T 27ed6c910f234c96ad999ea23411bc89 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:17.356765  9013 raft_consensus.cc:2686] T ca29694da91044f28b09dc349794ab78 P a6a0de662d36410c907287e73cb2e4db: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:04:17.358661   430 tablet_replica.cc:333] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.359225   430 raft_consensus.cc:2243] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.359975   430 raft_consensus.cc:2272] T 1d3d7a987863451999601c9a8735d401 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.361760   430 tablet_replica.cc:333] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.362239   430 raft_consensus.cc:2243] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.362582   430 raft_consensus.cc:2272] T b17c73a16b7141ef885babed8fb13dc6 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.364405   430 tablet_replica.cc:333] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.364874   430 raft_consensus.cc:2243] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.365245   430 raft_consensus.cc:2272] T 21c21ca1a09148199552cd054209efd1 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.366994   430 tablet_replica.cc:333] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.367544   430 raft_consensus.cc:2243] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.367871   430 raft_consensus.cc:2272] T f5624f032fa846eebb830e2ea2bb857b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.369462   430 tablet_replica.cc:333] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.369941   430 raft_consensus.cc:2243] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.370570   430 raft_consensus.cc:2272] T 41c1944d902340e79c6e9648cad9d681 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.372375   430 tablet_replica.cc:333] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.372833   430 raft_consensus.cc:2243] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.373466   430 raft_consensus.cc:2272] T e7a1a88fae5d41d0abb4bd9ee1898658 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.375113   430 tablet_replica.cc:333] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.375753   430 raft_consensus.cc:2243] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.376125   430 raft_consensus.cc:2272] T 8d68cd517ce44baf88aa239a275ce8d0 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.377827   430 tablet_replica.cc:333] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.378443   430 raft_consensus.cc:2243] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.378896   430 raft_consensus.cc:2272] T 448e990629c04a25945e8b2f7c71d414 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.381592   430 tablet_replica.cc:333] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.382362   430 raft_consensus.cc:2243] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.382817   430 raft_consensus.cc:2272] T 75657aca6e034936ba57c704cedb5563 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.384835   430 tablet_replica.cc:333] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.385432   430 raft_consensus.cc:2243] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.385833   430 raft_consensus.cc:2272] T aa6de9e2aaa341cfb862ee9073bab6dd P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.387827   430 tablet_replica.cc:333] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.388566   430 raft_consensus.cc:2243] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.389173   430 raft_consensus.cc:2272] T 6221e3a375814ae5ba834de940d071af P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.391021   430 tablet_replica.cc:333] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.391592   430 raft_consensus.cc:2243] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.391973   430 raft_consensus.cc:2272] T e40b1dd371c548b58e6454e560a04271 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.393762   430 tablet_replica.cc:333] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.394254   430 raft_consensus.cc:2243] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.394968   430 raft_consensus.cc:2272] T 237e06066ca940fb8dd923588f437acb P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.396817   430 tablet_replica.cc:333] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.397357   430 raft_consensus.cc:2243] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.397763   430 raft_consensus.cc:2272] T 1ec2f73ef1f1465cb94938ff88587897 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.399663   430 tablet_replica.cc:333] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.400198   430 raft_consensus.cc:2243] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.400615   430 raft_consensus.cc:2272] T de518c02ce8d4d278d359e001b96db41 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.402503   430 tablet_replica.cc:333] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.403017   430 raft_consensus.cc:2243] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.403403   430 raft_consensus.cc:2272] T 350fc78f6e2a42ce8ec15f7a6d7a7a27 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.405063   430 tablet_replica.cc:333] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.405588   430 raft_consensus.cc:2243] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.406329   430 raft_consensus.cc:2272] T d979f18121e6477a8261596acbc4f58a P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.408165   430 tablet_replica.cc:333] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.408706   430 raft_consensus.cc:2243] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.409400   430 raft_consensus.cc:2272] T d9b04160c71b417c9a4db4e3f6692906 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.411098   430 tablet_replica.cc:333] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.411749   430 raft_consensus.cc:2243] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.412155   430 raft_consensus.cc:2272] T 92e29794ffb24d7c898647fbcf5e0d77 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.413975   430 tablet_replica.cc:333] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.414507   430 raft_consensus.cc:2243] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.414945  9849 raft_consensus.cc:493] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c955bfd0b9541f9860c5f84cb255b90)
I20260709 13:04:17.415112   430 raft_consensus.cc:2272] T 977d385d3eeb49a799b9c161940c175a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.415408  9849 raft_consensus.cc:515] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245d19d5c71647a9857ac68df13802d5" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33479 } } peers { permanent_uuid: "a6a0de662d36410c907287e73cb2e4db" member_type: VOTER last_known_addr { host: "127.0.107.132" port: 45733 } } peers { permanent_uuid: "0c955bfd0b9541f9860c5f84cb255b90" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 45051 } }
I20260709 13:04:17.417038  9849 leader_election.cc:290] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479), 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051)
I20260709 13:04:17.417302   430 tablet_replica.cc:333] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.417996   430 raft_consensus.cc:2243] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.418421   430 raft_consensus.cc:2272] T a097a815a3194dc7a54ca93a122cfed8 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:17.420830  9014 leader_election.cc:336] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 245d19d5c71647a9857ac68df13802d5 (127.0.107.131:33479): Network error: Client connection negotiation failed: client connection to 127.0.107.131:33479: connect: Connection refused (error 111)
I20260709 13:04:17.420887   430 tablet_replica.cc:333] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
W20260709 13:04:17.421316  9013 leader_election.cc:336] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c955bfd0b9541f9860c5f84cb255b90 (127.0.107.129:45051): Network error: Client connection negotiation failed: client connection to 127.0.107.129:45051: connect: Connection refused (error 111)
I20260709 13:04:17.421707  9013 leader_election.cc:304] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a0de662d36410c907287e73cb2e4db; no voters: 0c955bfd0b9541f9860c5f84cb255b90, 245d19d5c71647a9857ac68df13802d5
I20260709 13:04:17.421833   430 raft_consensus.cc:2243] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.422344   430 raft_consensus.cc:2272] T 5fcaea8afc7941f0aaaa6b3b2c0d1171 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.422262  9849 raft_consensus.cc:2749] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:17.424278   430 tablet_replica.cc:333] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.424834   430 raft_consensus.cc:2243] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.425271   430 raft_consensus.cc:2272] T f5eae864d4cf4f2ea2d5b52e7ffc1c12 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.427131   430 tablet_replica.cc:333] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.427700   430 raft_consensus.cc:2243] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.428435   430 raft_consensus.cc:2272] T 8fa59e81ed8e4c0ca2890a10befbf996 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.430258   430 tablet_replica.cc:333] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.430757   430 raft_consensus.cc:2243] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.431137   430 raft_consensus.cc:2272] T 5c4408002b8e4e67a7bf17118232afd5 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.432909   430 tablet_replica.cc:333] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.433409   430 raft_consensus.cc:2243] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.434135   430 raft_consensus.cc:2272] T bddeae20846c4ef98e62e0666f4030b4 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.435977   430 tablet_replica.cc:333] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.436482   430 raft_consensus.cc:2243] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.436866   430 raft_consensus.cc:2272] T ebefe5d3d0a64ae087a329b7c032225a P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.438565   430 tablet_replica.cc:333] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.439054   430 raft_consensus.cc:2243] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.439481   430 raft_consensus.cc:2272] T cfb43858b9264896af25d56cdbb44d80 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.441429   430 tablet_replica.cc:333] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.442004   430 raft_consensus.cc:2243] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.442454   430 raft_consensus.cc:2272] T 64b41045f959459f885308feb894963c P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.444768   430 tablet_replica.cc:333] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.445474   430 raft_consensus.cc:2243] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.446187   430 raft_consensus.cc:2272] T e3411c58e61642e499aafe48daae38e0 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.448052   430 tablet_replica.cc:333] T 5b8666482fd746c1bc9d0c3c1bc30613 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.448519   430 raft_consensus.cc:2243] T 5b8666482fd746c1bc9d0c3c1bc30613 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.448866   430 raft_consensus.cc:2272] T 5b8666482fd746c1bc9d0c3c1bc30613 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.450645   430 tablet_replica.cc:333] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.451092   430 raft_consensus.cc:2243] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.451483   430 raft_consensus.cc:2272] T 0986587761fb4f0387746bee54af0e5b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.453100   430 tablet_replica.cc:333] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.453549   430 raft_consensus.cc:2243] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.453873   430 raft_consensus.cc:2272] T 105ca1309d4c495293d5da6c6b316b04 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.455581   430 tablet_replica.cc:333] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.456027   430 raft_consensus.cc:2243] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.457038   430 raft_consensus.cc:2272] T 76d0a76f1a2b45df971cecac7ccb46b3 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.458689   430 tablet_replica.cc:333] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.459127   430 raft_consensus.cc:2243] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.459903   430 raft_consensus.cc:2272] T dec23c2e3be3416a84d3d12becfa90fa P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.461599   430 tablet_replica.cc:333] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.462045   430 raft_consensus.cc:2243] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.462363   430 raft_consensus.cc:2272] T 99a4989c61c249ebab0dfa6b8990d350 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.464300   430 tablet_replica.cc:333] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.464993   430 raft_consensus.cc:2243] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.465484   430 raft_consensus.cc:2272] T 1ede05852c17421192022144629e6a6b P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.467690   430 tablet_replica.cc:333] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.468165   430 raft_consensus.cc:2243] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.468859   430 raft_consensus.cc:2272] T dce2804142c04505bd469904f288178b P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.470584   430 tablet_replica.cc:333] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.471139   430 raft_consensus.cc:2243] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.471597   430 raft_consensus.cc:2272] T 572cae6a298d45448d43956a1842ecc5 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.473428   430 tablet_replica.cc:333] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.473903   430 raft_consensus.cc:2243] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.474574   430 raft_consensus.cc:2272] T 2b608c0e2df74b2a898f03761cfc1813 P a6a0de662d36410c907287e73cb2e4db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.476449   430 tablet_replica.cc:333] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.476912   430 raft_consensus.cc:2243] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.477262   430 raft_consensus.cc:2272] T ff17e11e1d8e4902ac9cfb17935d7de6 P a6a0de662d36410c907287e73cb2e4db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.478962   430 tablet_replica.cc:333] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db: stopping tablet replica
I20260709 13:04:17.479468   430 raft_consensus.cc:2243] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:17.479875   430 raft_consensus.cc:2272] T 205bb6a61d8f4ea4aa9d7c5844d05930 P a6a0de662d36410c907287e73cb2e4db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.543522   430 tablet_server.cc:196] TabletServer@127.0.107.132:0 shutdown complete.
I20260709 13:04:17.602301   430 master.cc:562] Master@127.0.107.190:46327 shutting down...
I20260709 13:04:17.627473   430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:17.627987   430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:17.628250   430 tablet_replica.cc:333] T 00000000000000000000000000000000 P b3aa4ec0e3cc435d99f45f3f24f70e4c: stopping tablet replica
I20260709 13:04:17.650823   430 master.cc:584] Master@127.0.107.190:46327 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32375 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:04:17.734745   430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.190:43291
I20260709 13:04:17.735817   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:17.741616  9993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:17.741649  9992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:17.742583  9995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:17.743196   430 server_base.cc:1061] running on GCE node
I20260709 13:04:17.744217   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:17.744387   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:17.744566   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602257744551 us; error 0 us; skew 500 ppm
I20260709 13:04:17.745127   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:17.747735   430 webserver.cc:533] Webserver started at http://127.0.107.190:37803/ using document root <none> and password file <none>
I20260709 13:04:17.748284   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:17.748485   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:17.748806   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:17.750025   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/master-0-root/instance:
uuid: "4dfc51f8e12e4ccb9a9484426f618630"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-th5x"
I20260709 13:04:17.754890   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:04:17.758463 10000 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:17.759366   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:17.760102   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/master-0-root
uuid: "4dfc51f8e12e4ccb9a9484426f618630"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-th5x"
I20260709 13:04:17.760412   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:17.777910   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:17.779235   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:17.819825   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.190:43291
I20260709 13:04:17.819948 10051 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.190:43291 every 8 connection(s)
I20260709 13:04:17.823763 10052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.834107 10052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630: Bootstrap starting.
I20260709 13:04:17.838730 10052 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.842828 10052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630: No bootstrap required, opened a new log
I20260709 13:04:17.844848 10052 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dfc51f8e12e4ccb9a9484426f618630" member_type: VOTER }
I20260709 13:04:17.845198 10052 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.845381 10052 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dfc51f8e12e4ccb9a9484426f618630, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.846028 10052 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dfc51f8e12e4ccb9a9484426f618630" member_type: VOTER }
I20260709 13:04:17.846426 10052 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:17.846607 10052 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:17.846820 10052 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.851034 10052 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dfc51f8e12e4ccb9a9484426f618630" member_type: VOTER }
I20260709 13:04:17.851538 10052 leader_election.cc:304] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4dfc51f8e12e4ccb9a9484426f618630; no voters: 
I20260709 13:04:17.852555 10052 leader_election.cc:290] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:17.852938 10055 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.854568 10055 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [term 1 LEADER]: Becoming Leader. State: Replica: 4dfc51f8e12e4ccb9a9484426f618630, State: Running, Role: LEADER
I20260709 13:04:17.855345 10055 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dfc51f8e12e4ccb9a9484426f618630" member_type: VOTER }
I20260709 13:04:17.855540 10052 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:17.860219 10057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4dfc51f8e12e4ccb9a9484426f618630. Latest consensus state: current_term: 1 leader_uuid: "4dfc51f8e12e4ccb9a9484426f618630" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dfc51f8e12e4ccb9a9484426f618630" member_type: VOTER } }
I20260709 13:04:17.860867 10057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:17.860726 10056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4dfc51f8e12e4ccb9a9484426f618630" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dfc51f8e12e4ccb9a9484426f618630" member_type: VOTER } }
I20260709 13:04:17.861539 10056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:17.864214 10063 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:17.868821 10063 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:17.872063   430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:17.877022 10063 catalog_manager.cc:1383] Generated new cluster ID: 1d1e06bfa9d64b63b1c57fed2076216b
I20260709 13:04:17.877307 10063 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:17.893814 10063 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:17.895054 10063 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:17.912397 10063 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630: Generated new TSK 0
I20260709 13:04:17.913100 10063 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:17.938505   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:17.944661 10073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:17.945633 10074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:17.948220   430 server_base.cc:1061] running on GCE node
W20260709 13:04:17.948618 10076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:17.949540   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:17.949739   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:17.949852   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602257949841 us; error 0 us; skew 500 ppm
I20260709 13:04:17.950306   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:17.952607   430 webserver.cc:533] Webserver started at http://127.0.107.129:33643/ using document root <none> and password file <none>
I20260709 13:04:17.953042   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:17.953195   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:17.953400   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:17.954424   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-0-root/instance:
uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-th5x"
I20260709 13:04:17.959030   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:17.962471 10081 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:17.963295   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:04:17.963640   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-0-root
uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-th5x"
I20260709 13:04:17.963932   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:17.980785   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:17.981999   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:17.983434   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:17.985724   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:17.985939   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:17.986202   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:17.986392   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:18.027740   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.129:39665
I20260709 13:04:18.027850 10143 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.129:39665 every 8 connection(s)
I20260709 13:04:18.032827   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:18.040046 10148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:18.040663 10149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:18.044204 10152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:18.044323   430 server_base.cc:1061] running on GCE node
I20260709 13:04:18.045603   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:18.045828   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:18.046022   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602258046004 us; error 0 us; skew 500 ppm
I20260709 13:04:18.046523   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:18.049203   430 webserver.cc:533] Webserver started at http://127.0.107.130:33067/ using document root <none> and password file <none>
I20260709 13:04:18.049793   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:18.050021   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:18.050330   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:18.050751 10144 heartbeater.cc:344] Connected to a master server at 127.0.107.190:43291
I20260709 13:04:18.051187 10144 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:18.051609   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-1-root/instance:
uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
format_stamp: "Formatted at 2026-07-09 13:04:18 on dist-test-slave-th5x"
I20260709 13:04:18.051908 10144 heartbeater.cc:507] Master 127.0.107.190:43291 requested a full tablet report, sending...
I20260709 13:04:18.053999 10017 ts_manager.cc:194] Registered new tserver with Master: 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665)
I20260709 13:04:18.055738 10017 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33250
I20260709 13:04:18.056674   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:04:18.060199 10156 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:18.060916   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:18.061194   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-1-root
uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
format_stamp: "Formatted at 2026-07-09 13:04:18 on dist-test-slave-th5x"
I20260709 13:04:18.061484   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:18.071072   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:18.072232   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:18.073570   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:18.076639   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:18.076928   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:18.077247   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:18.077481   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:18.117713   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.130:40273
I20260709 13:04:18.117810 10218 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.130:40273 every 8 connection(s)
I20260709 13:04:18.122426   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:18.129616 10222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:18.130538 10223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:18.132529 10225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:18.133459   430 server_base.cc:1061] running on GCE node
I20260709 13:04:18.134202 10219 heartbeater.cc:344] Connected to a master server at 127.0.107.190:43291
I20260709 13:04:18.134634 10219 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:18.134637   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:18.135121   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:18.135347   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602258135329 us; error 0 us; skew 500 ppm
I20260709 13:04:18.135767 10219 heartbeater.cc:507] Master 127.0.107.190:43291 requested a full tablet report, sending...
I20260709 13:04:18.136178   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:18.137951 10017 ts_manager.cc:194] Registered new tserver with Master: a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:18.138986   430 webserver.cc:533] Webserver started at http://127.0.107.131:40225/ using document root <none> and password file <none>
I20260709 13:04:18.139508 10017 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33262
I20260709 13:04:18.139576   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:18.140070   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:18.140388   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:18.141580   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-2-root/instance:
uuid: "ef618097776646d283d2da929e16499c"
format_stamp: "Formatted at 2026-07-09 13:04:18 on dist-test-slave-th5x"
I20260709 13:04:18.145639   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:18.148607 10230 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:18.149326   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:18.149609   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-2-root
uuid: "ef618097776646d283d2da929e16499c"
format_stamp: "Formatted at 2026-07-09 13:04:18 on dist-test-slave-th5x"
I20260709 13:04:18.149883   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:18.167209   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:18.168356   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:18.169803   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:18.171960   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:18.172183   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:18.172427   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:18.172601   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:18.211930   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.131:46305
I20260709 13:04:18.212051 10292 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.131:46305 every 8 connection(s)
I20260709 13:04:18.226024 10293 heartbeater.cc:344] Connected to a master server at 127.0.107.190:43291
I20260709 13:04:18.226440 10293 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:18.227084 10293 heartbeater.cc:507] Master 127.0.107.190:43291 requested a full tablet report, sending...
I20260709 13:04:18.228947 10017 ts_manager.cc:194] Registered new tserver with Master: ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:18.229741   430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014621494s
I20260709 13:04:18.230285 10017 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33270
I20260709 13:04:18.254879 10017 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33276:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:18.257958 10017 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:18.325358 10184 tablet_service.cc:1511] Processing CreateTablet for tablet b15a041a533c4404bddfa23568ea6947 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:18.325924 10183 tablet_service.cc:1511] Processing CreateTablet for tablet e073e16f87fa4f4797eb1706d3e1b626 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:18.326838 10184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15a041a533c4404bddfa23568ea6947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.328085 10182 tablet_service.cc:1511] Processing CreateTablet for tablet f955cd662e8d4fe0aeb79a0438ae21e0 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:18.329463 10182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f955cd662e8d4fe0aeb79a0438ae21e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.329195 10181 tablet_service.cc:1511] Processing CreateTablet for tablet 6ca175cf9b084d8bb9713f3dabf93183 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:18.330534 10181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ca175cf9b084d8bb9713f3dabf93183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.331930 10183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e073e16f87fa4f4797eb1706d3e1b626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.341146 10258 tablet_service.cc:1511] Processing CreateTablet for tablet b15a041a533c4404bddfa23568ea6947 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:18.341529 10257 tablet_service.cc:1511] Processing CreateTablet for tablet e073e16f87fa4f4797eb1706d3e1b626 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:18.342582 10258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15a041a533c4404bddfa23568ea6947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.343425 10257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e073e16f87fa4f4797eb1706d3e1b626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.352733 10256 tablet_service.cc:1511] Processing CreateTablet for tablet f955cd662e8d4fe0aeb79a0438ae21e0 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:18.353317 10180 tablet_service.cc:1511] Processing CreateTablet for tablet 9c456d4b841a437e88c893fbe5a43f28 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:18.354154 10256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f955cd662e8d4fe0aeb79a0438ae21e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.354626 10180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c456d4b841a437e88c893fbe5a43f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.359117 10179 tablet_service.cc:1511] Processing CreateTablet for tablet af5b3ac2356141c7b489fe22a01b3656 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:18.360507 10179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5b3ac2356141c7b489fe22a01b3656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.361234 10307 tablet_bootstrap.cc:492] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c: Bootstrap starting.
I20260709 13:04:18.365447 10255 tablet_service.cc:1511] Processing CreateTablet for tablet 6ca175cf9b084d8bb9713f3dabf93183 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:18.366770 10255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ca175cf9b084d8bb9713f3dabf93183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.368813 10254 tablet_service.cc:1511] Processing CreateTablet for tablet 9c456d4b841a437e88c893fbe5a43f28 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:18.370121 10254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c456d4b841a437e88c893fbe5a43f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.372383 10253 tablet_service.cc:1511] Processing CreateTablet for tablet af5b3ac2356141c7b489fe22a01b3656 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:18.379874 10253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5b3ac2356141c7b489fe22a01b3656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.388260 10308 tablet_bootstrap.cc:492] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c: Bootstrap starting.
I20260709 13:04:18.397593 10184 tablet_service.cc:1511] Processing CreateTablet for tablet 4d67e27ca3974a268ed08d072938f622 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:18.398880 10184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d67e27ca3974a268ed08d072938f622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.401046 10308 tablet_bootstrap.cc:654] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.405550 10307 tablet_bootstrap.cc:654] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.411252 10256 tablet_service.cc:1511] Processing CreateTablet for tablet 4d67e27ca3974a268ed08d072938f622 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:18.412423 10108 tablet_service.cc:1511] Processing CreateTablet for tablet e073e16f87fa4f4797eb1706d3e1b626 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:18.413020 10256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d67e27ca3974a268ed08d072938f622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.413729 10108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e073e16f87fa4f4797eb1706d3e1b626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.416553 10107 tablet_service.cc:1511] Processing CreateTablet for tablet f955cd662e8d4fe0aeb79a0438ae21e0 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:18.418519 10107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f955cd662e8d4fe0aeb79a0438ae21e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.420375 10103 tablet_service.cc:1511] Processing CreateTablet for tablet 4d67e27ca3974a268ed08d072938f622 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:18.420805 10183 tablet_service.cc:1511] Processing CreateTablet for tablet d6ea6be6d4734f0bb618e54fa53a1bef (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:18.421643 10103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d67e27ca3974a268ed08d072938f622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.422027 10183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6ea6be6d4734f0bb618e54fa53a1bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.423990 10104 tablet_service.cc:1511] Processing CreateTablet for tablet af5b3ac2356141c7b489fe22a01b3656 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:18.425238 10104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5b3ac2356141c7b489fe22a01b3656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.428537 10105 tablet_service.cc:1511] Processing CreateTablet for tablet 9c456d4b841a437e88c893fbe5a43f28 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:18.429764 10105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c456d4b841a437e88c893fbe5a43f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.432456 10106 tablet_service.cc:1511] Processing CreateTablet for tablet 6ca175cf9b084d8bb9713f3dabf93183 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:18.433732 10106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ca175cf9b084d8bb9713f3dabf93183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.435526 10109 tablet_service.cc:1511] Processing CreateTablet for tablet b15a041a533c4404bddfa23568ea6947 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:18.437115 10109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b15a041a533c4404bddfa23568ea6947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.445060 10102 tablet_service.cc:1511] Processing CreateTablet for tablet d6ea6be6d4734f0bb618e54fa53a1bef (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:18.446369 10102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6ea6be6d4734f0bb618e54fa53a1bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.451103 10101 tablet_service.cc:1511] Processing CreateTablet for tablet ab79ea29a6484b329e1b0025fa9851b8 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:18.452472 10101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab79ea29a6484b329e1b0025fa9851b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.466373 10258 tablet_service.cc:1511] Processing CreateTablet for tablet ab79ea29a6484b329e1b0025fa9851b8 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:18.466596 10180 tablet_service.cc:1511] Processing CreateTablet for tablet ab79ea29a6484b329e1b0025fa9851b8 (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:18.467732 10258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab79ea29a6484b329e1b0025fa9851b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.467907 10180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab79ea29a6484b329e1b0025fa9851b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.461359 10257 tablet_service.cc:1511] Processing CreateTablet for tablet d6ea6be6d4734f0bb618e54fa53a1bef (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:18.484710 10257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6ea6be6d4734f0bb618e54fa53a1bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.504961 10102 tablet_service.cc:1511] Processing CreateTablet for tablet 18b66c65d3f44836beeebe8c5450facb (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:18.506371 10102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b66c65d3f44836beeebe8c5450facb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.532220 10311 tablet_bootstrap.cc:492] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:18.538542 10311 tablet_bootstrap.cc:654] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.540277 10179 tablet_service.cc:1511] Processing CreateTablet for tablet 18b66c65d3f44836beeebe8c5450facb (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:18.540678 10308 tablet_bootstrap.cc:492] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c: No bootstrap required, opened a new log
I20260709 13:04:18.541257 10308 ts_tablet_manager.cc:1403] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c: Time spent bootstrapping tablet: real 0.153s	user 0.023s	sys 0.061s
I20260709 13:04:18.541572 10179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b66c65d3f44836beeebe8c5450facb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.544137 10257 tablet_service.cc:1511] Processing CreateTablet for tablet 18b66c65d3f44836beeebe8c5450facb (DEFAULT_TABLE table=test-workload [id=7234d247cb93460eba3739a5a89ab3e4]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:18.544157 10308 raft_consensus.cc:359] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:18.545076 10308 raft_consensus.cc:385] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.545387 10308 raft_consensus.cc:740] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.546268 10308 consensus_queue.cc:260] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:18.547276 10257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b66c65d3f44836beeebe8c5450facb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:18.540746 10307 tablet_bootstrap.cc:492] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c: No bootstrap required, opened a new log
I20260709 13:04:18.588862 10307 ts_tablet_manager.cc:1403] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent bootstrapping tablet: real 0.228s	user 0.022s	sys 0.023s
I20260709 13:04:18.590197 10308 ts_tablet_manager.cc:1434] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c: Time spent starting tablet: real 0.049s	user 0.026s	sys 0.020s
I20260709 13:04:18.590577 10311 tablet_bootstrap.cc:492] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8: No bootstrap required, opened a new log
I20260709 13:04:18.590564 10293 heartbeater.cc:499] Master 127.0.107.190:43291 was elected leader, sending a full tablet report...
I20260709 13:04:18.591260 10308 tablet_bootstrap.cc:492] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c: Bootstrap starting.
I20260709 13:04:18.592788 10307 raft_consensus.cc:359] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.593600 10307 raft_consensus.cc:385] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.593905 10307 raft_consensus.cc:740] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.594995 10311 ts_tablet_manager.cc:1403] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.063s	user 0.002s	sys 0.032s
I20260709 13:04:18.594660 10307 consensus_queue.cc:260] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.597546 10308 tablet_bootstrap.cc:654] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.597994 10311 raft_consensus.cc:359] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.598762 10311 raft_consensus.cc:385] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.599048 10311 raft_consensus.cc:740] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.599931 10311 consensus_queue.cc:260] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.603112 10219 heartbeater.cc:499] Master 127.0.107.190:43291 was elected leader, sending a full tablet report...
I20260709 13:04:18.604285 10307 ts_tablet_manager.cc:1434] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:04:18.605329 10307 tablet_bootstrap.cc:492] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c: Bootstrap starting.
I20260709 13:04:18.612145 10307 tablet_bootstrap.cc:654] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.616446 10144 heartbeater.cc:499] Master 127.0.107.190:43291 was elected leader, sending a full tablet report...
I20260709 13:04:18.617198 10311 ts_tablet_manager.cc:1434] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.013s
I20260709 13:04:18.618542 10311 tablet_bootstrap.cc:492] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
W20260709 13:04:18.621776 10220 tablet.cc:2406] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:18.626500 10311 tablet_bootstrap.cc:654] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.630429 10307 tablet_bootstrap.cc:492] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c: No bootstrap required, opened a new log
I20260709 13:04:18.631001 10307 ts_tablet_manager.cc:1403] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 13:04:18.634527 10307 raft_consensus.cc:359] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:18.635367 10307 raft_consensus.cc:385] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.635746 10307 raft_consensus.cc:740] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.636570 10307 consensus_queue.cc:260] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:18.639389 10307 ts_tablet_manager.cc:1434] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:04:18.640492 10307 tablet_bootstrap.cc:492] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c: Bootstrap starting.
I20260709 13:04:18.648198 10307 tablet_bootstrap.cc:654] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.659351 10307 tablet_bootstrap.cc:492] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c: No bootstrap required, opened a new log
I20260709 13:04:18.659883 10307 ts_tablet_manager.cc:1403] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.013s
I20260709 13:04:18.662964 10307 raft_consensus.cc:359] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.663872 10307 raft_consensus.cc:385] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.664156 10307 raft_consensus.cc:740] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.667588 10307 consensus_queue.cc:260] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.669731 10308 tablet_bootstrap.cc:492] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c: No bootstrap required, opened a new log
I20260709 13:04:18.670446 10308 ts_tablet_manager.cc:1403] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c: Time spent bootstrapping tablet: real 0.079s	user 0.031s	sys 0.043s
I20260709 13:04:18.671582 10307 ts_tablet_manager.cc:1434] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:04:18.672636 10307 tablet_bootstrap.cc:492] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c: Bootstrap starting.
I20260709 13:04:18.674185 10308 raft_consensus.cc:359] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.675222 10308 raft_consensus.cc:385] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.675644 10308 raft_consensus.cc:740] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.676591 10308 consensus_queue.cc:260] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.679461 10308 ts_tablet_manager.cc:1434] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.004s
I20260709 13:04:18.680258 10307 tablet_bootstrap.cc:654] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.680665 10308 tablet_bootstrap.cc:492] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c: Bootstrap starting.
I20260709 13:04:18.690002 10308 tablet_bootstrap.cc:654] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.703358 10311 tablet_bootstrap.cc:492] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8: No bootstrap required, opened a new log
I20260709 13:04:18.703585 10308 tablet_bootstrap.cc:492] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c: No bootstrap required, opened a new log
I20260709 13:04:18.703943 10311 ts_tablet_manager.cc:1403] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.086s	user 0.038s	sys 0.045s
I20260709 13:04:18.704090 10308 ts_tablet_manager.cc:1403] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.013s
I20260709 13:04:18.706864 10307 tablet_bootstrap.cc:492] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c: No bootstrap required, opened a new log
I20260709 13:04:18.707348 10307 ts_tablet_manager.cc:1403] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.005s
I20260709 13:04:18.706993 10308 raft_consensus.cc:359] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.707183 10311 raft_consensus.cc:359] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.707924 10308 raft_consensus.cc:385] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.707971 10311 raft_consensus.cc:385] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.708395 10308 raft_consensus.cc:740] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.708437 10311 raft_consensus.cc:740] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.709306 10308 consensus_queue.cc:260] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.709326 10311 consensus_queue.cc:260] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.710008 10307 raft_consensus.cc:359] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.710817 10307 raft_consensus.cc:385] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.711089 10307 raft_consensus.cc:740] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.711730 10308 ts_tablet_manager.cc:1434] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:04:18.711836 10307 consensus_queue.cc:260] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.712843 10308 tablet_bootstrap.cc:492] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c: Bootstrap starting.
I20260709 13:04:18.713438 10311 ts_tablet_manager.cc:1434] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:18.714390 10311 tablet_bootstrap.cc:492] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:18.718207 10307 ts_tablet_manager.cc:1434] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:18.719293 10307 tablet_bootstrap.cc:492] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c: Bootstrap starting.
I20260709 13:04:18.720337 10308 tablet_bootstrap.cc:654] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.721417 10311 tablet_bootstrap.cc:654] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.726861 10307 tablet_bootstrap.cc:654] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.737867 10311 tablet_bootstrap.cc:492] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8: No bootstrap required, opened a new log
I20260709 13:04:18.738528 10311 ts_tablet_manager.cc:1403] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.005s
I20260709 13:04:18.742761 10311 raft_consensus.cc:359] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.743757 10311 raft_consensus.cc:385] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.744130 10311 raft_consensus.cc:740] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.745968 10311 consensus_queue.cc:260] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.750201 10311 ts_tablet_manager.cc:1434] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.004s
I20260709 13:04:18.751833 10311 tablet_bootstrap.cc:492] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:18.758617 10311 tablet_bootstrap.cc:654] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.761176 10307 tablet_bootstrap.cc:492] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c: No bootstrap required, opened a new log
I20260709 13:04:18.761685 10307 ts_tablet_manager.cc:1403] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.019s
I20260709 13:04:18.764243 10311 tablet_bootstrap.cc:492] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8: No bootstrap required, opened a new log
I20260709 13:04:18.764374 10308 tablet_bootstrap.cc:492] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c: No bootstrap required, opened a new log
I20260709 13:04:18.764837 10311 ts_tablet_manager.cc:1403] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 13:04:18.764839 10308 ts_tablet_manager.cc:1403] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.019s
I20260709 13:04:18.765615 10307 raft_consensus.cc:359] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.766836 10307 raft_consensus.cc:385] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.767191 10307 raft_consensus.cc:740] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.767997 10312 raft_consensus.cc:493] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.768029 10311 raft_consensus.cc:359] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.768266 10308 raft_consensus.cc:359] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.769145 10308 raft_consensus.cc:385] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.769083 10311 raft_consensus.cc:385] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.769871 10308 raft_consensus.cc:740] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.769891 10311 raft_consensus.cc:740] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.769423 10314 raft_consensus.cc:493] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.769033 10312 raft_consensus.cc:515] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:18.770920 10314 raft_consensus.cc:515] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.771133 10311 consensus_queue.cc:260] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.771059 10308 consensus_queue.cc:260] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.773411 10314 leader_election.cc:290] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:18.776788 10311 ts_tablet_manager.cc:1434] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:04:18.783058 10312 leader_election.cc:290] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273), 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665)
I20260709 13:04:18.792896 10312 raft_consensus.cc:493] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.793408 10312 raft_consensus.cc:515] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.794967 10311 tablet_bootstrap.cc:492] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:18.796062 10307 consensus_queue.cc:260] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.796641 10312 leader_election.cc:290] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:18.798606 10307 ts_tablet_manager.cc:1434] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:04:18.798694 10308 ts_tablet_manager.cc:1434] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.005s
I20260709 13:04:18.799798 10307 tablet_bootstrap.cc:492] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c: Bootstrap starting.
I20260709 13:04:18.799887 10308 tablet_bootstrap.cc:492] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c: Bootstrap starting.
I20260709 13:04:18.802438 10311 tablet_bootstrap.cc:654] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.808393 10307 tablet_bootstrap.cc:654] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.832494 10268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:18.833449 10268 raft_consensus.cc:2468] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 0.
I20260709 13:04:18.835032 10157 leader_election.cc:304] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:18.836517 10314 raft_consensus.cc:2804] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.836997 10314 raft_consensus.cc:493] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.837468 10314 raft_consensus.cc:3060] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.838837 10119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" is_pre_election: true
W20260709 13:04:18.840936 10157 leader_election.cc:343] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.845391 10194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15a041a533c4404bddfa23568ea6947" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
I20260709 13:04:18.846223 10119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15a041a533c4404bddfa23568ea6947" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" is_pre_election: true
I20260709 13:04:18.846498 10118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" is_pre_election: true
W20260709 13:04:18.848382 10231 leader_election.cc:343] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:18.849315 10231 leader_election.cc:343] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.847237 10193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
I20260709 13:04:18.846297 10194 raft_consensus.cc:2468] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 0.
I20260709 13:04:18.852496 10233 leader_election.cc:304] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8
I20260709 13:04:18.845880 10308 tablet_bootstrap.cc:654] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.854074 10316 raft_consensus.cc:493] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.854696 10312 raft_consensus.cc:493] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.854988 10307 tablet_bootstrap.cc:492] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c: No bootstrap required, opened a new log
I20260709 13:04:18.854151 10326 raft_consensus.cc:2804] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.854771 10316 raft_consensus.cc:515] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.855791 10307 ts_tablet_manager.cc:1403] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.013s
I20260709 13:04:18.856122 10326 raft_consensus.cc:493] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.856500 10326 raft_consensus.cc:3060] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.859205 10307 raft_consensus.cc:359] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.860105 10307 raft_consensus.cc:385] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.860468 10307 raft_consensus.cc:740] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.855319 10312 raft_consensus.cc:515] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.861337 10307 consensus_queue.cc:260] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.863870 10118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" is_pre_election: true
W20260709 13:04:18.866544 10231 leader_election.cc:343] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:18.867321 10065 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:18.868984 10194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
I20260709 13:04:18.869596 10316 leader_election.cc:290] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
W20260709 13:04:18.870841 10233 leader_election.cc:343] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.871498 10233 leader_election.cc:304] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c
I20260709 13:04:18.872876 10312 leader_election.cc:290] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:18.873575 10312 raft_consensus.cc:2749] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.882500 10314 raft_consensus.cc:515] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.884078 10193 raft_consensus.cc:2393] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef618097776646d283d2da929e16499c in current term 1: Already voted for candidate a96cb1bb4a724cf48e91a3f40146db5c in this term.
I20260709 13:04:18.885175 10311 tablet_bootstrap.cc:492] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8: No bootstrap required, opened a new log
I20260709 13:04:18.885932 10311 ts_tablet_manager.cc:1403] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.091s	user 0.036s	sys 0.020s
I20260709 13:04:18.879040 10326 raft_consensus.cc:515] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:18.896479 10118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15a041a533c4404bddfa23568ea6947" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
W20260709 13:04:18.898375 10231 leader_election.cc:343] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.901368 10268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:18.902221 10268 raft_consensus.cc:3060] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.904457 10311 raft_consensus.cc:359] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.905515 10311 raft_consensus.cc:385] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.905900 10311 raft_consensus.cc:740] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.908856 10118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
W20260709 13:04:18.910754 10157 leader_election.cc:343] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.912706 10268 raft_consensus.cc:2468] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 1.
I20260709 13:04:18.914278 10157 leader_election.cc:304] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8
I20260709 13:04:18.917637 10308 tablet_bootstrap.cc:492] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c: No bootstrap required, opened a new log
I20260709 13:04:18.918195 10308 ts_tablet_manager.cc:1403] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c: Time spent bootstrapping tablet: real 0.119s	user 0.030s	sys 0.039s
W20260709 13:04:18.919754 10233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.130:40273, user_credentials={real_user=slave}} blocked reactor thread for 48970.9us
I20260709 13:04:18.921331 10193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15a041a533c4404bddfa23568ea6947" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:18.921170 10308 raft_consensus.cc:359] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.922027 10193 raft_consensus.cc:3060] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.922865 10340 raft_consensus.cc:2804] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.923916 10340 raft_consensus.cc:697] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Becoming Leader. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:18.925334 10340 consensus_queue.cc:237] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.922309 10338 raft_consensus.cc:493] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.928239 10338 raft_consensus.cc:515] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.927342 10233 leader_election.cc:304] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c
I20260709 13:04:18.928480 10194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b66c65d3f44836beeebe8c5450facb" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
I20260709 13:04:18.929693 10193 raft_consensus.cc:2468] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 1.
I20260709 13:04:18.922008 10308 raft_consensus.cc:385] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:18.930509 10084 leader_election.cc:343] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.930785 10308 raft_consensus.cc:740] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.931813 10118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca175cf9b084d8bb9713f3dabf93183" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" is_pre_election: true
I20260709 13:04:18.931996 10338 leader_election.cc:290] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:18.932461 10118 raft_consensus.cc:2468] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 0.
I20260709 13:04:18.917080 10307 ts_tablet_manager.cc:1434] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent starting tablet: real 0.061s	user 0.013s	sys 0.014s
I20260709 13:04:18.931881 10308 consensus_queue.cc:260] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.930783 10311 consensus_queue.cc:260] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.933727 10267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b66c65d3f44836beeebe8c5450facb" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:18.934116 10316 raft_consensus.cc:493] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.934047 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca175cf9b084d8bb9713f3dabf93183" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:18.934870 10266 raft_consensus.cc:2468] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 0.
W20260709 13:04:18.935737 10082 leader_election.cc:343] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef618097776646d283d2da929e16499c (127.0.107.131:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.936210 10082 leader_election.cc:304] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8; no voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c
I20260709 13:04:18.934744 10316 raft_consensus.cc:515] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.936239 10157 leader_election.cc:304] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:18.937906 10338 raft_consensus.cc:2804] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.938323 10338 raft_consensus.cc:493] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.938726 10338 raft_consensus.cc:3060] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.939289 10339 raft_consensus.cc:2749] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.940908 10316 leader_election.cc:290] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:18.941530 10233 leader_election.cc:304] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8
I20260709 13:04:18.942349 10314 leader_election.cc:290] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:18.943533 10193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
I20260709 13:04:18.944207 10193 raft_consensus.cc:2468] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d4df224ed2e4fcfb865ab144a250fa8 in term 0.
I20260709 13:04:18.945291 10084 leader_election.cc:304] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c; no voters: 
I20260709 13:04:18.941628 10316 raft_consensus.cc:2749] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.946683 10307 tablet_bootstrap.cc:492] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c: Bootstrap starting.
I20260709 13:04:18.946970 10339 raft_consensus.cc:2804] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.947507 10339 raft_consensus.cc:697] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 1 LEADER]: Becoming Leader. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:18.948356 10339 consensus_queue.cc:237] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:18.950037 10341 raft_consensus.cc:2804] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.950461 10341 raft_consensus.cc:493] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.950806 10341 raft_consensus.cc:3060] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.952571 10326 leader_election.cc:290] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 election: Requested vote from peers a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273), 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665)
I20260709 13:04:18.954919 10316 raft_consensus.cc:493] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.955646 10316 raft_consensus.cc:515] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.962285 10268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:18.963390 10341 raft_consensus.cc:515] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.964203 10316 leader_election.cc:290] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
W20260709 13:04:18.964223 10082 leader_election.cc:343] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef618097776646d283d2da929e16499c (127.0.107.131:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.964818 10193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab79ea29a6484b329e1b0025fa9851b8" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
I20260709 13:04:18.965469 10193 raft_consensus.cc:2468] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d4df224ed2e4fcfb865ab144a250fa8 in term 0.
I20260709 13:04:18.965548 10341 leader_election.cc:290] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 election: Requested vote from peers a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:18.965655 10308 ts_tablet_manager.cc:1434] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.001s
I20260709 13:04:18.966912 10308 tablet_bootstrap.cc:492] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c: Bootstrap starting.
I20260709 13:04:18.967103 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab79ea29a6484b329e1b0025fa9851b8" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:18.967428 10084 leader_election.cc:304] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c; no voters: 
I20260709 13:04:18.968358 10267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:18.968827 10193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:18.969439 10193 raft_consensus.cc:3060] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.969631 10266 raft_consensus.cc:2468] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d4df224ed2e4fcfb865ab144a250fa8 in term 0.
I20260709 13:04:18.969439 10311 ts_tablet_manager.cc:1434] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.083s	user 0.015s	sys 0.003s
I20260709 13:04:18.973536 10307 tablet_bootstrap.cc:654] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:18.974370 10082 leader_election.cc:343] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef618097776646d283d2da929e16499c (127.0.107.131:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.954877 10338 raft_consensus.cc:515] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.982956 10193 raft_consensus.cc:2468] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d4df224ed2e4fcfb865ab144a250fa8 in term 1.
I20260709 13:04:18.983331 10118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca175cf9b084d8bb9713f3dabf93183" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:18.984100 10118 raft_consensus.cc:3060] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.984509 10084 leader_election.cc:304] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c; no voters: ef618097776646d283d2da929e16499c
I20260709 13:04:18.986171 10316 raft_consensus.cc:2804] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.986388 10338 leader_election.cc:290] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:18.983225 10311 tablet_bootstrap.cc:492] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:18.987751 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca175cf9b084d8bb9713f3dabf93183" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:18.988394 10266 raft_consensus.cc:3060] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.986838 10316 raft_consensus.cc:697] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 LEADER]: Becoming Leader. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Running, Role: LEADER
I20260709 13:04:18.992336 10308 tablet_bootstrap.cc:654] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.992748 10316 consensus_queue.cc:237] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:18.976421 10341 raft_consensus.cc:2804] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.998898 10017 catalog_manager.cc:5697] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef618097776646d283d2da929e16499c (127.0.107.131). New cstate: current_term: 1 leader_uuid: "ef618097776646d283d2da929e16499c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.000123 10341 raft_consensus.cc:493] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.000947 10341 raft_consensus.cc:3060] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.001863 10118 raft_consensus.cc:2468] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 1.
I20260709 13:04:19.006027 10307 tablet_bootstrap.cc:492] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c: No bootstrap required, opened a new log
I20260709 13:04:19.006549 10307 ts_tablet_manager.cc:1403] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.007s
I20260709 13:04:19.004292 10015 catalog_manager.cc:5697] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c reported cstate change: term changed from 0 to 1, leader changed from <none> to a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.007789 10157 leader_election.cc:304] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c; no voters: 
I20260709 13:04:19.008773 10338 raft_consensus.cc:2804] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.008935 10266 raft_consensus.cc:2468] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 1.
I20260709 13:04:19.009310 10338 raft_consensus.cc:697] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Becoming Leader. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:19.010221 10338 consensus_queue.cc:237] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.015527 10307 raft_consensus.cc:359] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.016363 10307 raft_consensus.cc:385] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.016674 10307 raft_consensus.cc:740] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.017664 10307 consensus_queue.cc:260] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.019243 10340 raft_consensus.cc:493] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.020519 10311 tablet_bootstrap.cc:654] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.020288 10340 raft_consensus.cc:515] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.024206 10118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c456d4b841a437e88c893fbe5a43f28" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" is_pre_election: true
I20260709 13:04:19.024989 10308 tablet_bootstrap.cc:492] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c: No bootstrap required, opened a new log
I20260709 13:04:19.025494 10308 ts_tablet_manager.cc:1403] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.004s
W20260709 13:04:19.025954 10157 leader_election.cc:343] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.023209 10340 leader_election.cc:290] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:19.025585 10341 raft_consensus.cc:515] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.029968 10308 raft_consensus.cc:359] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.030737 10308 raft_consensus.cc:385] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.031026 10308 raft_consensus.cc:740] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.033252 10307 ts_tablet_manager.cc:1434] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 13:04:19.033799 10193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab79ea29a6484b329e1b0025fa9851b8" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:19.034349 10193 raft_consensus.cc:3060] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.034642 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c456d4b841a437e88c893fbe5a43f28" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:19.034754 10267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab79ea29a6484b329e1b0025fa9851b8" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:19.035441 10267 raft_consensus.cc:3060] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.035903 10308 consensus_queue.cc:260] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
W20260709 13:04:19.037611 10157 leader_election.cc:343] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef618097776646d283d2da929e16499c (127.0.107.131:46305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.038086 10157 leader_election.cc:304] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8, ef618097776646d283d2da929e16499c
I20260709 13:04:19.039191 10338 raft_consensus.cc:2749] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:19.041180 10308 ts_tablet_manager.cc:1434] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:04:19.034353 10307 tablet_bootstrap.cc:492] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c: Bootstrap starting.
I20260709 13:04:19.042403 10308 tablet_bootstrap.cc:492] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c: Bootstrap starting.
I20260709 13:04:19.043154 10267 raft_consensus.cc:2468] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d4df224ed2e4fcfb865ab144a250fa8 in term 1.
I20260709 13:04:19.043542 10341 leader_election.cc:290] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 election: Requested vote from peers a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:19.044548 10082 leader_election.cc:304] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:19.045480 10341 raft_consensus.cc:2804] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.046012 10341 raft_consensus.cc:697] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 LEADER]: Becoming Leader. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Running, Role: LEADER
I20260709 13:04:19.046864 10341 consensus_queue.cc:237] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.048314 10193 raft_consensus.cc:2468] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d4df224ed2e4fcfb865ab144a250fa8 in term 1.
I20260709 13:04:19.049356 10308 tablet_bootstrap.cc:654] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.050550 10016 catalog_manager.cc:5697] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.064697 10014 catalog_manager.cc:5697] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c reported cstate change: term changed from 0 to 1, leader changed from <none> to a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.069218 10307 tablet_bootstrap.cc:654] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.076566 10308 tablet_bootstrap.cc:492] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c: No bootstrap required, opened a new log
I20260709 13:04:19.077085 10308 ts_tablet_manager.cc:1403] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.024s
I20260709 13:04:19.079991 10308 raft_consensus.cc:359] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.080714 10308 raft_consensus.cc:385] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.081018 10308 raft_consensus.cc:740] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.081740 10308 consensus_queue.cc:260] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.084188 10308 ts_tablet_manager.cc:1434] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:04:19.084206 10311 tablet_bootstrap.cc:492] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8: No bootstrap required, opened a new log
I20260709 13:04:19.084970 10311 ts_tablet_manager.cc:1403] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.001s
I20260709 13:04:19.085227 10308 tablet_bootstrap.cc:492] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c: Bootstrap starting.
I20260709 13:04:19.092332 10308 tablet_bootstrap.cc:654] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.093407 10311 raft_consensus.cc:359] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:19.094404 10311 raft_consensus.cc:385] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.094789 10311 raft_consensus.cc:740] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.095785 10311 consensus_queue.cc:260] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:19.098507 10311 ts_tablet_manager.cc:1434] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:04:19.099648 10311 tablet_bootstrap.cc:492] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:19.102080 10308 tablet_bootstrap.cc:492] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c: No bootstrap required, opened a new log
I20260709 13:04:19.102715 10308 ts_tablet_manager.cc:1403] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:04:19.104923 10338 raft_consensus.cc:493] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.105754 10307 tablet_bootstrap.cc:492] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c: No bootstrap required, opened a new log
I20260709 13:04:19.105520 10308 raft_consensus.cc:359] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.106349 10308 raft_consensus.cc:385] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.105588 10338 raft_consensus.cc:515] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.106426 10307 ts_tablet_manager.cc:1403] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.007s
I20260709 13:04:19.106639 10308 raft_consensus.cc:740] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.107577 10308 consensus_queue.cc:260] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.109220 10307 raft_consensus.cc:359] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.109918 10307 raft_consensus.cc:385] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.110174 10307 raft_consensus.cc:740] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.110690 10118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" is_pre_election: true
I20260709 13:04:19.110960 10307 consensus_queue.cc:260] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.112036 10308 ts_tablet_manager.cc:1434] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:04:19.112843 10307 ts_tablet_manager.cc:1434] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:19.112938 10308 tablet_bootstrap.cc:492] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c: Bootstrap starting.
I20260709 13:04:19.113821 10307 tablet_bootstrap.cc:492] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c: Bootstrap starting.
I20260709 13:04:19.118042 10316 raft_consensus.cc:493] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.119319 10308 tablet_bootstrap.cc:654] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.118772 10316 raft_consensus.cc:515] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.122290 10267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ea6be6d4734f0bb618e54fa53a1bef" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:19.122781 10307 tablet_bootstrap.cc:654] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.122959 10267 raft_consensus.cc:2468] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d4df224ed2e4fcfb865ab144a250fa8 in term 0.
I20260709 13:04:19.124300 10082 leader_election.cc:304] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:19.125236 10342 raft_consensus.cc:2804] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.125618 10342 raft_consensus.cc:493] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.126008 10342 raft_consensus.cc:3060] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.129024 10193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ea6be6d4734f0bb618e54fa53a1bef" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
I20260709 13:04:19.129684 10193 raft_consensus.cc:2468] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d4df224ed2e4fcfb865ab144a250fa8 in term 0.
I20260709 13:04:19.131534 10316 leader_election.cc:290] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
W20260709 13:04:19.132194 10157 leader_election.cc:343] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.135313 10307 tablet_bootstrap.cc:492] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c: No bootstrap required, opened a new log
I20260709 13:04:19.135390 10342 raft_consensus.cc:515] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.135991 10307 ts_tablet_manager.cc:1403] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.009s
I20260709 13:04:19.136047 10267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:19.136974 10267 raft_consensus.cc:2468] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 0.
I20260709 13:04:19.138507 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ea6be6d4734f0bb618e54fa53a1bef" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:19.139197 10266 raft_consensus.cc:3060] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.138870 10307 raft_consensus.cc:359] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.139637 10307 raft_consensus.cc:385] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.139925 10307 raft_consensus.cc:740] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.140352 10193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ea6be6d4734f0bb618e54fa53a1bef" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:19.145944 10193 raft_consensus.cc:3060] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.138376 10157 leader_election.cc:304] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8
I20260709 13:04:19.149438 10340 raft_consensus.cc:2804] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.149916 10340 raft_consensus.cc:493] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.150336 10340 raft_consensus.cc:3060] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.140447 10338 leader_election.cc:290] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:19.155756 10193 raft_consensus.cc:2468] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d4df224ed2e4fcfb865ab144a250fa8 in term 1.
I20260709 13:04:19.157472 10084 leader_election.cc:304] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c; no voters: 
I20260709 13:04:19.142820 10307 consensus_queue.cc:260] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.164500 10307 ts_tablet_manager.cc:1434] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:04:19.165153 10316 raft_consensus.cc:2804] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.165411 10307 tablet_bootstrap.cc:492] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c: Bootstrap starting.
I20260709 13:04:19.173987 10307 tablet_bootstrap.cc:654] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.176359 10311 tablet_bootstrap.cc:654] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.180274 10266 raft_consensus.cc:2468] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d4df224ed2e4fcfb865ab144a250fa8 in term 1.
I20260709 13:04:19.182796 10016 catalog_manager.cc:5697] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.183959 10316 raft_consensus.cc:697] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 LEADER]: Becoming Leader. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Running, Role: LEADER
I20260709 13:04:19.185390 10316 consensus_queue.cc:237] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.188855 10340 raft_consensus.cc:515] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.191960 10342 leader_election.cc:290] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 election: Requested vote from peers a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:19.192207 10118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:19.194172 10307 tablet_bootstrap.cc:492] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c: No bootstrap required, opened a new log
I20260709 13:04:19.194772 10307 ts_tablet_manager.cc:1403] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.002s
W20260709 13:04:19.195247 10157 leader_election.cc:343] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.198299 10307 raft_consensus.cc:359] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.199203 10307 raft_consensus.cc:385] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.200093 10307 raft_consensus.cc:740] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.202109 10308 tablet_bootstrap.cc:492] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c: No bootstrap required, opened a new log
I20260709 13:04:19.202539 10308 ts_tablet_manager.cc:1403] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c: Time spent bootstrapping tablet: real 0.090s	user 0.035s	sys 0.029s
I20260709 13:04:19.201049 10307 consensus_queue.cc:260] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.205471 10307 ts_tablet_manager.cc:1434] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 13:04:19.207360 10340 leader_election.cc:290] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:19.208483 10311 tablet_bootstrap.cc:492] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8: No bootstrap required, opened a new log
I20260709 13:04:19.208441 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:19.209153 10311 ts_tablet_manager.cc:1403] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.110s	user 0.016s	sys 0.002s
I20260709 13:04:19.209205 10266 raft_consensus.cc:3060] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.212605 10311 raft_consensus.cc:359] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.213155 10311 raft_consensus.cc:385] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.213399 10311 raft_consensus.cc:740] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.213724 10308 raft_consensus.cc:359] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.214042 10311 consensus_queue.cc:260] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.214421 10308 raft_consensus.cc:385] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.214787 10308 raft_consensus.cc:740] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.215484 10308 consensus_queue.cc:260] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.216373 10266 raft_consensus.cc:2468] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 1.
I20260709 13:04:19.217447 10308 ts_tablet_manager.cc:1434] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:04:19.217536 10157 leader_election.cc:304] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8
I20260709 13:04:19.218454 10308 tablet_bootstrap.cc:492] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c: Bootstrap starting.
I20260709 13:04:19.218827 10340 raft_consensus.cc:2804] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.219493 10340 raft_consensus.cc:697] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Becoming Leader. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:19.219370 10014 catalog_manager.cc:5697] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.220386 10340 consensus_queue.cc:237] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.224786 10308 tablet_bootstrap.cc:654] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.233697 10311 ts_tablet_manager.cc:1434] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:04:19.234788 10311 tablet_bootstrap.cc:492] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:19.239900 10014 catalog_manager.cc:5697] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c reported cstate change: term changed from 0 to 1, leader changed from <none> to a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.242955 10311 tablet_bootstrap.cc:654] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.247936 10308 tablet_bootstrap.cc:492] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c: No bootstrap required, opened a new log
I20260709 13:04:19.248390 10308 ts_tablet_manager.cc:1403] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c: Time spent bootstrapping tablet: real 0.030s	user 0.023s	sys 0.005s
I20260709 13:04:19.250589 10308 raft_consensus.cc:359] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.251277 10308 raft_consensus.cc:385] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.251566 10308 raft_consensus.cc:740] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.252146 10308 consensus_queue.cc:260] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.253787 10308 ts_tablet_manager.cc:1434] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:04:19.255308 10311 tablet_bootstrap.cc:492] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8: No bootstrap required, opened a new log
I20260709 13:04:19.255810 10311 ts_tablet_manager.cc:1403] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:04:19.257632 10311 raft_consensus.cc:359] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.258100 10311 raft_consensus.cc:385] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.258325 10311 raft_consensus.cc:740] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.258944 10311 consensus_queue.cc:260] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.260756 10311 ts_tablet_manager.cc:1434] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:19.261439 10311 tablet_bootstrap.cc:492] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:19.266723 10311 tablet_bootstrap.cc:654] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.270759 10311 tablet_bootstrap.cc:492] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8: No bootstrap required, opened a new log
I20260709 13:04:19.271119 10311 ts_tablet_manager.cc:1403] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:04:19.273084 10311 raft_consensus.cc:359] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.273530 10311 raft_consensus.cc:385] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.273751 10311 raft_consensus.cc:740] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.274245 10311 consensus_queue.cc:260] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.275643 10311 ts_tablet_manager.cc:1434] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:04:19.276341 10311 tablet_bootstrap.cc:492] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:19.280284 10311 tablet_bootstrap.cc:654] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.284006 10311 tablet_bootstrap.cc:492] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8: No bootstrap required, opened a new log
I20260709 13:04:19.284412 10311 ts_tablet_manager.cc:1403] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:19.286175 10311 raft_consensus.cc:359] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.286646 10311 raft_consensus.cc:385] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.286870 10311 raft_consensus.cc:740] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.287341 10311 consensus_queue.cc:260] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.288729 10311 ts_tablet_manager.cc:1434] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:19.305168 10316 raft_consensus.cc:493] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.305625 10316 raft_consensus.cc:515] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.307456 10316 leader_election.cc:290] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:19.308144 10193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
I20260709 13:04:19.308466 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:19.309314 10266 raft_consensus.cc:2393] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d4df224ed2e4fcfb865ab144a250fa8 in current term 1: Already voted for candidate a96cb1bb4a724cf48e91a3f40146db5c in this term.
I20260709 13:04:19.310146 10082 leader_election.cc:304] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8; no voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c
I20260709 13:04:19.310807 10316 raft_consensus.cc:3060] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.315860 10316 raft_consensus.cc:2749] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:19.339371 10118 raft_consensus.cc:3060] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.345580 10339 consensus_queue.cc:1048] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.355160 10340 consensus_queue.cc:1048] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.355161 10339 raft_consensus.cc:493] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.357034 10339 raft_consensus.cc:515] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.359179 10339 leader_election.cc:290] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:19.360261 10193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
I20260709 13:04:19.361433 10193 raft_consensus.cc:2393] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef618097776646d283d2da929e16499c in current term 1: Already voted for candidate 2d4df224ed2e4fcfb865ab144a250fa8 in this term.
I20260709 13:04:19.361752 10118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" is_pre_election: true
I20260709 13:04:19.363770 10231 leader_election.cc:304] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c
I20260709 13:04:19.365166 10339 raft_consensus.cc:3060] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.371057 10312 consensus_queue.cc:1048] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.377919 10339 raft_consensus.cc:2749] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:19.382555 10374 raft_consensus.cc:493] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.383028 10374 raft_consensus.cc:515] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.384641 10340 consensus_queue.cc:1048] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.385910 10374 leader_election.cc:290] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:19.389483 10194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c456d4b841a437e88c893fbe5a43f28" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
I20260709 13:04:19.390178 10194 raft_consensus.cc:2468] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 0.
I20260709 13:04:19.391027 10119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c456d4b841a437e88c893fbe5a43f28" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" is_pre_election: true
I20260709 13:04:19.391235 10233 leader_election.cc:304] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:19.391721 10119 raft_consensus.cc:2468] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 0.
I20260709 13:04:19.392163 10374 raft_consensus.cc:2804] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.392726 10374 raft_consensus.cc:493] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.393179 10374 raft_consensus.cc:3060] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.399976 10374 raft_consensus.cc:515] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.402215 10374 leader_election.cc:290] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:19.402343 10119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c456d4b841a437e88c893fbe5a43f28" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:19.403012 10119 raft_consensus.cc:3060] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.403232 10193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c456d4b841a437e88c893fbe5a43f28" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:19.403857 10193 raft_consensus.cc:3060] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.410279 10119 raft_consensus.cc:2468] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 1.
I20260709 13:04:19.410604 10193 raft_consensus.cc:2468] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 1.
I20260709 13:04:19.411742 10231 leader_election.cc:304] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:19.412405 10374 raft_consensus.cc:2804] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.412873 10374 raft_consensus.cc:697] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 1 LEADER]: Becoming Leader. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:19.413376 10316 consensus_queue.cc:1048] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.413673 10374 consensus_queue.cc:237] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.414871 10338 consensus_queue.cc:1048] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.427191 10014 catalog_manager.cc:5697] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c reported cstate change: term changed from 0 to 1, leader changed from <none> to ef618097776646d283d2da929e16499c (127.0.107.131). New cstate: current_term: 1 leader_uuid: "ef618097776646d283d2da929e16499c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:19.429493 10316 consensus_queue.cc:1048] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.441169 10314 consensus_queue.cc:1048] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.444537 10316 raft_consensus.cc:493] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.445168 10316 raft_consensus.cc:515] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.446442 10342 consensus_queue.cc:1048] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.447378 10316 leader_election.cc:290] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:19.448505 10267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:19.449311 10267 raft_consensus.cc:2393] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d4df224ed2e4fcfb865ab144a250fa8 in current term 1: Already voted for candidate a96cb1bb4a724cf48e91a3f40146db5c in this term.
I20260709 13:04:19.450330 10192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0" candidate_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
I20260709 13:04:19.453713 10084 leader_election.cc:304] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8; no voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c
I20260709 13:04:19.454571 10342 raft_consensus.cc:3060] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.462343 10342 raft_consensus.cc:2749] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:19.468901 10342 consensus_queue.cc:1048] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.485445 10314 raft_consensus.cc:493] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.485968 10314 raft_consensus.cc:515] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.487494 10314 leader_election.cc:290] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:19.488236 10119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d67e27ca3974a268ed08d072938f622" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" is_pre_election: true
I20260709 13:04:19.488598 10374 raft_consensus.cc:493] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.488698 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d67e27ca3974a268ed08d072938f622" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:19.488961 10119 raft_consensus.cc:2468] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 0.
I20260709 13:04:19.489143 10374 raft_consensus.cc:515] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.490130 10266 raft_consensus.cc:2468] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 0.
I20260709 13:04:19.490116 10157 leader_election.cc:304] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c; no voters: 
I20260709 13:04:19.491150 10314 raft_consensus.cc:2804] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.491235 10374 leader_election.cc:290] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:19.491580 10314 raft_consensus.cc:493] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.491962 10314 raft_consensus.cc:3060] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.492357 10192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d67e27ca3974a268ed08d072938f622" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
I20260709 13:04:19.492713 10119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d67e27ca3974a268ed08d072938f622" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" is_pre_election: true
I20260709 13:04:19.493336 10119 raft_consensus.cc:2468] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 0.
I20260709 13:04:19.494275 10231 leader_election.cc:304] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:19.495002 10374 raft_consensus.cc:2804] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.495333 10374 raft_consensus.cc:493] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.495697 10374 raft_consensus.cc:3060] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.497983 10314 raft_consensus.cc:515] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.499028 10192 raft_consensus.cc:2393] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef618097776646d283d2da929e16499c in current term 1: Already voted for candidate a96cb1bb4a724cf48e91a3f40146db5c in this term.
I20260709 13:04:19.500305 10314 leader_election.cc:290] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:19.501039 10119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d67e27ca3974a268ed08d072938f622" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:19.501328 10374 raft_consensus.cc:515] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.501670 10119 raft_consensus.cc:3060] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.502050 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d67e27ca3974a268ed08d072938f622" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:19.502857 10266 raft_consensus.cc:2393] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a96cb1bb4a724cf48e91a3f40146db5c in current term 1: Already voted for candidate ef618097776646d283d2da929e16499c in this term.
I20260709 13:04:19.503304 10374 leader_election.cc:290] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:19.504009 10118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d67e27ca3974a268ed08d072938f622" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:19.506042 10192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d67e27ca3974a268ed08d072938f622" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:19.506645 10192 raft_consensus.cc:2393] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef618097776646d283d2da929e16499c in current term 1: Already voted for candidate a96cb1bb4a724cf48e91a3f40146db5c in this term.
I20260709 13:04:19.507529 10233 leader_election.cc:304] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c
I20260709 13:04:19.507678 10119 raft_consensus.cc:2468] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 1.
I20260709 13:04:19.508325 10374 raft_consensus.cc:2749] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:19.508751 10157 leader_election.cc:304] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c; no voters: ef618097776646d283d2da929e16499c
I20260709 13:04:19.509506 10314 raft_consensus.cc:2804] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.509919 10314 raft_consensus.cc:697] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Becoming Leader. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:19.510672 10314 consensus_queue.cc:237] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.518091 10016 catalog_manager.cc:5697] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c reported cstate change: term changed from 0 to 1, leader changed from <none> to a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.602604 10342 consensus_queue.cc:1048] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.613603 10316 consensus_queue.cc:1048] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.658631 10314 raft_consensus.cc:493] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.659271 10314 raft_consensus.cc:515] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.661068 10314 leader_election.cc:290] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:19.661784 10119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b66c65d3f44836beeebe8c5450facb" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" is_pre_election: true
I20260709 13:04:19.662251 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b66c65d3f44836beeebe8c5450facb" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:19.662496 10119 raft_consensus.cc:2468] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 0.
I20260709 13:04:19.662932 10266 raft_consensus.cc:2468] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 0.
I20260709 13:04:19.663663 10157 leader_election.cc:304] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c; no voters: 
I20260709 13:04:19.664353 10314 raft_consensus.cc:2804] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.664719 10314 raft_consensus.cc:493] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.665004 10314 raft_consensus.cc:3060] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.669884 10314 raft_consensus.cc:515] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.671506 10314 leader_election.cc:290] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:19.672246 10119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b66c65d3f44836beeebe8c5450facb" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:19.672405 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b66c65d3f44836beeebe8c5450facb" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:19.672765 10119 raft_consensus.cc:3060] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.673007 10266 raft_consensus.cc:3060] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.677610 10266 raft_consensus.cc:2468] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 1.
I20260709 13:04:19.677603 10119 raft_consensus.cc:2468] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 1.
I20260709 13:04:19.678753 10157 leader_election.cc:304] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:19.679530 10314 raft_consensus.cc:2804] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.679930 10314 raft_consensus.cc:697] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Becoming Leader. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:19.680625 10314 consensus_queue.cc:237] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:19.687978 10016 catalog_manager.cc:5697] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c reported cstate change: term changed from 0 to 1, leader changed from <none> to a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130). New cstate: current_term: 1 leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.789320   430 ts_manager.cc:295] Set tserver state for 2d4df224ed2e4fcfb865ab144a250fa8 to MAINTENANCE_MODE
I20260709 13:04:19.790180   430 tablet_server.cc:179] TabletServer@127.0.107.129:0 shutting down...
W20260709 13:04:19.800911 10231 consensus_peers.cc:597] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:19.808676 10157 consensus_peers.cc:597] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:19.810515 10340 consensus_queue.cc:1048] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.827390   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:04:19.827576 10157 consensus_peers.cc:597] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:19.828418   430 tablet_replica.cc:333] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8: stopping tablet replica
I20260709 13:04:19.829291   430 raft_consensus.cc:2243] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.829808   430 raft_consensus.cc:2272] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.832080   430 tablet_replica.cc:333] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8: stopping tablet replica
I20260709 13:04:19.832654   430 raft_consensus.cc:2243] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.833127   430 raft_consensus.cc:2272] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.837147   430 tablet_replica.cc:333] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8: stopping tablet replica
I20260709 13:04:19.837697   430 raft_consensus.cc:2243] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.838024   430 raft_consensus.cc:2272] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.839751   430 tablet_replica.cc:333] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8: stopping tablet replica
I20260709 13:04:19.840224   430 raft_consensus.cc:2243] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.840574   430 raft_consensus.cc:2272] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.842935   430 tablet_replica.cc:333] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8: stopping tablet replica
I20260709 13:04:19.843621   430 raft_consensus.cc:2243] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:19.844400   430 raft_consensus.cc:2272] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.847446   430 tablet_replica.cc:333] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8: stopping tablet replica
I20260709 13:04:19.848202   430 raft_consensus.cc:2243] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.848738   430 raft_consensus.cc:2272] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.850473   430 tablet_replica.cc:333] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8: stopping tablet replica
I20260709 13:04:19.850929   430 raft_consensus.cc:2243] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.851284   430 raft_consensus.cc:2272] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.852937   430 tablet_replica.cc:333] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8: stopping tablet replica
I20260709 13:04:19.853416   430 raft_consensus.cc:2243] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:19.853813   430 raft_consensus.cc:2272] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.856077   430 tablet_replica.cc:333] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8: stopping tablet replica
I20260709 13:04:19.856642   430 raft_consensus.cc:2243] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:19.857391   430 raft_consensus.cc:2272] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:19.859500   430 tablet_replica.cc:333] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8: stopping tablet replica
I20260709 13:04:19.859975   430 raft_consensus.cc:2243] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:19.860744   430 raft_consensus.cc:2272] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:19.868254 10065 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:19.879336   430 tablet_server.cc:196] TabletServer@127.0.107.129:0 shutdown complete.
I20260709 13:04:19.937274 10374 consensus_queue.cc:1048] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:19.952425 10231 consensus_peers.cc:597] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:19.992818 10157 consensus_peers.cc:597] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.043334 10314 consensus_queue.cc:1048] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:20.059369 10157 consensus_peers.cc:597] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:20.107211 10314 consensus_queue.cc:1048] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:20.119896 10157 consensus_peers.cc:597] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:20.804862 10157 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111) [suppressed 169 similar messages]
W20260709 13:04:20.869253 10065 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:20.933790 10340 raft_consensus.cc:493] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d4df224ed2e4fcfb865ab144a250fa8)
I20260709 13:04:20.934468 10340 raft_consensus.cc:515] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:20.936353 10340 leader_election.cc:290] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:20.937849 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:20.939320 10374 raft_consensus.cc:493] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d4df224ed2e4fcfb865ab144a250fa8)
W20260709 13:04:20.939939 10157 leader_election.cc:336] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111)
I20260709 13:04:20.939828 10374 raft_consensus.cc:515] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:20.940482 10157 leader_election.cc:304] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8, ef618097776646d283d2da929e16499c
I20260709 13:04:20.941236 10340 raft_consensus.cc:2749] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:20.941954 10374 leader_election.cc:290] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:20.943087 10192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
I20260709 13:04:20.943851 10192 raft_consensus.cc:2468] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 1.
I20260709 13:04:20.945101 10233 leader_election.cc:304] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 
W20260709 13:04:20.945678 10231 leader_election.cc:336] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111)
I20260709 13:04:20.945775 10374 raft_consensus.cc:2804] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:20.946197 10374 raft_consensus.cc:493] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d4df224ed2e4fcfb865ab144a250fa8)
I20260709 13:04:20.946482 10374 raft_consensus.cc:3060] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.952137 10374 raft_consensus.cc:515] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:20.953619 10374 leader_election.cc:290] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:20.954627 10192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:20.955188 10192 raft_consensus.cc:3060] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:20.957161 10231 leader_election.cc:336] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111)
I20260709 13:04:20.960299 10192 raft_consensus.cc:2468] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 2.
I20260709 13:04:20.961378 10233 leader_election.cc:304] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8
I20260709 13:04:20.962210 10374 raft_consensus.cc:2804] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.963251 10374 raft_consensus.cc:697] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Becoming Leader. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:20.964107 10374 consensus_queue.cc:237] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:20.969609 10340 raft_consensus.cc:493] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d4df224ed2e4fcfb865ab144a250fa8)
I20260709 13:04:20.970175 10340 raft_consensus.cc:515] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:20.971802 10340 leader_election.cc:290] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:20.971285 10016 catalog_manager.cc:5697] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c reported cstate change: term changed from 1 to 2, leader changed from 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129) to ef618097776646d283d2da929e16499c (127.0.107.131). New cstate: current_term: 2 leader_uuid: "ef618097776646d283d2da929e16499c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.973357 10374 raft_consensus.cc:493] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d4df224ed2e4fcfb865ab144a250fa8)
I20260709 13:04:20.974052 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab79ea29a6484b329e1b0025fa9851b8" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:20.973881 10374 raft_consensus.cc:515] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:20.975478 10266 raft_consensus.cc:2468] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 1.
W20260709 13:04:20.975908 10157 leader_election.cc:336] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111)
I20260709 13:04:20.976794 10157 leader_election.cc:304] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8
I20260709 13:04:20.977545 10374 leader_election.cc:290] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:20.978247 10340 raft_consensus.cc:2804] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:20.978662 10340 raft_consensus.cc:493] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d4df224ed2e4fcfb865ab144a250fa8)
I20260709 13:04:20.979048 10340 raft_consensus.cc:3060] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.979715 10192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab79ea29a6484b329e1b0025fa9851b8" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
W20260709 13:04:20.981506 10231 leader_election.cc:336] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111)
I20260709 13:04:20.986689 10340 raft_consensus.cc:515] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:20.988010 10192 raft_consensus.cc:2393] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef618097776646d283d2da929e16499c in current term 2: Already voted for candidate a96cb1bb4a724cf48e91a3f40146db5c in this term.
I20260709 13:04:20.988941 10340 leader_election.cc:290] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:20.989966 10233 leader_election.cc:304] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c
I20260709 13:04:20.990257 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab79ea29a6484b329e1b0025fa9851b8" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:20.990680 10374 raft_consensus.cc:3060] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:20.993175 10157 leader_election.cc:336] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111)
I20260709 13:04:20.995930 10374 raft_consensus.cc:2749] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:21.003206 10266 raft_consensus.cc:2468] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 2.
I20260709 13:04:21.004832 10157 leader_election.cc:304] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8
I20260709 13:04:21.005569 10340 raft_consensus.cc:2804] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:21.006574 10340 raft_consensus.cc:697] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 LEADER]: Becoming Leader. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:21.007257 10340 consensus_queue.cc:237] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:21.014688 10016 catalog_manager.cc:5697] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c reported cstate change: term changed from 1 to 2, leader changed from 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129) to a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130). New cstate: current_term: 2 leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.113271 10340 raft_consensus.cc:493] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d4df224ed2e4fcfb865ab144a250fa8)
I20260709 13:04:21.113775 10340 raft_consensus.cc:515] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:21.115521 10340 leader_election.cc:290] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:21.117499 10374 raft_consensus.cc:493] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d4df224ed2e4fcfb865ab144a250fa8)
I20260709 13:04:21.117142 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ea6be6d4734f0bb618e54fa53a1bef" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c" is_pre_election: true
I20260709 13:04:21.118245 10374 raft_consensus.cc:515] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:21.119061 10266 raft_consensus.cc:2468] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 1.
W20260709 13:04:21.119300 10157 leader_election.cc:336] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111)
I20260709 13:04:21.120234 10374 leader_election.cc:290] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:21.120203 10157 leader_election.cc:304] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8
I20260709 13:04:21.121203 10340 raft_consensus.cc:2804] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:21.121580 10340 raft_consensus.cc:493] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d4df224ed2e4fcfb865ab144a250fa8)
I20260709 13:04:21.121966 10340 raft_consensus.cc:3060] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:21.121973 10192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ea6be6d4734f0bb618e54fa53a1bef" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" is_pre_election: true
W20260709 13:04:21.124234 10231 leader_election.cc:336] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111)
I20260709 13:04:21.128024 10340 raft_consensus.cc:515] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:21.129200 10192 raft_consensus.cc:2393] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef618097776646d283d2da929e16499c in current term 2: Already voted for candidate a96cb1bb4a724cf48e91a3f40146db5c in this term.
I20260709 13:04:21.130081 10340 leader_election.cc:290] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:21.131294 10233 leader_election.cc:304] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c
I20260709 13:04:21.131593 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ea6be6d4734f0bb618e54fa53a1bef" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:21.132113 10374 raft_consensus.cc:3060] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:21.133854 10157 leader_election.cc:336] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111)
I20260709 13:04:21.137508 10374 raft_consensus.cc:2749] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:21.142876 10266 raft_consensus.cc:2468] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 2.
I20260709 13:04:21.144466 10157 leader_election.cc:304] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 2d4df224ed2e4fcfb865ab144a250fa8
I20260709 13:04:21.145193 10404 raft_consensus.cc:2804] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:21.145659 10404 raft_consensus.cc:697] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 2 LEADER]: Becoming Leader. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:21.146387 10404 consensus_queue.cc:237] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:21.153561 10016 catalog_manager.cc:5697] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c reported cstate change: term changed from 1 to 2, leader changed from 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129) to a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130). New cstate: current_term: 2 leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:21.473569 10157 consensus_peers.cc:597] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.487015 10192 raft_consensus.cc:1275] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:21.489591 10374 consensus_queue.cc:1048] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:21.490420 10231 consensus_peers.cc:597] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:21.532348 10157 consensus_peers.cc:597] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:21.550127 10267 raft_consensus.cc:1275] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:21.551746 10340 consensus_queue.cc:1048] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:21.625182 10267 raft_consensus.cc:1275] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:21.626473 10340 consensus_queue.cc:1048] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:21.870500 10065 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:22.176396 10157 consensus_peers.cc:597] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.228497 10157 consensus_peers.cc:597] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.230716 10231 consensus_peers.cc:597] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.388562 10157 consensus_peers.cc:597] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.409551 10157 consensus_peers.cc:597] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.412490 10231 consensus_peers.cc:597] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.535379 10157 consensus_peers.cc:597] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:22.871506 10065 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:23.696915 10231 consensus_peers.cc:597] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:23.872381 10065 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:24.012153 10157 consensus_peers.cc:597] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:24.033928 10157 consensus_peers.cc:597] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:24.284157 10231 consensus_peers.cc:597] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:24.561769 10157 consensus_peers.cc:597] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:24.577291 10157 consensus_peers.cc:597] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:24.717535 10157 consensus_peers.cc:597] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:24.980927 10065 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:24.994367 10231 consensus_peers.cc:597] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:25.127751   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:25.139026 10157 consensus_peers.cc:597] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.139505 10157 consensus_peers.cc:597] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:25.145998 10419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:25.146258 10418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:25.155040 10421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:25.155820   430 server_base.cc:1061] running on GCE node
I20260709 13:04:25.157315   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:25.157595   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:25.157735   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602265157724 us; error 0 us; skew 500 ppm
I20260709 13:04:25.158226   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:25.161947   430 webserver.cc:533] Webserver started at http://127.0.107.129:33643/ using document root <none> and password file <none>
I20260709 13:04:25.162499   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:25.162704   430 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:04:25.166693   430 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:04:25.170856 10426 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:25.171767   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:04:25.172091   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-0-root
uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
format_stamp: "Formatted at 2026-07-09 13:04:17 on dist-test-slave-th5x"
I20260709 13:04:25.172495   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601969268282-430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:25.184866   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:25.186230   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:25.187913   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:25.192039 10433 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:04:25.239291   430 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:04:25.239733   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.049s	user 0.003s	sys 0.000s
I20260709 13:04:25.240062   430 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:04:25.245679 10433 tablet_bootstrap.cc:492] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:25.258208 10433 tablet_bootstrap.cc:492] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.258881 10433 tablet_bootstrap.cc:492] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap complete.
I20260709 13:04:25.259516 10433 ts_tablet_manager.cc:1403] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.007s
I20260709 13:04:25.261817 10433 raft_consensus.cc:359] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.262356 10433 raft_consensus.cc:740] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.263136 10433 consensus_queue.cc:260] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.265504 10433 ts_tablet_manager.cc:1434] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:04:25.266157 10433 tablet_bootstrap.cc:492] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:25.278822 10433 tablet_bootstrap.cc:492] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.279518   430 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:04:25.279693 10433 tablet_bootstrap.cc:492] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap complete.
I20260709 13:04:25.279847   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.040s	user 0.037s	sys 0.003s
I20260709 13:04:25.280489 10433 ts_tablet_manager.cc:1403] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:04:25.282563 10433 raft_consensus.cc:359] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.283083 10433 raft_consensus.cc:740] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.283766 10433 consensus_queue.cc:260] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.285265 10433 ts_tablet_manager.cc:1434] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:25.285964 10433 tablet_bootstrap.cc:492] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:25.299952 10433 tablet_bootstrap.cc:492] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.300976 10433 tablet_bootstrap.cc:492] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap complete.
I20260709 13:04:25.301589 10433 ts_tablet_manager.cc:1403] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:04:25.303820 10433 raft_consensus.cc:359] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.304616 10433 raft_consensus.cc:740] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.305320 10433 consensus_queue.cc:260] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.307010 10433 ts_tablet_manager.cc:1434] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:04:25.307760 10433 tablet_bootstrap.cc:492] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:25.319332 10433 tablet_bootstrap.cc:492] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.320175 10433 tablet_bootstrap.cc:492] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap complete.
I20260709 13:04:25.320848 10433 ts_tablet_manager.cc:1403] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:04:25.322853 10433 raft_consensus.cc:359] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.324424 10433 raft_consensus.cc:740] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.325184 10433 consensus_queue.cc:260] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.327111 10433 ts_tablet_manager.cc:1434] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:04:25.327824 10433 tablet_bootstrap.cc:492] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:25.339178 10433 tablet_bootstrap.cc:492] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.339982 10433 tablet_bootstrap.cc:492] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap complete.
I20260709 13:04:25.340514 10433 ts_tablet_manager.cc:1403] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:04:25.341787   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.129:39665
I20260709 13:04:25.341920 10495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.129:39665 every 8 connection(s)
I20260709 13:04:25.342623 10433 raft_consensus.cc:359] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.343197 10433 raft_consensus.cc:740] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.343951 10433 consensus_queue.cc:260] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.346104 10433 ts_tablet_manager.cc:1434] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:04:25.346773 10433 tablet_bootstrap.cc:492] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:25.359537   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:25.364456 10433 tablet_bootstrap.cc:492] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.365548 10433 tablet_bootstrap.cc:492] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap complete.
I20260709 13:04:25.366088 10433 ts_tablet_manager.cc:1403] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:04:25.368098 10433 raft_consensus.cc:359] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:25.368588 10433 raft_consensus.cc:740] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.369244 10433 consensus_queue.cc:260] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:25.371062 10433 ts_tablet_manager.cc:1434] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:04:25.371941 10433 tablet_bootstrap.cc:492] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:25.375451 10496 heartbeater.cc:344] Connected to a master server at 127.0.107.190:43291
I20260709 13:04:25.376065 10496 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:25.377151 10496 heartbeater.cc:507] Master 127.0.107.190:43291 requested a full tablet report, sending...
I20260709 13:04:25.387028 10014 ts_manager.cc:194] Re-registered known tserver with Master: 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665)
I20260709 13:04:25.391121 10194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ca175cf9b084d8bb9713f3dabf93183"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
mode: GRACEFUL
new_leader_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:51640
I20260709 13:04:25.391923 10194 raft_consensus.cc:606] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Received request to transfer leadership to TS ef618097776646d283d2da929e16499c
I20260709 13:04:25.393635 10433 tablet_bootstrap.cc:492] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.394567 10433 tablet_bootstrap.cc:492] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap complete.
I20260709 13:04:25.395125 10433 ts_tablet_manager.cc:1403] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.009s
I20260709 13:04:25.395116 10194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
mode: GRACEFUL
new_leader_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:51640
I20260709 13:04:25.395905 10194 raft_consensus.cc:606] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Received request to transfer leadership to TS ef618097776646d283d2da929e16499c
I20260709 13:04:25.397833 10433 raft_consensus.cc:359] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.398413 10433 raft_consensus.cc:740] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.398694 10194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
mode: GRACEFUL
new_leader_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:51640
I20260709 13:04:25.399118 10433 consensus_queue.cc:260] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.399389 10194 raft_consensus.cc:606] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Received request to transfer leadership to TS ef618097776646d283d2da929e16499c
I20260709 13:04:25.400815   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:25.401163 10433 ts_tablet_manager.cc:1434] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:25.401512   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:25.401985 10433 tablet_bootstrap.cc:492] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:25.402335   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:25.403337 10014 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35864
I20260709 13:04:25.406610 10496 heartbeater.cc:499] Master 127.0.107.190:43291 was elected leader, sending a full tablet report...
I20260709 13:04:25.416648 10433 tablet_bootstrap.cc:492] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.417377 10433 tablet_bootstrap.cc:492] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap complete.
I20260709 13:04:25.417894 10433 ts_tablet_manager.cc:1403] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:04:25.419795 10433 raft_consensus.cc:359] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.420321 10433 raft_consensus.cc:740] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.420831 10433 consensus_queue.cc:260] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.422318 10433 ts_tablet_manager.cc:1434] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:04:25.422912 10433 tablet_bootstrap.cc:492] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:25.432241 10433 tablet_bootstrap.cc:492] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.432864 10433 tablet_bootstrap.cc:492] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap complete.
I20260709 13:04:25.433362 10433 ts_tablet_manager.cc:1403] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:25.435582 10433 raft_consensus.cc:359] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.436066 10433 raft_consensus.cc:740] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.436618 10433 consensus_queue.cc:260] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.438026 10433 ts_tablet_manager.cc:1434] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:25.438787 10433 tablet_bootstrap.cc:492] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap starting.
I20260709 13:04:25.451377 10433 tablet_bootstrap.cc:492] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:25.452185 10433 tablet_bootstrap.cc:492] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8: Bootstrap complete.
I20260709 13:04:25.452749 10433 ts_tablet_manager.cc:1403] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.006s
I20260709 13:04:25.454715 10433 raft_consensus.cc:359] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.455243 10433 raft_consensus.cc:740] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d4df224ed2e4fcfb865ab144a250fa8, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.455976 10433 consensus_queue.cc:260] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.458088 10433 ts_tablet_manager.cc:1434] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:04:25.459520 10470 raft_consensus.cc:3060] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.488531 10340 raft_consensus.cc:993] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c: : Instructing follower ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:25.489112 10417 raft_consensus.cc:1081] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Signalling peer ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:25.490444 10267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ca175cf9b084d8bb9713f3dabf93183"
dest_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:59300
I20260709 13:04:25.490868 10267 raft_consensus.cc:493] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:25.491106 10267 raft_consensus.cc:3060] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.496791 10267 raft_consensus.cc:515] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.498283 10267 leader_election.cc:290] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:25.499228 10470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca175cf9b084d8bb9713f3dabf93183" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:25.499428 10194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca175cf9b084d8bb9713f3dabf93183" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:25.499955 10470 raft_consensus.cc:3060] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.500108 10194 raft_consensus.cc:3055] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:25.500505 10194 raft_consensus.cc:740] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:25.501396 10194 consensus_queue.cc:260] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.502835 10194 raft_consensus.cc:3060] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.509079 10470 raft_consensus.cc:2468] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 2.
I20260709 13:04:25.510478 10231 leader_election.cc:304] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:25.511332 10374 raft_consensus.cc:2804] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:25.512146 10194 raft_consensus.cc:2468] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 2.
I20260709 13:04:25.512619 10374 raft_consensus.cc:697] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Becoming Leader. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:25.513754 10374 consensus_queue.cc:237] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.521731 10014 catalog_manager.cc:5697] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c reported cstate change: term changed from 1 to 2, leader changed from a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130) to ef618097776646d283d2da929e16499c (127.0.107.131). New cstate: current_term: 2 leader_uuid: "ef618097776646d283d2da929e16499c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.673002 10468 raft_consensus.cc:3060] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.674431 10340 raft_consensus.cc:993] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c: : Instructing follower ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:25.674934 10417 raft_consensus.cc:1081] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Signalling peer ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:25.676424 10267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0"
dest_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:59300
I20260709 13:04:25.676996 10267 raft_consensus.cc:493] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:25.677357 10267 raft_consensus.cc:3060] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.685323 10267 raft_consensus.cc:515] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.687065 10267 leader_election.cc:290] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:25.687891 10468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:25.688012 10194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:25.688570 10468 raft_consensus.cc:3060] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.688681 10194 raft_consensus.cc:3055] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:25.689117 10194 raft_consensus.cc:740] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:25.689891 10194 consensus_queue.cc:260] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.690933 10194 raft_consensus.cc:3060] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.698853 10194 raft_consensus.cc:2468] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 2.
I20260709 13:04:25.700103 10233 leader_election.cc:304] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:25.700989 10374 raft_consensus.cc:2804] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:25.699517 10468 raft_consensus.cc:2468] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 2.
I20260709 13:04:25.701560 10374 raft_consensus.cc:697] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Becoming Leader. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:25.702550 10374 consensus_queue.cc:237] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.711035 10014 catalog_manager.cc:5697] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c reported cstate change: term changed from 1 to 2, leader changed from a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130) to ef618097776646d283d2da929e16499c (127.0.107.131). New cstate: current_term: 2 leader_uuid: "ef618097776646d283d2da929e16499c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.829082 10340 raft_consensus.cc:993] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c: : Instructing follower ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:25.829595 10417 raft_consensus.cc:1081] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Signalling peer ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:25.830956 10267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626"
dest_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:59300
I20260709 13:04:25.831377 10267 raft_consensus.cc:493] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:25.831707 10267 raft_consensus.cc:3060] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.838083 10267 raft_consensus.cc:515] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.840301 10267 leader_election.cc:290] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:25.840552 10468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:25.841147 10194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:25.841602 10468 raft_consensus.cc:3060] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.841704 10194 raft_consensus.cc:3055] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:25.842104 10194 raft_consensus.cc:740] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:25.842927 10194 consensus_queue.cc:260] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.844237 10194 raft_consensus.cc:3060] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.848749 10468 raft_consensus.cc:2468] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 2.
I20260709 13:04:25.849972 10231 leader_election.cc:304] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:25.850689 10374 raft_consensus.cc:2804] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:25.851060 10194 raft_consensus.cc:2468] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 2.
I20260709 13:04:25.851205 10374 raft_consensus.cc:697] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Becoming Leader. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:25.852301 10374 consensus_queue.cc:237] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:25.859054 10014 catalog_manager.cc:5697] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c reported cstate change: term changed from 1 to 2, leader changed from a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130) to ef618097776646d283d2da929e16499c (127.0.107.131). New cstate: current_term: 2 leader_uuid: "ef618097776646d283d2da929e16499c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.908555 10468 raft_consensus.cc:3060] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.925431 10468 raft_consensus.cc:1275] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.926784 10374 consensus_queue.cc:1048] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.936728 10194 raft_consensus.cc:1275] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.938381 10511 consensus_queue.cc:1048] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:25.982013 10065 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:26.122325 10289 debug-util.cc:398] Leaking SignalData structure 0x7b08000a71c0 after lost signal to thread 433
W20260709 13:04:26.125079 10289 debug-util.cc:398] Leaking SignalData structure 0x7b0800008d00 after lost signal to thread 10292
I20260709 13:04:26.228585 10194 raft_consensus.cc:1275] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.230108 10526 consensus_queue.cc:1048] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.240628 10468 raft_consensus.cc:1275] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.242192 10374 consensus_queue.cc:1048] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:26.356963 10194 raft_consensus.cc:1275] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.358385 10374 consensus_queue.cc:1048] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.368502 10468 raft_consensus.cc:1275] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:26.370267 10526 consensus_queue.cc:1048] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:26.412413   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:26.431383 10267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b15a041a533c4404bddfa23568ea6947"
dest_uuid: "ef618097776646d283d2da929e16499c"
mode: GRACEFUL
new_leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
 from {username='slave'} at 127.0.0.1:42346
I20260709 13:04:26.431979 10267 raft_consensus.cc:606] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 1 LEADER]: Received request to transfer leadership to TS a96cb1bb4a724cf48e91a3f40146db5c
I20260709 13:04:26.435629 10267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626"
dest_uuid: "ef618097776646d283d2da929e16499c"
mode: GRACEFUL
new_leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
 from {username='slave'} at 127.0.0.1:42346
I20260709 13:04:26.436161 10267 raft_consensus.cc:606] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Received request to transfer leadership to TS a96cb1bb4a724cf48e91a3f40146db5c
I20260709 13:04:26.437561   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:26.438184   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:26.438912   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:26.710094 10511 raft_consensus.cc:993] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c: : Instructing follower a96cb1bb4a724cf48e91a3f40146db5c to start an election
I20260709 13:04:26.710588 10374 raft_consensus.cc:1081] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 1 LEADER]: Signalling peer a96cb1bb4a724cf48e91a3f40146db5c to start an election
I20260709 13:04:26.711993 10194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b15a041a533c4404bddfa23568ea6947"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
 from {username='slave'} at 127.0.0.1:32982
I20260709 13:04:26.712450 10194 raft_consensus.cc:493] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:26.712740 10194 raft_consensus.cc:3060] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.717963 10194 raft_consensus.cc:515] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:26.719626 10194 leader_election.cc:290] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 election: Requested vote from peers ef618097776646d283d2da929e16499c (127.0.107.131:46305), 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665)
I20260709 13:04:26.720351 10267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15a041a533c4404bddfa23568ea6947" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:26.720680 10468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b15a041a533c4404bddfa23568ea6947" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:26.721057 10267 raft_consensus.cc:3055] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:26.721336 10468 raft_consensus.cc:3060] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.721467 10267 raft_consensus.cc:740] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:26.722465 10267 consensus_queue.cc:260] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:26.724001 10267 raft_consensus.cc:3060] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:26.730530 10468 raft_consensus.cc:2468] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 2.
I20260709 13:04:26.734760 10267 raft_consensus.cc:2468] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 2.
I20260709 13:04:26.735009 10157 leader_election.cc:304] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c; no voters: 
I20260709 13:04:26.738301 10417 raft_consensus.cc:2804] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:26.738933 10417 raft_consensus.cc:697] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 LEADER]: Becoming Leader. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:26.739940 10417 consensus_queue.cc:237] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } }
I20260709 13:04:26.748425 10015 catalog_manager.cc:5697] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c reported cstate change: term changed from 1 to 2, leader changed from ef618097776646d283d2da929e16499c (127.0.107.131) to a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130). New cstate: current_term: 2 leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:26.938786 10535 raft_consensus.cc:993] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c: : Instructing follower a96cb1bb4a724cf48e91a3f40146db5c to start an election
I20260709 13:04:26.939301 10535 raft_consensus.cc:1081] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Signalling peer a96cb1bb4a724cf48e91a3f40146db5c to start an election
W20260709 13:04:27.070439 10065 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:27.110652 10194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
 from {username='slave'} at 127.0.0.1:32982
I20260709 13:04:27.111300 10194 raft_consensus.cc:493] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.111655 10194 raft_consensus.cc:3060] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.116662 10194 raft_consensus.cc:515] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:27.118870 10194 leader_election.cc:290] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 3 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:27.120631 10267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:27.121953 10267 raft_consensus.cc:3055] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:27.120754 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:27.123922 10467 raft_consensus.cc:3060] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.124851 10266 raft_consensus.cc:1275] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:27.126118 10267 raft_consensus.cc:740] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:27.126370 10521 consensus_queue.cc:1048] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:27.127120 10267 consensus_queue.cc:260] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:27.128473 10267 raft_consensus.cc:3060] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.131737 10467 raft_consensus.cc:2468] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 3.
I20260709 13:04:27.134538 10157 leader_election.cc:304] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c; no voters: 
I20260709 13:04:27.135874 10521 raft_consensus.cc:2804] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.135075 10267 raft_consensus.cc:2468] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 3.
I20260709 13:04:27.139679 10521 raft_consensus.cc:697] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Becoming Leader. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:27.140512 10521 consensus_queue.cc:237] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:27.157495 10016 catalog_manager.cc:5697] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c reported cstate change: term changed from 2 to 3, leader changed from ef618097776646d283d2da929e16499c (127.0.107.131) to a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130). New cstate: current_term: 3 leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.166793 10467 raft_consensus.cc:1275] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:27.168313 10521 consensus_queue.cc:1048] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:27.466843   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:27.474388 10194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d67e27ca3974a268ed08d072938f622"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
mode: GRACEFUL
new_leader_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:51640
I20260709 13:04:27.474925 10194 raft_consensus.cc:606] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Received request to transfer leadership to TS ef618097776646d283d2da929e16499c
I20260709 13:04:27.477560 10194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab79ea29a6484b329e1b0025fa9851b8"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
mode: GRACEFUL
new_leader_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:51640
I20260709 13:04:27.478020 10194 raft_consensus.cc:606] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 LEADER]: Received request to transfer leadership to TS ef618097776646d283d2da929e16499c
I20260709 13:04:27.480962 10266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656"
dest_uuid: "ef618097776646d283d2da929e16499c"
mode: GRACEFUL
new_leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
 from {username='slave'} at 127.0.0.1:42346
I20260709 13:04:27.481424 10266 raft_consensus.cc:606] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Received request to transfer leadership to TS a96cb1bb4a724cf48e91a3f40146db5c
I20260709 13:04:27.482604   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:27.483075   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:27.483649   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:27.540812 10541 raft_consensus.cc:993] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c: : Instructing follower ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:27.541463 10521 raft_consensus.cc:1081] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 LEADER]: Signalling peer ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:27.543118 10266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab79ea29a6484b329e1b0025fa9851b8"
dest_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:59300
I20260709 13:04:27.543632 10266 raft_consensus.cc:493] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.543926 10266 raft_consensus.cc:3060] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.549624 10266 raft_consensus.cc:515] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:27.549921 10267 raft_consensus.cc:1275] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:27.551319 10521 consensus_queue.cc:1048] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:27.552309 10468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab79ea29a6484b329e1b0025fa9851b8" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:27.552445 10194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab79ea29a6484b329e1b0025fa9851b8" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:27.552645 10266 leader_election.cc:290] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 3 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:27.552958 10468 raft_consensus.cc:3060] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.553051 10194 raft_consensus.cc:3055] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:27.553519 10194 raft_consensus.cc:740] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:27.554343 10194 consensus_queue.cc:260] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:27.555624 10194 raft_consensus.cc:3060] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.561908 10468 raft_consensus.cc:2468] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 3.
I20260709 13:04:27.563304 10231 leader_election.cc:304] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:27.565514 10374 raft_consensus.cc:2804] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.565948 10374 raft_consensus.cc:697] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 3 LEADER]: Becoming Leader. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:27.566991 10374 consensus_queue.cc:237] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:27.565753 10194 raft_consensus.cc:2468] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 3.
I20260709 13:04:27.574815 10467 raft_consensus.cc:1275] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:27.576452 10541 consensus_queue.cc:1048] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:27.583250 10015 catalog_manager.cc:5697] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c reported cstate change: term changed from 2 to 3, leader changed from a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130) to ef618097776646d283d2da929e16499c (127.0.107.131). New cstate: current_term: 3 leader_uuid: "ef618097776646d283d2da929e16499c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:27.589597 10374 raft_consensus.cc:993] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c: : Instructing follower a96cb1bb4a724cf48e91a3f40146db5c to start an election
I20260709 13:04:27.590112 10374 raft_consensus.cc:1081] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Signalling peer a96cb1bb4a724cf48e91a3f40146db5c to start an election
I20260709 13:04:27.592285 10194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
 from {username='slave'} at 127.0.0.1:32982
I20260709 13:04:27.592865 10194 raft_consensus.cc:493] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.593232 10194 raft_consensus.cc:3060] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.607322 10194 raft_consensus.cc:515] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:27.609469 10194 leader_election.cc:290] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 3 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:27.610473 10468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:27.610944 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:27.611109 10468 raft_consensus.cc:3060] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.611533 10266 raft_consensus.cc:3055] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:27.612010 10266 raft_consensus.cc:740] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:27.612960 10266 consensus_queue.cc:260] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:27.614279 10266 raft_consensus.cc:3060] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:27.618121 10468 raft_consensus.cc:2468] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 3.
I20260709 13:04:27.619321 10157 leader_election.cc:304] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c; no voters: 
I20260709 13:04:27.620049 10541 raft_consensus.cc:2804] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:27.620544 10541 raft_consensus.cc:697] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Becoming Leader. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:27.620659 10266 raft_consensus.cc:2468] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 3.
I20260709 13:04:27.621536 10541 consensus_queue.cc:237] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:27.629133 10015 catalog_manager.cc:5697] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c reported cstate change: term changed from 2 to 3, leader changed from ef618097776646d283d2da929e16499c (127.0.107.131) to a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130). New cstate: current_term: 3 leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.658576 10417 raft_consensus.cc:993] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c: : Instructing follower ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:27.659080 10541 raft_consensus.cc:1081] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Signalling peer ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:27.660499 10266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d67e27ca3974a268ed08d072938f622"
dest_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:59300
I20260709 13:04:27.660923 10266 raft_consensus.cc:493] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.661180 10266 raft_consensus.cc:3060] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:27.665431 10266 raft_consensus.cc:515] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:27.667580 10266 leader_election.cc:290] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:27.668309 10468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d67e27ca3974a268ed08d072938f622" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:27.668547 10192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d67e27ca3974a268ed08d072938f622" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:27.668994 10468 raft_consensus.cc:3060] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:27.669180 10192 raft_consensus.cc:3055] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:27.669580 10192 raft_consensus.cc:740] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:27.672756 10192 consensus_queue.cc:260] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:27.673856 10192 raft_consensus.cc:3060] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:27.679595 10468 raft_consensus.cc:2468] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 2.
I20260709 13:04:27.680543 10192 raft_consensus.cc:2468] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 2.
I20260709 13:04:27.680819 10231 leader_election.cc:304] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:27.681910 10374 raft_consensus.cc:2804] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:27.682964 10374 raft_consensus.cc:697] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Becoming Leader. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:27.683647 10374 consensus_queue.cc:237] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:27.691556 10015 catalog_manager.cc:5697] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c reported cstate change: term changed from 1 to 2, leader changed from a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130) to ef618097776646d283d2da929e16499c (127.0.107.131). New cstate: current_term: 2 leader_uuid: "ef618097776646d283d2da929e16499c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:27.994714 10048 debug-util.cc:398] Leaking SignalData structure 0x7b0800147340 after lost signal to thread 433
W20260709 13:04:27.995816 10048 debug-util.cc:398] Leaking SignalData structure 0x7b08002f1d60 after lost signal to thread 10051
W20260709 13:04:27.996888 10048 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6c80 after lost signal to thread 10218
W20260709 13:04:27.997819 10048 debug-util.cc:398] Leaking SignalData structure 0x7b08001ed260 after lost signal to thread 10292
W20260709 13:04:27.998800 10048 debug-util.cc:398] Leaking SignalData structure 0x7b08000f8800 after lost signal to thread 10495
I20260709 13:04:28.013450 10467 raft_consensus.cc:1275] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.015074 10541 consensus_queue.cc:1048] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:28.033447 10266 raft_consensus.cc:1275] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.035058 10521 consensus_queue.cc:1048] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:28.071554 10065 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:28.113509 10192 raft_consensus.cc:1275] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.115141 10526 consensus_queue.cc:1048] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:28.130981 10467 raft_consensus.cc:1275] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:28.133288 10526 consensus_queue.cc:1048] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:28.168613 10192 raft_consensus.cc:1275] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.170163 10526 consensus_queue.cc:1048] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:28.186131 10467 raft_consensus.cc:1275] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:28.197871 10374 consensus_queue.cc:1048] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:28.490074   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:28.501168 10266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c456d4b841a437e88c893fbe5a43f28"
dest_uuid: "ef618097776646d283d2da929e16499c"
mode: GRACEFUL
new_leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
 from {username='slave'} at 127.0.0.1:42346
I20260709 13:04:28.501801 10266 raft_consensus.cc:606] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 1 LEADER]: Received request to transfer leadership to TS a96cb1bb4a724cf48e91a3f40146db5c
I20260709 13:04:28.504915 10192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
mode: GRACEFUL
new_leader_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:51640
I20260709 13:04:28.505544 10192 raft_consensus.cc:606] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Received request to transfer leadership to TS ef618097776646d283d2da929e16499c
I20260709 13:04:28.508489 10266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0"
dest_uuid: "ef618097776646d283d2da929e16499c"
mode: GRACEFUL
new_leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
 from {username='slave'} at 127.0.0.1:42346
I20260709 13:04:28.509065 10266 raft_consensus.cc:606] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Received request to transfer leadership to TS a96cb1bb4a724cf48e91a3f40146db5c
I20260709 13:04:28.510417   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:28.511128   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:28.511948   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:28.518168 10541 raft_consensus.cc:993] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c: : Instructing follower ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:28.518801 10541 raft_consensus.cc:1081] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Signalling peer ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:28.521552 10266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626"
dest_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:59300
I20260709 13:04:28.522223 10266 raft_consensus.cc:493] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.522680 10266 raft_consensus.cc:3060] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:28.531121 10266 raft_consensus.cc:515] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:28.533993 10266 leader_election.cc:290] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 4 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:28.534579 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:28.535303 10467 raft_consensus.cc:3060] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:28.536369 10192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e073e16f87fa4f4797eb1706d3e1b626" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:28.537055 10192 raft_consensus.cc:3055] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:28.537424 10192 raft_consensus.cc:740] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:28.538359 10192 consensus_queue.cc:260] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:28.539847 10192 raft_consensus.cc:3060] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:28.543545 10467 raft_consensus.cc:2468] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 4.
I20260709 13:04:28.545099 10231 leader_election.cc:304] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:28.546115 10526 raft_consensus.cc:2804] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:28.546624 10526 raft_consensus.cc:697] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 4 LEADER]: Becoming Leader. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:28.547504 10526 consensus_queue.cc:237] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:28.556941 10016 catalog_manager.cc:5697] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c reported cstate change: term changed from 3 to 4, leader changed from a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130) to ef618097776646d283d2da929e16499c (127.0.107.131). New cstate: current_term: 4 leader_uuid: "ef618097776646d283d2da929e16499c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.558429 10192 raft_consensus.cc:2468] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 4.
I20260709 13:04:28.649399 10555 raft_consensus.cc:993] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c: : Instructing follower a96cb1bb4a724cf48e91a3f40146db5c to start an election
I20260709 13:04:28.649983 10526 raft_consensus.cc:1081] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Signalling peer a96cb1bb4a724cf48e91a3f40146db5c to start an election
I20260709 13:04:28.651708 10192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
 from {username='slave'} at 127.0.0.1:32982
I20260709 13:04:28.652351 10192 raft_consensus.cc:493] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.652741 10192 raft_consensus.cc:3060] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.665624 10192 raft_consensus.cc:515] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:28.669267 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:28.669838 10266 raft_consensus.cc:3055] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:28.670121 10266 raft_consensus.cc:740] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:28.670229 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f955cd662e8d4fe0aeb79a0438ae21e0" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:28.671003 10467 raft_consensus.cc:3060] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.670878 10266 consensus_queue.cc:260] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:28.672025 10266 raft_consensus.cc:3060] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.679934 10192 leader_election.cc:290] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 3 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:28.680675 10467 raft_consensus.cc:2468] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 3.
I20260709 13:04:28.681430 10266 raft_consensus.cc:2468] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 3.
I20260709 13:04:28.682991 10157 leader_election.cc:304] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a96cb1bb4a724cf48e91a3f40146db5c, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:28.683996 10521 raft_consensus.cc:2804] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:28.684435 10521 raft_consensus.cc:697] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Becoming Leader. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:28.685325 10521 consensus_queue.cc:237] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:28.698521 10015 catalog_manager.cc:5697] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c reported cstate change: term changed from 2 to 3, leader changed from ef618097776646d283d2da929e16499c (127.0.107.131) to a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130). New cstate: current_term: 3 leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.953152 10555 raft_consensus.cc:993] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c: : Instructing follower a96cb1bb4a724cf48e91a3f40146db5c to start an election
I20260709 13:04:28.953672 10555 raft_consensus.cc:1081] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 1 LEADER]: Signalling peer a96cb1bb4a724cf48e91a3f40146db5c to start an election
I20260709 13:04:28.955639 10192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c456d4b841a437e88c893fbe5a43f28"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
 from {username='slave'} at 127.0.0.1:32982
I20260709 13:04:28.956241 10192 raft_consensus.cc:493] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.956627 10192 raft_consensus.cc:3060] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.965204 10192 raft_consensus.cc:515] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:28.967532 10192 leader_election.cc:290] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:28.968875 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c456d4b841a437e88c893fbe5a43f28" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:28.969322 10266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c456d4b841a437e88c893fbe5a43f28" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:28.970142 10266 raft_consensus.cc:3055] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:28.970499 10266 raft_consensus.cc:740] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:28.973347 10467 raft_consensus.cc:3060] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.971835 10266 consensus_queue.cc:260] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:28.978333 10266 raft_consensus.cc:3060] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.981015 10467 raft_consensus.cc:2468] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 2.
I20260709 13:04:28.982332 10157 leader_election.cc:304] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c; no voters: 
I20260709 13:04:28.983175 10521 raft_consensus.cc:2804] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:28.983716 10521 raft_consensus.cc:697] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 LEADER]: Becoming Leader. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:28.984758 10521 consensus_queue.cc:237] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:28.989463 10266 raft_consensus.cc:2468] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 2.
I20260709 13:04:29.001710 10015 catalog_manager.cc:5697] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c reported cstate change: term changed from 1 to 2, leader changed from ef618097776646d283d2da929e16499c (127.0.107.131) to a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130). New cstate: current_term: 2 leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:29.072700 10065 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:29.121378 10192 raft_consensus.cc:1275] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 4 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:29.123512 10374 consensus_queue.cc:1048] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:29.128706 10467 raft_consensus.cc:1275] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 4 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:29.132211 10526 consensus_queue.cc:1048] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:29.136909 10468 raft_consensus.cc:1275] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:29.139061 10521 consensus_queue.cc:1048] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:29.185158 10266 raft_consensus.cc:1275] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:29.186975 10521 consensus_queue.cc:1048] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.442641 10467 raft_consensus.cc:1275] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.444289 10521 consensus_queue.cc:1048] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.459878 10266 raft_consensus.cc:1275] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.462162 10417 consensus_queue.cc:1048] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.522570   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:29.535077 10192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18b66c65d3f44836beeebe8c5450facb"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
mode: GRACEFUL
new_leader_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:51640
I20260709 13:04:29.535861 10192 raft_consensus.cc:606] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Received request to transfer leadership to TS ef618097776646d283d2da929e16499c
I20260709 13:04:29.538792 10267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ca175cf9b084d8bb9713f3dabf93183"
dest_uuid: "ef618097776646d283d2da929e16499c"
mode: GRACEFUL
new_leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
 from {username='slave'} at 127.0.0.1:42346
I20260709 13:04:29.539315 10267 raft_consensus.cc:606] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Received request to transfer leadership to TS a96cb1bb4a724cf48e91a3f40146db5c
I20260709 13:04:29.542210 10192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
mode: GRACEFUL
new_leader_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:51640
I20260709 13:04:29.542876 10192 raft_consensus.cc:606] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Received request to transfer leadership to TS ef618097776646d283d2da929e16499c
I20260709 13:04:29.544247   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:29.544991   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:29.545781   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:29.653893 10572 raft_consensus.cc:993] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c: : Instructing follower a96cb1bb4a724cf48e91a3f40146db5c to start an election
I20260709 13:04:29.654568 10374 raft_consensus.cc:1081] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Signalling peer a96cb1bb4a724cf48e91a3f40146db5c to start an election
I20260709 13:04:29.656345 10192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ca175cf9b084d8bb9713f3dabf93183"
dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
 from {username='slave'} at 127.0.0.1:32982
I20260709 13:04:29.657048 10192 raft_consensus.cc:493] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.657490 10192 raft_consensus.cc:3060] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:29.666940 10192 raft_consensus.cc:515] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:29.669454 10192 leader_election.cc:290] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 3 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), ef618097776646d283d2da929e16499c (127.0.107.131:46305)
I20260709 13:04:29.670228 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca175cf9b084d8bb9713f3dabf93183" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:29.670643 10267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ca175cf9b084d8bb9713f3dabf93183" candidate_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef618097776646d283d2da929e16499c"
I20260709 13:04:29.670898 10467 raft_consensus.cc:3060] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:29.671370 10267 raft_consensus.cc:3055] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:29.671820 10267 raft_consensus.cc:740] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:29.672755 10267 consensus_queue.cc:260] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:29.674389 10267 raft_consensus.cc:3060] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:29.676934 10467 raft_consensus.cc:2468] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 3.
I20260709 13:04:29.678092 10157 leader_election.cc:304] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, a96cb1bb4a724cf48e91a3f40146db5c; no voters: 
I20260709 13:04:29.678834 10576 raft_consensus.cc:2804] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:29.679260 10576 raft_consensus.cc:697] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Becoming Leader. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:29.680351 10576 consensus_queue.cc:237] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:29.683494 10267 raft_consensus.cc:2468] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96cb1bb4a724cf48e91a3f40146db5c in term 3.
I20260709 13:04:29.688413 10015 catalog_manager.cc:5697] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c reported cstate change: term changed from 2 to 3, leader changed from ef618097776646d283d2da929e16499c (127.0.107.131) to a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130). New cstate: current_term: 3 leader_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.925009 10417 raft_consensus.cc:993] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c: : Instructing follower ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:29.925570 10576 raft_consensus.cc:1081] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Signalling peer ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:29.926949 10267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656"
dest_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:59300
I20260709 13:04:29.927474 10267 raft_consensus.cc:493] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.927912 10267 raft_consensus.cc:3060] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:29.934283 10267 raft_consensus.cc:515] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:29.935775 10267 leader_election.cc:290] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 4 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:29.936888 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:29.937732 10467 raft_consensus.cc:3060] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:29.937107 10192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af5b3ac2356141c7b489fe22a01b3656" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:29.940718 10192 raft_consensus.cc:3055] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:29.941059 10192 raft_consensus.cc:740] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:29.941768 10192 consensus_queue.cc:260] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:29.943038 10192 raft_consensus.cc:3060] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:29.946540 10467 raft_consensus.cc:2468] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 4.
I20260709 13:04:29.948160 10192 raft_consensus.cc:2468] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 4.
I20260709 13:04:29.948094 10231 leader_election.cc:304] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:29.949141 10374 raft_consensus.cc:2804] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:29.949620 10374 raft_consensus.cc:697] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 4 LEADER]: Becoming Leader. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:29.950322 10374 consensus_queue.cc:237] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:29.957718 10015 catalog_manager.cc:5697] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c reported cstate change: term changed from 3 to 4, leader changed from a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130) to ef618097776646d283d2da929e16499c (127.0.107.131). New cstate: current_term: 4 leader_uuid: "ef618097776646d283d2da929e16499c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:30.073719 10065 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:30.108731 10467 raft_consensus.cc:1275] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:30.110174 10576 consensus_queue.cc:1048] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:30.125597 10417 raft_consensus.cc:993] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c: : Instructing follower ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:30.132329 10267 raft_consensus.cc:1275] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Refusing update from remote peer a96cb1bb4a724cf48e91a3f40146db5c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:30.139551 10576 raft_consensus.cc:1081] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Signalling peer ef618097776646d283d2da929e16499c to start an election
I20260709 13:04:30.140784 10576 consensus_queue.cc:1048] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:30.144138 10267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18b66c65d3f44836beeebe8c5450facb"
dest_uuid: "ef618097776646d283d2da929e16499c"
 from {username='slave'} at 127.0.0.1:59300
I20260709 13:04:30.144691 10267 raft_consensus.cc:493] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.145044 10267 raft_consensus.cc:3060] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.153389 10267 raft_consensus.cc:515] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:30.156833 10467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b66c65d3f44836beeebe8c5450facb" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d4df224ed2e4fcfb865ab144a250fa8"
I20260709 13:04:30.157502 10467 raft_consensus.cc:3060] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.158016 10267 leader_election.cc:290] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 election: Requested vote from peers 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665), a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273)
I20260709 13:04:30.158402 10192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b66c65d3f44836beeebe8c5450facb" candidate_uuid: "ef618097776646d283d2da929e16499c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96cb1bb4a724cf48e91a3f40146db5c"
I20260709 13:04:30.158944 10192 raft_consensus.cc:3055] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:30.159225 10192 raft_consensus.cc:740] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a96cb1bb4a724cf48e91a3f40146db5c, State: Running, Role: LEADER
I20260709 13:04:30.160377 10192 consensus_queue.cc:260] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:30.161608 10192 raft_consensus.cc:3060] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.166329 10467 raft_consensus.cc:2468] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 2.
I20260709 13:04:30.167678 10231 leader_election.cc:304] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d4df224ed2e4fcfb865ab144a250fa8, ef618097776646d283d2da929e16499c; no voters: 
I20260709 13:04:30.168412 10374 raft_consensus.cc:2804] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:30.168964 10374 raft_consensus.cc:697] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [term 2 LEADER]: Becoming Leader. State: Replica: ef618097776646d283d2da929e16499c, State: Running, Role: LEADER
I20260709 13:04:30.170099 10192 raft_consensus.cc:2468] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef618097776646d283d2da929e16499c in term 2.
I20260709 13:04:30.169974 10374 consensus_queue.cc:237] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } }
I20260709 13:04:30.180428 10015 catalog_manager.cc:5697] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c reported cstate change: term changed from 1 to 2, leader changed from a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130) to ef618097776646d283d2da929e16499c (127.0.107.131). New cstate: current_term: 2 leader_uuid: "ef618097776646d283d2da929e16499c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef618097776646d283d2da929e16499c" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46305 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.380030 10192 raft_consensus.cc:1275] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 4 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:30.381458 10572 consensus_queue.cc:1048] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:30.390933 10467 raft_consensus.cc:1275] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 4 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:30.392511 10572 consensus_queue.cc:1048] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:30.557000   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:30.568746 10192 raft_consensus.cc:1275] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:30.570372 10572 consensus_queue.cc:1048] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96cb1bb4a724cf48e91a3f40146db5c" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 40273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:30.581773 10467 raft_consensus.cc:1275] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Refusing update from remote peer ef618097776646d283d2da929e16499c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:30.585520 10374 consensus_queue.cc:1048] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d4df224ed2e4fcfb865ab144a250fa8" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 39665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:30.597574   430 tablet_server.cc:179] TabletServer@127.0.107.129:39665 shutting down...
W20260709 13:04:30.608179 10157 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 100 similar messages]
W20260709 13:04:30.613672 10157 consensus_peers.cc:597] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.627204   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:30.628000   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.628901   430 raft_consensus.cc:2243] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.629462   430 raft_consensus.cc:2272] T ab79ea29a6484b329e1b0025fa9851b8 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.633868   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.634770   430 raft_consensus.cc:2243] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.635437   430 raft_consensus.cc:2272] T 9c456d4b841a437e88c893fbe5a43f28 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.638120   430 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:30.638864 10231 consensus_peers.cc:597] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.638923   430 raft_consensus.cc:2243] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.639696   430 raft_consensus.cc:2272] T d6ea6be6d4734f0bb618e54fa53a1bef P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.642539   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.643491   430 raft_consensus.cc:2243] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.644070   430 raft_consensus.cc:2272] T 6ca175cf9b084d8bb9713f3dabf93183 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.647280   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.648157   430 raft_consensus.cc:2243] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.648680   430 raft_consensus.cc:2272] T e073e16f87fa4f4797eb1706d3e1b626 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.651070   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.651726   430 raft_consensus.cc:2243] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.652136   430 raft_consensus.cc:2272] T af5b3ac2356141c7b489fe22a01b3656 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.654433   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.654994   430 raft_consensus.cc:2243] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.655503   430 raft_consensus.cc:2272] T 18b66c65d3f44836beeebe8c5450facb P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.657886   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.658420   430 raft_consensus.cc:2243] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.658847   430 raft_consensus.cc:2272] T 4d67e27ca3974a268ed08d072938f622 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.660674   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.661170   430 raft_consensus.cc:2243] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.661569   430 raft_consensus.cc:2272] T b15a041a533c4404bddfa23568ea6947 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.663335   430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:30.663863   430 raft_consensus.cc:2243] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.664247   430 raft_consensus.cc:2272] T f955cd662e8d4fe0aeb79a0438ae21e0 P 2d4df224ed2e4fcfb865ab144a250fa8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.693436   430 tablet_server.cc:196] TabletServer@127.0.107.129:39665 shutdown complete.
I20260709 13:04:30.713333   430 tablet_server.cc:179] TabletServer@127.0.107.130:0 shutting down...
W20260709 13:04:30.724411 10233 consensus_peers.cc:597] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c -> Peer a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273): Couldn't send request to peer a96cb1bb4a724cf48e91a3f40146db5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:30.728216 10233 consensus_peers.cc:597] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c -> Peer a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273): Couldn't send request to peer a96cb1bb4a724cf48e91a3f40146db5c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.752662   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:30.753487   430 tablet_replica.cc:333] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c: stopping tablet replica
I20260709 13:04:30.754534   430 raft_consensus.cc:2243] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.755080   430 raft_consensus.cc:2272] T 18b66c65d3f44836beeebe8c5450facb P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.758047   430 tablet_replica.cc:333] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c: stopping tablet replica
I20260709 13:04:30.758630   430 raft_consensus.cc:2243] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.759028   430 raft_consensus.cc:2272] T 4d67e27ca3974a268ed08d072938f622 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.761087   430 tablet_replica.cc:333] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c: stopping tablet replica
I20260709 13:04:30.761703   430 raft_consensus.cc:2243] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.762092   430 raft_consensus.cc:2272] T af5b3ac2356141c7b489fe22a01b3656 P a96cb1bb4a724cf48e91a3f40146db5c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.764771   430 tablet_replica.cc:333] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c: stopping tablet replica
I20260709 13:04:30.765409   430 raft_consensus.cc:2243] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.766121   430 raft_consensus.cc:2272] T 9c456d4b841a437e88c893fbe5a43f28 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.768146   430 tablet_replica.cc:333] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c: stopping tablet replica
I20260709 13:04:30.768678   430 raft_consensus.cc:2243] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.769070   430 raft_consensus.cc:2272] T e073e16f87fa4f4797eb1706d3e1b626 P a96cb1bb4a724cf48e91a3f40146db5c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.771117   430 tablet_replica.cc:333] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c: stopping tablet replica
I20260709 13:04:30.771660   430 raft_consensus.cc:2243] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.772380   430 raft_consensus.cc:2272] T f955cd662e8d4fe0aeb79a0438ae21e0 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.774377   430 tablet_replica.cc:333] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c: stopping tablet replica
I20260709 13:04:30.774879   430 raft_consensus.cc:2243] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.775611   430 raft_consensus.cc:2272] T b15a041a533c4404bddfa23568ea6947 P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.777606   430 tablet_replica.cc:333] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c: stopping tablet replica
I20260709 13:04:30.778141   430 raft_consensus.cc:2243] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.778595   430 raft_consensus.cc:2272] T ab79ea29a6484b329e1b0025fa9851b8 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.780704   430 tablet_replica.cc:333] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c: stopping tablet replica
I20260709 13:04:30.781198   430 raft_consensus.cc:2243] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.781893   430 raft_consensus.cc:2272] T d6ea6be6d4734f0bb618e54fa53a1bef P a96cb1bb4a724cf48e91a3f40146db5c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.783972   430 tablet_replica.cc:333] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c: stopping tablet replica
I20260709 13:04:30.784479   430 raft_consensus.cc:2243] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.785158   430 raft_consensus.cc:2272] T 6ca175cf9b084d8bb9713f3dabf93183 P a96cb1bb4a724cf48e91a3f40146db5c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:30.809340 10231 consensus_peers.cc:597] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.817233   430 tablet_server.cc:196] TabletServer@127.0.107.130:0 shutdown complete.
I20260709 13:04:30.844168   430 tablet_server.cc:179] TabletServer@127.0.107.131:0 shutting down...
W20260709 13:04:30.850165 10231 consensus_peers.cc:597] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c -> Peer 2d4df224ed2e4fcfb865ab144a250fa8 (127.0.107.129:39665): Couldn't send request to peer 2d4df224ed2e4fcfb865ab144a250fa8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:39665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:30.860142 10233 consensus_peers.cc:597] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c -> Peer a96cb1bb4a724cf48e91a3f40146db5c (127.0.107.130:40273): Couldn't send request to peer a96cb1bb4a724cf48e91a3f40146db5c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:40273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:30.876855   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:30.877679   430 tablet_replica.cc:333] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c: stopping tablet replica
I20260709 13:04:30.878502   430 raft_consensus.cc:2243] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.879320   430 raft_consensus.cc:2272] T af5b3ac2356141c7b489fe22a01b3656 P ef618097776646d283d2da929e16499c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.881951   430 tablet_replica.cc:333] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c: stopping tablet replica
I20260709 13:04:30.882594   430 raft_consensus.cc:2243] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.882995   430 raft_consensus.cc:2272] T 9c456d4b841a437e88c893fbe5a43f28 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.885141   430 tablet_replica.cc:333] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c: stopping tablet replica
I20260709 13:04:30.885758   430 raft_consensus.cc:2243] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.886510   430 raft_consensus.cc:2272] T 18b66c65d3f44836beeebe8c5450facb P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.888885   430 tablet_replica.cc:333] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c: stopping tablet replica
I20260709 13:04:30.889405   430 raft_consensus.cc:2243] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.890159   430 raft_consensus.cc:2272] T 4d67e27ca3974a268ed08d072938f622 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.892186   430 tablet_replica.cc:333] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c: stopping tablet replica
I20260709 13:04:30.892732   430 raft_consensus.cc:2243] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.893152   430 raft_consensus.cc:2272] T d6ea6be6d4734f0bb618e54fa53a1bef P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.895036   430 tablet_replica.cc:333] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c: stopping tablet replica
I20260709 13:04:30.895666   430 raft_consensus.cc:2243] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.896066   430 raft_consensus.cc:2272] T 6ca175cf9b084d8bb9713f3dabf93183 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.898499   430 tablet_replica.cc:333] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c: stopping tablet replica
I20260709 13:04:30.899052   430 raft_consensus.cc:2243] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.899837   430 raft_consensus.cc:2272] T ab79ea29a6484b329e1b0025fa9851b8 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.901909   430 tablet_replica.cc:333] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c: stopping tablet replica
I20260709 13:04:30.902431   430 raft_consensus.cc:2243] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.902808   430 raft_consensus.cc:2272] T b15a041a533c4404bddfa23568ea6947 P ef618097776646d283d2da929e16499c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.905165   430 tablet_replica.cc:333] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c: stopping tablet replica
I20260709 13:04:30.905642   430 raft_consensus.cc:2243] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.906025   430 raft_consensus.cc:2272] T f955cd662e8d4fe0aeb79a0438ae21e0 P ef618097776646d283d2da929e16499c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.908062   430 tablet_replica.cc:333] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c: stopping tablet replica
I20260709 13:04:30.908535   430 raft_consensus.cc:2243] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.909215   430 raft_consensus.cc:2272] T e073e16f87fa4f4797eb1706d3e1b626 P ef618097776646d283d2da929e16499c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.960839   430 tablet_server.cc:196] TabletServer@127.0.107.131:0 shutdown complete.
I20260709 13:04:30.990303   430 master.cc:562] Master@127.0.107.190:43291 shutting down...
I20260709 13:04:31.025552   430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:31.026270   430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:31.026712   430 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4dfc51f8e12e4ccb9a9484426f618630: stopping tablet replica
I20260709 13:04:31.581171   430 master.cc:584] Master@127.0.107.190:43291 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13906 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:04:31.642238   430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.190:40509
I20260709 13:04:31.643492   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:31.649533 10604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:31.649668 10603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:31.650573 10606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:31.652133   430 server_base.cc:1061] running on GCE node
I20260709 13:04:31.653128   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:31.653303   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:31.653475   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602271653456 us; error 0 us; skew 500 ppm
I20260709 13:04:31.654057   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:31.656575   430 webserver.cc:533] Webserver started at http://127.0.107.190:39663/ using document root <none> and password file <none>
I20260709 13:04:31.657064   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:31.657259   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:31.657553   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:31.658778   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/master-0-root/instance:
uuid: "6b9f277ed4224a22897dfe953c07a132"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-th5x"
I20260709 13:04:31.663172   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:31.667059 10611 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.667896   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:31.668183   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/master-0-root
uuid: "6b9f277ed4224a22897dfe953c07a132"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-th5x"
I20260709 13:04:31.668499   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:31.677524   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:31.678689   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:31.718760   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.190:40509
I20260709 13:04:31.718880 10662 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.190:40509 every 8 connection(s)
I20260709 13:04:31.722811 10663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:31.735241 10663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132: Bootstrap starting.
I20260709 13:04:31.740196 10663 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.744405 10663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132: No bootstrap required, opened a new log
I20260709 13:04:31.746759 10663 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b9f277ed4224a22897dfe953c07a132" member_type: VOTER }
I20260709 13:04:31.747228 10663 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.747548 10663 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b9f277ed4224a22897dfe953c07a132, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.748147 10663 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b9f277ed4224a22897dfe953c07a132" member_type: VOTER }
I20260709 13:04:31.748610 10663 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:31.748840 10663 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:31.749166 10663 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.754006 10663 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b9f277ed4224a22897dfe953c07a132" member_type: VOTER }
I20260709 13:04:31.754545 10663 leader_election.cc:304] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b9f277ed4224a22897dfe953c07a132; no voters: 
I20260709 13:04:31.755854 10663 leader_election.cc:290] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:31.756361 10666 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.757891 10666 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [term 1 LEADER]: Becoming Leader. State: Replica: 6b9f277ed4224a22897dfe953c07a132, State: Running, Role: LEADER
I20260709 13:04:31.758695 10666 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b9f277ed4224a22897dfe953c07a132" member_type: VOTER }
I20260709 13:04:31.758881 10663 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:31.766754 10668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b9f277ed4224a22897dfe953c07a132. Latest consensus state: current_term: 1 leader_uuid: "6b9f277ed4224a22897dfe953c07a132" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b9f277ed4224a22897dfe953c07a132" member_type: VOTER } }
I20260709 13:04:31.766935 10667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b9f277ed4224a22897dfe953c07a132" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b9f277ed4224a22897dfe953c07a132" member_type: VOTER } }
I20260709 13:04:31.767340 10668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:31.767774 10667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:31.769706 10675 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:31.777331 10675 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:31.778338   430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:31.786401 10675 catalog_manager.cc:1383] Generated new cluster ID: e84e93b6c92c4e788a7578a499ef8f2e
I20260709 13:04:31.786659 10675 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:31.801630 10675 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:31.803056 10675 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:31.817512 10675 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132: Generated new TSK 0
I20260709 13:04:31.818118 10675 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:31.845706   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:31.852190 10684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:31.853447 10685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:31.854984 10687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:31.855345   430 server_base.cc:1061] running on GCE node
I20260709 13:04:31.856334   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:31.856519   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:31.856647   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602271856635 us; error 0 us; skew 500 ppm
I20260709 13:04:31.857144   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:31.859324   430 webserver.cc:533] Webserver started at http://127.0.107.129:34505/ using document root <none> and password file <none>
I20260709 13:04:31.859835   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:31.860033   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:31.860244   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:31.861550   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-0-root/instance:
uuid: "71564e30312f4ced842375c5cbeca7ca"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-th5x"
I20260709 13:04:31.866094   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:31.869659 10692 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.870615   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:31.870954   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-0-root
uuid: "71564e30312f4ced842375c5cbeca7ca"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-th5x"
I20260709 13:04:31.871263   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:31.881384   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:31.882550   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:31.884037   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:31.886346   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:31.886575   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.886812   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:31.886991   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.929314   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.129:42231
I20260709 13:04:31.929445 10754 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.129:42231 every 8 connection(s)
I20260709 13:04:31.934319   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:31.942842 10759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:31.944147 10760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:31.947384 10762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:31.948112 10755 heartbeater.cc:344] Connected to a master server at 127.0.107.190:40509
I20260709 13:04:31.948341   430 server_base.cc:1061] running on GCE node
I20260709 13:04:31.948638 10755 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:31.950402 10755 heartbeater.cc:507] Master 127.0.107.190:40509 requested a full tablet report, sending...
I20260709 13:04:31.950589   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:31.950894   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:31.951071   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602271951057 us; error 0 us; skew 500 ppm
I20260709 13:04:31.951767   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:31.952894 10628 ts_manager.cc:194] Registered new tserver with Master: 71564e30312f4ced842375c5cbeca7ca (127.0.107.129:42231)
I20260709 13:04:31.954684   430 webserver.cc:533] Webserver started at http://127.0.107.130:36173/ using document root <none> and password file <none>
I20260709 13:04:31.955395   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:31.955646   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:31.955678 10628 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46912
I20260709 13:04:31.956049   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:31.957496   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-1-root/instance:
uuid: "ac4d8cda76df407abde8be9a1d9ec0d9"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-th5x"
I20260709 13:04:31.961972   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:04:31.965404 10767 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:31.966120   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:04:31.966437   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-1-root
uuid: "ac4d8cda76df407abde8be9a1d9ec0d9"
format_stamp: "Formatted at 2026-07-09 13:04:31 on dist-test-slave-th5x"
I20260709 13:04:31.966702   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:31.995255   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:31.996500   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:31.997979   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:32.000279   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:32.000452   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:32.000748   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:32.000905   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:32.041702   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.130:46483
I20260709 13:04:32.041790 10829 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.130:46483 every 8 connection(s)
I20260709 13:04:32.046684   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:32.054382 10833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:32.055835 10834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:32.057850   430 server_base.cc:1061] running on GCE node
W20260709 13:04:32.058408 10836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:32.059041 10830 heartbeater.cc:344] Connected to a master server at 127.0.107.190:40509
I20260709 13:04:32.059454   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:32.059474 10830 heartbeater.cc:461] Registering TS with master...
W20260709 13:04:32.059775   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:32.060019   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602272059998 us; error 0 us; skew 500 ppm
I20260709 13:04:32.060530 10830 heartbeater.cc:507] Master 127.0.107.190:40509 requested a full tablet report, sending...
I20260709 13:04:32.060665   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:32.062602 10628 ts_manager.cc:194] Registered new tserver with Master: ac4d8cda76df407abde8be9a1d9ec0d9 (127.0.107.130:46483)
I20260709 13:04:32.063270   430 webserver.cc:533] Webserver started at http://127.0.107.131:46151/ using document root <none> and password file <none>
I20260709 13:04:32.063910   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:32.064102   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:32.064157 10628 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46924
I20260709 13:04:32.064378   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:32.065937   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-2-root/instance:
uuid: "21db410dc3804a1e86dc12df298bfabc"
format_stamp: "Formatted at 2026-07-09 13:04:32 on dist-test-slave-th5x"
I20260709 13:04:32.070622   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:32.074218 10841 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:32.075255   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:32.075654   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-2-root
uuid: "21db410dc3804a1e86dc12df298bfabc"
format_stamp: "Formatted at 2026-07-09 13:04:32 on dist-test-slave-th5x"
I20260709 13:04:32.076045   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601969268282-430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:32.098323   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:32.099506   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:32.100879   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:32.103132   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:32.103307   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:32.103616   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:32.103760   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:32.147811   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.131:43391
I20260709 13:04:32.147921 10903 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.131:43391 every 8 connection(s)
I20260709 13:04:32.163133 10904 heartbeater.cc:344] Connected to a master server at 127.0.107.190:40509
I20260709 13:04:32.163600 10904 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:32.164387 10904 heartbeater.cc:507] Master 127.0.107.190:40509 requested a full tablet report, sending...
I20260709 13:04:32.166699 10628 ts_manager.cc:194] Registered new tserver with Master: 21db410dc3804a1e86dc12df298bfabc (127.0.107.131:43391)
I20260709 13:04:32.166848   430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015922364s
I20260709 13:04:32.168678 10628 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46936
I20260709 13:04:32.195228 10628 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46946:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:32.197397 10628 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:32.243304 10720 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8f07ef122e46e8b71c0ee7b1a56779 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4c21daac6a7a4679bb828b6675d09f53]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:32.245050 10720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8f07ef122e46e8b71c0ee7b1a56779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.247258 10719 tablet_service.cc:1511] Processing CreateTablet for tablet 302ab0974b224ba287d59371e7ccb2d9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4c21daac6a7a4679bb828b6675d09f53]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:32.248696 10719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302ab0974b224ba287d59371e7ccb2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.260684 10869 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8f07ef122e46e8b71c0ee7b1a56779 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4c21daac6a7a4679bb828b6675d09f53]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:32.261277 10868 tablet_service.cc:1511] Processing CreateTablet for tablet 302ab0974b224ba287d59371e7ccb2d9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4c21daac6a7a4679bb828b6675d09f53]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:32.262149 10869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8f07ef122e46e8b71c0ee7b1a56779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.262840 10868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302ab0974b224ba287d59371e7ccb2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.271117 10919 tablet_bootstrap.cc:492] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca: Bootstrap starting.
I20260709 13:04:32.272629 10794 tablet_service.cc:1511] Processing CreateTablet for tablet 302ab0974b224ba287d59371e7ccb2d9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4c21daac6a7a4679bb828b6675d09f53]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:32.274012 10794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302ab0974b224ba287d59371e7ccb2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.275795 10795 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8f07ef122e46e8b71c0ee7b1a56779 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4c21daac6a7a4679bb828b6675d09f53]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:32.277105 10795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8f07ef122e46e8b71c0ee7b1a56779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.278811 10919 tablet_bootstrap.cc:654] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.290872 10919 tablet_bootstrap.cc:492] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca: No bootstrap required, opened a new log
I20260709 13:04:32.291393 10919 ts_tablet_manager.cc:1403] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.012s
I20260709 13:04:32.294380 10919 raft_consensus.cc:359] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } }
I20260709 13:04:32.295228 10919 raft_consensus.cc:385] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.295822 10919 raft_consensus.cc:740] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71564e30312f4ced842375c5cbeca7ca, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.296909 10921 tablet_bootstrap.cc:492] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc: Bootstrap starting.
I20260709 13:04:32.296619 10919 consensus_queue.cc:260] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } }
I20260709 13:04:32.306041 10919 ts_tablet_manager.cc:1434] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.005s
I20260709 13:04:32.306835 10755 heartbeater.cc:499] Master 127.0.107.190:40509 was elected leader, sending a full tablet report...
I20260709 13:04:32.308269 10923 tablet_bootstrap.cc:492] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9: Bootstrap starting.
I20260709 13:04:32.308954 10921 tablet_bootstrap.cc:654] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.309402 10919 tablet_bootstrap.cc:492] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca: Bootstrap starting.
I20260709 13:04:32.316690 10919 tablet_bootstrap.cc:654] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.316751 10923 tablet_bootstrap.cc:654] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.327013 10921 tablet_bootstrap.cc:492] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc: No bootstrap required, opened a new log
I20260709 13:04:32.327251 10923 tablet_bootstrap.cc:492] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9: No bootstrap required, opened a new log
I20260709 13:04:32.327530 10921 ts_tablet_manager.cc:1403] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.017s
I20260709 13:04:32.327828 10923 ts_tablet_manager.cc:1403] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.009s
I20260709 13:04:32.328059 10919 tablet_bootstrap.cc:492] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca: No bootstrap required, opened a new log
I20260709 13:04:32.328603 10919 ts_tablet_manager.cc:1403] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 13:04:32.330271 10923 raft_consensus.cc:359] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.330856 10923 raft_consensus.cc:385] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.331248 10923 raft_consensus.cc:740] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4d8cda76df407abde8be9a1d9ec0d9, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.330761 10921 raft_consensus.cc:359] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } }
I20260709 13:04:32.331704 10921 raft_consensus.cc:385] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.331374 10919 raft_consensus.cc:359] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.332072 10921 raft_consensus.cc:740] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21db410dc3804a1e86dc12df298bfabc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.332226 10919 raft_consensus.cc:385] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.332737 10919 raft_consensus.cc:740] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71564e30312f4ced842375c5cbeca7ca, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.332089 10923 consensus_queue.cc:260] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.333073 10921 consensus_queue.cc:260] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } }
I20260709 13:04:32.333470 10919 consensus_queue.cc:260] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.334686 10830 heartbeater.cc:499] Master 127.0.107.190:40509 was elected leader, sending a full tablet report...
I20260709 13:04:32.335702 10923 ts_tablet_manager.cc:1434] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:04:32.335813 10919 ts_tablet_manager.cc:1434] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:04:32.337169 10923 tablet_bootstrap.cc:492] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9: Bootstrap starting.
I20260709 13:04:32.345082 10904 heartbeater.cc:499] Master 127.0.107.190:40509 was elected leader, sending a full tablet report...
I20260709 13:04:32.345621 10921 ts_tablet_manager.cc:1434] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.011s
I20260709 13:04:32.346521 10923 tablet_bootstrap.cc:654] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.346735 10921 tablet_bootstrap.cc:492] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc: Bootstrap starting.
I20260709 13:04:32.355141 10921 tablet_bootstrap.cc:654] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.356061 10923 tablet_bootstrap.cc:492] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9: No bootstrap required, opened a new log
I20260709 13:04:32.356606 10923 ts_tablet_manager.cc:1403] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.009s
I20260709 13:04:32.359535 10923 raft_consensus.cc:359] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } }
I20260709 13:04:32.360332 10923 raft_consensus.cc:385] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.360644 10923 raft_consensus.cc:740] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4d8cda76df407abde8be9a1d9ec0d9, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.361425 10923 consensus_queue.cc:260] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } }
I20260709 13:04:32.363313 10923 ts_tablet_manager.cc:1434] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:04:32.365733 10921 tablet_bootstrap.cc:492] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc: No bootstrap required, opened a new log
I20260709 13:04:32.366180 10921 ts_tablet_manager.cc:1403] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.010s
I20260709 13:04:32.368678 10921 raft_consensus.cc:359] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.369395 10921 raft_consensus.cc:385] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.369688 10921 raft_consensus.cc:740] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21db410dc3804a1e86dc12df298bfabc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.370441 10921 consensus_queue.cc:260] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.372629 10921 ts_tablet_manager.cc:1434] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:04:32.483626 10927 raft_consensus.cc:493] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.484193 10927 raft_consensus.cc:515] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.486429 10927 leader_election.cc:290] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71564e30312f4ced842375c5cbeca7ca (127.0.107.129:42231), 21db410dc3804a1e86dc12df298bfabc (127.0.107.131:43391)
I20260709 13:04:32.496099 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302ab0974b224ba287d59371e7ccb2d9" candidate_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71564e30312f4ced842375c5cbeca7ca" is_pre_election: true
I20260709 13:04:32.496855 10730 raft_consensus.cc:2468] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4d8cda76df407abde8be9a1d9ec0d9 in term 0.
I20260709 13:04:32.497540 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302ab0974b224ba287d59371e7ccb2d9" candidate_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21db410dc3804a1e86dc12df298bfabc" is_pre_election: true
I20260709 13:04:32.498131 10879 raft_consensus.cc:2468] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4d8cda76df407abde8be9a1d9ec0d9 in term 0.
I20260709 13:04:32.498164 10770 leader_election.cc:304] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71564e30312f4ced842375c5cbeca7ca, ac4d8cda76df407abde8be9a1d9ec0d9; no voters: 
I20260709 13:04:32.499127 10927 raft_consensus.cc:2804] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.499511 10927 raft_consensus.cc:493] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.499806 10927 raft_consensus.cc:3060] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.505230 10927 raft_consensus.cc:515] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.506711 10927 leader_election.cc:290] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [CANDIDATE]: Term 1 election: Requested vote from peers 71564e30312f4ced842375c5cbeca7ca (127.0.107.129:42231), 21db410dc3804a1e86dc12df298bfabc (127.0.107.131:43391)
I20260709 13:04:32.507686 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302ab0974b224ba287d59371e7ccb2d9" candidate_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71564e30312f4ced842375c5cbeca7ca"
I20260709 13:04:32.507870 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302ab0974b224ba287d59371e7ccb2d9" candidate_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21db410dc3804a1e86dc12df298bfabc"
I20260709 13:04:32.508297 10730 raft_consensus.cc:3060] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.508405 10879 raft_consensus.cc:3060] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.516554 10879 raft_consensus.cc:2468] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4d8cda76df407abde8be9a1d9ec0d9 in term 1.
I20260709 13:04:32.516554 10730 raft_consensus.cc:2468] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4d8cda76df407abde8be9a1d9ec0d9 in term 1.
I20260709 13:04:32.517940 10768 leader_election.cc:304] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21db410dc3804a1e86dc12df298bfabc, ac4d8cda76df407abde8be9a1d9ec0d9; no voters: 
I20260709 13:04:32.518651 10927 raft_consensus.cc:2804] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.519585 10927 raft_consensus.cc:697] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 LEADER]: Becoming Leader. State: Replica: ac4d8cda76df407abde8be9a1d9ec0d9, State: Running, Role: LEADER
I20260709 13:04:32.520416 10927 consensus_queue.cc:237] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.527376 10627 catalog_manager.cc:5697] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac4d8cda76df407abde8be9a1d9ec0d9 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.573823 10928 raft_consensus.cc:493] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.574326 10928 raft_consensus.cc:515] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } }
I20260709 13:04:32.576489 10928 leader_election.cc:290] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71564e30312f4ced842375c5cbeca7ca (127.0.107.129:42231), ac4d8cda76df407abde8be9a1d9ec0d9 (127.0.107.130:46483)
I20260709 13:04:32.585671 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8f07ef122e46e8b71c0ee7b1a56779" candidate_uuid: "21db410dc3804a1e86dc12df298bfabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71564e30312f4ced842375c5cbeca7ca" is_pre_election: true
I20260709 13:04:32.586462 10730 raft_consensus.cc:2468] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21db410dc3804a1e86dc12df298bfabc in term 0.
I20260709 13:04:32.587231 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8f07ef122e46e8b71c0ee7b1a56779" candidate_uuid: "21db410dc3804a1e86dc12df298bfabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" is_pre_election: true
I20260709 13:04:32.587595 10844 leader_election.cc:304] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21db410dc3804a1e86dc12df298bfabc, 71564e30312f4ced842375c5cbeca7ca; no voters: 
I20260709 13:04:32.587992 10805 raft_consensus.cc:2468] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21db410dc3804a1e86dc12df298bfabc in term 0.
I20260709 13:04:32.588549 10928 raft_consensus.cc:2804] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.588886 10928 raft_consensus.cc:493] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.589221 10928 raft_consensus.cc:3060] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.594799 10928 raft_consensus.cc:515] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } }
I20260709 13:04:32.596602 10928 leader_election.cc:290] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [CANDIDATE]: Term 1 election: Requested vote from peers 71564e30312f4ced842375c5cbeca7ca (127.0.107.129:42231), ac4d8cda76df407abde8be9a1d9ec0d9 (127.0.107.130:46483)
I20260709 13:04:32.597327 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8f07ef122e46e8b71c0ee7b1a56779" candidate_uuid: "21db410dc3804a1e86dc12df298bfabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71564e30312f4ced842375c5cbeca7ca"
I20260709 13:04:32.597524 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8f07ef122e46e8b71c0ee7b1a56779" candidate_uuid: "21db410dc3804a1e86dc12df298bfabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9"
I20260709 13:04:32.597847 10730 raft_consensus.cc:3060] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.598091 10805 raft_consensus.cc:3060] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.602591 10730 raft_consensus.cc:2468] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21db410dc3804a1e86dc12df298bfabc in term 1.
I20260709 13:04:32.603632 10844 leader_election.cc:304] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21db410dc3804a1e86dc12df298bfabc, 71564e30312f4ced842375c5cbeca7ca; no voters: 
I20260709 13:04:32.603941 10805 raft_consensus.cc:2468] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21db410dc3804a1e86dc12df298bfabc in term 1.
I20260709 13:04:32.604321 10928 raft_consensus.cc:2804] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.605559 10928 raft_consensus.cc:697] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 1 LEADER]: Becoming Leader. State: Replica: 21db410dc3804a1e86dc12df298bfabc, State: Running, Role: LEADER
I20260709 13:04:32.606382 10928 consensus_queue.cc:237] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } }
I20260709 13:04:32.613149 10627 catalog_manager.cc:5697] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc reported cstate change: term changed from 0 to 1, leader changed from <none> to 21db410dc3804a1e86dc12df298bfabc (127.0.107.131). New cstate: current_term: 1 leader_uuid: "21db410dc3804a1e86dc12df298bfabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.677420 10627 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46954:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:32.679621 10627 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:32.702620 10720 tablet_service.cc:1511] Processing CreateTablet for tablet 1c69d3535edf4a619d71abc421ebc16b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=013a78c7c067494ebafefc007b39534a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:32.703953 10720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c69d3535edf4a619d71abc421ebc16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.704186 10794 tablet_service.cc:1511] Processing CreateTablet for tablet 1c69d3535edf4a619d71abc421ebc16b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=013a78c7c067494ebafefc007b39534a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:32.705394 10794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c69d3535edf4a619d71abc421ebc16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.706020 10869 tablet_service.cc:1511] Processing CreateTablet for tablet 1c69d3535edf4a619d71abc421ebc16b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=013a78c7c067494ebafefc007b39534a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:32.707253 10869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c69d3535edf4a619d71abc421ebc16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.709263 10719 tablet_service.cc:1511] Processing CreateTablet for tablet 10e1a1bd138b4e94bbb2433ace438769 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=013a78c7c067494ebafefc007b39534a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:32.710116 10868 tablet_service.cc:1511] Processing CreateTablet for tablet 10e1a1bd138b4e94bbb2433ace438769 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=013a78c7c067494ebafefc007b39534a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:32.710522 10719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e1a1bd138b4e94bbb2433ace438769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.711350 10868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e1a1bd138b4e94bbb2433ace438769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.712765 10795 tablet_service.cc:1511] Processing CreateTablet for tablet 10e1a1bd138b4e94bbb2433ace438769 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=013a78c7c067494ebafefc007b39534a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:32.713977 10795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e1a1bd138b4e94bbb2433ace438769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:32.726333 10919 tablet_bootstrap.cc:492] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca: Bootstrap starting.
I20260709 13:04:32.729353 10923 tablet_bootstrap.cc:492] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9: Bootstrap starting.
I20260709 13:04:32.733031 10919 tablet_bootstrap.cc:654] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.737154 10923 tablet_bootstrap.cc:654] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.739547 10921 tablet_bootstrap.cc:492] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc: Bootstrap starting.
I20260709 13:04:32.746034 10921 tablet_bootstrap.cc:654] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.749025 10919 tablet_bootstrap.cc:492] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca: No bootstrap required, opened a new log
I20260709 13:04:32.749609 10919 ts_tablet_manager.cc:1403] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 13:04:32.752985 10919 raft_consensus.cc:359] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.753695 10919 raft_consensus.cc:385] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.753986 10921 tablet_bootstrap.cc:492] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc: No bootstrap required, opened a new log
I20260709 13:04:32.753990 10919 raft_consensus.cc:740] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71564e30312f4ced842375c5cbeca7ca, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.754830 10921 ts_tablet_manager.cc:1403] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 13:04:32.753973 10923 tablet_bootstrap.cc:492] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9: No bootstrap required, opened a new log
I20260709 13:04:32.755666 10923 ts_tablet_manager.cc:1403] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.002s
I20260709 13:04:32.755249 10919 consensus_queue.cc:260] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.757644 10919 ts_tablet_manager.cc:1434] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:32.758513 10919 tablet_bootstrap.cc:492] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca: Bootstrap starting.
I20260709 13:04:32.758137 10921 raft_consensus.cc:359] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.758926 10921 raft_consensus.cc:385] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.759222 10921 raft_consensus.cc:740] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21db410dc3804a1e86dc12df298bfabc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.760123 10921 consensus_queue.cc:260] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.760478 10923 raft_consensus.cc:359] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.761273 10923 raft_consensus.cc:385] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.761552 10923 raft_consensus.cc:740] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4d8cda76df407abde8be9a1d9ec0d9, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.762372 10923 consensus_queue.cc:260] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.765583 10919 tablet_bootstrap.cc:654] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.767072 10923 ts_tablet_manager.cc:1434] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:32.768359 10923 tablet_bootstrap.cc:492] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9: Bootstrap starting.
I20260709 13:04:32.771396 10921 ts_tablet_manager.cc:1434] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
W20260709 13:04:32.771591 10676 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:32.775239 10923 tablet_bootstrap.cc:654] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.776279 10921 tablet_bootstrap.cc:492] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc: Bootstrap starting.
I20260709 13:04:32.783849 10919 tablet_bootstrap.cc:492] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca: No bootstrap required, opened a new log
I20260709 13:04:32.784613 10919 ts_tablet_manager.cc:1403] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 13:04:32.788038 10923 tablet_bootstrap.cc:492] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9: No bootstrap required, opened a new log
I20260709 13:04:32.788520 10923 ts_tablet_manager.cc:1403] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:04:32.788196 10919 raft_consensus.cc:359] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.789058 10919 raft_consensus.cc:385] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.789377 10919 raft_consensus.cc:740] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71564e30312f4ced842375c5cbeca7ca, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.790115 10919 consensus_queue.cc:260] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.790694 10921 tablet_bootstrap.cc:654] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.791119 10923 raft_consensus.cc:359] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.791862 10923 raft_consensus.cc:385] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.792145 10923 raft_consensus.cc:740] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4d8cda76df407abde8be9a1d9ec0d9, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.792495 10919 ts_tablet_manager.cc:1434] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:32.792907 10923 consensus_queue.cc:260] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.795164 10923 ts_tablet_manager.cc:1434] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:32.798148 10921 tablet_bootstrap.cc:492] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc: No bootstrap required, opened a new log
I20260709 13:04:32.798681 10921 ts_tablet_manager.cc:1403] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.002s
I20260709 13:04:32.801774 10921 raft_consensus.cc:359] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.802487 10921 raft_consensus.cc:385] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.802814 10921 raft_consensus.cc:740] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21db410dc3804a1e86dc12df298bfabc, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.803608 10921 consensus_queue.cc:260] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.805845 10921 ts_tablet_manager.cc:1434] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:04:32.806149 10927 raft_consensus.cc:493] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.806643 10927 raft_consensus.cc:515] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.808461 10927 leader_election.cc:290] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71564e30312f4ced842375c5cbeca7ca (127.0.107.129:42231), 21db410dc3804a1e86dc12df298bfabc (127.0.107.131:43391)
I20260709 13:04:32.809276 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1a1bd138b4e94bbb2433ace438769" candidate_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71564e30312f4ced842375c5cbeca7ca" is_pre_election: true
I20260709 13:04:32.809605 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1a1bd138b4e94bbb2433ace438769" candidate_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21db410dc3804a1e86dc12df298bfabc" is_pre_election: true
I20260709 13:04:32.809903 10730 raft_consensus.cc:2468] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4d8cda76df407abde8be9a1d9ec0d9 in term 0.
I20260709 13:04:32.810300 10879 raft_consensus.cc:2468] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4d8cda76df407abde8be9a1d9ec0d9 in term 0.
I20260709 13:04:32.810904 10770 leader_election.cc:304] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71564e30312f4ced842375c5cbeca7ca, ac4d8cda76df407abde8be9a1d9ec0d9; no voters: 
I20260709 13:04:32.811754 10927 raft_consensus.cc:2804] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.812059 10927 raft_consensus.cc:493] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.812327 10927 raft_consensus.cc:3060] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.817647 10927 raft_consensus.cc:515] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.819279 10927 leader_election.cc:290] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [CANDIDATE]: Term 1 election: Requested vote from peers 71564e30312f4ced842375c5cbeca7ca (127.0.107.129:42231), 21db410dc3804a1e86dc12df298bfabc (127.0.107.131:43391)
I20260709 13:04:32.820020 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1a1bd138b4e94bbb2433ace438769" candidate_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71564e30312f4ced842375c5cbeca7ca"
I20260709 13:04:32.820241 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1a1bd138b4e94bbb2433ace438769" candidate_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21db410dc3804a1e86dc12df298bfabc"
I20260709 13:04:32.820559 10730 raft_consensus.cc:3060] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.820782 10879 raft_consensus.cc:3060] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.825166 10730 raft_consensus.cc:2468] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4d8cda76df407abde8be9a1d9ec0d9 in term 1.
I20260709 13:04:32.825315 10879 raft_consensus.cc:2468] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4d8cda76df407abde8be9a1d9ec0d9 in term 1.
I20260709 13:04:32.826218 10770 leader_election.cc:304] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71564e30312f4ced842375c5cbeca7ca, ac4d8cda76df407abde8be9a1d9ec0d9; no voters: 
I20260709 13:04:32.827247 10927 raft_consensus.cc:2804] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.827679 10927 raft_consensus.cc:697] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 LEADER]: Becoming Leader. State: Replica: ac4d8cda76df407abde8be9a1d9ec0d9, State: Running, Role: LEADER
I20260709 13:04:32.828390 10927 consensus_queue.cc:237] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:32.836316 10626 catalog_manager.cc:5697] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac4d8cda76df407abde8be9a1d9ec0d9 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.910027 10927 consensus_queue.cc:1048] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.924402 10951 consensus_queue.cc:1048] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.998075 10928 consensus_queue.cc:1048] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.008198 10935 consensus_queue.cc:1048] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.061196 10922 raft_consensus.cc:493] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.061666 10922 raft_consensus.cc:515] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:33.063799 10922 leader_election.cc:290] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac4d8cda76df407abde8be9a1d9ec0d9 (127.0.107.130:46483), 21db410dc3804a1e86dc12df298bfabc (127.0.107.131:43391)
I20260709 13:04:33.074806 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c69d3535edf4a619d71abc421ebc16b" candidate_uuid: "71564e30312f4ced842375c5cbeca7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" is_pre_election: true
I20260709 13:04:33.075582 10805 raft_consensus.cc:2468] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71564e30312f4ced842375c5cbeca7ca in term 0.
I20260709 13:04:33.075704 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c69d3535edf4a619d71abc421ebc16b" candidate_uuid: "71564e30312f4ced842375c5cbeca7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21db410dc3804a1e86dc12df298bfabc" is_pre_election: true
I20260709 13:04:33.076345 10879 raft_consensus.cc:2468] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71564e30312f4ced842375c5cbeca7ca in term 0.
I20260709 13:04:33.076562 10696 leader_election.cc:304] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71564e30312f4ced842375c5cbeca7ca, ac4d8cda76df407abde8be9a1d9ec0d9; no voters: 
I20260709 13:04:33.077370 10922 raft_consensus.cc:2804] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.077759 10922 raft_consensus.cc:493] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.078044 10922 raft_consensus.cc:3060] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.083370 10922 raft_consensus.cc:515] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:33.084967 10922 leader_election.cc:290] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [CANDIDATE]: Term 1 election: Requested vote from peers ac4d8cda76df407abde8be9a1d9ec0d9 (127.0.107.130:46483), 21db410dc3804a1e86dc12df298bfabc (127.0.107.131:43391)
I20260709 13:04:33.085764 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c69d3535edf4a619d71abc421ebc16b" candidate_uuid: "71564e30312f4ced842375c5cbeca7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9"
I20260709 13:04:33.086158 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c69d3535edf4a619d71abc421ebc16b" candidate_uuid: "71564e30312f4ced842375c5cbeca7ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21db410dc3804a1e86dc12df298bfabc"
I20260709 13:04:33.086378 10805 raft_consensus.cc:3060] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.086736 10879 raft_consensus.cc:3060] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.093277 10805 raft_consensus.cc:2468] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71564e30312f4ced842375c5cbeca7ca in term 1.
I20260709 13:04:33.093283 10879 raft_consensus.cc:2468] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71564e30312f4ced842375c5cbeca7ca in term 1.
I20260709 13:04:33.094699 10693 leader_election.cc:304] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21db410dc3804a1e86dc12df298bfabc, 71564e30312f4ced842375c5cbeca7ca; no voters: 
I20260709 13:04:33.095355 10922 raft_consensus.cc:2804] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.096239 10922 raft_consensus.cc:697] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 1 LEADER]: Becoming Leader. State: Replica: 71564e30312f4ced842375c5cbeca7ca, State: Running, Role: LEADER
I20260709 13:04:33.096891 10922 consensus_queue.cc:237] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:33.103482 10627 catalog_manager.cc:5697] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 71564e30312f4ced842375c5cbeca7ca (127.0.107.129). New cstate: current_term: 1 leader_uuid: "71564e30312f4ced842375c5cbeca7ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.123625 10879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b8f07ef122e46e8b71c0ee7b1a56779"
dest_uuid: "21db410dc3804a1e86dc12df298bfabc"
mode: GRACEFUL
new_leader_uuid: "71564e30312f4ced842375c5cbeca7ca"
 from {username='slave'} at 127.0.0.1:42154
I20260709 13:04:33.124168 10879 raft_consensus.cc:606] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 1 LEADER]: Received request to transfer leadership to TS 71564e30312f4ced842375c5cbeca7ca
I20260709 13:04:33.136154 10805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "302ab0974b224ba287d59371e7ccb2d9"
dest_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9"
mode: GRACEFUL
new_leader_uuid: "21db410dc3804a1e86dc12df298bfabc"
 from {username='slave'} at 127.0.0.1:43346
I20260709 13:04:33.136644 10805 raft_consensus.cc:606] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 LEADER]: Received request to transfer leadership to TS 21db410dc3804a1e86dc12df298bfabc
I20260709 13:04:33.144465 10805 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10e1a1bd138b4e94bbb2433ace438769"
dest_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9"
mode: GRACEFUL
new_leader_uuid: "71564e30312f4ced842375c5cbeca7ca"
 from {username='slave'} at 127.0.0.1:43346
I20260709 13:04:33.144942 10805 raft_consensus.cc:606] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 LEADER]: Received request to transfer leadership to TS 71564e30312f4ced842375c5cbeca7ca
I20260709 13:04:33.303085 10927 raft_consensus.cc:993] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9: : Instructing follower 21db410dc3804a1e86dc12df298bfabc to start an election
I20260709 13:04:33.303637 10951 raft_consensus.cc:1081] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 LEADER]: Signalling peer 21db410dc3804a1e86dc12df298bfabc to start an election
I20260709 13:04:33.304467 10951 consensus_queue.cc:1048] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.305122 10879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "302ab0974b224ba287d59371e7ccb2d9"
dest_uuid: "21db410dc3804a1e86dc12df298bfabc"
 from {username='slave'} at 127.0.0.1:42136
I20260709 13:04:33.305704 10879 raft_consensus.cc:493] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:33.306098 10879 raft_consensus.cc:3060] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.311051 10927 raft_consensus.cc:993] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9: : Instructing follower 71564e30312f4ced842375c5cbeca7ca to start an election
I20260709 13:04:33.311633 10932 raft_consensus.cc:1081] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 LEADER]: Signalling peer 71564e30312f4ced842375c5cbeca7ca to start an election
I20260709 13:04:33.313156 10730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10e1a1bd138b4e94bbb2433ace438769"
dest_uuid: "71564e30312f4ced842375c5cbeca7ca"
 from {username='slave'} at 127.0.0.1:57306
I20260709 13:04:33.313861 10730 raft_consensus.cc:493] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:33.314251 10730 raft_consensus.cc:3060] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.317040 10932 consensus_queue.cc:1048] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.321201 10730 raft_consensus.cc:515] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:33.322276 10729 raft_consensus.cc:1240] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 2 FOLLOWER]: Rejecting Update request from peer ac4d8cda76df407abde8be9a1d9ec0d9 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:33.313159 10879 raft_consensus.cc:515] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:33.324364 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1a1bd138b4e94bbb2433ace438769" candidate_uuid: "71564e30312f4ced842375c5cbeca7ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9"
I20260709 13:04:33.324975 10805 raft_consensus.cc:3055] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:33.325287 10805 raft_consensus.cc:740] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac4d8cda76df407abde8be9a1d9ec0d9, State: Running, Role: LEADER
I20260709 13:04:33.326040 10805 consensus_queue.cc:260] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:33.326416 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302ab0974b224ba287d59371e7ccb2d9" candidate_uuid: "21db410dc3804a1e86dc12df298bfabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71564e30312f4ced842375c5cbeca7ca"
I20260709 13:04:33.327025 10728 raft_consensus.cc:3060] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.327863 10804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302ab0974b224ba287d59371e7ccb2d9" candidate_uuid: "21db410dc3804a1e86dc12df298bfabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9"
I20260709 13:04:33.328511 10804 raft_consensus.cc:3055] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:04:33.328228 10932 consensus_queue.cc:1175] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "71564e30312f4ced842375c5cbeca7ca" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ac4d8cda76df407abde8be9a1d9ec0d9 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:33.328871 10804 raft_consensus.cc:740] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac4d8cda76df407abde8be9a1d9ec0d9, State: Running, Role: LEADER
I20260709 13:04:33.329774 10804 consensus_queue.cc:260] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:33.331033 10804 raft_consensus.cc:3060] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.326975 10805 raft_consensus.cc:3060] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.334673 10728 raft_consensus.cc:2468] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21db410dc3804a1e86dc12df298bfabc in term 2.
I20260709 13:04:33.335722 10844 leader_election.cc:304] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21db410dc3804a1e86dc12df298bfabc, 71564e30312f4ced842375c5cbeca7ca; no voters: 
I20260709 13:04:33.336447 10935 raft_consensus.cc:2804] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:33.336894 10935 raft_consensus.cc:697] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 2 LEADER]: Becoming Leader. State: Replica: 21db410dc3804a1e86dc12df298bfabc, State: Running, Role: LEADER
I20260709 13:04:33.337625 10935 consensus_queue.cc:237] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:33.344884 10805 raft_consensus.cc:2468] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71564e30312f4ced842375c5cbeca7ca in term 2.
I20260709 13:04:33.345009 10804 raft_consensus.cc:2468] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21db410dc3804a1e86dc12df298bfabc in term 2.
I20260709 13:04:33.326928 10879 leader_election.cc:290] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [CANDIDATE]: Term 2 election: Requested vote from peers 71564e30312f4ced842375c5cbeca7ca (127.0.107.129:42231), ac4d8cda76df407abde8be9a1d9ec0d9 (127.0.107.130:46483)
I20260709 13:04:33.347223 10626 catalog_manager.cc:5697] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc reported cstate change: term changed from 1 to 2, leader changed from ac4d8cda76df407abde8be9a1d9ec0d9 (127.0.107.130) to 21db410dc3804a1e86dc12df298bfabc (127.0.107.131). New cstate: current_term: 2 leader_uuid: "21db410dc3804a1e86dc12df298bfabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.349121 10696 leader_election.cc:304] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71564e30312f4ced842375c5cbeca7ca, ac4d8cda76df407abde8be9a1d9ec0d9; no voters: 
I20260709 13:04:33.349654 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1a1bd138b4e94bbb2433ace438769" candidate_uuid: "71564e30312f4ced842375c5cbeca7ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21db410dc3804a1e86dc12df298bfabc"
I20260709 13:04:33.350030 10922 raft_consensus.cc:2804] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:33.350318 10879 raft_consensus.cc:3060] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.350617 10922 raft_consensus.cc:697] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 2 LEADER]: Becoming Leader. State: Replica: 71564e30312f4ced842375c5cbeca7ca, State: Running, Role: LEADER
I20260709 13:04:33.351487 10922 consensus_queue.cc:237] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:33.352092 10730 leader_election.cc:290] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [CANDIDATE]: Term 2 election: Requested vote from peers ac4d8cda76df407abde8be9a1d9ec0d9 (127.0.107.130:46483), 21db410dc3804a1e86dc12df298bfabc (127.0.107.131:43391)
I20260709 13:04:33.358361 10879 raft_consensus.cc:2468] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71564e30312f4ced842375c5cbeca7ca in term 2.
I20260709 13:04:33.359131 10628 catalog_manager.cc:5697] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca reported cstate change: term changed from 1 to 2, leader changed from ac4d8cda76df407abde8be9a1d9ec0d9 (127.0.107.130) to 71564e30312f4ced842375c5cbeca7ca (127.0.107.129). New cstate: current_term: 2 leader_uuid: "71564e30312f4ced842375c5cbeca7ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.442492 10928 raft_consensus.cc:993] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc: : Instructing follower 71564e30312f4ced842375c5cbeca7ca to start an election
I20260709 13:04:33.442965 10935 raft_consensus.cc:1081] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 1 LEADER]: Signalling peer 71564e30312f4ced842375c5cbeca7ca to start an election
I20260709 13:04:33.444501 10730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b8f07ef122e46e8b71c0ee7b1a56779"
dest_uuid: "71564e30312f4ced842375c5cbeca7ca"
 from {username='slave'} at 127.0.0.1:57318
I20260709 13:04:33.444981 10730 raft_consensus.cc:493] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:33.445348 10730 raft_consensus.cc:3060] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.450101 10730 raft_consensus.cc:515] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } }
I20260709 13:04:33.451743 10730 leader_election.cc:290] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [CANDIDATE]: Term 2 election: Requested vote from peers 21db410dc3804a1e86dc12df298bfabc (127.0.107.131:43391), ac4d8cda76df407abde8be9a1d9ec0d9 (127.0.107.130:46483)
I20260709 13:04:33.452459 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8f07ef122e46e8b71c0ee7b1a56779" candidate_uuid: "71564e30312f4ced842375c5cbeca7ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21db410dc3804a1e86dc12df298bfabc"
I20260709 13:04:33.452819 10805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8f07ef122e46e8b71c0ee7b1a56779" candidate_uuid: "71564e30312f4ced842375c5cbeca7ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9"
I20260709 13:04:33.453025 10879 raft_consensus.cc:3055] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:33.453365 10805 raft_consensus.cc:3060] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.453434 10879 raft_consensus.cc:740] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21db410dc3804a1e86dc12df298bfabc, State: Running, Role: LEADER
I20260709 13:04:33.454288 10879 consensus_queue.cc:260] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } }
I20260709 13:04:33.455201 10879 raft_consensus.cc:3060] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.458241 10805 raft_consensus.cc:2468] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71564e30312f4ced842375c5cbeca7ca in term 2.
I20260709 13:04:33.459226 10696 leader_election.cc:304] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71564e30312f4ced842375c5cbeca7ca, ac4d8cda76df407abde8be9a1d9ec0d9; no voters: 
I20260709 13:04:33.459940 10922 raft_consensus.cc:2804] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:33.460413 10922 raft_consensus.cc:697] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 2 LEADER]: Becoming Leader. State: Replica: 71564e30312f4ced842375c5cbeca7ca, State: Running, Role: LEADER
I20260709 13:04:33.460522 10879 raft_consensus.cc:2468] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71564e30312f4ced842375c5cbeca7ca in term 2.
I20260709 13:04:33.461305 10922 consensus_queue.cc:237] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } }
I20260709 13:04:33.467142 10628 catalog_manager.cc:5697] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca reported cstate change: term changed from 1 to 2, leader changed from 21db410dc3804a1e86dc12df298bfabc (127.0.107.131) to 71564e30312f4ced842375c5cbeca7ca (127.0.107.129). New cstate: current_term: 2 leader_uuid: "71564e30312f4ced842375c5cbeca7ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.584334   430 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:04:33.585834   430 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:04:33.586210   430 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:04:33.597872 10730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c69d3535edf4a619d71abc421ebc16b"
dest_uuid: "71564e30312f4ced842375c5cbeca7ca"
mode: GRACEFUL
new_leader_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9"
 from {username='slave'} at 127.0.0.1:57334
I20260709 13:04:33.598433 10730 raft_consensus.cc:606] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 1 LEADER]: Received request to transfer leadership to TS ac4d8cda76df407abde8be9a1d9ec0d9
I20260709 13:04:33.599678   430 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:04:33.619498 10922 consensus_queue.cc:1048] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.632299 10922 consensus_queue.cc:1048] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.640831 10961 raft_consensus.cc:993] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca: : Instructing follower ac4d8cda76df407abde8be9a1d9ec0d9 to start an election
I20260709 13:04:33.641325 10922 raft_consensus.cc:1081] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 1 LEADER]: Signalling peer ac4d8cda76df407abde8be9a1d9ec0d9 to start an election
I20260709 13:04:33.642947 10805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c69d3535edf4a619d71abc421ebc16b"
dest_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9"
 from {username='slave'} at 127.0.0.1:43344
I20260709 13:04:33.643553 10805 raft_consensus.cc:493] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:33.643913 10805 raft_consensus.cc:3060] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.649217 10805 raft_consensus.cc:515] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:33.651949 10730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c69d3535edf4a619d71abc421ebc16b" candidate_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71564e30312f4ced842375c5cbeca7ca"
I20260709 13:04:33.652264 10879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c69d3535edf4a619d71abc421ebc16b" candidate_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "21db410dc3804a1e86dc12df298bfabc"
I20260709 13:04:33.652505 10730 raft_consensus.cc:3055] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:33.652900 10730 raft_consensus.cc:740] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71564e30312f4ced842375c5cbeca7ca, State: Running, Role: LEADER
I20260709 13:04:33.652915 10879 raft_consensus.cc:3060] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.652989 10805 leader_election.cc:290] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [CANDIDATE]: Term 2 election: Requested vote from peers 71564e30312f4ced842375c5cbeca7ca (127.0.107.129:42231), 21db410dc3804a1e86dc12df298bfabc (127.0.107.131:43391)
I20260709 13:04:33.653929 10730 consensus_queue.cc:260] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:33.655189 10730 raft_consensus.cc:3060] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.660301 10879 raft_consensus.cc:2468] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4d8cda76df407abde8be9a1d9ec0d9 in term 2.
I20260709 13:04:33.661607 10768 leader_election.cc:304] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21db410dc3804a1e86dc12df298bfabc, ac4d8cda76df407abde8be9a1d9ec0d9; no voters: 
I20260709 13:04:33.662335 10730 raft_consensus.cc:2468] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4d8cda76df407abde8be9a1d9ec0d9 in term 2.
I20260709 13:04:33.662410 10932 raft_consensus.cc:2804] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:33.663025 10932 raft_consensus.cc:697] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 LEADER]: Becoming Leader. State: Replica: ac4d8cda76df407abde8be9a1d9ec0d9, State: Running, Role: LEADER
I20260709 13:04:33.663884 10932 consensus_queue.cc:237] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } }
I20260709 13:04:33.671190 10627 catalog_manager.cc:5697] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 reported cstate change: term changed from 1 to 2, leader changed from 71564e30312f4ced842375c5cbeca7ca (127.0.107.129) to ac4d8cda76df407abde8be9a1d9ec0d9 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71564e30312f4ced842375c5cbeca7ca" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac4d8cda76df407abde8be9a1d9ec0d9" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 46483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21db410dc3804a1e86dc12df298bfabc" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 43391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.698375   430 tablet_server.cc:179] TabletServer@127.0.107.129:0 shutting down...
I20260709 13:04:33.718724   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:33.719460   430 tablet_replica.cc:333] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca: stopping tablet replica
I20260709 13:04:33.720044   430 raft_consensus.cc:2243] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.720607   430 pending_rounds.cc:70] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca: Trying to abort 2 pending ops.
I20260709 13:04:33.720773   430 pending_rounds.cc:77] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634911660052480 op_type: NO_OP noop_request { }
I20260709 13:04:33.721015   430 raft_consensus.cc:2889] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:33.721196   430 pending_rounds.cc:77] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634909513981952 op_type: NO_OP noop_request { }
I20260709 13:04:33.721375   430 raft_consensus.cc:2889] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:33.721586   430 raft_consensus.cc:2272] T 10e1a1bd138b4e94bbb2433ace438769 P 71564e30312f4ced842375c5cbeca7ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.723908   430 tablet_replica.cc:333] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca: stopping tablet replica
I20260709 13:04:33.724395   430 raft_consensus.cc:2243] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.724754   430 raft_consensus.cc:2272] T 302ab0974b224ba287d59371e7ccb2d9 P 71564e30312f4ced842375c5cbeca7ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.727178   430 tablet_replica.cc:333] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca: stopping tablet replica
I20260709 13:04:33.727716   430 raft_consensus.cc:2243] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.728063   430 raft_consensus.cc:2272] T 1c69d3535edf4a619d71abc421ebc16b P 71564e30312f4ced842375c5cbeca7ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.730129   430 tablet_replica.cc:333] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca: stopping tablet replica
I20260709 13:04:33.730561   430 raft_consensus.cc:2243] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.731060   430 pending_rounds.cc:70] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca: Trying to abort 1 pending ops.
I20260709 13:04:33.731210   430 pending_rounds.cc:77] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634912105086976 op_type: NO_OP noop_request { }
I20260709 13:04:33.731477   430 raft_consensus.cc:2889] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:33.731724   430 raft_consensus.cc:2272] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 71564e30312f4ced842375c5cbeca7ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.754063   430 tablet_server.cc:196] TabletServer@127.0.107.129:0 shutdown complete.
I20260709 13:04:33.765648   430 tablet_server.cc:179] TabletServer@127.0.107.130:0 shutting down...
I20260709 13:04:33.783711   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:33.784345   430 tablet_replica.cc:333] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9: stopping tablet replica
I20260709 13:04:33.784907   430 raft_consensus.cc:2243] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.785540   430 pending_rounds.cc:70] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9: Trying to abort 1 pending ops.
I20260709 13:04:33.785764   430 pending_rounds.cc:77] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634912935829504 op_type: NO_OP noop_request { }
I20260709 13:04:33.786037   430 raft_consensus.cc:2889] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:33.786314   430 raft_consensus.cc:2272] T 1c69d3535edf4a619d71abc421ebc16b P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.788511   430 tablet_replica.cc:333] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9: stopping tablet replica
I20260709 13:04:33.789041   430 raft_consensus.cc:2243] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.789446   430 raft_consensus.cc:2272] T 8b8f07ef122e46e8b71c0ee7b1a56779 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.791528   430 tablet_replica.cc:333] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9: stopping tablet replica
I20260709 13:04:33.792011   430 raft_consensus.cc:2243] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.792409   430 raft_consensus.cc:2272] T 10e1a1bd138b4e94bbb2433ace438769 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.794472   430 tablet_replica.cc:333] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9: stopping tablet replica
I20260709 13:04:33.794970   430 raft_consensus.cc:2243] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.795368   430 raft_consensus.cc:2272] T 302ab0974b224ba287d59371e7ccb2d9 P ac4d8cda76df407abde8be9a1d9ec0d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.817926   430 tablet_server.cc:196] TabletServer@127.0.107.130:0 shutdown complete.
W20260709 13:04:33.828032 10844 consensus_peers.cc:597] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc -> Peer 71564e30312f4ced842375c5cbeca7ca (127.0.107.129:42231): Couldn't send request to peer 71564e30312f4ced842375c5cbeca7ca. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:42231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.829931   430 tablet_server.cc:179] TabletServer@127.0.107.131:0 shutting down...
I20260709 13:04:33.848908   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:33.849562   430 tablet_replica.cc:333] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc: stopping tablet replica
I20260709 13:04:33.850207   430 raft_consensus.cc:2243] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.850601   430 raft_consensus.cc:2272] T 10e1a1bd138b4e94bbb2433ace438769 P 21db410dc3804a1e86dc12df298bfabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.852973   430 tablet_replica.cc:333] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc: stopping tablet replica
I20260709 13:04:33.853456   430 raft_consensus.cc:2243] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.854054   430 pending_rounds.cc:70] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc: Trying to abort 1 pending ops.
I20260709 13:04:33.854226   430 pending_rounds.cc:77] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634911598051328 op_type: NO_OP noop_request { }
I20260709 13:04:33.854444   430 raft_consensus.cc:2889] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:33.854655   430 raft_consensus.cc:2272] T 302ab0974b224ba287d59371e7ccb2d9 P 21db410dc3804a1e86dc12df298bfabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.856897   430 tablet_replica.cc:333] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc: stopping tablet replica
I20260709 13:04:33.857342   430 raft_consensus.cc:2243] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.857682   430 raft_consensus.cc:2272] T 1c69d3535edf4a619d71abc421ebc16b P 21db410dc3804a1e86dc12df298bfabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.859820   430 tablet_replica.cc:333] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc: stopping tablet replica
I20260709 13:04:33.860239   430 raft_consensus.cc:2243] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.860666   430 raft_consensus.cc:2272] T 8b8f07ef122e46e8b71c0ee7b1a56779 P 21db410dc3804a1e86dc12df298bfabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.883095   430 tablet_server.cc:196] TabletServer@127.0.107.131:0 shutdown complete.
I20260709 13:04:33.895226   430 master.cc:562] Master@127.0.107.190:40509 shutting down...
I20260709 13:04:33.910199   430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.910746   430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.911062   430 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6b9f277ed4224a22897dfe953c07a132: stopping tablet replica
I20260709 13:04:33.929133   430 master.cc:584] Master@127.0.107.190:40509 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2318 ms)
[----------] 6 tests from LeaderRebalancerTest (304520 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:04:33.960029   430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.190:41137
I20260709 13:04:33.961172   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:33.966440 10973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:33.966779 10974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:33.968011 10976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:33.968751   430 server_base.cc:1061] running on GCE node
I20260709 13:04:33.969803   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:33.970029   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:33.970230   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602273970212 us; error 0 us; skew 500 ppm
I20260709 13:04:33.970777   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:33.973129   430 webserver.cc:533] Webserver started at http://127.0.107.190:32941/ using document root <none> and password file <none>
I20260709 13:04:33.973608   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:33.973812   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:33.974071   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:33.975136   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/master-0-root/instance:
uuid: "6603d2a7d2d44226b812104f9b542dd0"
format_stamp: "Formatted at 2026-07-09 13:04:33 on dist-test-slave-th5x"
I20260709 13:04:33.979537   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:04:33.983583 10981 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:33.984516   430 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:04:33.984850   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/master-0-root
uuid: "6603d2a7d2d44226b812104f9b542dd0"
format_stamp: "Formatted at 2026-07-09 13:04:33 on dist-test-slave-th5x"
I20260709 13:04:33.985199   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:34.004536   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:34.005615   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:34.041368   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.190:41137
I20260709 13:04:34.041460 11032 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.190:41137 every 8 connection(s)
I20260709 13:04:34.045351 11033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.056463 11033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0: Bootstrap starting.
I20260709 13:04:34.060889 11033 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.064566 11033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0: No bootstrap required, opened a new log
I20260709 13:04:34.066977 11033 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6603d2a7d2d44226b812104f9b542dd0" member_type: VOTER }
I20260709 13:04:34.067325 11033 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.067520 11033 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6603d2a7d2d44226b812104f9b542dd0, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.067999 11033 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6603d2a7d2d44226b812104f9b542dd0" member_type: VOTER }
I20260709 13:04:34.068420 11033 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:34.068605 11033 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:34.068979 11033 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.073769 11033 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6603d2a7d2d44226b812104f9b542dd0" member_type: VOTER }
I20260709 13:04:34.074383 11033 leader_election.cc:304] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6603d2a7d2d44226b812104f9b542dd0; no voters: 
I20260709 13:04:34.078163 11033 leader_election.cc:290] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:34.078565 11036 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.080466 11036 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [term 1 LEADER]: Becoming Leader. State: Replica: 6603d2a7d2d44226b812104f9b542dd0, State: Running, Role: LEADER
I20260709 13:04:34.081368 11036 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6603d2a7d2d44226b812104f9b542dd0" member_type: VOTER }
I20260709 13:04:34.082521 11033 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:34.084518 11037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6603d2a7d2d44226b812104f9b542dd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6603d2a7d2d44226b812104f9b542dd0" member_type: VOTER } }
I20260709 13:04:34.084583 11038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6603d2a7d2d44226b812104f9b542dd0. Latest consensus state: current_term: 1 leader_uuid: "6603d2a7d2d44226b812104f9b542dd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6603d2a7d2d44226b812104f9b542dd0" member_type: VOTER } }
I20260709 13:04:34.085265 11037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:34.085326 11038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:34.088496 11041 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:34.092967 11041 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:34.103374   430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:34.104197 11041 catalog_manager.cc:1383] Generated new cluster ID: fe89eed74b2f4909b4c710b449341002
I20260709 13:04:34.104425 11041 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:34.126217 11041 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:34.127519 11041 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:34.141594 11041 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0: Generated new TSK 0
I20260709 13:04:34.142191 11041 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:34.170300   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:34.176451 11054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:34.177654 11055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:34.179118   430 server_base.cc:1061] running on GCE node
W20260709 13:04:34.179054 11057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:34.180322   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:34.180509   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:34.180635   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602274180625 us; error 0 us; skew 500 ppm
I20260709 13:04:34.181087   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:34.183614   430 webserver.cc:533] Webserver started at http://127.0.107.129:44711/ using document root <none> and password file <none>
I20260709 13:04:34.184098   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:34.184295   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:34.184508   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:34.185607   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-0-root/instance:
uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
format_stamp: "Formatted at 2026-07-09 13:04:34 on dist-test-slave-th5x"
I20260709 13:04:34.190320   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:34.193740 11062 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:34.194621   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:04:34.194962   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-0-root
uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
format_stamp: "Formatted at 2026-07-09 13:04:34 on dist-test-slave-th5x"
I20260709 13:04:34.195215   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:34.213461   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:34.214636   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:34.216390   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:34.218755   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:34.218930   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:34.219216   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:34.219386   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:34.256923   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.129:34461
I20260709 13:04:34.257118 11124 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.129:34461 every 8 connection(s)
I20260709 13:04:34.262329   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:34.269043 11129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:34.270437 11130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:34.274266   430 server_base.cc:1061] running on GCE node
W20260709 13:04:34.274497 11132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:34.274624 11125 heartbeater.cc:344] Connected to a master server at 127.0.107.190:41137
I20260709 13:04:34.275252 11125 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:34.276033   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:34.276078 11125 heartbeater.cc:507] Master 127.0.107.190:41137 requested a full tablet report, sending...
W20260709 13:04:34.276397   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:34.276684   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602274276665 us; error 0 us; skew 500 ppm
I20260709 13:04:34.277362   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:34.278816 10998 ts_manager.cc:194] Registered new tserver with Master: b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461)
I20260709 13:04:34.280224   430 webserver.cc:533] Webserver started at http://127.0.107.130:38101/ using document root <none> and password file <none>
I20260709 13:04:34.280907   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:34.281128   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:34.281299 10998 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58140
I20260709 13:04:34.281448   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:34.282932   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-1-root/instance:
uuid: "32498d04cc914621a17c1972a7981515"
format_stamp: "Formatted at 2026-07-09 13:04:34 on dist-test-slave-th5x"
I20260709 13:04:34.287358   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:04:34.290571 11137 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:34.291286   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:34.291687   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-1-root
uuid: "32498d04cc914621a17c1972a7981515"
format_stamp: "Formatted at 2026-07-09 13:04:34 on dist-test-slave-th5x"
I20260709 13:04:34.292004   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:34.306686   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:34.307839   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:34.309285   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:34.311575   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:34.311790   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:34.312026   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:34.312204   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:34.350811   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.130:42841
I20260709 13:04:34.350915 11199 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.130:42841 every 8 connection(s)
I20260709 13:04:34.355701   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:34.363107 11204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:34.363147 11203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:34.366390   430 server_base.cc:1061] running on GCE node
I20260709 13:04:34.366791 11200 heartbeater.cc:344] Connected to a master server at 127.0.107.190:41137
I20260709 13:04:34.367290 11200 heartbeater.cc:461] Registering TS with master...
W20260709 13:04:34.367239 11207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:34.368379 11200 heartbeater.cc:507] Master 127.0.107.190:41137 requested a full tablet report, sending...
I20260709 13:04:34.368392   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:34.368822   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:34.368996   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602274368981 us; error 0 us; skew 500 ppm
I20260709 13:04:34.369614   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:34.370661 10998 ts_manager.cc:194] Registered new tserver with Master: 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:34.372205   430 webserver.cc:533] Webserver started at http://127.0.107.131:45543/ using document root <none> and password file <none>
I20260709 13:04:34.372370 10998 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58152
I20260709 13:04:34.372786   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:34.373055   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:34.373345   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:34.374423   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-2-root/instance:
uuid: "3282e3a9d92949228a78169bb357df6b"
format_stamp: "Formatted at 2026-07-09 13:04:34 on dist-test-slave-th5x"
I20260709 13:04:34.378677   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:34.381865 11211 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:34.382745   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:04:34.383030   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-2-root
uuid: "3282e3a9d92949228a78169bb357df6b"
format_stamp: "Formatted at 2026-07-09 13:04:34 on dist-test-slave-th5x"
I20260709 13:04:34.383320   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601969268282-430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:34.399763   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:34.400743   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:34.402155   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:34.404390   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:34.404565   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:34.404852   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:34.405009   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:34.443377   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.131:33567
I20260709 13:04:34.443528 11273 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.131:33567 every 8 connection(s)
I20260709 13:04:34.456604 11274 heartbeater.cc:344] Connected to a master server at 127.0.107.190:41137
I20260709 13:04:34.457044 11274 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:34.457680 11274 heartbeater.cc:507] Master 127.0.107.190:41137 requested a full tablet report, sending...
I20260709 13:04:34.459671 10998 ts_manager.cc:194] Registered new tserver with Master: 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:34.460031   430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013530104s
I20260709 13:04:34.461524 10998 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58168
I20260709 13:04:34.485503 10998 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58182:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:34.488041 10998 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:34.574995 11163 tablet_service.cc:1511] Processing CreateTablet for tablet c1e82f82310644c8846acff8026b74f2 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:34.575203 11162 tablet_service.cc:1511] Processing CreateTablet for tablet 29e469e5e17a4d75a189610ae28e1086 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:34.575702 11164 tablet_service.cc:1511] Processing CreateTablet for tablet b8d8697b063449ce959639e018b22b2b (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:34.576471 11163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e82f82310644c8846acff8026b74f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.576761 11165 tablet_service.cc:1511] Processing CreateTablet for tablet cb028abf64f94157a502849dcd7df79a (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:34.577543 11164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d8697b063449ce959639e018b22b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.578356 11165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb028abf64f94157a502849dcd7df79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.579152 11161 tablet_service.cc:1511] Processing CreateTablet for tablet ca7c378bc1234c0ba7af5023204e3c9e (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:34.580466 11160 tablet_service.cc:1511] Processing CreateTablet for tablet ce5a8621786e4faf984b4fd2b6f09b91 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:34.582052 11159 tablet_service.cc:1511] Processing CreateTablet for tablet efbcd6d4d30f4ef29510e2d266298528 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:34.580514 11161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca7c378bc1234c0ba7af5023204e3c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.584796 11159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbcd6d4d30f4ef29510e2d266298528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.586824 11160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5a8621786e4faf984b4fd2b6f09b91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.587714 11162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e469e5e17a4d75a189610ae28e1086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.596292 11239 tablet_service.cc:1511] Processing CreateTablet for tablet cb028abf64f94157a502849dcd7df79a (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:34.597699 11239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb028abf64f94157a502849dcd7df79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.601038 11238 tablet_service.cc:1511] Processing CreateTablet for tablet b8d8697b063449ce959639e018b22b2b (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:34.602389 11238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d8697b063449ce959639e018b22b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.606030 11090 tablet_service.cc:1511] Processing CreateTablet for tablet cb028abf64f94157a502849dcd7df79a (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:34.608458 11089 tablet_service.cc:1511] Processing CreateTablet for tablet b8d8697b063449ce959639e018b22b2b (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:34.612753 11088 tablet_service.cc:1511] Processing CreateTablet for tablet c1e82f82310644c8846acff8026b74f2 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:34.614895 11087 tablet_service.cc:1511] Processing CreateTablet for tablet 29e469e5e17a4d75a189610ae28e1086 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:34.617055 11086 tablet_service.cc:1511] Processing CreateTablet for tablet ca7c378bc1234c0ba7af5023204e3c9e (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:34.607348 11090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb028abf64f94157a502849dcd7df79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.618388 11086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca7c378bc1234c0ba7af5023204e3c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.620419 11085 tablet_service.cc:1511] Processing CreateTablet for tablet ce5a8621786e4faf984b4fd2b6f09b91 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:34.621713 11085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5a8621786e4faf984b4fd2b6f09b91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.624470 11084 tablet_service.cc:1511] Processing CreateTablet for tablet efbcd6d4d30f4ef29510e2d266298528 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:34.625831 11084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbcd6d4d30f4ef29510e2d266298528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.627288 11237 tablet_service.cc:1511] Processing CreateTablet for tablet c1e82f82310644c8846acff8026b74f2 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:34.627737 11087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e469e5e17a4d75a189610ae28e1086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.628650 11237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e82f82310644c8846acff8026b74f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.631738 11088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e82f82310644c8846acff8026b74f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.632860 11089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d8697b063449ce959639e018b22b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.632964 11236 tablet_service.cc:1511] Processing CreateTablet for tablet 29e469e5e17a4d75a189610ae28e1086 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:34.634276 11236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29e469e5e17a4d75a189610ae28e1086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.635123 11083 tablet_service.cc:1511] Processing CreateTablet for tablet 52789773737a4f5db8915c627ece4817 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:34.636511 11083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52789773737a4f5db8915c627ece4817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.636591 11235 tablet_service.cc:1511] Processing CreateTablet for tablet ca7c378bc1234c0ba7af5023204e3c9e (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:34.637965 11235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca7c378bc1234c0ba7af5023204e3c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.640767 11234 tablet_service.cc:1511] Processing CreateTablet for tablet ce5a8621786e4faf984b4fd2b6f09b91 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:34.642418 11234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5a8621786e4faf984b4fd2b6f09b91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.673329 11233 tablet_service.cc:1511] Processing CreateTablet for tablet efbcd6d4d30f4ef29510e2d266298528 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:34.675032 11233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbcd6d4d30f4ef29510e2d266298528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.676019 11160 tablet_service.cc:1511] Processing CreateTablet for tablet 52789773737a4f5db8915c627ece4817 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:34.677376 11160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52789773737a4f5db8915c627ece4817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.710834 11232 tablet_service.cc:1511] Processing CreateTablet for tablet 52789773737a4f5db8915c627ece4817 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:34.712513 11232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52789773737a4f5db8915c627ece4817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.716562 11231 tablet_service.cc:1511] Processing CreateTablet for tablet f3da02cdb98e49cd9660dcb34e1abf77 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:34.718166 11231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3da02cdb98e49cd9660dcb34e1abf77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.718597 11289 tablet_bootstrap.cc:492] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:34.723953 11082 tablet_service.cc:1511] Processing CreateTablet for tablet f3da02cdb98e49cd9660dcb34e1abf77 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:34.725484 11082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3da02cdb98e49cd9660dcb34e1abf77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.740365 11290 tablet_bootstrap.cc:492] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:34.744089 11165 tablet_service.cc:1511] Processing CreateTablet for tablet f3da02cdb98e49cd9660dcb34e1abf77 (DEFAULT_TABLE table=test-workload [id=02e5e3363f604a489a7d86e1e8346758]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:34.745458 11165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3da02cdb98e49cd9660dcb34e1abf77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:34.761868 11289 tablet_bootstrap.cc:654] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.768457 11291 tablet_bootstrap.cc:492] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:34.782488 11290 tablet_bootstrap.cc:654] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.783016 11289 tablet_bootstrap.cc:492] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:34.783541 11289 ts_tablet_manager.cc:1403] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.003s
I20260709 13:04:34.786365 11289 raft_consensus.cc:359] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.790438 11289 raft_consensus.cc:385] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.790766 11289 raft_consensus.cc:740] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.791582 11289 consensus_queue.cc:260] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.793852 11291 tablet_bootstrap.cc:654] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.794503 11290 tablet_bootstrap.cc:492] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:34.795045 11290 ts_tablet_manager.cc:1403] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.000s
I20260709 13:04:34.798121 11290 raft_consensus.cc:359] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.798796 11290 raft_consensus.cc:385] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.799085 11290 raft_consensus.cc:740] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.799908 11290 consensus_queue.cc:260] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.802502 11289 ts_tablet_manager.cc:1434] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 13:04:34.803207 11200 heartbeater.cc:499] Master 127.0.107.190:41137 was elected leader, sending a full tablet report...
I20260709 13:04:34.803576 11289 tablet_bootstrap.cc:492] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:34.809228 11290 ts_tablet_manager.cc:1434] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.005s
I20260709 13:04:34.809856 11289 tablet_bootstrap.cc:654] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.809990 11125 heartbeater.cc:499] Master 127.0.107.190:41137 was elected leader, sending a full tablet report...
I20260709 13:04:34.811141 11291 tablet_bootstrap.cc:492] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:34.811764 11291 ts_tablet_manager.cc:1403] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.004s
I20260709 13:04:34.815685 11290 tablet_bootstrap.cc:492] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:34.821420 11291 raft_consensus.cc:359] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.822232 11291 raft_consensus.cc:385] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.822533 11291 raft_consensus.cc:740] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.823444 11291 consensus_queue.cc:260] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.823956 11290 tablet_bootstrap.cc:654] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.826563 11274 heartbeater.cc:499] Master 127.0.107.190:41137 was elected leader, sending a full tablet report...
I20260709 13:04:34.827077 11291 ts_tablet_manager.cc:1434] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 13:04:34.828169 11291 tablet_bootstrap.cc:492] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:34.834113 11291 tablet_bootstrap.cc:654] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.838258 11289 tablet_bootstrap.cc:492] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:34.838786 11289 ts_tablet_manager.cc:1403] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.007s
I20260709 13:04:34.841646 11289 raft_consensus.cc:359] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.842336 11289 raft_consensus.cc:385] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.842643 11289 raft_consensus.cc:740] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.843073 11291 tablet_bootstrap.cc:492] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:34.843741 11291 ts_tablet_manager.cc:1403] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:04:34.843355 11289 consensus_queue.cc:260] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.845723 11289 ts_tablet_manager.cc:1434] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:04:34.846650 11289 tablet_bootstrap.cc:492] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:34.846545 11291 raft_consensus.cc:359] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.847395 11291 raft_consensus.cc:385] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.847728 11291 raft_consensus.cc:740] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.848551 11291 consensus_queue.cc:260] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.850739 11291 ts_tablet_manager.cc:1434] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:34.851683 11291 tablet_bootstrap.cc:492] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:34.855232 11289 tablet_bootstrap.cc:654] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.857451 11291 tablet_bootstrap.cc:654] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.867079 11290 tablet_bootstrap.cc:492] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:34.867837 11290 ts_tablet_manager.cc:1403] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.008s
I20260709 13:04:34.868698 11291 tablet_bootstrap.cc:492] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:34.869215 11291 ts_tablet_manager.cc:1403] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:04:34.871953 11291 raft_consensus.cc:359] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.872687 11291 raft_consensus.cc:385] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.872997 11291 raft_consensus.cc:740] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.873879 11291 consensus_queue.cc:260] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.876166 11290 raft_consensus.cc:359] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.876978 11291 ts_tablet_manager.cc:1434] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:34.877013 11290 raft_consensus.cc:385] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.877609 11290 raft_consensus.cc:740] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.878165 11291 tablet_bootstrap.cc:492] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:34.880856 11289 tablet_bootstrap.cc:492] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:34.878268 11290 consensus_queue.cc:260] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.881467 11289 ts_tablet_manager.cc:1403] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.020s
I20260709 13:04:34.883220 11290 ts_tablet_manager.cc:1434] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:04:34.884338 11290 tablet_bootstrap.cc:492] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:34.885032 11291 tablet_bootstrap.cc:654] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.884732 11289 raft_consensus.cc:359] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.885725 11289 raft_consensus.cc:385] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.886090 11289 raft_consensus.cc:740] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.887050 11289 consensus_queue.cc:260] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.889526 11289 ts_tablet_manager.cc:1434] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:34.890556 11289 tablet_bootstrap.cc:492] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:34.896602 11289 tablet_bootstrap.cc:654] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.897940 11290 tablet_bootstrap.cc:654] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.900414 11294 raft_consensus.cc:493] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.900889 11294 raft_consensus.cc:515] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.903401 11294 leader_election.cc:290] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:34.908623 11291 tablet_bootstrap.cc:492] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:34.908931 11289 tablet_bootstrap.cc:492] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:34.909183 11291 ts_tablet_manager.cc:1403] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.007s
I20260709 13:04:34.909391 11289 ts_tablet_manager.cc:1403] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:04:34.910477 11290 tablet_bootstrap.cc:492] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:34.911211 11290 ts_tablet_manager.cc:1403] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.004s
I20260709 13:04:34.912814 11291 raft_consensus.cc:359] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.912904 11289 raft_consensus.cc:359] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.913928 11291 raft_consensus.cc:385] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.913962 11289 raft_consensus.cc:385] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.914616 11291 raft_consensus.cc:740] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.914654 11289 raft_consensus.cc:740] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.915797 11289 consensus_queue.cc:260] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.915836 11291 consensus_queue.cc:260] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.916283 11290 raft_consensus.cc:359] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.917085 11290 raft_consensus.cc:385] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.917434 11290 raft_consensus.cc:740] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.918315 11290 consensus_queue.cc:260] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.920821 11291 ts_tablet_manager.cc:1434] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:04:34.920924 11289 ts_tablet_manager.cc:1434] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:04:34.922114 11289 tablet_bootstrap.cc:492] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:34.922160 11291 tablet_bootstrap.cc:492] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:34.926957 11298 raft_consensus.cc:493] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.927575 11298 raft_consensus.cc:515] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.929404 11291 tablet_bootstrap.cc:654] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.935216 11290 ts_tablet_manager.cc:1434] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:04:34.941311 11291 tablet_bootstrap.cc:492] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:34.941996 11291 ts_tablet_manager.cc:1403] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 13:04:34.944882 11291 raft_consensus.cc:359] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.945416 11291 raft_consensus.cc:385] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.945676 11291 raft_consensus.cc:740] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.946308 11291 consensus_queue.cc:260] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.948163 11290 tablet_bootstrap.cc:492] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:34.950841 11298 leader_election.cc:290] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:34.954722 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb028abf64f94157a502849dcd7df79a" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:34.955472 11175 raft_consensus.cc:2468] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 0.
I20260709 13:04:34.956305 11290 tablet_bootstrap.cc:654] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.956887 11215 leader_election.cc:304] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:34.957923 11298 raft_consensus.cc:2804] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.958371 11298 raft_consensus.cc:493] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.958748 11298 raft_consensus.cc:3060] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.967054 11289 tablet_bootstrap.cc:654] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.970450 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d8697b063449ce959639e018b22b2b" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:34.971359 11249 raft_consensus.cc:2468] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 0.
I20260709 13:04:34.973006 11140 leader_election.cc:304] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:34.973991 11294 raft_consensus.cc:2804] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.974377 11294 raft_consensus.cc:493] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.974663 11294 raft_consensus.cc:3060] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.977927 11298 raft_consensus.cc:515] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.981832 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb028abf64f94157a502849dcd7df79a" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:34.982421 11175 raft_consensus.cc:3060] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.982798 11298 leader_election.cc:290] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:34.984383 11290 tablet_bootstrap.cc:492] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:34.985098 11290 ts_tablet_manager.cc:1403] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.011s
I20260709 13:04:34.982357 11294 raft_consensus.cc:515] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.988291 11290 raft_consensus.cc:359] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:34.989135 11290 raft_consensus.cc:385] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.989580 11175 raft_consensus.cc:2468] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 1.
I20260709 13:04:34.990262 11294 leader_election.cc:290] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:34.990732 11215 leader_election.cc:304] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:34.991297 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d8697b063449ce959639e018b22b2b" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:34.991755 11298 raft_consensus.cc:2804] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.991886 11249 raft_consensus.cc:3060] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.992686 11100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d8697b063449ce959639e018b22b2b" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
I20260709 13:04:34.993373 11100 raft_consensus.cc:2468] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 0.
I20260709 13:04:34.994009 11098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb028abf64f94157a502849dcd7df79a" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
I20260709 13:04:34.994464 11298 raft_consensus.cc:697] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Becoming Leader. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:34.993343 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d8697b063449ce959639e018b22b2b" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:34.995399 11097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb028abf64f94157a502849dcd7df79a" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:34.996030 11099 raft_consensus.cc:3060] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.995380 11298 consensus_queue.cc:237] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
W20260709 13:04:34.998862 11214 leader_election.cc:343] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:34.999871 11214 leader_election.cc:343] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:35.000324 11249 raft_consensus.cc:2468] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 1.
I20260709 13:04:34.989493 11290 raft_consensus.cc:740] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.001412 11140 leader_election.cc:304] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:35.002250 11294 raft_consensus.cc:2804] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.002115 11290 consensus_queue.cc:260] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.004760 11290 ts_tablet_manager.cc:1434] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:04:35.005234 11099 raft_consensus.cc:2468] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 1.
I20260709 13:04:35.005903 11290 tablet_bootstrap.cc:492] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:35.008404 11291 ts_tablet_manager.cc:1434] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.066s	user 0.014s	sys 0.017s
I20260709 13:04:35.009495 11291 tablet_bootstrap.cc:492] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:35.014297 11290 tablet_bootstrap.cc:654] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.014135 11294 raft_consensus.cc:697] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Becoming Leader. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:35.015324 11294 consensus_queue.cc:237] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.019188 11291 tablet_bootstrap.cc:654] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.029100 11290 tablet_bootstrap.cc:492] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:35.029659 11290 ts_tablet_manager.cc:1403] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.005s
I20260709 13:04:35.022832 10997 catalog_manager.cc:5697] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3282e3a9d92949228a78169bb357df6b (127.0.107.131). New cstate: current_term: 1 leader_uuid: "3282e3a9d92949228a78169bb357df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:35.032718 11290 raft_consensus.cc:359] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.033432 11290 raft_consensus.cc:385] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.033768 11290 raft_consensus.cc:740] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.033545 10996 catalog_manager.cc:5697] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32498d04cc914621a17c1972a7981515 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "32498d04cc914621a17c1972a7981515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.034786 11290 consensus_queue.cc:260] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.038246 11290 ts_tablet_manager.cc:1434] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:35.043310 11290 tablet_bootstrap.cc:492] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:35.046444 11296 raft_consensus.cc:493] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.046986 11296 raft_consensus.cc:515] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.053463 11289 tablet_bootstrap.cc:492] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:35.054225 11289 ts_tablet_manager.cc:1403] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.132s	user 0.012s	sys 0.004s
I20260709 13:04:35.056044 11298 raft_consensus.cc:493] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.056701 11298 raft_consensus.cc:515] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.058606 11296 leader_election.cc:290] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.061086 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbcd6d4d30f4ef29510e2d266298528" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:35.061965 11175 raft_consensus.cc:2468] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 0.
I20260709 13:04:35.063508 11215 leader_election.cc:304] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:35.064709 11311 raft_consensus.cc:2804] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.064888 11290 tablet_bootstrap.cc:654] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.065189 11311 raft_consensus.cc:493] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.065729 11311 raft_consensus.cc:3060] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.090554 11294 raft_consensus.cc:493] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.086480 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbcd6d4d30f4ef29510e2d266298528" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
I20260709 13:04:35.094177 11294 raft_consensus.cc:515] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.094270 11099 raft_consensus.cc:2468] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 0.
I20260709 13:04:35.096900 11294 leader_election.cc:290] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
W20260709 13:04:35.098263 11046 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:35.098188 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a8621786e4faf984b4fd2b6f09b91" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
W20260709 13:04:35.100006 11140 leader_election.cc:343] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:35.095800 11289 raft_consensus.cc:359] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.100840 11289 raft_consensus.cc:385] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.100901 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a8621786e4faf984b4fd2b6f09b91" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
I20260709 13:04:35.101217 11289 raft_consensus.cc:740] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.069540 11298 leader_election.cc:290] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
W20260709 13:04:35.102394 11140 leader_election.cc:343] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:35.091172 11311 raft_consensus.cc:515] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.103215 11291 tablet_bootstrap.cc:492] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:35.102989 11140 leader_election.cc:304] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32498d04cc914621a17c1972a7981515; no voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86
I20260709 13:04:35.103817 11291 ts_tablet_manager.cc:1403] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.095s	user 0.046s	sys 0.011s
I20260709 13:04:35.104411 11294 raft_consensus.cc:2749] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:35.105217 11289 consensus_queue.cc:260] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.106269 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbcd6d4d30f4ef29510e2d266298528" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:35.106997 11099 raft_consensus.cc:3060] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.107089 11291 raft_consensus.cc:359] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.107844 11289 ts_tablet_manager.cc:1434] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.053s	user 0.011s	sys 0.000s
I20260709 13:04:35.107980 11291 raft_consensus.cc:385] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.108366 11291 raft_consensus.cc:740] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.108974 11289 tablet_bootstrap.cc:492] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:35.111342 11291 consensus_queue.cc:260] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.114161 11291 ts_tablet_manager.cc:1434] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:35.114477 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7c378bc1234c0ba7af5023204e3c9e" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:35.115207 11291 tablet_bootstrap.cc:492] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:35.115309 11249 raft_consensus.cc:2468] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:35.117187 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbcd6d4d30f4ef29510e2d266298528" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:35.117358 11065 leader_election.cc:304] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:35.117950 11175 raft_consensus.cc:3060] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.121068 11296 raft_consensus.cc:2804] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.121538 11296 raft_consensus.cc:493] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.121953 11296 raft_consensus.cc:3060] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.129127 11175 raft_consensus.cc:2468] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 1.
I20260709 13:04:35.130995 11215 leader_election.cc:304] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:35.132079 11298 raft_consensus.cc:2804] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.131784 11296 raft_consensus.cc:515] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.134662 11311 leader_election.cc:290] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:35.139119 11291 tablet_bootstrap.cc:654] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.144459 11099 raft_consensus.cc:2468] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 1.
I20260709 13:04:35.148259 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7c378bc1234c0ba7af5023204e3c9e" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:35.149039 11249 raft_consensus.cc:3060] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.150259 11291 tablet_bootstrap.cc:492] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:35.150810 11291 ts_tablet_manager.cc:1403] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.007s
I20260709 13:04:35.152792 11289 tablet_bootstrap.cc:654] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.153954 11291 raft_consensus.cc:359] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.154773 11291 raft_consensus.cc:385] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.155088 11291 raft_consensus.cc:740] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.157155 11298 raft_consensus.cc:697] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Becoming Leader. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:35.158404 11298 consensus_queue.cc:237] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.163441 11291 consensus_queue.cc:260] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.164680 11296 leader_election.cc:290] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.164739 11289 tablet_bootstrap.cc:492] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:35.165683 11289 ts_tablet_manager.cc:1403] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.007s
I20260709 13:04:35.167510 11291 ts_tablet_manager.cc:1434] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:04:35.167572 11249 raft_consensus.cc:2468] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:35.168723 11291 tablet_bootstrap.cc:492] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:35.168748 11289 raft_consensus.cc:359] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.169243 11065 leader_election.cc:304] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:35.169669 11289 raft_consensus.cc:385] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.170083 11289 raft_consensus.cc:740] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.170945 11289 consensus_queue.cc:260] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.173882 11296 raft_consensus.cc:2804] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.174115 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7c378bc1234c0ba7af5023204e3c9e" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:35.174856 11174 raft_consensus.cc:3060] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.177488 11296 raft_consensus.cc:697] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Leader. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:35.178367 11296 consensus_queue.cc:237] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.174870 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7c378bc1234c0ba7af5023204e3c9e" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:35.181478 11289 ts_tablet_manager.cc:1434] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:04:35.183112 11289 tablet_bootstrap.cc:492] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:35.183372 11325 raft_consensus.cc:493] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.183097 10997 catalog_manager.cc:5697] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3282e3a9d92949228a78169bb357df6b (127.0.107.131). New cstate: current_term: 1 leader_uuid: "3282e3a9d92949228a78169bb357df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:35.184055 11325 raft_consensus.cc:515] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.185647 11174 raft_consensus.cc:2468] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:35.187284 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
W20260709 13:04:35.188607 11214 leader_election.cc:343] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:35.190474 11290 tablet_bootstrap.cc:492] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:35.190423 11325 leader_election.cc:290] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:35.191082 11290 ts_tablet_manager.cc:1403] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.148s	user 0.026s	sys 0.044s
I20260709 13:04:35.191331 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
W20260709 13:04:35.192766 11215 leader_election.cc:343] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:35.193202 11215 leader_election.cc:304] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b; no voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86
I20260709 13:04:35.194425 11325 raft_consensus.cc:2749] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:35.194465 11290 raft_consensus.cc:359] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.195300 11290 raft_consensus.cc:385] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.195652 11290 raft_consensus.cc:740] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.196313 11290 consensus_queue.cc:260] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.198977 11291 tablet_bootstrap.cc:654] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.203577 11289 tablet_bootstrap.cc:654] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.205528 11290 ts_tablet_manager.cc:1434] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:04:35.206377 11290 tablet_bootstrap.cc:492] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:35.208448 11330 raft_consensus.cc:493] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.208967 11330 raft_consensus.cc:515] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.212667 11290 tablet_bootstrap.cc:654] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.213414 11330 leader_election.cc:290] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.213604 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:35.214287 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
W20260709 13:04:35.215076 11065 leader_election.cc:343] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:35.215760 11066 leader_election.cc:343] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:35.216262 11066 leader_election.cc:304] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7c6f88e6d6449678331d4ec00f6ac86; no voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b
I20260709 13:04:35.217423 11330 raft_consensus.cc:2749] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:35.221756 11289 tablet_bootstrap.cc:492] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:35.221966 11291 tablet_bootstrap.cc:492] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:35.222308 11289 ts_tablet_manager.cc:1403] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.011s
I20260709 13:04:35.222393 11291 ts_tablet_manager.cc:1403] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.014s
I20260709 13:04:35.225226 11291 raft_consensus.cc:359] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.225436 11289 raft_consensus.cc:359] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.225890 11291 raft_consensus.cc:385] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.226132 11289 raft_consensus.cc:385] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.226197 11291 raft_consensus.cc:740] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.226518 11289 raft_consensus.cc:740] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.226176 10996 catalog_manager.cc:5697] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.227320 11291 consensus_queue.cc:260] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.227514 11289 consensus_queue.cc:260] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.228622 11290 tablet_bootstrap.cc:492] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:35.229136 11290 ts_tablet_manager.cc:1403] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 13:04:35.231583 11291 ts_tablet_manager.cc:1434] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:35.232537 11291 tablet_bootstrap.cc:492] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:35.232156 11290 raft_consensus.cc:359] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.232915 11290 raft_consensus.cc:385] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.233152 11289 ts_tablet_manager.cc:1434] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:04:35.233211 11290 raft_consensus.cc:740] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.237093 11289 tablet_bootstrap.cc:492] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:35.238910 11291 tablet_bootstrap.cc:654] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.238996 11290 consensus_queue.cc:260] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.241508 11290 ts_tablet_manager.cc:1434] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:35.242456 11290 tablet_bootstrap.cc:492] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:35.249084 11290 tablet_bootstrap.cc:654] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.255784 11289 tablet_bootstrap.cc:654] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.262687 11291 tablet_bootstrap.cc:492] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:35.263355 11291 ts_tablet_manager.cc:1403] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.015s
I20260709 13:04:35.266366 11290 tablet_bootstrap.cc:492] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:35.266258 11291 raft_consensus.cc:359] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.266901 11290 ts_tablet_manager.cc:1403] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.015s
I20260709 13:04:35.266980 11291 raft_consensus.cc:385] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.267390 11291 raft_consensus.cc:740] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.268091 11289 tablet_bootstrap.cc:492] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:35.268087 11291 consensus_queue.cc:260] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.268707 11289 ts_tablet_manager.cc:1403] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.008s
I20260709 13:04:35.269443 11290 raft_consensus.cc:359] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.269956 11290 raft_consensus.cc:385] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.270172 11290 raft_consensus.cc:740] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.270268 11291 ts_tablet_manager.cc:1434] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.003s
I20260709 13:04:35.270830 11290 consensus_queue.cc:260] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.272701 11290 ts_tablet_manager.cc:1434] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:35.273712 11290 tablet_bootstrap.cc:492] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:35.273530 11289 raft_consensus.cc:359] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.274282 11289 raft_consensus.cc:385] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.274564 11289 raft_consensus.cc:740] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.275383 11289 consensus_queue.cc:260] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.280495 11290 tablet_bootstrap.cc:654] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.283592 11296 raft_consensus.cc:493] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.284265 11296 raft_consensus.cc:515] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.285171 11289 ts_tablet_manager.cc:1434] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:04:35.286134 11289 tablet_bootstrap.cc:492] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:35.289121 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e82f82310644c8846acff8026b74f2" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:35.289849 11249 raft_consensus.cc:2468] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:35.291782 11290 tablet_bootstrap.cc:492] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:35.292269 11290 ts_tablet_manager.cc:1403] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:04:35.292742 11289 tablet_bootstrap.cc:654] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.292596 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e82f82310644c8846acff8026b74f2" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:35.293283 11174 raft_consensus.cc:2468] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:35.295099 11290 raft_consensus.cc:359] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.295843 11290 raft_consensus.cc:385] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.296104 11290 raft_consensus.cc:740] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.291203 11065 leader_election.cc:304] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:35.297281 11289 tablet_bootstrap.cc:492] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:35.297559 11330 raft_consensus.cc:2804] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.297814 11289 ts_tablet_manager.cc:1403] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:04:35.298026 11330 raft_consensus.cc:493] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.298473 11330 raft_consensus.cc:3060] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.296928 11290 consensus_queue.cc:260] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.300736 11289 raft_consensus.cc:359] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.301409 11289 raft_consensus.cc:385] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.287082 11296 leader_election.cc:290] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.301681 11289 raft_consensus.cc:740] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.302624 11289 consensus_queue.cc:260] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.306682 11289 ts_tablet_manager.cc:1434] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:35.313238 11330 raft_consensus.cc:515] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.316706 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e82f82310644c8846acff8026b74f2" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:35.317104 11290 ts_tablet_manager.cc:1434] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.014s
I20260709 13:04:35.317299 11174 raft_consensus.cc:3060] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.320374 11330 leader_election.cc:290] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.321475 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e82f82310644c8846acff8026b74f2" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:35.322109 11249 raft_consensus.cc:3060] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.322986 11174 raft_consensus.cc:2468] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:35.324039 11066 leader_election.cc:304] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:35.324801 11330 raft_consensus.cc:2804] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.325256 11330 raft_consensus.cc:697] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Leader. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:35.326069 11330 consensus_queue.cc:237] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.328696 11249 raft_consensus.cc:2468] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:35.333457 10996 catalog_manager.cc:5697] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.354638 11330 raft_consensus.cc:493] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.355226 11330 raft_consensus.cc:515] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.357142 11330 leader_election.cc:290] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.357858 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52789773737a4f5db8915c627ece4817" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:35.358116 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52789773737a4f5db8915c627ece4817" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:35.358466 11174 raft_consensus.cc:2468] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:35.358741 11249 raft_consensus.cc:2468] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:35.359479 11066 leader_election.cc:304] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:35.360289 11330 raft_consensus.cc:2804] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.360673 11330 raft_consensus.cc:493] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.360945 11330 raft_consensus.cc:3060] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.366086 11330 raft_consensus.cc:515] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.367775 11330 leader_election.cc:290] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.368489 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52789773737a4f5db8915c627ece4817" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:35.368769 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52789773737a4f5db8915c627ece4817" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:35.369040 11174 raft_consensus.cc:3060] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.369305 11249 raft_consensus.cc:3060] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.374148 11174 raft_consensus.cc:2468] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:35.374162 11249 raft_consensus.cc:2468] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:35.375339 11066 leader_election.cc:304] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:35.376061 11330 raft_consensus.cc:2804] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.376477 11330 raft_consensus.cc:697] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Leader. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:35.377228 11330 consensus_queue.cc:237] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.383972 10996 catalog_manager.cc:5697] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.392710 11294 raft_consensus.cc:493] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.393327 11294 raft_consensus.cc:515] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.394917 11294 leader_election.cc:290] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.395807 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
I20260709 13:04:35.396095 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:35.396495 11099 raft_consensus.cc:2468] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 0.
I20260709 13:04:35.396711 11249 raft_consensus.cc:2468] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 0.
I20260709 13:04:35.397614 11140 leader_election.cc:304] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:35.398322 11294 raft_consensus.cc:2804] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.398651 11294 raft_consensus.cc:493] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.398928 11294 raft_consensus.cc:3060] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.403635 11294 raft_consensus.cc:515] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.405149 11294 leader_election.cc:290] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.405984 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:35.406200 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:35.406531 11099 raft_consensus.cc:3060] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.406795 11330 raft_consensus.cc:493] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.406790 11249 raft_consensus.cc:3060] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.408360 11330 raft_consensus.cc:515] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.411326 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a8621786e4faf984b4fd2b6f09b91" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:35.411762 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a8621786e4faf984b4fd2b6f09b91" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:35.412012 11174 raft_consensus.cc:2468] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:35.412479 11248 raft_consensus.cc:2468] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:35.413151 11099 raft_consensus.cc:2468] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 1.
I20260709 13:04:35.413924 11330 leader_election.cc:290] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.413880 11065 leader_election.cc:304] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:35.414345 11249 raft_consensus.cc:2468] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 1.
I20260709 13:04:35.414981 11330 raft_consensus.cc:2804] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.415390 11330 raft_consensus.cc:493] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.415445 11140 leader_election.cc:304] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:35.415885 11330 raft_consensus.cc:3060] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.416337 11294 raft_consensus.cc:2804] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.416812 11294 raft_consensus.cc:697] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Becoming Leader. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:35.417608 11294 consensus_queue.cc:237] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.423202 11330 raft_consensus.cc:515] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.424882 11325 consensus_queue.cc:1048] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.425252 11330 leader_election.cc:290] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.426714 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a8621786e4faf984b4fd2b6f09b91" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:35.426832 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a8621786e4faf984b4fd2b6f09b91" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:35.426287 10996 catalog_manager.cc:5697] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32498d04cc914621a17c1972a7981515 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "32498d04cc914621a17c1972a7981515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.427337 11249 raft_consensus.cc:3060] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.427462 11174 raft_consensus.cc:3060] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.434619 11249 raft_consensus.cc:2468] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:35.435990 11065 leader_election.cc:304] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:35.436861 11330 raft_consensus.cc:2804] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.437394 11330 raft_consensus.cc:697] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Leader. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:35.438604 11330 consensus_queue.cc:237] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.440539 11174 raft_consensus.cc:2468] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:35.448908 11099 raft_consensus.cc:3060] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.448889 10996 catalog_manager.cc:5697] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.462190 11325 consensus_queue.cc:1048] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.538818 11294 consensus_queue.cc:1048] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.545507 11325 consensus_queue.cc:1048] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.552120 11351 consensus_queue.cc:1048] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:35.563947 11311 consensus_queue.cc:1048] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.586470 11330 consensus_queue.cc:1048] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.597127 11340 consensus_queue.cc:1048] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:35.702915 11351 raft_consensus.cc:493] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.703636 11351 raft_consensus.cc:515] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.704110 11340 raft_consensus.cc:493] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.704641 11340 raft_consensus.cc:515] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.705761 11351 leader_election.cc:290] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.706550 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
I20260709 13:04:35.707068 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:35.707078 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:35.707221 11099 raft_consensus.cc:2468] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 0.
I20260709 13:04:35.708117 11174 raft_consensus.cc:2468] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:35.708662 11249 raft_consensus.cc:2468] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 0.
I20260709 13:04:35.709414 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:35.709802 11066 leader_election.cc:304] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:35.709527 11340 leader_election.cc:290] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.709446 11140 leader_election.cc:304] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:35.710690 11330 raft_consensus.cc:2804] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.711091 11330 raft_consensus.cc:493] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.711259 11351 raft_consensus.cc:2804] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.710158 11248 raft_consensus.cc:2468] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:35.711468 11330 raft_consensus.cc:3060] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.711783 11351 raft_consensus.cc:493] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.712236 11351 raft_consensus.cc:3060] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.719645 11330 raft_consensus.cc:515] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.719843 11351 raft_consensus.cc:515] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.722190 11351 leader_election.cc:290] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.722190 11330 leader_election.cc:290] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:35.723310 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:35.723723 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:35.724267 11099 raft_consensus.cc:2393] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 32498d04cc914621a17c1972a7981515 in current term 1: Already voted for candidate b7c6f88e6d6449678331d4ec00f6ac86 in this term.
I20260709 13:04:35.724363 11249 raft_consensus.cc:3060] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.724558 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:35.723313 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:35.726076 11174 raft_consensus.cc:2393] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b7c6f88e6d6449678331d4ec00f6ac86 in current term 1: Already voted for candidate 32498d04cc914621a17c1972a7981515 in this term.
I20260709 13:04:35.728619 11065 leader_election.cc:304] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7c6f88e6d6449678331d4ec00f6ac86; no voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b
I20260709 13:04:35.729504 11330 raft_consensus.cc:2749] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:35.732404 11249 raft_consensus.cc:2468] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 1.
I20260709 13:04:35.733764 11140 leader_election.cc:304] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: b7c6f88e6d6449678331d4ec00f6ac86
I20260709 13:04:35.734633 11351 raft_consensus.cc:2804] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.735183 11351 raft_consensus.cc:697] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Becoming Leader. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:35.736073 11351 consensus_queue.cc:237] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:35.743157 10998 catalog_manager.cc:5697] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32498d04cc914621a17c1972a7981515 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "32498d04cc914621a17c1972a7981515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.757763 11330 consensus_queue.cc:1048] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.770790 11330 consensus_queue.cc:1048] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.848762 11296 consensus_queue.cc:1048] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.859109 11359 consensus_queue.cc:1048] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:35.889699 11359 consensus_queue.cc:1048] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.900413 11296 consensus_queue.cc:1048] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.981353 11249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb028abf64f94157a502849dcd7df79a"
dest_uuid: "3282e3a9d92949228a78169bb357df6b"
mode: GRACEFUL
new_leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
 from {username='slave'} at 127.0.0.1:35056
I20260709 13:04:35.982015 11249 raft_consensus.cc:606] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Received request to transfer leadership to TS b7c6f88e6d6449678331d4ec00f6ac86
I20260709 13:04:35.989641 11351 consensus_queue.cc:1048] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:36.000234 11174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8d8697b063449ce959639e018b22b2b"
dest_uuid: "32498d04cc914621a17c1972a7981515"
mode: GRACEFUL
new_leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
 from {username='slave'} at 127.0.0.1:49672
I20260709 13:04:36.000895 11174 raft_consensus.cc:606] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Received request to transfer leadership to TS b7c6f88e6d6449678331d4ec00f6ac86
I20260709 13:04:36.007618 11351 consensus_queue.cc:1048] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:36.014179 11174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086"
dest_uuid: "32498d04cc914621a17c1972a7981515"
mode: GRACEFUL
new_leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
 from {username='slave'} at 127.0.0.1:49672
I20260709 13:04:36.014762 11174 raft_consensus.cc:606] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Received request to transfer leadership to TS b7c6f88e6d6449678331d4ec00f6ac86
I20260709 13:04:36.030189 11099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca7c378bc1234c0ba7af5023204e3c9e"
dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
mode: GRACEFUL
new_leader_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:04:36.030751 11099 raft_consensus.cc:606] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Received request to transfer leadership to TS 32498d04cc914621a17c1972a7981515
I20260709 13:04:36.035979 11099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce5a8621786e4faf984b4fd2b6f09b91"
dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
mode: GRACEFUL
new_leader_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:04:36.036476 11099 raft_consensus.cc:606] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Received request to transfer leadership to TS 32498d04cc914621a17c1972a7981515
I20260709 13:04:36.041491 11249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efbcd6d4d30f4ef29510e2d266298528"
dest_uuid: "3282e3a9d92949228a78169bb357df6b"
mode: GRACEFUL
new_leader_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:35056
I20260709 13:04:36.041980 11249 raft_consensus.cc:606] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Received request to transfer leadership to TS 32498d04cc914621a17c1972a7981515
I20260709 13:04:36.046929 11099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52789773737a4f5db8915c627ece4817"
dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
mode: GRACEFUL
new_leader_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:04:36.047536 11099 raft_consensus.cc:606] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Received request to transfer leadership to TS 32498d04cc914621a17c1972a7981515
I20260709 13:04:36.052779 11174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77"
dest_uuid: "32498d04cc914621a17c1972a7981515"
mode: GRACEFUL
new_leader_uuid: "3282e3a9d92949228a78169bb357df6b"
 from {username='slave'} at 127.0.0.1:49672
I20260709 13:04:36.053303 11174 raft_consensus.cc:606] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Received request to transfer leadership to TS 3282e3a9d92949228a78169bb357df6b
I20260709 13:04:36.146756 11351 consensus_queue.cc:1048] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:36.159080 11325 raft_consensus.cc:993] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b: : Instructing follower 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:36.159641 11325 raft_consensus.cc:1081] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Signalling peer 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:36.159897 11351 consensus_queue.cc:1048] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:36.161383 11174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efbcd6d4d30f4ef29510e2d266298528"
dest_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:49650
I20260709 13:04:36.161979 11174 raft_consensus.cc:493] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:36.162331 11174 raft_consensus.cc:3060] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.168365 11174 raft_consensus.cc:515] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.170077 11174 leader_election.cc:290] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:36.171264 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbcd6d4d30f4ef29510e2d266298528" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:36.171675 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbcd6d4d30f4ef29510e2d266298528" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:36.171981 11248 raft_consensus.cc:3055] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:36.172407 11248 raft_consensus.cc:740] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:36.172508 11099 raft_consensus.cc:3060] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.173308 11248 consensus_queue.cc:260] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.174687 11248 raft_consensus.cc:3060] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.175945 11351 raft_consensus.cc:993] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515: : Instructing follower 3282e3a9d92949228a78169bb357df6b to start an election
I20260709 13:04:36.176570 11294 raft_consensus.cc:1081] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Signalling peer 3282e3a9d92949228a78169bb357df6b to start an election
I20260709 13:04:36.178416 11249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77"
dest_uuid: "3282e3a9d92949228a78169bb357df6b"
 from {username='slave'} at 127.0.0.1:35036
I20260709 13:04:36.178962 11249 raft_consensus.cc:493] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:36.179343 11249 raft_consensus.cc:3060] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.180503 11099 raft_consensus.cc:2468] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:36.181762 11140 leader_election.cc:304] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:36.182564 11294 raft_consensus.cc:2804] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:36.183041 11294 raft_consensus.cc:697] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Becoming Leader. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:36.183591 11248 raft_consensus.cc:2468] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:36.183926 11294 consensus_queue.cc:237] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.186403 11249 raft_consensus.cc:515] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.189078 11249 leader_election.cc:290] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 2 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:36.189664 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:36.189675 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3da02cdb98e49cd9660dcb34e1abf77" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:36.191620 11174 raft_consensus.cc:3055] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:36.191293 10998 catalog_manager.cc:5697] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 reported cstate change: term changed from 1 to 2, leader changed from 3282e3a9d92949228a78169bb357df6b (127.0.107.131) to 32498d04cc914621a17c1972a7981515 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "32498d04cc914621a17c1972a7981515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.192102 11174 raft_consensus.cc:740] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:36.193028 11174 consensus_queue.cc:260] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.194314 11174 raft_consensus.cc:3060] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.190634 11099 raft_consensus.cc:3060] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.201241 11174 raft_consensus.cc:2468] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 2.
I20260709 13:04:36.202514 11215 leader_election.cc:304] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:36.203241 11298 raft_consensus.cc:2804] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:36.203756 11298 raft_consensus.cc:697] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 2 LEADER]: Becoming Leader. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:36.204164 11099 raft_consensus.cc:2468] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 2.
I20260709 13:04:36.204610 11298 consensus_queue.cc:237] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.211115 10998 catalog_manager.cc:5697] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b reported cstate change: term changed from 1 to 2, leader changed from 32498d04cc914621a17c1972a7981515 (127.0.107.130) to 3282e3a9d92949228a78169bb357df6b (127.0.107.131). New cstate: current_term: 2 leader_uuid: "3282e3a9d92949228a78169bb357df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:36.297466 11340 raft_consensus.cc:993] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86: : Instructing follower 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:36.297902 11296 raft_consensus.cc:1081] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Signalling peer 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:36.299297 11174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52789773737a4f5db8915c627ece4817"
dest_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:49666
I20260709 13:04:36.299777 11174 raft_consensus.cc:493] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:36.300069 11174 raft_consensus.cc:3060] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.304762 11174 raft_consensus.cc:515] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.306216 11174 leader_election.cc:290] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:36.307132 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52789773737a4f5db8915c627ece4817" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:36.307338 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52789773737a4f5db8915c627ece4817" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:36.307817 11099 raft_consensus.cc:3055] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:36.307965 11249 raft_consensus.cc:3060] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.308126 11099 raft_consensus.cc:740] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:36.309123 11099 consensus_queue.cc:260] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.310343 11099 raft_consensus.cc:3060] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.313333 11249 raft_consensus.cc:2468] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:36.314560 11140 leader_election.cc:304] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:36.315356 11294 raft_consensus.cc:2804] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:36.315490 11099 raft_consensus.cc:2468] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:36.315856 11294 raft_consensus.cc:697] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Becoming Leader. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:36.316759 11294 consensus_queue.cc:237] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.322638 10998 catalog_manager.cc:5697] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 reported cstate change: term changed from 1 to 2, leader changed from b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129) to 32498d04cc914621a17c1972a7981515 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "32498d04cc914621a17c1972a7981515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.404088 11340 raft_consensus.cc:993] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86: : Instructing follower 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:36.404528 11296 raft_consensus.cc:1081] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Signalling peer 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:36.405927 11174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca7c378bc1234c0ba7af5023204e3c9e"
dest_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:49666
I20260709 13:04:36.406400 11174 raft_consensus.cc:493] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:36.406695 11174 raft_consensus.cc:3060] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.411331 11174 raft_consensus.cc:515] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.412835 11174 leader_election.cc:290] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:36.413687 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7c378bc1234c0ba7af5023204e3c9e" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:36.414032 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca7c378bc1234c0ba7af5023204e3c9e" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:36.414353 11099 raft_consensus.cc:3055] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:36.414636 11249 raft_consensus.cc:3060] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.414729 11099 raft_consensus.cc:740] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:36.415625 11099 consensus_queue.cc:260] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.416544 11099 raft_consensus.cc:3060] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.419670 11249 raft_consensus.cc:2468] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:36.420662 11140 leader_election.cc:304] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:36.421353 11294 raft_consensus.cc:2804] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:36.421406 11099 raft_consensus.cc:2468] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:36.421813 11294 raft_consensus.cc:697] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Becoming Leader. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:36.422726 11294 consensus_queue.cc:237] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.428604 10998 catalog_manager.cc:5697] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 reported cstate change: term changed from 1 to 2, leader changed from b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129) to 32498d04cc914621a17c1972a7981515 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "32498d04cc914621a17c1972a7981515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.440183 11325 raft_consensus.cc:993] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b: : Instructing follower b7c6f88e6d6449678331d4ec00f6ac86 to start an election
I20260709 13:04:36.440663 11325 raft_consensus.cc:1081] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Signalling peer b7c6f88e6d6449678331d4ec00f6ac86 to start an election
I20260709 13:04:36.442252 11099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb028abf64f94157a502849dcd7df79a"
dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
 from {username='slave'} at 127.0.0.1:40202
I20260709 13:04:36.442802 11099 raft_consensus.cc:493] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:36.443104 11099 raft_consensus.cc:3060] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.447873 11099 raft_consensus.cc:515] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.449429 11099 leader_election.cc:290] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 2 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:36.450310 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb028abf64f94157a502849dcd7df79a" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:36.450548 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb028abf64f94157a502849dcd7df79a" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:36.450971 11174 raft_consensus.cc:3060] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.451116 11249 raft_consensus.cc:3055] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:36.451561 11249 raft_consensus.cc:740] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:36.452397 11249 consensus_queue.cc:260] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.453619 11249 raft_consensus.cc:3060] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.457958 11174 raft_consensus.cc:2468] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 2.
I20260709 13:04:36.459227 11066 leader_election.cc:304] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:36.460191 11296 raft_consensus.cc:2804] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:36.460322 11249 raft_consensus.cc:2468] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 2.
I20260709 13:04:36.460750 11296 raft_consensus.cc:697] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 LEADER]: Becoming Leader. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:36.461597 11296 consensus_queue.cc:237] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.463912 11314 raft_consensus.cc:993] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515: : Instructing follower b7c6f88e6d6449678331d4ec00f6ac86 to start an election
I20260709 13:04:36.464424 11294 raft_consensus.cc:1081] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Signalling peer b7c6f88e6d6449678331d4ec00f6ac86 to start an election
I20260709 13:04:36.465741 11099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8d8697b063449ce959639e018b22b2b"
dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
 from {username='slave'} at 127.0.0.1:40190
I20260709 13:04:36.466234 11099 raft_consensus.cc:493] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:36.466586 11099 raft_consensus.cc:3060] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.468403 10998 catalog_manager.cc:5697] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 reported cstate change: term changed from 1 to 2, leader changed from 3282e3a9d92949228a78169bb357df6b (127.0.107.131) to b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.472621 11099 raft_consensus.cc:515] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.474416 11099 leader_election.cc:290] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 2 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:36.475158 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d8697b063449ce959639e018b22b2b" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:36.475404 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d8697b063449ce959639e018b22b2b" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:36.476962 11249 raft_consensus.cc:3060] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.479198 11174 raft_consensus.cc:3055] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:36.479529 11174 raft_consensus.cc:740] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:36.479900 11340 raft_consensus.cc:993] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86: : Instructing follower 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:36.480463 11296 raft_consensus.cc:1081] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Signalling peer 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:36.480294 11174 consensus_queue.cc:260] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.482244 11174 raft_consensus.cc:3060] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.482719 11175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce5a8621786e4faf984b4fd2b6f09b91"
dest_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:49666
I20260709 13:04:36.483460 11175 raft_consensus.cc:493] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:36.483846 11175 raft_consensus.cc:3060] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.485239 11249 raft_consensus.cc:2468] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 2.
I20260709 13:04:36.486416 11065 leader_election.cc:304] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:36.487246 11296 raft_consensus.cc:2804] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:36.487744 11296 raft_consensus.cc:697] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 LEADER]: Becoming Leader. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:36.488807 11174 raft_consensus.cc:2468] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 2.
I20260709 13:04:36.488535 11296 consensus_queue.cc:237] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.491158 11175 raft_consensus.cc:515] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.493575 11175 leader_election.cc:290] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:36.494212 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a8621786e4faf984b4fd2b6f09b91" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:36.494870 11099 raft_consensus.cc:3055] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:36.494903 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5a8621786e4faf984b4fd2b6f09b91" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:36.495285 11099 raft_consensus.cc:740] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:36.495606 11249 raft_consensus.cc:3060] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.496138 11099 consensus_queue.cc:260] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.496516 10998 catalog_manager.cc:5697] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 reported cstate change: term changed from 1 to 2, leader changed from 32498d04cc914621a17c1972a7981515 (127.0.107.130) to b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.497330 11099 raft_consensus.cc:3060] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.502470 11249 raft_consensus.cc:2468] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:36.503636 11099 raft_consensus.cc:2468] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:36.504683 11140 leader_election.cc:304] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:36.505594 11314 raft_consensus.cc:2804] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:36.506063 11314 raft_consensus.cc:697] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Becoming Leader. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:36.506856 11314 consensus_queue.cc:237] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.514348 10998 catalog_manager.cc:5697] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 reported cstate change: term changed from 1 to 2, leader changed from b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129) to 32498d04cc914621a17c1972a7981515 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "32498d04cc914621a17c1972a7981515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.612912 11294 raft_consensus.cc:993] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515: : Instructing follower b7c6f88e6d6449678331d4ec00f6ac86 to start an election
I20260709 13:04:36.613368 11314 raft_consensus.cc:1081] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Signalling peer b7c6f88e6d6449678331d4ec00f6ac86 to start an election
I20260709 13:04:36.614866 11099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086"
dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
 from {username='slave'} at 127.0.0.1:40190
I20260709 13:04:36.615398 11099 raft_consensus.cc:493] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:36.615722 11099 raft_consensus.cc:3060] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.620468 11099 raft_consensus.cc:515] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.621981 11099 leader_election.cc:290] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 2 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:36.622835 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:36.622933 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:36.623446 11175 raft_consensus.cc:3055] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:36.623576 11248 raft_consensus.cc:3060] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.623853 11175 raft_consensus.cc:740] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:36.624696 11175 consensus_queue.cc:260] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.625614 11175 raft_consensus.cc:3060] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.629736 11248 raft_consensus.cc:2468] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 2.
I20260709 13:04:36.630191 11175 raft_consensus.cc:2468] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 2.
I20260709 13:04:36.630810 11065 leader_election.cc:304] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:36.631701 11296 raft_consensus.cc:2804] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:36.632088 11296 raft_consensus.cc:697] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 LEADER]: Becoming Leader. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:36.632843 11296 consensus_queue.cc:237] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:36.636737 11175 raft_consensus.cc:1275] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Refusing update from remote peer 3282e3a9d92949228a78169bb357df6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.638042 11325 consensus_queue.cc:1048] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.639155 10998 catalog_manager.cc:5697] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 reported cstate change: term changed from 1 to 2, leader changed from 32498d04cc914621a17c1972a7981515 (127.0.107.130) to b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.645623 11099 raft_consensus.cc:1275] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Refusing update from remote peer 3282e3a9d92949228a78169bb357df6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.646956 11298 consensus_queue.cc:1048] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.658401 11248 raft_consensus.cc:1275] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.659880 11314 consensus_queue.cc:1048] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.668483 11099 raft_consensus.cc:1275] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.669761 11351 consensus_queue.cc:1048] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.774235 11099 raft_consensus.cc:1275] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.775520 11351 consensus_queue.cc:1048] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.782498 11248 raft_consensus.cc:1275] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.787343 11294 consensus_queue.cc:1048] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.809049 11248 raft_consensus.cc:1275] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.810282 11294 consensus_queue.cc:1048] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.819111 11099 raft_consensus.cc:1275] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.820837 11376 consensus_queue.cc:1048] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.861510 11175 raft_consensus.cc:1275] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Refusing update from remote peer b7c6f88e6d6449678331d4ec00f6ac86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.862825 11340 consensus_queue.cc:1048] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.871618 11248 raft_consensus.cc:1275] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Refusing update from remote peer b7c6f88e6d6449678331d4ec00f6ac86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.873713 11296 consensus_queue.cc:1048] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.895304 11099 raft_consensus.cc:1275] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.896458 11376 consensus_queue.cc:1048] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.904819 11248 raft_consensus.cc:1275] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.906900 11351 consensus_queue.cc:1048] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.943238 11175 raft_consensus.cc:1275] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Refusing update from remote peer b7c6f88e6d6449678331d4ec00f6ac86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.944533 11296 consensus_queue.cc:1048] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:36.953038 11248 raft_consensus.cc:1275] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Refusing update from remote peer b7c6f88e6d6449678331d4ec00f6ac86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:36.954870 11296 consensus_queue.cc:1048] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:37.049278 11175 raft_consensus.cc:1275] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Refusing update from remote peer b7c6f88e6d6449678331d4ec00f6ac86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:37.050684 11296 consensus_queue.cc:1048] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:37.060671 11248 raft_consensus.cc:1275] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Refusing update from remote peer b7c6f88e6d6449678331d4ec00f6ac86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:37.062287 11379 consensus_queue.cc:1048] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:39.078560 10998 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58198:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:39.080785 10998 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:39.128072 11082 tablet_service.cc:1511] Processing CreateTablet for tablet 5f09b37947d44db08aad9ac594d72fa9 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:39.129187 11165 tablet_service.cc:1511] Processing CreateTablet for tablet 5f09b37947d44db08aad9ac594d72fa9 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:39.130525 11165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f09b37947d44db08aad9ac594d72fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.131038 11232 tablet_service.cc:1511] Processing CreateTablet for tablet 5f09b37947d44db08aad9ac594d72fa9 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:39.132241 11232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f09b37947d44db08aad9ac594d72fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.132305 11161 tablet_service.cc:1511] Processing CreateTablet for tablet 21a6cf85813e44b0a88bd518cbf2cfba (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:39.133529 11161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a6cf85813e44b0a88bd518cbf2cfba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.129475 11082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f09b37947d44db08aad9ac594d72fa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.136708 11160 tablet_service.cc:1511] Processing CreateTablet for tablet 8fef0813e5914988981094d967ba8d7b (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
W20260709 13:04:39.137686 11046 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:39.137449 11083 tablet_service.cc:1511] Processing CreateTablet for tablet 8fef0813e5914988981094d967ba8d7b (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:39.137943 11160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fef0813e5914988981094d967ba8d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.138650 11083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fef0813e5914988981094d967ba8d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.142867 11162 tablet_service.cc:1511] Processing CreateTablet for tablet 72737b1293814567ac04458773c85390 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:39.144121 11162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72737b1293814567ac04458773c85390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.144361 11090 tablet_service.cc:1511] Processing CreateTablet for tablet 21a6cf85813e44b0a88bd518cbf2cfba (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:39.145568 11090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a6cf85813e44b0a88bd518cbf2cfba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.146355 11089 tablet_service.cc:1511] Processing CreateTablet for tablet 6af2becbbd5744fb8d4c185be1a479f5 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:39.147593 11089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af2becbbd5744fb8d4c185be1a479f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.150228 11087 tablet_service.cc:1511] Processing CreateTablet for tablet 48764888265f4f1baff20839d3384df3 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:39.151526 11087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48764888265f4f1baff20839d3384df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.152304 11163 tablet_service.cc:1511] Processing CreateTablet for tablet 6af2becbbd5744fb8d4c185be1a479f5 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:39.153565 11163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af2becbbd5744fb8d4c185be1a479f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.152305 11236 tablet_service.cc:1511] Processing CreateTablet for tablet 21a6cf85813e44b0a88bd518cbf2cfba (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:39.160379 11236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a6cf85813e44b0a88bd518cbf2cfba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.162922 11159 tablet_service.cc:1511] Processing CreateTablet for tablet 48764888265f4f1baff20839d3384df3 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:39.164232 11159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48764888265f4f1baff20839d3384df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.165411 11235 tablet_service.cc:1511] Processing CreateTablet for tablet 6af2becbbd5744fb8d4c185be1a479f5 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:39.166638 11235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af2becbbd5744fb8d4c185be1a479f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.146382 11085 tablet_service.cc:1511] Processing CreateTablet for tablet 72737b1293814567ac04458773c85390 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:39.169508 11234 tablet_service.cc:1511] Processing CreateTablet for tablet 72737b1293814567ac04458773c85390 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:39.171176 11234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72737b1293814567ac04458773c85390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.171897 11085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72737b1293814567ac04458773c85390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.175647 11237 tablet_service.cc:1511] Processing CreateTablet for tablet 8fef0813e5914988981094d967ba8d7b (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:39.176901 11237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fef0813e5914988981094d967ba8d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.178586 11233 tablet_service.cc:1511] Processing CreateTablet for tablet 48764888265f4f1baff20839d3384df3 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:39.179811 11233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48764888265f4f1baff20839d3384df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.180761 11164 tablet_service.cc:1511] Processing CreateTablet for tablet 4868902e0fa149e884580db68fab331f (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:39.182003 11164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4868902e0fa149e884580db68fab331f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.184410 11084 tablet_service.cc:1511] Processing CreateTablet for tablet 4868902e0fa149e884580db68fab331f (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:39.185709 11084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4868902e0fa149e884580db68fab331f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.201565 11238 tablet_service.cc:1511] Processing CreateTablet for tablet 4868902e0fa149e884580db68fab331f (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:39.202986 11238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4868902e0fa149e884580db68fab331f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.246448 11090 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb6ba3173fe4304b9596bfca843f7be (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:39.247821 11090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb6ba3173fe4304b9596bfca843f7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.255085 11398 tablet_bootstrap.cc:492] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:39.260417 11165 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb6ba3173fe4304b9596bfca843f7be (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:39.262069 11165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb6ba3173fe4304b9596bfca843f7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.272524 11397 tablet_bootstrap.cc:492] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:39.280571 11399 tablet_bootstrap.cc:492] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:39.282491 11398 tablet_bootstrap.cc:654] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.287889 11399 tablet_bootstrap.cc:654] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.297490 11159 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5bca825fcd42e6b9f0cd43be8eb552 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:39.298949 11159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5bca825fcd42e6b9f0cd43be8eb552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.298780 11237 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5bca825fcd42e6b9f0cd43be8eb552 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:39.300066 11237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5bca825fcd42e6b9f0cd43be8eb552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.304427 11238 tablet_service.cc:1511] Processing CreateTablet for tablet 1cb6ba3173fe4304b9596bfca843f7be (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:39.305784 11238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb6ba3173fe4304b9596bfca843f7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.328847 11399 tablet_bootstrap.cc:492] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:39.330793 11398 tablet_bootstrap.cc:492] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:39.333587 11398 ts_tablet_manager.cc:1403] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.012s
I20260709 13:04:39.336551 11398 raft_consensus.cc:359] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.337807 11398 raft_consensus.cc:385] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.338320 11398 raft_consensus.cc:740] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.339184 11398 consensus_queue.cc:260] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.341854 11398 ts_tablet_manager.cc:1434] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:39.343011 11398 tablet_bootstrap.cc:492] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:39.345541 11397 tablet_bootstrap.cc:654] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.336993 11089 tablet_service.cc:1511] Processing CreateTablet for tablet 8b5bca825fcd42e6b9f0cd43be8eb552 (DEFAULT_TABLE table=soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:39.337486 11399 ts_tablet_manager.cc:1403] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.057s	user 0.026s	sys 0.016s
I20260709 13:04:39.350850 11399 raft_consensus.cc:359] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.351567 11399 raft_consensus.cc:385] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.351871 11399 raft_consensus.cc:740] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.352669 11399 consensus_queue.cc:260] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.354272 11398 tablet_bootstrap.cc:654] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.355084 11399 ts_tablet_manager.cc:1434] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:39.356257 11399 tablet_bootstrap.cc:492] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:39.358992 11089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b5bca825fcd42e6b9f0cd43be8eb552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:39.373692 11399 tablet_bootstrap.cc:654] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.378819 11398 tablet_bootstrap.cc:492] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:39.379438 11398 ts_tablet_manager.cc:1403] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.012s
I20260709 13:04:39.381953 11398 raft_consensus.cc:359] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.382493 11398 raft_consensus.cc:385] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.382784 11398 raft_consensus.cc:740] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.383605 11398 consensus_queue.cc:260] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.385783 11398 ts_tablet_manager.cc:1434] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:39.386777 11398 tablet_bootstrap.cc:492] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:39.399657 11397 tablet_bootstrap.cc:492] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:39.400250 11397 ts_tablet_manager.cc:1403] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.009s
I20260709 13:04:39.401867 11398 tablet_bootstrap.cc:654] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.405164 11399 tablet_bootstrap.cc:492] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:39.405058 11397 raft_consensus.cc:359] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.405704 11399 ts_tablet_manager.cc:1403] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.003s
I20260709 13:04:39.405915 11397 raft_consensus.cc:385] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.406250 11397 raft_consensus.cc:740] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.407141 11397 consensus_queue.cc:260] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.408565 11398 tablet_bootstrap.cc:492] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:39.409065 11398 ts_tablet_manager.cc:1403] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.005s
I20260709 13:04:39.409312 11397 ts_tablet_manager.cc:1434] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:04:39.410343 11397 tablet_bootstrap.cc:492] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:39.411888 11398 raft_consensus.cc:359] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.412565 11398 raft_consensus.cc:385] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.412851 11398 raft_consensus.cc:740] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.413507 11399 raft_consensus.cc:359] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.413523 11398 consensus_queue.cc:260] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.414471 11399 raft_consensus.cc:385] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.414812 11399 raft_consensus.cc:740] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.415591 11399 consensus_queue.cc:260] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.417310 11397 tablet_bootstrap.cc:654] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.417837 11399 ts_tablet_manager.cc:1434] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:39.418809 11399 tablet_bootstrap.cc:492] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:39.420221 11398 ts_tablet_manager.cc:1434] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:04:39.421244 11398 tablet_bootstrap.cc:492] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:39.425143 11399 tablet_bootstrap.cc:654] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.430647 11398 tablet_bootstrap.cc:654] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.431715 11379 raft_consensus.cc:493] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.432186 11379 raft_consensus.cc:515] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.435351 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fef0813e5914988981094d967ba8d7b" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:39.436277 11248 raft_consensus.cc:2468] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:39.437716 11065 leader_election.cc:304] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:39.438242 11404 raft_consensus.cc:493] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.438932 11404 raft_consensus.cc:515] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.440099 11379 leader_election.cc:290] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.440997 11379 raft_consensus.cc:2804] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.441732 11379 raft_consensus.cc:493] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.443811 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48764888265f4f1baff20839d3384df3" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:39.444634 11379 raft_consensus.cc:3060] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.435292 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fef0813e5914988981094d967ba8d7b" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:39.446597 11175 raft_consensus.cc:2468] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
W20260709 13:04:39.448312 11066 leader_election.cc:343] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.441846 11404 leader_election.cc:290] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.462725 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48764888265f4f1baff20839d3384df3" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
W20260709 13:04:39.464884 11065 leader_election.cc:343] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.465236 11397 tablet_bootstrap.cc:492] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:39.465983 11397 ts_tablet_manager.cc:1403] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.005s
I20260709 13:04:39.465636 11065 leader_election.cc:304] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7c6f88e6d6449678331d4ec00f6ac86; no voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b
I20260709 13:04:39.467764 11408 raft_consensus.cc:2749] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:39.465243 11399 tablet_bootstrap.cc:492] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:39.469465 11397 raft_consensus.cc:359] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.470233 11397 raft_consensus.cc:385] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.470325 11399 ts_tablet_manager.cc:1403] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.052s	user 0.030s	sys 0.017s
I20260709 13:04:39.470579 11397 raft_consensus.cc:740] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.467968 11379 raft_consensus.cc:515] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.471344 11397 consensus_queue.cc:260] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.471963 11398 tablet_bootstrap.cc:492] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:39.472793 11398 ts_tablet_manager.cc:1403] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.023s
I20260709 13:04:39.473753 11397 ts_tablet_manager.cc:1434] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:39.473410 11399 raft_consensus.cc:359] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.474138 11399 raft_consensus.cc:385] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.474423 11399 raft_consensus.cc:740] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.474758 11397 tablet_bootstrap.cc:492] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:39.475169 11399 consensus_queue.cc:260] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.475658 11398 raft_consensus.cc:359] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.476372 11398 raft_consensus.cc:385] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.476636 11398 raft_consensus.cc:740] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.477535 11399 ts_tablet_manager.cc:1434] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:39.477469 11398 consensus_queue.cc:260] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.478554 11399 tablet_bootstrap.cc:492] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:39.481989 11398 ts_tablet_manager.cc:1434] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:04:39.482983 11398 tablet_bootstrap.cc:492] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:39.485343 11399 tablet_bootstrap.cc:654] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.488508 11379 leader_election.cc:290] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.489346 11398 tablet_bootstrap.cc:654] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.489476 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fef0813e5914988981094d967ba8d7b" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:39.490293 11175 raft_consensus.cc:3060] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.491534 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fef0813e5914988981094d967ba8d7b" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:39.492147 11248 raft_consensus.cc:3060] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.501289 11398 tablet_bootstrap.cc:492] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:39.501849 11398 ts_tablet_manager.cc:1403] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:04:39.505002 11398 raft_consensus.cc:359] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.505693 11398 raft_consensus.cc:385] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.505981 11398 raft_consensus.cc:740] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.506726 11398 consensus_queue.cc:260] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.510142 11398 ts_tablet_manager.cc:1434] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:04:39.511147 11398 tablet_bootstrap.cc:492] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:39.513764 11248 raft_consensus.cc:2468] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:39.517513 11398 tablet_bootstrap.cc:654] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.517544 11065 leader_election.cc:304] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:39.518699 11379 raft_consensus.cc:2804] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.519264 11379 raft_consensus.cc:697] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Leader. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:39.520169 11379 consensus_queue.cc:237] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.532793 11398 tablet_bootstrap.cc:492] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:39.533342 11398 ts_tablet_manager.cc:1403] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.022s	user 0.003s	sys 0.014s
I20260709 13:04:39.536345 11398 raft_consensus.cc:359] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.537056 11398 raft_consensus.cc:385] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.537094 11175 raft_consensus.cc:2468] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:39.537416 11398 raft_consensus.cc:740] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.537518 11397 tablet_bootstrap.cc:654] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.539398 11398 consensus_queue.cc:260] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.540443 11399 tablet_bootstrap.cc:492] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:39.540932 11399 ts_tablet_manager.cc:1403] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.063s	user 0.028s	sys 0.032s
I20260709 13:04:39.542693 11398 ts_tablet_manager.cc:1434] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:39.543745 11399 raft_consensus.cc:359] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.544209 11398 tablet_bootstrap.cc:492] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:39.544481 11399 raft_consensus.cc:385] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.544915 11399 raft_consensus.cc:740] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.545763 11399 consensus_queue.cc:260] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.545501 10996 catalog_manager.cc:5697] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.549845 11399 ts_tablet_manager.cc:1434] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:39.550846 11399 tablet_bootstrap.cc:492] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:39.554281 11398 tablet_bootstrap.cc:654] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.559490 11399 tablet_bootstrap.cc:654] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.574218 11397 tablet_bootstrap.cc:492] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:39.574967 11397 ts_tablet_manager.cc:1403] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.100s	user 0.018s	sys 0.003s
I20260709 13:04:39.578470 11399 tablet_bootstrap.cc:492] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:39.578756 11398 tablet_bootstrap.cc:492] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:39.578964 11399 ts_tablet_manager.cc:1403] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.028s	user 0.002s	sys 0.019s
I20260709 13:04:39.578661 11397 raft_consensus.cc:359] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.579468 11398 ts_tablet_manager.cc:1403] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.019s
I20260709 13:04:39.579661 11397 raft_consensus.cc:385] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.580003 11397 raft_consensus.cc:740] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.580730 11397 consensus_queue.cc:260] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.581787 11399 raft_consensus.cc:359] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.582548 11399 raft_consensus.cc:385] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.582391 11398 raft_consensus.cc:359] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.582891 11399 raft_consensus.cc:740] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.583009 11397 ts_tablet_manager.cc:1434] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:04:39.583240 11398 raft_consensus.cc:385] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.583590 11398 raft_consensus.cc:740] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.583784 11399 consensus_queue.cc:260] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.584306 11398 consensus_queue.cc:260] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.586277 11399 ts_tablet_manager.cc:1434] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:39.586884 11398 ts_tablet_manager.cc:1434] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:39.587431 11397 tablet_bootstrap.cc:492] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:39.590276 11399 tablet_bootstrap.cc:492] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:39.593228 11398 tablet_bootstrap.cc:492] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:39.597157 11399 tablet_bootstrap.cc:654] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.600159 11398 tablet_bootstrap.cc:654] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.604434 11397 tablet_bootstrap.cc:654] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.609422 11398 tablet_bootstrap.cc:492] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:39.610026 11398 ts_tablet_manager.cc:1403] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.001s
I20260709 13:04:39.613413 11398 raft_consensus.cc:359] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.614044 11398 raft_consensus.cc:385] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.614308 11398 raft_consensus.cc:740] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.614951 11398 consensus_queue.cc:260] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.615327 11399 tablet_bootstrap.cc:492] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:39.615387 11397 tablet_bootstrap.cc:492] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:39.616111 11397 ts_tablet_manager.cc:1403] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.008s
I20260709 13:04:39.616228 11399 ts_tablet_manager.cc:1403] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.018s
I20260709 13:04:39.617198 11398 ts_tablet_manager.cc:1434] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:39.618160 11398 tablet_bootstrap.cc:492] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86: Bootstrap starting.
I20260709 13:04:39.619058 11397 raft_consensus.cc:359] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.619303 11399 raft_consensus.cc:359] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.619791 11397 raft_consensus.cc:385] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.619831 11298 raft_consensus.cc:493] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.620083 11399 raft_consensus.cc:385] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.620206 11397 raft_consensus.cc:740] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.620497 11399 raft_consensus.cc:740] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.620457 11298 raft_consensus.cc:515] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.621119 11397 consensus_queue.cc:260] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.621619 11399 consensus_queue.cc:260] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.622673 11298 leader_election.cc:290] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:39.623507 11397 ts_tablet_manager.cc:1434] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:39.624493 11397 tablet_bootstrap.cc:492] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:39.626488 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4868902e0fa149e884580db68fab331f" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:39.628108 11097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4868902e0fa149e884580db68fab331f" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
I20260709 13:04:39.628866 11097 raft_consensus.cc:2468] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 0.
W20260709 13:04:39.628181 11215 leader_election.cc:343] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.630759 11397 tablet_bootstrap.cc:654] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.631985 11214 leader_election.cc:304] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 32498d04cc914621a17c1972a7981515
I20260709 13:04:39.633216 11298 raft_consensus.cc:2804] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.633579 11298 raft_consensus.cc:493] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.633881 11298 raft_consensus.cc:3060] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.642319 11397 tablet_bootstrap.cc:492] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:39.642030 11298 raft_consensus.cc:515] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.642884 11397 ts_tablet_manager.cc:1403] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:04:39.643834 11398 tablet_bootstrap.cc:654] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.644773 11097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4868902e0fa149e884580db68fab331f" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:39.645351 11097 raft_consensus.cc:3060] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.645639 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4868902e0fa149e884580db68fab331f" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:39.645937 11397 raft_consensus.cc:359] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.646692 11397 raft_consensus.cc:385] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.646984 11397 raft_consensus.cc:740] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
W20260709 13:04:39.647163 11215 leader_election.cc:343] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.648058 11298 leader_election.cc:290] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:39.647828 11397 consensus_queue.cc:260] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.651213 11397 ts_tablet_manager.cc:1434] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:39.652757 11398 tablet_bootstrap.cc:492] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86: No bootstrap required, opened a new log
I20260709 13:04:39.653275 11398 ts_tablet_manager.cc:1403] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.001s
I20260709 13:04:39.655886 11398 raft_consensus.cc:359] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.656524 11398 raft_consensus.cc:385] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.656574 11397 tablet_bootstrap.cc:492] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:39.656859 11398 raft_consensus.cc:740] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.657791 11379 raft_consensus.cc:493] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.657784 11398 consensus_queue.cc:260] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.658576 11379 raft_consensus.cc:515] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.659997 11398 ts_tablet_manager.cc:1434] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:04:39.661337 11376 raft_consensus.cc:493] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.661275 11379 leader_election.cc:290] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.661916 11376 raft_consensus.cc:515] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.662654 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af2becbbd5744fb8d4c185be1a479f5" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:39.663291 11248 raft_consensus.cc:2468] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:39.664558 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af2becbbd5744fb8d4c185be1a479f5" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:39.666023 11065 leader_election.cc:304] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
W20260709 13:04:39.666941 11066 leader_election.cc:343] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.667124 11399 ts_tablet_manager.cc:1434] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.028s
I20260709 13:04:39.668314 11399 tablet_bootstrap.cc:492] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:39.669629 11376 leader_election.cc:290] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.671028 11379 raft_consensus.cc:2804] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.671522 11379 raft_consensus.cc:493] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.671952 11379 raft_consensus.cc:3060] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.672551 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48764888265f4f1baff20839d3384df3" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
I20260709 13:04:39.673156 11099 raft_consensus.cc:2468] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 0.
I20260709 13:04:39.671382 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48764888265f4f1baff20839d3384df3" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
W20260709 13:04:39.674804 11140 leader_election.cc:343] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.675086 11408 raft_consensus.cc:493] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.675606 11408 raft_consensus.cc:515] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.675892 11140 leader_election.cc:304] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 3282e3a9d92949228a78169bb357df6b
I20260709 13:04:39.675910 11399 tablet_bootstrap.cc:654] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.677767 11408 leader_election.cc:290] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.679292 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bca825fcd42e6b9f0cd43be8eb552" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:39.680197 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bca825fcd42e6b9f0cd43be8eb552" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:39.680576 11376 raft_consensus.cc:2804] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.681007 11376 raft_consensus.cc:493] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.681332 11376 raft_consensus.cc:3060] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.681774 11379 raft_consensus.cc:515] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
W20260709 13:04:39.681984 11066 leader_election.cc:343] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.671023 11397 tablet_bootstrap.cc:654] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.685632 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af2becbbd5744fb8d4c185be1a479f5" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:39.686237 11248 raft_consensus.cc:3060] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.687249 11379 leader_election.cc:290] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.690313 11421 raft_consensus.cc:493] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.690918 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af2becbbd5744fb8d4c185be1a479f5" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:39.690945 11421 raft_consensus.cc:515] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
W20260709 13:04:39.693032 11066 leader_election.cc:343] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.693607 11421 leader_election.cc:290] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
W20260709 13:04:39.690970 11065 leader_election.cc:343] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.694588 11065 leader_election.cc:304] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7c6f88e6d6449678331d4ec00f6ac86; no voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b
I20260709 13:04:39.694671 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a6cf85813e44b0a88bd518cbf2cfba" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:39.695343 11175 raft_consensus.cc:2468] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 0.
I20260709 13:04:39.696115 11379 raft_consensus.cc:2749] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:39.696587 11215 leader_election.cc:304] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:39.697017 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a6cf85813e44b0a88bd518cbf2cfba" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
I20260709 13:04:39.697615 11099 raft_consensus.cc:2468] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 0.
I20260709 13:04:39.697721 11421 raft_consensus.cc:2804] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.698105 11421 raft_consensus.cc:493] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.698446 11421 raft_consensus.cc:3060] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.693456 11397 tablet_bootstrap.cc:492] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:39.704151 11397 ts_tablet_manager.cc:1403] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.011s
I20260709 13:04:39.705718 11376 raft_consensus.cc:515] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.707922 11376 leader_election.cc:290] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.709300 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48764888265f4f1baff20839d3384df3" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:39.710005 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48764888265f4f1baff20839d3384df3" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
W20260709 13:04:39.710650 11140 leader_election.cc:343] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.710758 11099 raft_consensus.cc:3060] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.711040 11248 raft_consensus.cc:2468] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:39.707154 11397 raft_consensus.cc:359] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.712409 11397 raft_consensus.cc:385] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.712754 11065 leader_election.cc:304] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 32498d04cc914621a17c1972a7981515
I20260709 13:04:39.713624 11379 raft_consensus.cc:2804] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.714097 11379 raft_consensus.cc:697] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Leader. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:39.714506 11399 tablet_bootstrap.cc:492] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:39.715046 11399 ts_tablet_manager.cc:1403] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.047s	user 0.027s	sys 0.013s
I20260709 13:04:39.715176 11379 consensus_queue.cc:237] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.717262 11097 raft_consensus.cc:2468] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 1.
I20260709 13:04:39.718068 11399 raft_consensus.cc:359] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.718442 11099 raft_consensus.cc:2468] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 1.
I20260709 13:04:39.718864 11399 raft_consensus.cc:385] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.719241 11399 raft_consensus.cc:740] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.719610 11214 leader_election.cc:304] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 32498d04cc914621a17c1972a7981515
I20260709 13:04:39.719825 11140 leader_election.cc:304] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 3282e3a9d92949228a78169bb357df6b
I20260709 13:04:39.720214 11399 consensus_queue.cc:260] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.720952 11298 raft_consensus.cc:2804] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.721089 11376 raft_consensus.cc:2804] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.721349 11421 raft_consensus.cc:515] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.712742 11397 raft_consensus.cc:740] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.724948 11397 consensus_queue.cc:260] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.729965 11376 raft_consensus.cc:697] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Becoming Leader. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:39.731153 11376 consensus_queue.cc:237] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.733608 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a6cf85813e44b0a88bd518cbf2cfba" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:39.734620 11298 raft_consensus.cc:697] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Becoming Leader. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:39.734812 11175 raft_consensus.cc:3060] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.735607 11298 consensus_queue.cc:237] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.735702 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a6cf85813e44b0a88bd518cbf2cfba" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:39.741657 11099 raft_consensus.cc:3060] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.750028 11408 raft_consensus.cc:493] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.750831 11408 raft_consensus.cc:515] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.753908 11408 leader_election.cc:290] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.755842 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72737b1293814567ac04458773c85390" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:39.756456 11399 ts_tablet_manager.cc:1434] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.041s	user 0.014s	sys 0.029s
I20260709 13:04:39.757640 11399 tablet_bootstrap.cc:492] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
W20260709 13:04:39.757862 11066 leader_election.cc:343] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.757543 10996 catalog_manager.cc:5697] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32498d04cc914621a17c1972a7981515 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "32498d04cc914621a17c1972a7981515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.760833 10997 catalog_manager.cc:5697] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3282e3a9d92949228a78169bb357df6b (127.0.107.131). New cstate: current_term: 1 leader_uuid: "3282e3a9d92949228a78169bb357df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:39.761811 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72737b1293814567ac04458773c85390" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:39.762609 11248 raft_consensus.cc:2468] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:39.764842 11065 leader_election.cc:304] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 32498d04cc914621a17c1972a7981515
I20260709 13:04:39.765461 11399 tablet_bootstrap.cc:654] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.768074 11099 raft_consensus.cc:2468] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 1.
I20260709 13:04:39.769917 11421 leader_election.cc:290] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:39.771034 11379 raft_consensus.cc:493] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.771219 11397 ts_tablet_manager.cc:1434] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260709 13:04:39.771265 11399 tablet_bootstrap.cc:492] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:39.771982 11399 ts_tablet_manager.cc:1403] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:04:39.772500 11214 leader_election.cc:304] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:39.773159 11379 raft_consensus.cc:515] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.773691 11397 tablet_bootstrap.cc:492] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:39.773629 11404 raft_consensus.cc:2804] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.774576 11404 raft_consensus.cc:493] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.774988 11404 raft_consensus.cc:3060] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.775118 11399 raft_consensus.cc:359] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.775974 11399 raft_consensus.cc:385] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.776264 11399 raft_consensus.cc:740] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.777161 11379 leader_election.cc:290] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.776978 11399 consensus_queue.cc:260] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.778502 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f09b37947d44db08aad9ac594d72fa9" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:39.779196 11174 raft_consensus.cc:2468] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:39.780004 11399 ts_tablet_manager.cc:1434] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:39.779968 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f09b37947d44db08aad9ac594d72fa9" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:39.780824 11248 raft_consensus.cc:2468] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:39.781216 11399 tablet_bootstrap.cc:492] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b: Bootstrap starting.
I20260709 13:04:39.773974 11421 raft_consensus.cc:2804] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.783771 11421 raft_consensus.cc:697] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Becoming Leader. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:39.784713 11421 consensus_queue.cc:237] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.785899 11066 leader_election.cc:304] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:39.783193 11404 raft_consensus.cc:515] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.786861 11379 raft_consensus.cc:2804] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.787310 11379 raft_consensus.cc:493] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.787549 11397 tablet_bootstrap.cc:654] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.789023 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72737b1293814567ac04458773c85390" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:39.788555 10998 catalog_manager.cc:5697] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.793071 11399 tablet_bootstrap.cc:654] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:39.793320 11066 leader_election.cc:343] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:39.795544 11379 raft_consensus.cc:3060] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.796625 11175 raft_consensus.cc:2468] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 1.
I20260709 13:04:39.802433 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72737b1293814567ac04458773c85390" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:39.803128 11248 raft_consensus.cc:3060] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.803444 11379 raft_consensus.cc:515] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.806413 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f09b37947d44db08aad9ac594d72fa9" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:39.807018 11174 raft_consensus.cc:3060] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.798086 11404 leader_election.cc:290] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.814424 11379 leader_election.cc:290] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.814705 11174 raft_consensus.cc:2468] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:39.817252 11066 leader_election.cc:304] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:39.818362 11379 raft_consensus.cc:2804] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.818898 11379 raft_consensus.cc:697] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Leader. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:39.819813 11379 consensus_queue.cc:237] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.826207 11399 tablet_bootstrap.cc:492] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b: No bootstrap required, opened a new log
I20260709 13:04:39.829280 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f09b37947d44db08aad9ac594d72fa9" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:39.829908 11249 raft_consensus.cc:3060] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.831573 11399 ts_tablet_manager.cc:1403] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.002s
I20260709 13:04:39.834143 11421 raft_consensus.cc:493] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.834363 11399 raft_consensus.cc:359] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.835084 11399 raft_consensus.cc:385] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.836728 11248 raft_consensus.cc:2468] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:39.836773 11249 raft_consensus.cc:2468] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:39.838819 11065 leader_election.cc:304] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 32498d04cc914621a17c1972a7981515
I20260709 13:04:39.834635 11421 raft_consensus.cc:515] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.840045 11404 raft_consensus.cc:2804] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.840672 11404 raft_consensus.cc:697] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Leader. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:39.841997 11421 leader_election.cc:290] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:39.841692 11404 consensus_queue.cc:237] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.843243 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48764888265f4f1baff20839d3384df3" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:39.844300 11397 tablet_bootstrap.cc:492] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:39.844818 11397 ts_tablet_manager.cc:1403] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.073s	user 0.022s	sys 0.030s
I20260709 13:04:39.847245 10998 catalog_manager.cc:5697] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3282e3a9d92949228a78169bb357df6b (127.0.107.131). New cstate: current_term: 1 leader_uuid: "3282e3a9d92949228a78169bb357df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:39.848232 11397 raft_consensus.cc:359] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.848966 11097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48764888265f4f1baff20839d3384df3" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
I20260709 13:04:39.849509 11404 raft_consensus.cc:493] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.835373 11399 raft_consensus.cc:740] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.849848 11097 raft_consensus.cc:2393] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3282e3a9d92949228a78169bb357df6b in current term 1: Already voted for candidate 32498d04cc914621a17c1972a7981515 in this term.
I20260709 13:04:39.850162 11404 raft_consensus.cc:515] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.850965 11214 leader_election.cc:304] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b; no voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86
I20260709 13:04:39.851866 11421 raft_consensus.cc:3060] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.849005 11397 raft_consensus.cc:385] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.852659 11397 raft_consensus.cc:740] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.853173 11404 leader_election.cc:290] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.853246 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6ba3173fe4304b9596bfca843f7be" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515" is_pre_election: true
I20260709 13:04:39.854049 11174 raft_consensus.cc:2468] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:39.854089 11249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6ba3173fe4304b9596bfca843f7be" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:39.854100 11397 consensus_queue.cc:260] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.855507 11066 leader_election.cc:304] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:39.860105 11397 ts_tablet_manager.cc:1434] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:04:39.861220 11397 tablet_bootstrap.cc:492] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:39.863045 11421 raft_consensus.cc:2749] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:39.850692 11399 consensus_queue.cc:260] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.865482 11399 ts_tablet_manager.cc:1434] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:04:39.866652 11249 raft_consensus.cc:2468] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 0.
I20260709 13:04:39.869721 11397 tablet_bootstrap.cc:654] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.870101 11408 raft_consensus.cc:2804] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:39.870517 11408 raft_consensus.cc:493] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.870887 11408 raft_consensus.cc:3060] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.889689 11397 tablet_bootstrap.cc:492] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:39.890247 11397 ts_tablet_manager.cc:1403] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.008s
I20260709 13:04:39.889024 11408 raft_consensus.cc:515] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.893505 11408 leader_election.cc:290] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:39.892927 11397 raft_consensus.cc:359] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.894418 11397 raft_consensus.cc:385] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.894608 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6ba3173fe4304b9596bfca843f7be" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:39.894702 11397 raft_consensus.cc:740] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.895529 11248 raft_consensus.cc:3060] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.895812 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6ba3173fe4304b9596bfca843f7be" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:39.895869 11397 consensus_queue.cc:260] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.897092 10996 catalog_manager.cc:5697] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.898653 11397 ts_tablet_manager.cc:1434] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:39.899600 11397 tablet_bootstrap.cc:492] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515: Bootstrap starting.
I20260709 13:04:39.896514 11174 raft_consensus.cc:3060] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:39.903366 11248 raft_consensus.cc:2468] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:39.905139 11397 tablet_bootstrap.cc:654] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:39.906044 11065 leader_election.cc:304] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:39.906978 11408 raft_consensus.cc:2804] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:39.907580 11174 raft_consensus.cc:2468] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 1.
I20260709 13:04:39.907783 11408 raft_consensus.cc:697] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Leader. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:39.908763 11408 consensus_queue.cc:237] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.912071 11397 tablet_bootstrap.cc:492] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515: No bootstrap required, opened a new log
I20260709 13:04:39.912612 11397 ts_tablet_manager.cc:1403] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.001s
I20260709 13:04:39.915305 11397 raft_consensus.cc:359] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.916042 11397 raft_consensus.cc:385] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:39.916330 11397 raft_consensus.cc:740] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Initialized, Role: FOLLOWER
I20260709 13:04:39.917303 11397 consensus_queue.cc:260] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:39.919436 11397 ts_tablet_manager.cc:1434] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:39.921098 10996 catalog_manager.cc:5697] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:39.922865 10996 catalog_manager.cc:5697] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.083734 11408 consensus_queue.cc:1048] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.091883 11376 raft_consensus.cc:493] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.092538 11376 raft_consensus.cc:515] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.093871 11408 consensus_queue.cc:1048] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:40.101466 11376 leader_election.cc:290] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:40.102900 11097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bca825fcd42e6b9f0cd43be8eb552" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
I20260709 13:04:40.103716 11097 raft_consensus.cc:2468] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 0.
I20260709 13:04:40.105123 11140 leader_election.cc:304] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:40.106634 11376 raft_consensus.cc:2804] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:40.107555 11376 raft_consensus.cc:493] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.108337 11376 raft_consensus.cc:3060] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.108549 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bca825fcd42e6b9f0cd43be8eb552" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:40.109282 11248 raft_consensus.cc:2468] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 0.
I20260709 13:04:40.115253 11376 raft_consensus.cc:515] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.117835 11097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bca825fcd42e6b9f0cd43be8eb552" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:40.118104 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bca825fcd42e6b9f0cd43be8eb552" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:40.118460 11097 raft_consensus.cc:3060] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.117256 11376 leader_election.cc:290] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:40.118700 11248 raft_consensus.cc:3060] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.124431 11097 raft_consensus.cc:2468] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 1.
I20260709 13:04:40.124539 11248 raft_consensus.cc:2468] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 1.
I20260709 13:04:40.125411 11140 leader_election.cc:304] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:40.126169 11376 raft_consensus.cc:2804] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:40.126618 11376 raft_consensus.cc:697] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Becoming Leader. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:40.127266 11376 consensus_queue.cc:237] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.133507 10998 catalog_manager.cc:5697] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32498d04cc914621a17c1972a7981515 (127.0.107.130). New cstate: current_term: 1 leader_uuid: "32498d04cc914621a17c1972a7981515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.211155 11404 consensus_queue.cc:1048] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.226643 11379 consensus_queue.cc:1048] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.234094 11376 raft_consensus.cc:493] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.234576 11376 raft_consensus.cc:515] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.236603 11376 leader_election.cc:290] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:40.237298 11097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72737b1293814567ac04458773c85390" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
I20260709 13:04:40.239027 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72737b1293814567ac04458773c85390" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:40.239789 11248 raft_consensus.cc:2393] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32498d04cc914621a17c1972a7981515 in current term 1: Already voted for candidate b7c6f88e6d6449678331d4ec00f6ac86 in this term.
I20260709 13:04:40.240732 11140 leader_election.cc:304] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32498d04cc914621a17c1972a7981515; no voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86
I20260709 13:04:40.241677 11376 raft_consensus.cc:3060] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.248842 11376 raft_consensus.cc:2749] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:40.260813 11376 consensus_queue.cc:1048] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.266427 11376 consensus_queue.cc:1048] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.272208 11430 raft_consensus.cc:493] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.272732 11430 raft_consensus.cc:515] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.276856 11421 consensus_queue.cc:1048] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.278457 11430 leader_election.cc:290] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:40.281937 11097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4868902e0fa149e884580db68fab331f" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" is_pre_election: true
I20260709 13:04:40.291627 11247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4868902e0fa149e884580db68fab331f" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3282e3a9d92949228a78169bb357df6b" is_pre_election: true
I20260709 13:04:40.293967 11174 raft_consensus.cc:3060] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.295913 11140 leader_election.cc:304] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32498d04cc914621a17c1972a7981515; no voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86
I20260709 13:04:40.298401 11175 raft_consensus.cc:3060] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:40.305404 11379 consensus_queue.cc:1048] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.306560 11453 raft_consensus.cc:2749] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:40.312261 11455 consensus_queue.cc:1048] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:40.321825 11404 consensus_queue.cc:1048] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.322831 11455 consensus_queue.cc:1048] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:40.329682 11408 consensus_queue.cc:1048] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:40.344177 11455 consensus_queue.cc:1048] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.346421 11408 consensus_queue.cc:1048] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.347020 11247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21a6cf85813e44b0a88bd518cbf2cfba"
dest_uuid: "3282e3a9d92949228a78169bb357df6b"
mode: GRACEFUL
new_leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
 from {username='slave'} at 127.0.0.1:35056
I20260709 13:04:40.347675 11247 raft_consensus.cc:606] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Received request to transfer leadership to TS b7c6f88e6d6449678331d4ec00f6ac86
I20260709 13:04:40.355738 11298 raft_consensus.cc:993] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b: : Instructing follower b7c6f88e6d6449678331d4ec00f6ac86 to start an election
I20260709 13:04:40.356309 11455 raft_consensus.cc:1081] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Signalling peer b7c6f88e6d6449678331d4ec00f6ac86 to start an election
I20260709 13:04:40.374701 11097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6af2becbbd5744fb8d4c185be1a479f5"
dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
mode: GRACEFUL
new_leader_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:04:40.375355 11097 raft_consensus.cc:606] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Received request to transfer leadership to TS 32498d04cc914621a17c1972a7981515
I20260709 13:04:40.377454 11099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21a6cf85813e44b0a88bd518cbf2cfba"
dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
 from {username='slave'} at 127.0.0.1:40202
I20260709 13:04:40.378336 11099 raft_consensus.cc:493] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:40.378854 11099 raft_consensus.cc:3060] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.387594 11099 raft_consensus.cc:515] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.390419 11099 leader_election.cc:290] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 2 election: Requested vote from peers 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:40.390612 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a6cf85813e44b0a88bd518cbf2cfba" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:40.391275 11174 raft_consensus.cc:3060] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.391314 11247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4868902e0fa149e884580db68fab331f"
dest_uuid: "3282e3a9d92949228a78169bb357df6b"
mode: GRACEFUL
new_leader_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:35056
I20260709 13:04:40.392055 11247 raft_consensus.cc:606] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Received request to transfer leadership to TS 32498d04cc914621a17c1972a7981515
I20260709 13:04:40.396377 11248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a6cf85813e44b0a88bd518cbf2cfba" candidate_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:40.397173 11248 raft_consensus.cc:3055] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:40.397512 11248 raft_consensus.cc:740] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:40.398715 11248 consensus_queue.cc:260] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.399708 11248 raft_consensus.cc:3060] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.401105 11099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cb6ba3173fe4304b9596bfca843f7be"
dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
mode: GRACEFUL
new_leader_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:04:40.401748 11099 raft_consensus.cc:606] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Received request to transfer leadership to TS 32498d04cc914621a17c1972a7981515
I20260709 13:04:40.405932 11174 raft_consensus.cc:2468] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 2.
I20260709 13:04:40.407145 11066 leader_election.cc:304] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:40.407297 11248 raft_consensus.cc:2468] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7c6f88e6d6449678331d4ec00f6ac86 in term 2.
I20260709 13:04:40.407807 11174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b5bca825fcd42e6b9f0cd43be8eb552"
dest_uuid: "32498d04cc914621a17c1972a7981515"
mode: GRACEFUL
new_leader_uuid: "3282e3a9d92949228a78169bb357df6b"
 from {username='slave'} at 127.0.0.1:49672
I20260709 13:04:40.408017 11404 raft_consensus.cc:2804] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:40.408376 11174 raft_consensus.cc:606] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Received request to transfer leadership to TS 3282e3a9d92949228a78169bb357df6b
I20260709 13:04:40.408555 11404 raft_consensus.cc:697] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 LEADER]: Becoming Leader. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:40.409433 11404 consensus_queue.cc:237] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.411726 11379 consensus_queue.cc:1048] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.416563 10998 catalog_manager.cc:5697] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 reported cstate change: term changed from 1 to 2, leader changed from 3282e3a9d92949228a78169bb357df6b (127.0.107.131) to b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.422462 11379 consensus_queue.cc:1048] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.431645 11379 raft_consensus.cc:993] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86: : Instructing follower 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:40.432143 11408 raft_consensus.cc:1081] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Signalling peer 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:40.434196 11174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cb6ba3173fe4304b9596bfca843f7be"
dest_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:49666
I20260709 13:04:40.434851 11174 raft_consensus.cc:493] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:40.435204 11174 raft_consensus.cc:3060] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.441174 11174 raft_consensus.cc:515] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.442679 11174 leader_election.cc:290] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:40.443553 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6ba3173fe4304b9596bfca843f7be" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:40.443871 11247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6ba3173fe4304b9596bfca843f7be" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:40.444187 11099 raft_consensus.cc:3055] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:40.444463 11247 raft_consensus.cc:3060] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.444550 11099 raft_consensus.cc:740] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:40.445370 11099 consensus_queue.cc:260] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.446486 11099 raft_consensus.cc:3060] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.449915 11247 raft_consensus.cc:2468] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:40.451067 11140 leader_election.cc:304] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:40.451136 11099 raft_consensus.cc:2468] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:40.451808 11453 raft_consensus.cc:2804] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:40.452308 11453 raft_consensus.cc:697] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Becoming Leader. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:40.453307 11453 consensus_queue.cc:237] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.460006 10996 catalog_manager.cc:5697] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 reported cstate change: term changed from 1 to 2, leader changed from b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129) to 32498d04cc914621a17c1972a7981515 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "32498d04cc914621a17c1972a7981515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.578495 11453 consensus_queue.cc:1048] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.584887 11376 raft_consensus.cc:993] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515: : Instructing follower 3282e3a9d92949228a78169bb357df6b to start an election
I20260709 13:04:40.585407 11430 raft_consensus.cc:1081] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Signalling peer 3282e3a9d92949228a78169bb357df6b to start an election
I20260709 13:04:40.587021 11248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b5bca825fcd42e6b9f0cd43be8eb552"
dest_uuid: "3282e3a9d92949228a78169bb357df6b"
 from {username='slave'} at 127.0.0.1:35036
I20260709 13:04:40.591172 11248 raft_consensus.cc:493] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:40.591557 11248 raft_consensus.cc:3060] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.592556 11453 consensus_queue.cc:1048] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:40.598361 11248 raft_consensus.cc:515] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.602964 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bca825fcd42e6b9f0cd43be8eb552" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:40.603641 11099 raft_consensus.cc:3060] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.603736 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b5bca825fcd42e6b9f0cd43be8eb552" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:40.604393 11174 raft_consensus.cc:3055] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:40.604743 11174 raft_consensus.cc:740] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:40.605479 11174 consensus_queue.cc:260] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.606475 11174 raft_consensus.cc:3060] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.609403 11099 raft_consensus.cc:2468] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 2.
I20260709 13:04:40.610428 11214 leader_election.cc:304] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:40.603113 11248 leader_election.cc:290] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 2 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:40.611259 11455 raft_consensus.cc:2804] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:40.611945 11455 raft_consensus.cc:697] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [term 2 LEADER]: Becoming Leader. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:40.612485 11174 raft_consensus.cc:2468] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 2.
I20260709 13:04:40.612780 11455 consensus_queue.cc:237] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.620437 10998 catalog_manager.cc:5697] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b reported cstate change: term changed from 1 to 2, leader changed from 32498d04cc914621a17c1972a7981515 (127.0.107.130) to 3282e3a9d92949228a78169bb357df6b (127.0.107.131). New cstate: current_term: 2 leader_uuid: "3282e3a9d92949228a78169bb357df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:40.876715 11247 raft_consensus.cc:1275] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Refusing update from remote peer b7c6f88e6d6449678331d4ec00f6ac86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.878108 11408 consensus_queue.cc:1048] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:40.888562 11404 raft_consensus.cc:993] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86: : Instructing follower 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:40.889077 11404 raft_consensus.cc:1081] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Signalling peer 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:40.892604 11174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6af2becbbd5744fb8d4c185be1a479f5"
dest_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:49666
I20260709 13:04:40.892874 11173 raft_consensus.cc:1275] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Refusing update from remote peer b7c6f88e6d6449678331d4ec00f6ac86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.893196 11174 raft_consensus.cc:493] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:40.893592 11174 raft_consensus.cc:3060] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.897085 11408 consensus_queue.cc:1048] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:40.902505 11174 raft_consensus.cc:515] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.904428 11174 leader_election.cc:290] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:40.905328 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af2becbbd5744fb8d4c185be1a479f5" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:40.905645 11247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af2becbbd5744fb8d4c185be1a479f5" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:40.905998 11099 raft_consensus.cc:3055] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:40.906324 11099 raft_consensus.cc:740] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:40.906385 11247 raft_consensus.cc:3060] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.907260 11099 consensus_queue.cc:260] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.908329 11099 raft_consensus.cc:3060] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.912804 11298 raft_consensus.cc:993] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b: : Instructing follower 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:40.913221 11298 raft_consensus.cc:1081] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Signalling peer 32498d04cc914621a17c1972a7981515 to start an election
I20260709 13:04:40.914219 11247 raft_consensus.cc:2468] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:40.915251 11173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4868902e0fa149e884580db68fab331f"
dest_uuid: "32498d04cc914621a17c1972a7981515"
 from {username='slave'} at 127.0.0.1:49650
I20260709 13:04:40.915436 11140 leader_election.cc:304] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:40.915912 11173 raft_consensus.cc:493] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:40.916071 11099 raft_consensus.cc:2468] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:40.916244 11453 raft_consensus.cc:2804] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:40.916301 11173 raft_consensus.cc:3060] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.916996 11453 raft_consensus.cc:697] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Becoming Leader. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:40.917827 11453 consensus_queue.cc:237] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.922425 11173 raft_consensus.cc:515] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.924078 11173 leader_election.cc:290] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 3282e3a9d92949228a78169bb357df6b (127.0.107.131:33567)
I20260709 13:04:40.924914 11099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4868902e0fa149e884580db68fab331f" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:40.924474 10998 catalog_manager.cc:5697] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 reported cstate change: term changed from 1 to 2, leader changed from b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129) to 32498d04cc914621a17c1972a7981515 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "32498d04cc914621a17c1972a7981515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.925362 11247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4868902e0fa149e884580db68fab331f" candidate_uuid: "32498d04cc914621a17c1972a7981515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3282e3a9d92949228a78169bb357df6b"
I20260709 13:04:40.925524 11099 raft_consensus.cc:3060] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.926013 11247 raft_consensus.cc:3055] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:40.926465 11247 raft_consensus.cc:740] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:40.927282 11247 consensus_queue.cc:260] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.928369 11247 raft_consensus.cc:3060] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:40.931576 11099 raft_consensus.cc:2468] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:40.932791 11140 leader_election.cc:304] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:40.933573 11453 raft_consensus.cc:2804] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:40.934059 11453 raft_consensus.cc:697] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Becoming Leader. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:40.935143 11247 raft_consensus.cc:2468] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32498d04cc914621a17c1972a7981515 in term 2.
I20260709 13:04:40.934892 11453 consensus_queue.cc:237] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:40.941708 10998 catalog_manager.cc:5697] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 reported cstate change: term changed from 1 to 2, leader changed from 3282e3a9d92949228a78169bb357df6b (127.0.107.131) to 32498d04cc914621a17c1972a7981515 (127.0.107.130). New cstate: current_term: 2 leader_uuid: "32498d04cc914621a17c1972a7981515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.968930 11247 raft_consensus.cc:1275] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.970117 11453 consensus_queue.cc:1048] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:40.977401 11099 raft_consensus.cc:1275] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:40.978683 11430 consensus_queue.cc:1048] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:41.117337 11099 raft_consensus.cc:1275] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Refusing update from remote peer 3282e3a9d92949228a78169bb357df6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:41.118433 11455 consensus_queue.cc:1048] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:41.125027 11173 raft_consensus.cc:1275] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Refusing update from remote peer 3282e3a9d92949228a78169bb357df6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:41.126487 11298 consensus_queue.cc:1048] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:41.297276 11099 raft_consensus.cc:1275] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:41.298523 11376 consensus_queue.cc:1048] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:41.308302 11247 raft_consensus.cc:1275] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:41.309603 11430 consensus_queue.cc:1048] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:41.371044 11248 raft_consensus.cc:1275] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:41.372184 11430 consensus_queue.cc:1048] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:41.380002 11099 raft_consensus.cc:1275] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Refusing update from remote peer 32498d04cc914621a17c1972a7981515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:41.381551 11453 consensus_queue.cc:1048] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.412243 10998 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58198:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:04:43.434646 10998 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58198:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:04:43.476802   430 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:04:43.669168 11170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cb6ba3173fe4304b9596bfca843f7be"
dest_uuid: "32498d04cc914621a17c1972a7981515"
mode: GRACEFUL
new_leader_uuid: "3282e3a9d92949228a78169bb357df6b"
 from {username='slave'} at 127.0.0.1:45068
I20260709 13:04:43.683219 11170 raft_consensus.cc:606] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Received request to transfer leadership to TS 3282e3a9d92949228a78169bb357df6b
W20260709 13:04:43.684459 11494 log.cc:927] Time spent T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86: Append to log took a long time: real 0.145s	user 0.003s	sys 0.003s
I20260709 13:04:43.706892 11528 tablet.cc:1724] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.741029 11529 tablet.cc:1724] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.779282 11534 tablet.cc:1724] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.821867 11517 raft_consensus.cc:993] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515: : Instructing follower 3282e3a9d92949228a78169bb357df6b to start an election
I20260709 13:04:43.824769 11509 raft_consensus.cc:1081] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Signalling peer 3282e3a9d92949228a78169bb357df6b to start an election
I20260709 13:04:43.857465 11545 tablet.cc:1724] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.868373 11538 tablet.cc:1724] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.886953 11542 tablet.cc:1724] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.875844 11540 tablet.cc:1724] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.895819 11541 tablet.cc:1724] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.911588 11248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cb6ba3173fe4304b9596bfca843f7be"
dest_uuid: "3282e3a9d92949228a78169bb357df6b"
 from {username='slave'} at 127.0.0.1:35036
I20260709 13:04:43.914359 11541 tablet.cc:1724] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.916097 11546 tablet.cc:1724] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.927299 11096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f09b37947d44db08aad9ac594d72fa9"
dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
mode: GRACEFUL
new_leader_uuid: "3282e3a9d92949228a78169bb357df6b"
 from {username='slave'} at 127.0.0.1:60912
I20260709 13:04:43.928105 11096 raft_consensus.cc:606] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Received request to transfer leadership to TS 3282e3a9d92949228a78169bb357df6b
I20260709 13:04:43.930457   430 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:04:43.931119   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:43.939213 11472 raft_consensus.cc:993] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86: : Instructing follower 3282e3a9d92949228a78169bb357df6b to start an election
I20260709 13:04:43.939810 11472 raft_consensus.cc:1081] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Signalling peer 3282e3a9d92949228a78169bb357df6b to start an election
I20260709 13:04:43.941802 11243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f09b37947d44db08aad9ac594d72fa9"
dest_uuid: "3282e3a9d92949228a78169bb357df6b"
 from {username='slave'} at 127.0.0.1:35052
I20260709 13:04:43.942339 11243 raft_consensus.cc:493] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.934644 11538 tablet.cc:1724] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.948858 11243 raft_consensus.cc:3060] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.972836 11096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086"
dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
mode: GRACEFUL
new_leader_uuid: "3282e3a9d92949228a78169bb357df6b"
 from {username='slave'} at 127.0.0.1:60912
I20260709 13:04:43.972463 11545 tablet.cc:1724] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.973522 11096 raft_consensus.cc:606] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 LEADER]: Received request to transfer leadership to TS 3282e3a9d92949228a78169bb357df6b
I20260709 13:04:43.973919 11542 tablet.cc:1724] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.975222 11550 tablet.cc:1724] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.983697 11174 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efbcd6d4d30f4ef29510e2d266298528"
dest_uuid: "32498d04cc914621a17c1972a7981515"
mode: GRACEFUL
new_leader_uuid: "3282e3a9d92949228a78169bb357df6b"
 from {username='slave'} at 127.0.0.1:45068
I20260709 13:04:43.984174 11551 tablet.cc:1724] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.984931 11174 raft_consensus.cc:606] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Received request to transfer leadership to TS 3282e3a9d92949228a78169bb357df6b
I20260709 13:04:43.976409 11534 tablet.cc:1724] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.986850   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:43.986475 11529 tablet.cc:1724] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.989382 11248 raft_consensus.cc:493] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.978489 11540 tablet.cc:1724] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.994436 11248 raft_consensus.cc:3060] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.997059   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:43.990360 11541 tablet.cc:1724] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.998356 11549 tablet.cc:1724] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:43.993717 11243 raft_consensus.cc:515] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:44.024482 11243 leader_election.cc:290] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 2 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:44.010422 11248 raft_consensus.cc:515] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:44.026434 11174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f09b37947d44db08aad9ac594d72fa9" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:44.027215 11174 raft_consensus.cc:3060] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.030346 11096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6ba3173fe4304b9596bfca843f7be" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:44.030920 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cb6ba3173fe4304b9596bfca843f7be" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:44.031066 11096 raft_consensus.cc:3060] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.031592 11175 raft_consensus.cc:3055] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:44.031925 11175 raft_consensus.cc:740] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:44.032665 11248 leader_election.cc:290] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 3 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:44.032894 11175 consensus_queue.cc:260] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:44.034402 11175 raft_consensus.cc:3060] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.038552 11546 tablet.cc:1724] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:44.047529 11096 raft_consensus.cc:2468] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 3.
I20260709 13:04:44.050143 11482 raft_consensus.cc:993] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515: : Instructing follower 3282e3a9d92949228a78169bb357df6b to start an election
I20260709 13:04:44.057639 11482 raft_consensus.cc:1081] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Signalling peer 3282e3a9d92949228a78169bb357df6b to start an election
I20260709 13:04:44.059923 11248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efbcd6d4d30f4ef29510e2d266298528"
dest_uuid: "3282e3a9d92949228a78169bb357df6b"
 from {username='slave'} at 127.0.0.1:35036
I20260709 13:04:44.060549 11248 raft_consensus.cc:493] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:44.060950 11248 raft_consensus.cc:3060] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.063889 11540 tablet.cc:1724] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:44.052536 11545 tablet.cc:1724] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:44.054891 11097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f09b37947d44db08aad9ac594d72fa9" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:44.068665 11538 tablet.cc:1724] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:44.069252 11097 raft_consensus.cc:3055] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.069722 11097 raft_consensus.cc:740] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:44.070781 11097 consensus_queue.cc:260] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:44.072252 11097 raft_consensus.cc:3060] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.072414 11550 tablet.cc:1724] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:44.081650 11214 leader_election.cc:304] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3282e3a9d92949228a78169bb357df6b, b7c6f88e6d6449678331d4ec00f6ac86; no voters: 
I20260709 13:04:44.082468 11248 raft_consensus.cc:515] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:44.082864 11475 raft_consensus.cc:2804] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:44.083459 11475 raft_consensus.cc:697] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 3 LEADER]: Becoming Leader. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:44.069142 11175 raft_consensus.cc:2468] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 3.
I20260709 13:04:44.084461 11475 consensus_queue.cc:237] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:44.092526 11096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbcd6d4d30f4ef29510e2d266298528" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:44.074900 11174 raft_consensus.cc:2468] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 2.
I20260709 13:04:44.093241 11096 raft_consensus.cc:3060] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.094187 11215 leader_election.cc:304] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:44.095237 11475 raft_consensus.cc:2804] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:44.095134 10996 catalog_manager.cc:5697] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b reported cstate change: term changed from 2 to 3, leader changed from 32498d04cc914621a17c1972a7981515 (127.0.107.130) to 3282e3a9d92949228a78169bb357df6b (127.0.107.131). New cstate: current_term: 3 leader_uuid: "3282e3a9d92949228a78169bb357df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:44.096483 11248 leader_election.cc:290] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 3 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:44.102753 11528 tablet.cc:1724] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:44.097906 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbcd6d4d30f4ef29510e2d266298528" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:44.106874 11175 raft_consensus.cc:3055] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:44.107334 11175 raft_consensus.cc:740] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32498d04cc914621a17c1972a7981515, State: Running, Role: LEADER
I20260709 13:04:44.108349 11175 consensus_queue.cc:260] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:44.109733 11175 raft_consensus.cc:3060] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.117420 11175 raft_consensus.cc:2468] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 3.
I20260709 13:04:44.095909 11475 raft_consensus.cc:697] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [term 2 LEADER]: Becoming Leader. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:44.118611 11475 consensus_queue.cc:237] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:44.123875 11215 leader_election.cc:304] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:44.124848 11475 raft_consensus.cc:2804] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:44.125383 11475 raft_consensus.cc:697] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 3 LEADER]: Becoming Leader. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:44.125555 11096 raft_consensus.cc:2468] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 3.
I20260709 13:04:44.126336 11475 consensus_queue.cc:237] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:44.134354 11097 raft_consensus.cc:2468] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 2.
I20260709 13:04:44.141173 11549 tablet.cc:1724] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:44.159775 10995 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0: soft_deleted_table [id=9d8ab278b4174f61b0521ae9ed527a69] alter complete (version 1)
I20260709 13:04:44.173480 10995 catalog_manager.cc:5697] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b reported cstate change: term changed from 1 to 2, leader changed from b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129) to 3282e3a9d92949228a78169bb357df6b (127.0.107.131). New cstate: current_term: 2 leader_uuid: "3282e3a9d92949228a78169bb357df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:44.175112 10995 catalog_manager.cc:5697] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b reported cstate change: term changed from 2 to 3, leader changed from 32498d04cc914621a17c1972a7981515 (127.0.107.130) to 3282e3a9d92949228a78169bb357df6b (127.0.107.131). New cstate: current_term: 3 leader_uuid: "3282e3a9d92949228a78169bb357df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:44.283519 11497 raft_consensus.cc:993] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86: : Instructing follower 3282e3a9d92949228a78169bb357df6b to start an election
I20260709 13:04:44.284101 11506 raft_consensus.cc:1081] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 LEADER]: Signalling peer 3282e3a9d92949228a78169bb357df6b to start an election
I20260709 13:04:44.285580 11243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086"
dest_uuid: "3282e3a9d92949228a78169bb357df6b"
 from {username='slave'} at 127.0.0.1:35052
I20260709 13:04:44.286027 11243 raft_consensus.cc:493] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:44.286274 11243 raft_consensus.cc:3060] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.291666 11243 raft_consensus.cc:515] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:44.293426 11243 leader_election.cc:290] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 3 election: Requested vote from peers b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461), 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841)
I20260709 13:04:44.294214 11097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7c6f88e6d6449678331d4ec00f6ac86"
I20260709 13:04:44.294665 11175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29e469e5e17a4d75a189610ae28e1086" candidate_uuid: "3282e3a9d92949228a78169bb357df6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32498d04cc914621a17c1972a7981515"
I20260709 13:04:44.294884 11097 raft_consensus.cc:3055] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:44.295302 11175 raft_consensus.cc:3060] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.295320 11097 raft_consensus.cc:740] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b7c6f88e6d6449678331d4ec00f6ac86, State: Running, Role: LEADER
I20260709 13:04:44.296454 11097 consensus_queue.cc:260] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:44.297578 11097 raft_consensus.cc:3060] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:44.300786 11175 raft_consensus.cc:2468] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 3.
I20260709 13:04:44.301947 11215 leader_election.cc:304] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32498d04cc914621a17c1972a7981515, 3282e3a9d92949228a78169bb357df6b; no voters: 
I20260709 13:04:44.302779 11475 raft_consensus.cc:2804] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:44.303285 11475 raft_consensus.cc:697] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 3 LEADER]: Becoming Leader. State: Replica: 3282e3a9d92949228a78169bb357df6b, State: Running, Role: LEADER
I20260709 13:04:44.304251 11475 consensus_queue.cc:237] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } }
I20260709 13:04:44.304944 11097 raft_consensus.cc:2468] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3282e3a9d92949228a78169bb357df6b in term 3.
I20260709 13:04:44.313503 10995 catalog_manager.cc:5697] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b reported cstate change: term changed from 2 to 3, leader changed from b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129) to 3282e3a9d92949228a78169bb357df6b (127.0.107.131). New cstate: current_term: 3 leader_uuid: "3282e3a9d92949228a78169bb357df6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3282e3a9d92949228a78169bb357df6b" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 33567 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:44.578157 11096 raft_consensus.cc:1275] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 3 FOLLOWER]: Refusing update from remote peer 3282e3a9d92949228a78169bb357df6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:44.578295 11097 raft_consensus.cc:1275] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Refusing update from remote peer 3282e3a9d92949228a78169bb357df6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:44.579465 11475 consensus_queue.cc:1048] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:44.579834 11521 consensus_queue.cc:1048] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:44.605369 11175 raft_consensus.cc:1275] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Refusing update from remote peer 3282e3a9d92949228a78169bb357df6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:44.605805 11174 raft_consensus.cc:1275] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 3 FOLLOWER]: Refusing update from remote peer 3282e3a9d92949228a78169bb357df6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:44.609838 11565 consensus_queue.cc:1048] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:44.610827 11563 consensus_queue.cc:1048] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:44.629590 11174 raft_consensus.cc:1275] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 3 FOLLOWER]: Refusing update from remote peer 3282e3a9d92949228a78169bb357df6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:44.630919 11565 consensus_queue.cc:1048] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:44.638500 11097 raft_consensus.cc:1275] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 3 FOLLOWER]: Refusing update from remote peer 3282e3a9d92949228a78169bb357df6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:44.639925 11563 consensus_queue.cc:1048] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:44.733785 11175 raft_consensus.cc:1275] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 3 FOLLOWER]: Refusing update from remote peer 3282e3a9d92949228a78169bb357df6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:44.735000 11563 consensus_queue.cc:1048] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "32498d04cc914621a17c1972a7981515" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 42841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:44.743232 11097 raft_consensus.cc:1275] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 3 FOLLOWER]: Refusing update from remote peer 3282e3a9d92949228a78169bb357df6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:44.744858 11565 consensus_queue.cc:1048] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7c6f88e6d6449678331d4ec00f6ac86" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 34461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:45.054908   430 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:04:45.059950   430 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:04:45.060389   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:45.066525   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:04:45.067003   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:46.096836   430 tablet_server.cc:179] TabletServer@127.0.107.129:0 shutting down...
I20260709 13:04:46.128388   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:46.129530   430 tablet_replica.cc:333] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.130472   430 raft_consensus.cc:2243] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.131058   430 raft_consensus.cc:2272] T 8b5bca825fcd42e6b9f0cd43be8eb552 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.133419   430 tablet_replica.cc:333] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.133971   430 raft_consensus.cc:2243] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.134763   430 raft_consensus.cc:2272] T 72737b1293814567ac04458773c85390 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.136746   430 tablet_replica.cc:333] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.137334   430 raft_consensus.cc:2243] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.137781   430 raft_consensus.cc:2272] T 5f09b37947d44db08aad9ac594d72fa9 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.139796   430 tablet_replica.cc:333] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.140350   430 raft_consensus.cc:2243] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.140764   430 raft_consensus.cc:2272] T 48764888265f4f1baff20839d3384df3 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.142758   430 tablet_replica.cc:333] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.143352   430 raft_consensus.cc:2243] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.143910   430 raft_consensus.cc:2272] T ce5a8621786e4faf984b4fd2b6f09b91 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.145877   430 tablet_replica.cc:333] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.146451   430 raft_consensus.cc:2243] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.146890   430 raft_consensus.cc:2272] T ca7c378bc1234c0ba7af5023204e3c9e P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.149403   430 tablet_replica.cc:333] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
W20260709 13:04:46.149298 11140 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
I20260709 13:04:46.150447   430 raft_consensus.cc:2243] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.151059   430 raft_consensus.cc:2272] T 29e469e5e17a4d75a189610ae28e1086 P b7c6f88e6d6449678331d4ec00f6ac86 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:46.152534 11140 consensus_peers.cc:597] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 -> Peer b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461): Couldn't send request to peer b7c6f88e6d6449678331d4ec00f6ac86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:46.154021   430 tablet_replica.cc:333] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.154752   430 raft_consensus.cc:2243] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.155208   430 raft_consensus.cc:2272] T f3da02cdb98e49cd9660dcb34e1abf77 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.158166   430 tablet_replica.cc:333] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.158927   430 raft_consensus.cc:2243] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.159346   430 raft_consensus.cc:2272] T efbcd6d4d30f4ef29510e2d266298528 P b7c6f88e6d6449678331d4ec00f6ac86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.161387   430 tablet_replica.cc:333] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.161976   430 raft_consensus.cc:2243] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.162417   430 raft_consensus.cc:2272] T 52789773737a4f5db8915c627ece4817 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.164492   430 tablet_replica.cc:333] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.165031   430 raft_consensus.cc:2243] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.165514   430 raft_consensus.cc:2272] T 6af2becbbd5744fb8d4c185be1a479f5 P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.167610   430 tablet_replica.cc:333] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.168094   430 raft_consensus.cc:2243] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.168901   430 raft_consensus.cc:2272] T b8d8697b063449ce959639e018b22b2b P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.171001   430 tablet_replica.cc:333] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.171579   430 raft_consensus.cc:2243] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.172025   430 raft_consensus.cc:2272] T 1cb6ba3173fe4304b9596bfca843f7be P b7c6f88e6d6449678331d4ec00f6ac86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.174628   430 tablet_replica.cc:333] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.175333   430 raft_consensus.cc:2243] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.176213   430 raft_consensus.cc:2272] T 8fef0813e5914988981094d967ba8d7b P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.178277   430 tablet_replica.cc:333] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.178884   430 raft_consensus.cc:2243] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.179651   430 raft_consensus.cc:2272] T 21a6cf85813e44b0a88bd518cbf2cfba P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.181674   430 tablet_replica.cc:333] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.182241   430 raft_consensus.cc:2243] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.182732   430 raft_consensus.cc:2272] T 4868902e0fa149e884580db68fab331f P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.185249   430 tablet_replica.cc:333] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.185745   430 raft_consensus.cc:2243] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.186571   430 raft_consensus.cc:2272] T c1e82f82310644c8846acff8026b74f2 P b7c6f88e6d6449678331d4ec00f6ac86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.189417   430 tablet_replica.cc:333] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86: stopping tablet replica
I20260709 13:04:46.189980   430 raft_consensus.cc:2243] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.190950   430 raft_consensus.cc:2272] T cb028abf64f94157a502849dcd7df79a P b7c6f88e6d6449678331d4ec00f6ac86 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:46.204972 11214 consensus_peers.cc:597] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b -> Peer b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461): Couldn't send request to peer b7c6f88e6d6449678331d4ec00f6ac86. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:46.232334   430 tablet_server.cc:196] TabletServer@127.0.107.129:0 shutdown complete.
W20260709 13:04:46.256109 11214 consensus_peers.cc:597] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b -> Peer b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461): Couldn't send request to peer b7c6f88e6d6449678331d4ec00f6ac86. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:34461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:46.271389   430 tablet_server.cc:179] TabletServer@127.0.107.130:0 shutting down...
W20260709 13:04:46.290143 11140 consensus_peers.cc:597] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 -> Peer b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461): Couldn't send request to peer b7c6f88e6d6449678331d4ec00f6ac86. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:34461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:46.302986   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:46.303912   430 tablet_replica.cc:333] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.304618   430 raft_consensus.cc:2243] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.305104   430 raft_consensus.cc:2272] T 72737b1293814567ac04458773c85390 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.307224   430 tablet_replica.cc:333] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.307897   430 raft_consensus.cc:2243] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.308389   430 raft_consensus.cc:2272] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.310320   430 tablet_replica.cc:333] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.310906   430 raft_consensus.cc:2243] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.311796   430 raft_consensus.cc:2272] T 48764888265f4f1baff20839d3384df3 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.314159   430 tablet_replica.cc:333] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.314771   430 raft_consensus.cc:2243] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.315233   430 raft_consensus.cc:2272] T 1cb6ba3173fe4304b9596bfca843f7be P 32498d04cc914621a17c1972a7981515 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.317972   430 tablet_replica.cc:333] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.318776   430 raft_consensus.cc:2243] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.319353   430 raft_consensus.cc:2272] T 21a6cf85813e44b0a88bd518cbf2cfba P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:46.320398 11140 consensus_peers.cc:597] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 -> Peer b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461): Couldn't send request to peer b7c6f88e6d6449678331d4ec00f6ac86. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:34461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:46.320914 11140 consensus_peers.cc:597] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 -> Peer b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461): Couldn't send request to peer b7c6f88e6d6449678331d4ec00f6ac86. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:34461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:46.321856   430 tablet_replica.cc:333] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.322450   430 raft_consensus.cc:2243] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.322855   430 raft_consensus.cc:2272] T 8fef0813e5914988981094d967ba8d7b P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.324853   430 tablet_replica.cc:333] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.325364   430 raft_consensus.cc:2243] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.326261   430 raft_consensus.cc:2272] T ca7c378bc1234c0ba7af5023204e3c9e P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.329234   430 tablet_replica.cc:333] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515: stopping tablet replica
W20260709 13:04:46.329432 11215 consensus_peers.cc:597] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b -> Peer 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841): Couldn't send request to peer 32498d04cc914621a17c1972a7981515. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:46.329955   430 raft_consensus.cc:2243] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.330385   430 raft_consensus.cc:2272] T 29e469e5e17a4d75a189610ae28e1086 P 32498d04cc914621a17c1972a7981515 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.332409   430 tablet_replica.cc:333] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.332954   430 raft_consensus.cc:2243] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.333603   430 raft_consensus.cc:2272] T 4868902e0fa149e884580db68fab331f P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.335399   430 tablet_replica.cc:333] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.335983   430 raft_consensus.cc:2243] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.336429   430 raft_consensus.cc:2272] T cb028abf64f94157a502849dcd7df79a P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.338456   430 tablet_replica.cc:333] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.339026   430 raft_consensus.cc:2243] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.339550   430 raft_consensus.cc:2272] T c1e82f82310644c8846acff8026b74f2 P 32498d04cc914621a17c1972a7981515 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.341378   430 tablet_replica.cc:333] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.341856   430 raft_consensus.cc:2243] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.342245   430 raft_consensus.cc:2272] T 5f09b37947d44db08aad9ac594d72fa9 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.344028   430 tablet_replica.cc:333] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.344491   430 raft_consensus.cc:2243] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.344887   430 raft_consensus.cc:2272] T f3da02cdb98e49cd9660dcb34e1abf77 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.346741   430 tablet_replica.cc:333] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.347218   430 raft_consensus.cc:2243] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.347780   430 raft_consensus.cc:2272] T efbcd6d4d30f4ef29510e2d266298528 P 32498d04cc914621a17c1972a7981515 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.349659   430 tablet_replica.cc:333] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.350168   430 raft_consensus.cc:2243] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.350937   430 raft_consensus.cc:2272] T ce5a8621786e4faf984b4fd2b6f09b91 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.352962   430 tablet_replica.cc:333] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.353443   430 raft_consensus.cc:2243] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.354216   430 raft_consensus.cc:2272] T 52789773737a4f5db8915c627ece4817 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.356113   430 tablet_replica.cc:333] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.356595   430 raft_consensus.cc:2243] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.357348   430 raft_consensus.cc:2272] T 6af2becbbd5744fb8d4c185be1a479f5 P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.359138   430 tablet_replica.cc:333] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515: stopping tablet replica
I20260709 13:04:46.359597   430 raft_consensus.cc:2243] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.360016   430 raft_consensus.cc:2272] T b8d8697b063449ce959639e018b22b2b P 32498d04cc914621a17c1972a7981515 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:46.370036 11215 consensus_peers.cc:597] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b -> Peer 32498d04cc914621a17c1972a7981515 (127.0.107.130:42841): Couldn't send request to peer 32498d04cc914621a17c1972a7981515. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:46.388583 11214 consensus_peers.cc:597] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b -> Peer b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461): Couldn't send request to peer b7c6f88e6d6449678331d4ec00f6ac86. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:34461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:46.401751   430 tablet_server.cc:196] TabletServer@127.0.107.130:0 shutdown complete.
W20260709 13:04:46.419693 11214 consensus_peers.cc:597] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b -> Peer b7c6f88e6d6449678331d4ec00f6ac86 (127.0.107.129:34461): Couldn't send request to peer b7c6f88e6d6449678331d4ec00f6ac86. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:34461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:46.436308   430 tablet_server.cc:179] TabletServer@127.0.107.131:0 shutting down...
I20260709 13:04:46.463588   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:46.464335   430 tablet_replica.cc:333] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.464982   430 raft_consensus.cc:2243] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.465794   430 raft_consensus.cc:2272] T 8b5bca825fcd42e6b9f0cd43be8eb552 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.467736   430 tablet_replica.cc:333] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.468278   430 raft_consensus.cc:2243] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.468683   430 raft_consensus.cc:2272] T 48764888265f4f1baff20839d3384df3 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.470432   430 tablet_replica.cc:333] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.470948   430 raft_consensus.cc:2243] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.471715   430 raft_consensus.cc:2272] T 5f09b37947d44db08aad9ac594d72fa9 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.473501   430 tablet_replica.cc:333] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.474009   430 raft_consensus.cc:2243] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.474423   430 raft_consensus.cc:2272] T 72737b1293814567ac04458773c85390 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.476565   430 tablet_replica.cc:333] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.477161   430 raft_consensus.cc:2243] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.477597   430 raft_consensus.cc:2272] T cb028abf64f94157a502849dcd7df79a P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.479537   430 tablet_replica.cc:333] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.480055   430 raft_consensus.cc:2243] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.480499   430 raft_consensus.cc:2272] T c1e82f82310644c8846acff8026b74f2 P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.482375   430 tablet_replica.cc:333] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.482872   430 raft_consensus.cc:2243] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.483326   430 raft_consensus.cc:2272] T 4868902e0fa149e884580db68fab331f P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.485526   430 tablet_replica.cc:333] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.486065   430 raft_consensus.cc:2243] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.486917   430 raft_consensus.cc:2272] T 1cb6ba3173fe4304b9596bfca843f7be P 3282e3a9d92949228a78169bb357df6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.488890   430 tablet_replica.cc:333] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.489383   430 raft_consensus.cc:2243] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.489755   430 raft_consensus.cc:2272] T 21a6cf85813e44b0a88bd518cbf2cfba P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.491667   430 tablet_replica.cc:333] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.492122   430 raft_consensus.cc:2243] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.492471   430 raft_consensus.cc:2272] T 8fef0813e5914988981094d967ba8d7b P 3282e3a9d92949228a78169bb357df6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.494174   430 tablet_replica.cc:333] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.494675   430 raft_consensus.cc:2243] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.495033   430 raft_consensus.cc:2272] T ca7c378bc1234c0ba7af5023204e3c9e P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.496905   430 tablet_replica.cc:333] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.497484   430 raft_consensus.cc:2243] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.498217   430 raft_consensus.cc:2272] T 29e469e5e17a4d75a189610ae28e1086 P 3282e3a9d92949228a78169bb357df6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.499979   430 tablet_replica.cc:333] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.500480   430 raft_consensus.cc:2243] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.500877   430 raft_consensus.cc:2272] T ce5a8621786e4faf984b4fd2b6f09b91 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.502715   430 tablet_replica.cc:333] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.503229   430 raft_consensus.cc:2243] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.503955   430 raft_consensus.cc:2272] T efbcd6d4d30f4ef29510e2d266298528 P 3282e3a9d92949228a78169bb357df6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.505800   430 tablet_replica.cc:333] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.506290   430 raft_consensus.cc:2243] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.507045   430 raft_consensus.cc:2272] T f3da02cdb98e49cd9660dcb34e1abf77 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.508930   430 tablet_replica.cc:333] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.509402   430 raft_consensus.cc:2243] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.509817   430 raft_consensus.cc:2272] T 52789773737a4f5db8915c627ece4817 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.511616   430 tablet_replica.cc:333] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.512066   430 raft_consensus.cc:2243] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.512472   430 raft_consensus.cc:2272] T 6af2becbbd5744fb8d4c185be1a479f5 P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.514137   430 tablet_replica.cc:333] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b: stopping tablet replica
I20260709 13:04:46.514621   430 raft_consensus.cc:2243] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.515040   430 raft_consensus.cc:2272] T b8d8697b063449ce959639e018b22b2b P 3282e3a9d92949228a78169bb357df6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.552417   430 tablet_server.cc:196] TabletServer@127.0.107.131:0 shutdown complete.
I20260709 13:04:46.584874   430 master.cc:562] Master@127.0.107.190:41137 shutting down...
I20260709 13:04:46.608709   430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:46.609267   430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.609601   430 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6603d2a7d2d44226b812104f9b542dd0: stopping tablet replica
I20260709 13:04:46.629901   430 master.cc:584] Master@127.0.107.190:41137 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12722 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:04:46.682945   430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.190:38641
I20260709 13:04:46.684083   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:46.689839 11576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.689940 11577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.690726 11579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:46.692361   430 server_base.cc:1061] running on GCE node
I20260709 13:04:46.693145   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:46.693316   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:46.693426   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602286693414 us; error 0 us; skew 500 ppm
I20260709 13:04:46.693856   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:46.696213   430 webserver.cc:533] Webserver started at http://127.0.107.190:43079/ using document root <none> and password file <none>
I20260709 13:04:46.696657   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:46.696807   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:46.697012   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:46.698005   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/master-0-root/instance:
uuid: "5d0e365e601d47ddb9bf7508aa14d319"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-th5x"
I20260709 13:04:46.702236   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:46.705667 11584 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.706413   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:46.706741   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/master-0-root
uuid: "5d0e365e601d47ddb9bf7508aa14d319"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-th5x"
I20260709 13:04:46.707008   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:46.726724   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:46.727994   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:46.764637   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.190:38641
I20260709 13:04:46.764780 11635 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.190:38641 every 8 connection(s)
I20260709 13:04:46.768623 11636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:46.780071 11636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319: Bootstrap starting.
I20260709 13:04:46.785365 11636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.789685 11636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319: No bootstrap required, opened a new log
I20260709 13:04:46.792070 11636 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0e365e601d47ddb9bf7508aa14d319" member_type: VOTER }
I20260709 13:04:46.792450 11636 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.792742 11636 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0e365e601d47ddb9bf7508aa14d319, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.793357 11636 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0e365e601d47ddb9bf7508aa14d319" member_type: VOTER }
I20260709 13:04:46.793824 11636 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:46.794085 11636 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:46.794385 11636 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.799737 11636 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0e365e601d47ddb9bf7508aa14d319" member_type: VOTER }
I20260709 13:04:46.800302 11636 leader_election.cc:304] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d0e365e601d47ddb9bf7508aa14d319; no voters: 
I20260709 13:04:46.801437 11636 leader_election.cc:290] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:46.801771 11639 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:46.803171 11639 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [term 1 LEADER]: Becoming Leader. State: Replica: 5d0e365e601d47ddb9bf7508aa14d319, State: Running, Role: LEADER
I20260709 13:04:46.803871 11639 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0e365e601d47ddb9bf7508aa14d319" member_type: VOTER }
I20260709 13:04:46.804678 11636 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:46.808658 11641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d0e365e601d47ddb9bf7508aa14d319. Latest consensus state: current_term: 1 leader_uuid: "5d0e365e601d47ddb9bf7508aa14d319" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0e365e601d47ddb9bf7508aa14d319" member_type: VOTER } }
I20260709 13:04:46.809553 11641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:46.809774 11640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d0e365e601d47ddb9bf7508aa14d319" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d0e365e601d47ddb9bf7508aa14d319" member_type: VOTER } }
I20260709 13:04:46.810325 11640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:46.811625 11645 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:46.816303 11645 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:46.822346   430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:46.825001 11645 catalog_manager.cc:1383] Generated new cluster ID: eb45ba694714450484ed1a7142e3f266
I20260709 13:04:46.825260 11645 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:46.846189 11645 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:46.847471 11645 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:46.859146 11645 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319: Generated new TSK 0
I20260709 13:04:46.859786 11645 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:46.888576   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:46.894640 11657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.895309 11658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.897265 11660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:46.899672   430 server_base.cc:1061] running on GCE node
I20260709 13:04:46.900516   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:46.900695   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:46.900813   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602286900802 us; error 0 us; skew 500 ppm
I20260709 13:04:46.901242   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:46.903475   430 webserver.cc:533] Webserver started at http://127.0.107.129:36025/ using document root <none> and password file <none>
I20260709 13:04:46.903944   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:46.904106   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:46.904309   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:46.905298   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-0-root/instance:
uuid: "a83803170adc46cb9fe0e763733bd198"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-th5x"
I20260709 13:04:46.909801   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:46.913089 11665 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.913955   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:04:46.914317   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-0-root
uuid: "a83803170adc46cb9fe0e763733bd198"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-th5x"
I20260709 13:04:46.914633   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:46.927727   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:46.929000   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:46.930501   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:46.932811   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:46.933059   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.933315   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:46.933517   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:46.974298   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.129:33081
I20260709 13:04:46.974411 11727 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.129:33081 every 8 connection(s)
I20260709 13:04:46.979502   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:46.986727 11732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:46.987577 11733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:46.990414   430 server_base.cc:1061] running on GCE node
W20260709 13:04:46.991891 11736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:46.992893   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:46.993022 11728 heartbeater.cc:344] Connected to a master server at 127.0.107.190:38641
W20260709 13:04:46.993137   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:46.993459   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602286993437 us; error 0 us; skew 500 ppm
I20260709 13:04:46.993501 11728 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:46.994087   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:46.994367 11728 heartbeater.cc:507] Master 127.0.107.190:38641 requested a full tablet report, sending...
I20260709 13:04:46.996721 11601 ts_manager.cc:194] Registered new tserver with Master: a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081)
I20260709 13:04:46.996721   430 webserver.cc:533] Webserver started at http://127.0.107.130:38337/ using document root <none> and password file <none>
I20260709 13:04:46.997495   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:46.997705   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:46.998016   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:46.998701 11601 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56246
I20260709 13:04:46.999290   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-1-root/instance:
uuid: "6e3de92a308142c09eb4302b7ab01c4d"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-th5x"
I20260709 13:04:47.004092   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:47.007640 11740 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.008558   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:04:47.008876   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-1-root
uuid: "6e3de92a308142c09eb4302b7ab01c4d"
format_stamp: "Formatted at 2026-07-09 13:04:46 on dist-test-slave-th5x"
I20260709 13:04:47.009253   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:47.041288   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:47.042551   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:47.044003   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:47.046159   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:47.046391   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.046630   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:47.046797   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.086511   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.130:44849
I20260709 13:04:47.086633 11802 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.130:44849 every 8 connection(s)
I20260709 13:04:47.091257   430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:47.098382 11806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:47.099164 11807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:47.102476 11809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:47.102511   430 server_base.cc:1061] running on GCE node
I20260709 13:04:47.103574 11803 heartbeater.cc:344] Connected to a master server at 127.0.107.190:38641
I20260709 13:04:47.104034 11803 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:47.104086   430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:47.104447   430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:47.104650   430 hybrid_clock.cc:648] HybridClock initialized: now 1783602287104631 us; error 0 us; skew 500 ppm
I20260709 13:04:47.104969 11803 heartbeater.cc:507] Master 127.0.107.190:38641 requested a full tablet report, sending...
I20260709 13:04:47.105443   430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:47.107362 11601 ts_manager.cc:194] Registered new tserver with Master: 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:47.108497   430 webserver.cc:533] Webserver started at http://127.0.107.131:42617/ using document root <none> and password file <none>
I20260709 13:04:47.109225   430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:47.109474   430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:47.109432 11601 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56248
I20260709 13:04:47.110029   430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:47.111717   430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-2-root/instance:
uuid: "5cc9524393564c9195319d1d17362761"
format_stamp: "Formatted at 2026-07-09 13:04:47 on dist-test-slave-th5x"
I20260709 13:04:47.116703   430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:04:47.119892 11814 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.120746   430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:04:47.121068   430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-2-root
uuid: "5cc9524393564c9195319d1d17362761"
format_stamp: "Formatted at 2026-07-09 13:04:47 on dist-test-slave-th5x"
I20260709 13:04:47.121356   430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6lAS17/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601969268282-430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:47.140440   430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:47.141580   430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:47.142966   430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:47.145147   430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:47.145370   430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.145612   430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:47.145788   430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:47.184885   430 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.131:46761
I20260709 13:04:47.185024 11876 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.131:46761 every 8 connection(s)
I20260709 13:04:47.198978 11877 heartbeater.cc:344] Connected to a master server at 127.0.107.190:38641
I20260709 13:04:47.199534 11877 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:47.200276 11877 heartbeater.cc:507] Master 127.0.107.190:38641 requested a full tablet report, sending...
I20260709 13:04:47.202275 11601 ts_manager.cc:194] Registered new tserver with Master: 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:47.202781   430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014669304s
I20260709 13:04:47.203678 11601 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56264
I20260709 13:04:47.228210 11601 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56268:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:47.230780 11601 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:47.297745 11693 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2fc5b4849b43bab392c039d726546c (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:47.300489 11690 tablet_service.cc:1511] Processing CreateTablet for tablet 820d6dfd18f24e38bf7b04e1943080b6 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:47.301625 11691 tablet_service.cc:1511] Processing CreateTablet for tablet 674dd81cb2c045d298cc247aaec3cb63 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:47.300514 11692 tablet_service.cc:1511] Processing CreateTablet for tablet e540577978284a8db70fba607d981e75 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:47.304726 11689 tablet_service.cc:1511] Processing CreateTablet for tablet 2825ff31df094f538fa9178c022e6f83 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:47.308991 11693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2fc5b4849b43bab392c039d726546c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.309880 11688 tablet_service.cc:1511] Processing CreateTablet for tablet c8437aef30ea44fb943f054c5dfe9449 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:47.310829 11691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674dd81cb2c045d298cc247aaec3cb63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.311630 11689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2825ff31df094f538fa9178c022e6f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.313051 11688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8437aef30ea44fb943f054c5dfe9449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.313678 11692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e540577978284a8db70fba607d981e75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.315078 11687 tablet_service.cc:1511] Processing CreateTablet for tablet eef44f35bfce4c29be19207c829db079 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:47.316452 11687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef44f35bfce4c29be19207c829db079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.316805 11842 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2fc5b4849b43bab392c039d726546c (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:47.318177 11842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2fc5b4849b43bab392c039d726546c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.318503 11686 tablet_service.cc:1511] Processing CreateTablet for tablet b64f5902fc714bd290548d24fc7bbef4 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:47.319798 11690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820d6dfd18f24e38bf7b04e1943080b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.324450 11840 tablet_service.cc:1511] Processing CreateTablet for tablet 674dd81cb2c045d298cc247aaec3cb63 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:47.325754 11840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674dd81cb2c045d298cc247aaec3cb63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.323889 11841 tablet_service.cc:1511] Processing CreateTablet for tablet e540577978284a8db70fba607d981e75 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:47.328662 11686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b64f5902fc714bd290548d24fc7bbef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.329768 11685 tablet_service.cc:1511] Processing CreateTablet for tablet 251613b9d31a4611b3e0966d083a9fb6 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:47.331079 11685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251613b9d31a4611b3e0966d083a9fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.328661 11841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e540577978284a8db70fba607d981e75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.372812 11839 tablet_service.cc:1511] Processing CreateTablet for tablet 820d6dfd18f24e38bf7b04e1943080b6 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:47.374212 11839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820d6dfd18f24e38bf7b04e1943080b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.377053 11838 tablet_service.cc:1511] Processing CreateTablet for tablet 2825ff31df094f538fa9178c022e6f83 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:47.378432 11838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2825ff31df094f538fa9178c022e6f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.385048 11837 tablet_service.cc:1511] Processing CreateTablet for tablet c8437aef30ea44fb943f054c5dfe9449 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:47.387212 11837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8437aef30ea44fb943f054c5dfe9449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.388855 11836 tablet_service.cc:1511] Processing CreateTablet for tablet eef44f35bfce4c29be19207c829db079 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:47.390220 11836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef44f35bfce4c29be19207c829db079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.394220 11835 tablet_service.cc:1511] Processing CreateTablet for tablet b64f5902fc714bd290548d24fc7bbef4 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:47.396023 11835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b64f5902fc714bd290548d24fc7bbef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.398237 11834 tablet_service.cc:1511] Processing CreateTablet for tablet 251613b9d31a4611b3e0966d083a9fb6 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:47.399534 11834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251613b9d31a4611b3e0966d083a9fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.413228 11891 tablet_bootstrap.cc:492] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:47.433404 11892 tablet_bootstrap.cc:492] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:47.445052 11891 tablet_bootstrap.cc:654] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.448454 11768 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2fc5b4849b43bab392c039d726546c (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:47.450387 11768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2fc5b4849b43bab392c039d726546c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.450565 11767 tablet_service.cc:1511] Processing CreateTablet for tablet e540577978284a8db70fba607d981e75 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:47.451661 11892 tablet_bootstrap.cc:654] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.451948 11767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e540577978284a8db70fba607d981e75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.456538 11766 tablet_service.cc:1511] Processing CreateTablet for tablet 674dd81cb2c045d298cc247aaec3cb63 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:47.457826 11766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674dd81cb2c045d298cc247aaec3cb63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.460963 11765 tablet_service.cc:1511] Processing CreateTablet for tablet 820d6dfd18f24e38bf7b04e1943080b6 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:47.462690 11765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 820d6dfd18f24e38bf7b04e1943080b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.465252 11763 tablet_service.cc:1511] Processing CreateTablet for tablet c8437aef30ea44fb943f054c5dfe9449 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:47.465564 11762 tablet_service.cc:1511] Processing CreateTablet for tablet eef44f35bfce4c29be19207c829db079 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:47.466571 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8437aef30ea44fb943f054c5dfe9449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.467389 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef44f35bfce4c29be19207c829db079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.472273 11764 tablet_service.cc:1511] Processing CreateTablet for tablet 2825ff31df094f538fa9178c022e6f83 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:47.472654 11761 tablet_service.cc:1511] Processing CreateTablet for tablet b64f5902fc714bd290548d24fc7bbef4 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:47.474159 11764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2825ff31df094f538fa9178c022e6f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.474643 11760 tablet_service.cc:1511] Processing CreateTablet for tablet 251613b9d31a4611b3e0966d083a9fb6 (DEFAULT_TABLE table=test-workload [id=4156eab5bf49498dbcac3ce6ce61e882]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:47.478912 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251613b9d31a4611b3e0966d083a9fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.488333 11761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b64f5902fc714bd290548d24fc7bbef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:47.513851 11895 tablet_bootstrap.cc:492] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:47.514446 11891 tablet_bootstrap.cc:492] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:47.514650 11892 tablet_bootstrap.cc:492] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:47.514961 11891 ts_tablet_manager.cc:1403] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.103s	user 0.018s	sys 0.052s
I20260709 13:04:47.515165 11892 ts_tablet_manager.cc:1403] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.009s
I20260709 13:04:47.517550 11891 raft_consensus.cc:359] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.518129 11891 raft_consensus.cc:385] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.518397 11891 raft_consensus.cc:740] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.518229 11892 raft_consensus.cc:359] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.519086 11892 raft_consensus.cc:385] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.519170 11891 consensus_queue.cc:260] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.520356 11895 tablet_bootstrap.cc:654] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.522629 11892 raft_consensus.cc:740] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.523401 11892 consensus_queue.cc:260] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.534817 11891 ts_tablet_manager.cc:1434] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.005s
I20260709 13:04:47.539608 11877 heartbeater.cc:499] Master 127.0.107.190:38641 was elected leader, sending a full tablet report...
I20260709 13:04:47.543264 11895 tablet_bootstrap.cc:492] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:47.546072 11728 heartbeater.cc:499] Master 127.0.107.190:38641 was elected leader, sending a full tablet report...
I20260709 13:04:47.552320 11895 ts_tablet_manager.cc:1403] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.003s
I20260709 13:04:47.546617 11892 ts_tablet_manager.cc:1434] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.031s	user 0.016s	sys 0.011s
I20260709 13:04:47.555526 11895 raft_consensus.cc:359] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } }
I20260709 13:04:47.556279 11895 raft_consensus.cc:385] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.543361 11891 tablet_bootstrap.cc:492] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:47.556596 11895 raft_consensus.cc:740] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.556614 11892 tablet_bootstrap.cc:492] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:47.558833 11895 consensus_queue.cc:260] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } }
I20260709 13:04:47.564096 11891 tablet_bootstrap.cc:654] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.565711 11892 tablet_bootstrap.cc:654] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.570513 11803 heartbeater.cc:499] Master 127.0.107.190:38641 was elected leader, sending a full tablet report...
I20260709 13:04:47.571059 11895 ts_tablet_manager.cc:1434] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.011s
I20260709 13:04:47.572043 11895 tablet_bootstrap.cc:492] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:47.578893 11895 tablet_bootstrap.cc:654] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.579345 11892 tablet_bootstrap.cc:492] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:47.579936 11892 ts_tablet_manager.cc:1403] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 13:04:47.587270 11892 raft_consensus.cc:359] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.588995 11892 raft_consensus.cc:385] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.589344 11892 raft_consensus.cc:740] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.590258 11892 consensus_queue.cc:260] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.590886 11891 tablet_bootstrap.cc:492] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:47.591651 11891 ts_tablet_manager.cc:1403] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.021s
I20260709 13:04:47.592458 11892 ts_tablet_manager.cc:1434] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:47.593528 11892 tablet_bootstrap.cc:492] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:47.595468 11891 raft_consensus.cc:359] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.596436 11891 raft_consensus.cc:385] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.596817 11891 raft_consensus.cc:740] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.597935 11891 consensus_queue.cc:260] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.599982 11891 ts_tablet_manager.cc:1434] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:04:47.600879 11891 tablet_bootstrap.cc:492] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:47.605762 11892 tablet_bootstrap.cc:654] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.606256 11895 tablet_bootstrap.cc:492] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:47.606884 11895 ts_tablet_manager.cc:1403] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.013s
I20260709 13:04:47.607534 11891 tablet_bootstrap.cc:654] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.610230 11895 raft_consensus.cc:359] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.611186 11895 raft_consensus.cc:385] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.611584 11895 raft_consensus.cc:740] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.612793 11895 consensus_queue.cc:260] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.618722 11895 ts_tablet_manager.cc:1434] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:04:47.621294 11897 raft_consensus.cc:493] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.621979 11897 raft_consensus.cc:515] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.622848 11899 raft_consensus.cc:493] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.623323 11899 raft_consensus.cc:515] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.635145 11899 leader_election.cc:290] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:47.640292 11895 tablet_bootstrap.cc:492] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:47.641846 11892 tablet_bootstrap.cc:492] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:47.642591 11892 ts_tablet_manager.cc:1403] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.011s
I20260709 13:04:47.646023 11892 raft_consensus.cc:359] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.646951 11892 raft_consensus.cc:385] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.647317 11892 raft_consensus.cc:740] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.648273 11892 consensus_queue.cc:260] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.649820 11891 tablet_bootstrap.cc:492] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:47.650501 11891 ts_tablet_manager.cc:1403] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.004s
I20260709 13:04:47.654170 11891 raft_consensus.cc:359] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } }
I20260709 13:04:47.656411 11891 raft_consensus.cc:385] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.656845 11891 raft_consensus.cc:740] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.657557 11897 leader_election.cc:290] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:47.658336 11897 raft_consensus.cc:493] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.657908 11891 consensus_queue.cc:260] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } }
I20260709 13:04:47.661191 11891 ts_tablet_manager.cc:1434] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:04:47.662514 11891 tablet_bootstrap.cc:492] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:47.674638 11891 tablet_bootstrap.cc:654] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.665664 11895 tablet_bootstrap.cc:654] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.658913 11897 raft_consensus.cc:515] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.679049 11897 leader_election.cc:290] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:47.695142 11905 raft_consensus.cc:493] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.695739 11905 raft_consensus.cc:515] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.727396 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825ff31df094f538fa9178c022e6f83" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
W20260709 13:04:47.729712 11743 leader_election.cc:343] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.728266 11905 leader_election.cc:290] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:47.740477 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251613b9d31a4611b3e0966d083a9fb6" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:47.755523 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e540577978284a8db70fba607d981e75" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:47.757648 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674dd81cb2c045d298cc247aaec3cb63" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
W20260709 13:04:47.759224 11666 leader_election.cc:343] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:47.762166 11666 leader_election.cc:343] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:47.762879 11666 leader_election.cc:343] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.763219 11892 ts_tablet_manager.cc:1434] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.120s	user 0.032s	sys 0.049s
I20260709 13:04:47.764071 11896 raft_consensus.cc:493] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.765472 11892 tablet_bootstrap.cc:492] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:47.765292 11896 raft_consensus.cc:515] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.763362 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825ff31df094f538fa9178c022e6f83" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:47.767987 11896 leader_election.cc:290] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:47.771090 11895 tablet_bootstrap.cc:492] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:47.773901 11895 ts_tablet_manager.cc:1403] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.134s	user 0.037s	sys 0.039s
I20260709 13:04:47.778766 11891 tablet_bootstrap.cc:492] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:47.779476 11891 ts_tablet_manager.cc:1403] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.117s	user 0.045s	sys 0.037s
I20260709 13:04:47.780246 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e540577978284a8db70fba607d981e75" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:47.780978 11851 raft_consensus.cc:2468] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:47.781939 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674dd81cb2c045d298cc247aaec3cb63" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:47.782943 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251613b9d31a4611b3e0966d083a9fb6" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:47.784299 11666 leader_election.cc:304] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198; no voters: 6e3de92a308142c09eb4302b7ab01c4d
I20260709 13:04:47.785234 11909 raft_consensus.cc:2804] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:47.785596 11666 leader_election.cc:343] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.785604 11909 raft_consensus.cc:493] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.786258 11909 raft_consensus.cc:3060] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.786242 11666 leader_election.cc:304] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a83803170adc46cb9fe0e763733bd198; no voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d
I20260709 13:04:47.787107 11905 raft_consensus.cc:2749] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:47.787544 11666 leader_election.cc:343] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.787988 11666 leader_election.cc:304] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a83803170adc46cb9fe0e763733bd198; no voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d
I20260709 13:04:47.788700 11905 raft_consensus.cc:2749] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:47.788496 11895 raft_consensus.cc:359] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.789551 11895 raft_consensus.cc:385] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.789954 11895 raft_consensus.cc:740] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
W20260709 13:04:47.776494 11741 leader_election.cc:343] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.793504 11741 leader_election.cc:304] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d; no voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198
I20260709 13:04:47.790956 11895 consensus_queue.cc:260] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.794281 11899 raft_consensus.cc:2749] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:47.783164 11891 raft_consensus.cc:359] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.796180 11891 raft_consensus.cc:385] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.796458 11891 raft_consensus.cc:740] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.797911 11891 consensus_queue.cc:260] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.799124 11892 tablet_bootstrap.cc:654] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.804347 11891 ts_tablet_manager.cc:1434] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:04:47.804731 11895 ts_tablet_manager.cc:1434] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.007s
I20260709 13:04:47.805423 11891 tablet_bootstrap.cc:492] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:47.806078 11895 tablet_bootstrap.cc:492] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:47.812247 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d6dfd18f24e38bf7b04e1943080b6" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
W20260709 13:04:47.813982 11817 leader_election.cc:343] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:47.817239 11649 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:47.817198 11891 tablet_bootstrap.cc:654] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.817814 11895 tablet_bootstrap.cc:654] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.828959 11891 tablet_bootstrap.cc:492] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:47.829460 11891 ts_tablet_manager.cc:1403] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.002s
I20260709 13:04:47.831241 11916 raft_consensus.cc:493] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.831952 11916 raft_consensus.cc:515] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.832351 11891 raft_consensus.cc:359] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.833130 11891 raft_consensus.cc:385] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.833441 11891 raft_consensus.cc:740] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.834784 11916 leader_election.cc:290] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:47.835340 11909 raft_consensus.cc:515] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.836014 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e540577978284a8db70fba607d981e75" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:47.836653 11852 raft_consensus.cc:2468] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 0.
I20260709 13:04:47.837117 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e540577978284a8db70fba607d981e75" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:47.837502 11909 leader_election.cc:290] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Requested vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:47.837869 11741 leader_election.cc:304] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: 
I20260709 13:04:47.838197 11703 raft_consensus.cc:2393] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e3de92a308142c09eb4302b7ab01c4d in current term 1: Already voted for candidate a83803170adc46cb9fe0e763733bd198 in this term.
I20260709 13:04:47.834388 11891 consensus_queue.cc:260] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.840880 11891 ts_tablet_manager.cc:1434] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:47.841779 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e540577978284a8db70fba607d981e75" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:47.841957 11891 tablet_bootstrap.cc:492] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:47.842365 11852 raft_consensus.cc:3060] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.842911 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e540577978284a8db70fba607d981e75" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:47.843560 11778 raft_consensus.cc:3060] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.849066 11891 tablet_bootstrap.cc:654] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.850988 11778 raft_consensus.cc:2468] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:47.852488 11666 leader_election.cc:304] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:47.851603 11916 raft_consensus.cc:2764] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:04:47.851136 11852 raft_consensus.cc:2468] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:47.858498 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d6dfd18f24e38bf7b04e1943080b6" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
W20260709 13:04:47.859776 11815 leader_election.cc:343] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.860224 11815 leader_election.cc:304] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cc9524393564c9195319d1d17362761; no voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198
I20260709 13:04:47.860958 11896 raft_consensus.cc:2749] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:47.861687 11916 raft_consensus.cc:493] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.861840 11909 raft_consensus.cc:2804] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:47.862376 11909 raft_consensus.cc:697] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:47.863173 11891 tablet_bootstrap.cc:492] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:47.863804 11891 ts_tablet_manager.cc:1403] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.006s
I20260709 13:04:47.863263 11909 consensus_queue.cc:237] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.862213 11916 raft_consensus.cc:515] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } }
I20260709 13:04:47.867293 11916 leader_election.cc:290] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:47.869153 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2fc5b4849b43bab392c039d726546c" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
W20260709 13:04:47.870421 11743 leader_election.cc:343] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.870183 11891 raft_consensus.cc:359] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.869155 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2fc5b4849b43bab392c039d726546c" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:47.871341 11891 raft_consensus.cc:385] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.871625 11852 raft_consensus.cc:2468] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 0.
I20260709 13:04:47.871833 11891 raft_consensus.cc:740] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.872584 11895 tablet_bootstrap.cc:492] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:47.873080 11741 leader_election.cc:304] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: a83803170adc46cb9fe0e763733bd198
I20260709 13:04:47.873106 11895 ts_tablet_manager.cc:1403] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.067s	user 0.030s	sys 0.020s
I20260709 13:04:47.874467 11916 raft_consensus.cc:2804] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.873145 11891 consensus_queue.cc:260] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.874922 11916 raft_consensus.cc:493] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.875509 11916 raft_consensus.cc:3060] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.880616 11891 ts_tablet_manager.cc:1434] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.006s
I20260709 13:04:47.881073 11892 tablet_bootstrap.cc:492] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:47.881660 11892 ts_tablet_manager.cc:1403] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.032s
I20260709 13:04:47.882057 11891 tablet_bootstrap.cc:492] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:47.884730 11892 raft_consensus.cc:359] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.887740 11895 raft_consensus.cc:359] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.890107 11891 tablet_bootstrap.cc:654] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.890610 11892 raft_consensus.cc:385] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.890654 11895 raft_consensus.cc:385] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.890991 11892 raft_consensus.cc:740] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.891305 11895 raft_consensus.cc:740] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.892203 11895 consensus_queue.cc:260] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.890019 11916 raft_consensus.cc:515] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } }
I20260709 13:04:47.894340 11892 consensus_queue.cc:260] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.894953 11895 ts_tablet_manager.cc:1434] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:04:47.896580 11916 leader_election.cc:290] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:47.896715 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2fc5b4849b43bab392c039d726546c" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:47.897675 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2fc5b4849b43bab392c039d726546c" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:47.898065 11895 tablet_bootstrap.cc:492] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:47.898273 11852 raft_consensus.cc:3060] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:47.898293 11743 leader_election.cc:343] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:47.903035 11598 catalog_manager.cc:5697] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 0 to 1, leader changed from <none> to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.904258 11891 tablet_bootstrap.cc:492] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:47.904800 11891 ts_tablet_manager.cc:1403] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 13:04:47.907428 11891 raft_consensus.cc:359] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.908176 11891 raft_consensus.cc:385] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.908485 11891 raft_consensus.cc:740] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.909461 11852 raft_consensus.cc:2468] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 1.
I20260709 13:04:47.909380 11891 consensus_queue.cc:260] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.910702 11741 leader_election.cc:304] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: a83803170adc46cb9fe0e763733bd198
I20260709 13:04:47.911628 11916 raft_consensus.cc:2804] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:47.912082 11892 ts_tablet_manager.cc:1434] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 13:04:47.912169 11916 raft_consensus.cc:697] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Becoming Leader. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:47.913144 11892 tablet_bootstrap.cc:492] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:47.913091 11916 consensus_queue.cc:237] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } }
I20260709 13:04:47.911586 11891 ts_tablet_manager.cc:1434] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:47.919550 11891 tablet_bootstrap.cc:492] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:47.920120 11895 tablet_bootstrap.cc:654] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.922266 11892 tablet_bootstrap.cc:654] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.932350 11892 tablet_bootstrap.cc:492] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:47.932873 11891 tablet_bootstrap.cc:654] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.932924 11892 ts_tablet_manager.cc:1403] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 13:04:47.935824 11895 tablet_bootstrap.cc:492] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:47.936316 11895 ts_tablet_manager.cc:1403] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.002s
I20260709 13:04:47.936820 11892 raft_consensus.cc:359] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.937975 11892 raft_consensus.cc:385] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.938418 11892 raft_consensus.cc:740] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.939687 11895 raft_consensus.cc:359] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.940685 11895 raft_consensus.cc:385] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.940999 11895 raft_consensus.cc:740] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.939378 11892 consensus_queue.cc:260] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.941742 11895 consensus_queue.cc:260] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.943919 11892 ts_tablet_manager.cc:1434] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:04:47.944222 11895 ts_tablet_manager.cc:1434] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:47.939364 11601 catalog_manager.cc:5697] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130). New cstate: current_term: 1 leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.944918 11891 tablet_bootstrap.cc:492] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:47.945485 11891 ts_tablet_manager.cc:1403] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.005s
I20260709 13:04:47.945644 11895 tablet_bootstrap.cc:492] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:47.944937 11892 tablet_bootstrap.cc:492] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:47.948302 11891 raft_consensus.cc:359] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.949129 11891 raft_consensus.cc:385] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.949447 11891 raft_consensus.cc:740] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.950359 11891 consensus_queue.cc:260] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.952489 11891 ts_tablet_manager.cc:1434] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:47.953462 11891 tablet_bootstrap.cc:492] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:47.953778 11892 tablet_bootstrap.cc:654] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.955696 11895 tablet_bootstrap.cc:654] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.960055 11891 tablet_bootstrap.cc:654] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:47.970544 11909 raft_consensus.cc:493] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.971258 11909 raft_consensus.cc:515] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.975100 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64f5902fc714bd290548d24fc7bbef4" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:47.976011 11778 raft_consensus.cc:2468] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:47.977645 11666 leader_election.cc:304] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:47.978793 11905 raft_consensus.cc:2804] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.979266 11905 raft_consensus.cc:493] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.979728 11905 raft_consensus.cc:3060] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.990146 11895 tablet_bootstrap.cc:492] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:47.990252 11891 tablet_bootstrap.cc:492] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:47.990995 11895 ts_tablet_manager.cc:1403] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.017s
I20260709 13:04:47.991044 11891 ts_tablet_manager.cc:1403] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.015s
I20260709 13:04:47.994282 11891 raft_consensus.cc:359] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.994422 11905 raft_consensus.cc:515] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.994586 11895 raft_consensus.cc:359] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.995074 11891 raft_consensus.cc:385] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.995433 11895 raft_consensus.cc:385] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:47.995482 11891 raft_consensus.cc:740] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.995859 11895 raft_consensus.cc:740] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:47.996686 11895 consensus_queue.cc:260] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.996578 11891 consensus_queue.cc:260] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:47.998952 11895 ts_tablet_manager.cc:1434] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:47.999022 11891 ts_tablet_manager.cc:1434] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:04:48.000062 11895 tablet_bootstrap.cc:492] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:48.002090 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64f5902fc714bd290548d24fc7bbef4" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:48.002743 11852 raft_consensus.cc:2468] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:48.007531 11909 leader_election.cc:290] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.007652 11895 tablet_bootstrap.cc:654] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.010699 11892 tablet_bootstrap.cc:492] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:48.016202 11892 ts_tablet_manager.cc:1403] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.015s
I20260709 13:04:48.017385 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64f5902fc714bd290548d24fc7bbef4" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:48.018039 11895 tablet_bootstrap.cc:492] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:48.018138 11778 raft_consensus.cc:3060] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.018774 11895 ts_tablet_manager.cc:1403] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.009s
I20260709 13:04:48.019085 11892 raft_consensus.cc:359] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.019831 11892 raft_consensus.cc:385] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.020109 11892 raft_consensus.cc:740] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.020831 11892 consensus_queue.cc:260] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.022044 11895 raft_consensus.cc:359] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.023000 11895 raft_consensus.cc:385] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.023082 11892 ts_tablet_manager.cc:1434] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:04:48.023360 11895 raft_consensus.cc:740] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.024266 11895 consensus_queue.cc:260] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.024914 11905 leader_election.cc:290] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Requested vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.026052 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64f5902fc714bd290548d24fc7bbef4" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:48.026597 11852 raft_consensus.cc:3060] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.029165 11895 ts_tablet_manager.cc:1434] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:04:48.029708 11892 tablet_bootstrap.cc:492] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:48.030332 11895 tablet_bootstrap.cc:492] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:48.033598 11852 raft_consensus.cc:2468] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:48.035104 11666 leader_election.cc:304] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:48.036120 11905 raft_consensus.cc:2804] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:48.037056 11905 raft_consensus.cc:697] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:48.038072 11895 tablet_bootstrap.cc:654] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.038093 11905 consensus_queue.cc:237] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.041242 11778 raft_consensus.cc:2468] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:48.038122 11892 tablet_bootstrap.cc:654] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.047616 11895 tablet_bootstrap.cc:492] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:48.048219 11895 ts_tablet_manager.cc:1403] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:04:48.050209 11892 tablet_bootstrap.cc:492] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:48.050729 11892 ts_tablet_manager.cc:1403] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 13:04:48.050572 11895 raft_consensus.cc:359] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.051352 11895 raft_consensus.cc:385] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.051673 11895 raft_consensus.cc:740] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.052325 11895 consensus_queue.cc:260] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.053592 11892 raft_consensus.cc:359] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.054232 11892 raft_consensus.cc:385] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.054338 11895 ts_tablet_manager.cc:1434] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:48.052582 11601 catalog_manager.cc:5697] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 0 to 1, leader changed from <none> to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.054616 11892 raft_consensus.cc:740] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.055380 11895 tablet_bootstrap.cc:492] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:48.055683 11892 consensus_queue.cc:260] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.058218 11892 ts_tablet_manager.cc:1434] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:48.059259 11892 tablet_bootstrap.cc:492] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:48.061424 11895 tablet_bootstrap.cc:654] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.065968 11892 tablet_bootstrap.cc:654] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.068861 11895 tablet_bootstrap.cc:492] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:48.069295 11895 ts_tablet_manager.cc:1403] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:04:48.071768 11892 tablet_bootstrap.cc:492] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:48.072268 11892 ts_tablet_manager.cc:1403] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:04:48.071916 11895 raft_consensus.cc:359] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.072611 11895 raft_consensus.cc:385] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.072904 11895 raft_consensus.cc:740] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.073554 11895 consensus_queue.cc:260] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.074887 11892 raft_consensus.cc:359] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.075498 11895 ts_tablet_manager.cc:1434] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:48.075584 11892 raft_consensus.cc:385] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.075941 11892 raft_consensus.cc:740] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.076691 11892 consensus_queue.cc:260] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.078649 11892 ts_tablet_manager.cc:1434] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:48.080298 11892 tablet_bootstrap.cc:492] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:48.087128 11892 tablet_bootstrap.cc:654] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:48.091907 11892 tablet_bootstrap.cc:492] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:48.092139 11896 raft_consensus.cc:493] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.092360 11892 ts_tablet_manager.cc:1403] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:04:48.092655 11896 raft_consensus.cc:515] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.094776 11896 leader_election.cc:290] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:48.095235 11892 raft_consensus.cc:359] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } }
I20260709 13:04:48.095647 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251613b9d31a4611b3e0966d083a9fb6" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:48.095976 11892 raft_consensus.cc:385] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:48.096285 11892 raft_consensus.cc:740] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:48.096366 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251613b9d31a4611b3e0966d083a9fb6" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:48.097010 11778 raft_consensus.cc:2468] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 0.
I20260709 13:04:48.096360 11703 raft_consensus.cc:2468] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 0.
I20260709 13:04:48.096999 11892 consensus_queue.cc:260] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } }
I20260709 13:04:48.097899 11916 raft_consensus.cc:493] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.098428 11916 raft_consensus.cc:515] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.098894 11817 leader_election.cc:304] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:48.099300 11892 ts_tablet_manager.cc:1434] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:48.099857 11896 raft_consensus.cc:2804] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:48.100277 11896 raft_consensus.cc:493] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.100564 11896 raft_consensus.cc:3060] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.100862 11916 leader_election.cc:290] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.101660 11905 raft_consensus.cc:493] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.102018 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674dd81cb2c045d298cc247aaec3cb63" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:48.102115 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674dd81cb2c045d298cc247aaec3cb63" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:48.102690 11852 raft_consensus.cc:2468] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 0.
I20260709 13:04:48.102850 11703 raft_consensus.cc:2468] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 0.
I20260709 13:04:48.103682 11741 leader_election.cc:304] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: 
I20260709 13:04:48.104552 11916 raft_consensus.cc:2804] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:48.102161 11905 raft_consensus.cc:515] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.105147 11916 raft_consensus.cc:493] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.105643 11916 raft_consensus.cc:3060] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.108700 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825ff31df094f538fa9178c022e6f83" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:48.109424 11852 raft_consensus.cc:2468] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:48.109799 11896 raft_consensus.cc:515] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.110867 11666 leader_election.cc:304] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:48.106935 11905 leader_election.cc:290] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.110991 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825ff31df094f538fa9178c022e6f83" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:48.111959 11909 raft_consensus.cc:2804] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:48.112859 11778 raft_consensus.cc:2468] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:48.113130 11909 raft_consensus.cc:493] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.113127 11916 raft_consensus.cc:515] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.113812 11909 raft_consensus.cc:3060] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.114557 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251613b9d31a4611b3e0966d083a9fb6" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:48.115134 11778 raft_consensus.cc:3060] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.115424 11916 leader_election.cc:290] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.116569 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674dd81cb2c045d298cc247aaec3cb63" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:48.117146 11852 raft_consensus.cc:3060] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.117208 11702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674dd81cb2c045d298cc247aaec3cb63" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:48.118026 11702 raft_consensus.cc:3060] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.112598 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251613b9d31a4611b3e0966d083a9fb6" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:48.123059 11703 raft_consensus.cc:3060] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.123111 11896 leader_election.cc:290] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:48.122864 11778 raft_consensus.cc:2468] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 1.
I20260709 13:04:48.124249 11852 raft_consensus.cc:2468] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 1.
I20260709 13:04:48.125083 11815 leader_election.cc:304] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: 
I20260709 13:04:48.125792 11896 raft_consensus.cc:2804] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:48.126144 11702 raft_consensus.cc:2468] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 1.
I20260709 13:04:48.126319 11741 leader_election.cc:304] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: 
I20260709 13:04:48.127535 11916 raft_consensus.cc:2804] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:48.128159 11916 raft_consensus.cc:697] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Becoming Leader. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:48.122052 11909 raft_consensus.cc:515] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.129209 11916 consensus_queue.cc:237] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.130836 11703 raft_consensus.cc:2468] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 1.
I20260709 13:04:48.133358 11909 leader_election.cc:290] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Requested vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.134285 11896 raft_consensus.cc:697] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [term 1 LEADER]: Becoming Leader. State: Replica: 5cc9524393564c9195319d1d17362761, State: Running, Role: LEADER
I20260709 13:04:48.134373 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825ff31df094f538fa9178c022e6f83" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:48.134609 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825ff31df094f538fa9178c022e6f83" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:48.135071 11778 raft_consensus.cc:3060] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.135308 11852 raft_consensus.cc:3060] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.135378 11896 consensus_queue.cc:237] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.139068 11909 raft_consensus.cc:493] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.139814 11909 raft_consensus.cc:515] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.142052 11852 raft_consensus.cc:2468] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:48.143004 11909 leader_election.cc:290] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.143141 11666 leader_election.cc:304] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:48.144244 11909 raft_consensus.cc:2804] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:48.144996 11909 raft_consensus.cc:697] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:48.145884 11777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d6dfd18f24e38bf7b04e1943080b6" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:48.145949 11909 consensus_queue.cc:237] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.147034 11777 raft_consensus.cc:2468] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:48.153811 11941 raft_consensus.cc:493] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.153672 11600 catalog_manager.cc:5697] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130). New cstate: current_term: 1 leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.154663 11941 raft_consensus.cc:515] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.158667 11666 leader_election.cc:304] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:48.159150 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef44f35bfce4c29be19207c829db079" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:48.159829 11905 raft_consensus.cc:2804] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:48.160401 11905 raft_consensus.cc:493] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.161031 11905 raft_consensus.cc:3060] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.161790 11916 raft_consensus.cc:493] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.162356 11916 raft_consensus.cc:515] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.160239 11703 raft_consensus.cc:2468] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 0.
I20260709 13:04:48.163280 11777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef44f35bfce4c29be19207c829db079" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:48.164573 11817 leader_election.cc:304] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:48.164774 11916 leader_election.cc:290] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.165654 11777 raft_consensus.cc:2468] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 0.
I20260709 13:04:48.166931 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef44f35bfce4c29be19207c829db079" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:48.167209 11941 leader_election.cc:290] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:48.167651 11850 raft_consensus.cc:2468] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 0.
I20260709 13:04:48.168497 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef44f35bfce4c29be19207c829db079" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:48.168830 11941 raft_consensus.cc:2804] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:48.168923 11741 leader_election.cc:304] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: 
I20260709 13:04:48.169339 11703 raft_consensus.cc:2468] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 0.
I20260709 13:04:48.170177 11916 raft_consensus.cc:2804] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:48.170817 11916 raft_consensus.cc:493] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.171386 11916 raft_consensus.cc:3060] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.170202 11941 raft_consensus.cc:493] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.172174 11941 raft_consensus.cc:3060] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.179610 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d6dfd18f24e38bf7b04e1943080b6" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:48.181282 11916 raft_consensus.cc:515] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.184100 11905 raft_consensus.cc:515] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.187752 11777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d6dfd18f24e38bf7b04e1943080b6" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:48.187844 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef44f35bfce4c29be19207c829db079" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:48.182832 11778 raft_consensus.cc:2468] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:48.188377 11777 raft_consensus.cc:3060] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.192276 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "820d6dfd18f24e38bf7b04e1943080b6" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:48.194590 11905 leader_election.cc:290] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Requested vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.188663 11703 raft_consensus.cc:3060] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.188860 11852 raft_consensus.cc:2468] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:48.189321 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef44f35bfce4c29be19207c829db079" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:48.189178 11916 leader_election.cc:290] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.213644 11777 raft_consensus.cc:2468] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
W20260709 13:04:48.214919 11817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.129:33081, user_credentials={real_user=slave}} blocked reactor thread for 50451.5us
I20260709 13:04:48.214946 11666 leader_election.cc:304] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 5cc9524393564c9195319d1d17362761
I20260709 13:04:48.214974 11600 catalog_manager.cc:5697] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 0 to 1, leader changed from <none> to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.216312 11909 raft_consensus.cc:2804] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:48.217108 11909 raft_consensus.cc:697] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:48.217928 11703 raft_consensus.cc:2468] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 1.
I20260709 13:04:48.217948 11909 consensus_queue.cc:237] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.219172 11743 leader_election.cc:304] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:48.220196 11916 raft_consensus.cc:2804] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:48.220745 11916 raft_consensus.cc:697] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Becoming Leader. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:48.221539 11916 consensus_queue.cc:237] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.228960 11941 raft_consensus.cc:515] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.229524 11601 catalog_manager.cc:5697] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cc9524393564c9195319d1d17362761 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "5cc9524393564c9195319d1d17362761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:48.232369 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef44f35bfce4c29be19207c829db079" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:48.232412 11777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef44f35bfce4c29be19207c829db079" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:48.233153 11703 raft_consensus.cc:2393] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cc9524393564c9195319d1d17362761 in current term 1: Already voted for candidate 6e3de92a308142c09eb4302b7ab01c4d in this term.
I20260709 13:04:48.232540 11850 raft_consensus.cc:2393] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e3de92a308142c09eb4302b7ab01c4d in current term 1: Already voted for candidate 5cc9524393564c9195319d1d17362761 in this term.
I20260709 13:04:48.234616 11817 leader_election.cc:304] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cc9524393564c9195319d1d17362761; no voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198
I20260709 13:04:48.235526 11896 raft_consensus.cc:2749] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:48.236429 11941 leader_election.cc:290] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:48.248554 11601 catalog_manager.cc:5697] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130). New cstate: current_term: 1 leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.253607 11905 consensus_queue.cc:1048] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.255905 11600 catalog_manager.cc:5697] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 0 to 1, leader changed from <none> to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.272339 11909 consensus_queue.cc:1048] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.301066 11703 raft_consensus.cc:3060] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.307698 11916 consensus_queue.cc:1048] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.319830 11955 consensus_queue.cc:1048] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.371279 11909 raft_consensus.cc:493] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.371944 11909 raft_consensus.cc:515] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.372411 11896 raft_consensus.cc:493] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.372891 11896 raft_consensus.cc:515] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.373847 11909 leader_election.cc:290] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.374825 11896 leader_election.cc:290] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:48.375166 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:48.375590 11955 raft_consensus.cc:493] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.375635 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:48.375810 11850 raft_consensus.cc:2468] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:48.376042 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:48.376488 11703 raft_consensus.cc:2468] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 0.
I20260709 13:04:48.376158 11955 raft_consensus.cc:515] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.374837 11777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:48.377115 11666 leader_election.cc:304] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:48.377830 11817 leader_election.cc:304] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:48.378108 11778 raft_consensus.cc:2468] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 0.
I20260709 13:04:48.378705 11896 raft_consensus.cc:2804] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:48.378746 11909 raft_consensus.cc:2804] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:48.379384 11896 raft_consensus.cc:493] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.379489 11909 raft_consensus.cc:493] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.379814 11896 raft_consensus.cc:3060] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.379983 11909 raft_consensus.cc:3060] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.380566 11955 leader_election.cc:290] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.379504 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:48.381332 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:48.385409 11909 raft_consensus.cc:515] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.385478 11896 raft_consensus.cc:515] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.386492 11703 raft_consensus.cc:2393] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e3de92a308142c09eb4302b7ab01c4d in current term 1: Already voted for candidate a83803170adc46cb9fe0e763733bd198 in this term.
I20260709 13:04:48.386650 11850 raft_consensus.cc:2393] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e3de92a308142c09eb4302b7ab01c4d in current term 1: Already voted for candidate 5cc9524393564c9195319d1d17362761 in this term.
I20260709 13:04:48.387544 11909 leader_election.cc:290] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Requested vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.388269 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:48.388199 11702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:48.388907 11778 raft_consensus.cc:3060] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.389472 11702 raft_consensus.cc:2393] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cc9524393564c9195319d1d17362761 in current term 1: Already voted for candidate a83803170adc46cb9fe0e763733bd198 in this term.
I20260709 13:04:48.389442 11743 leader_election.cc:304] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d; no voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198
I20260709 13:04:48.390882 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:48.390914 11777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:48.391351 11896 leader_election.cc:290] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:48.391837 11850 raft_consensus.cc:2393] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a83803170adc46cb9fe0e763733bd198 in current term 1: Already voted for candidate 5cc9524393564c9195319d1d17362761 in this term.
I20260709 13:04:48.392537 11815 leader_election.cc:304] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cc9524393564c9195319d1d17362761; no voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198
I20260709 13:04:48.393318 11896 raft_consensus.cc:2749] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:48.395216 11778 raft_consensus.cc:2468] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:48.395713 11955 raft_consensus.cc:2749] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:48.396358 11666 leader_election.cc:304] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 5cc9524393564c9195319d1d17362761
I20260709 13:04:48.397003 11909 raft_consensus.cc:2804] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:48.397420 11909 raft_consensus.cc:697] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:48.398205 11909 consensus_queue.cc:237] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.405108 11600 catalog_manager.cc:5697] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 0 to 1, leader changed from <none> to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.435252 11778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d2fc5b4849b43bab392c039d726546c"
dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
mode: GRACEFUL
new_leader_uuid: "a83803170adc46cb9fe0e763733bd198"
 from {username='slave'} at 127.0.0.1:57788
I20260709 13:04:48.435824 11778 raft_consensus.cc:606] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Received request to transfer leadership to TS a83803170adc46cb9fe0e763733bd198
I20260709 13:04:48.443590 11778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "674dd81cb2c045d298cc247aaec3cb63"
dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
mode: GRACEFUL
new_leader_uuid: "a83803170adc46cb9fe0e763733bd198"
 from {username='slave'} at 127.0.0.1:57788
I20260709 13:04:48.444097 11778 raft_consensus.cc:606] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Received request to transfer leadership to TS a83803170adc46cb9fe0e763733bd198
I20260709 13:04:48.459244 11702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2825ff31df094f538fa9178c022e6f83"
dest_uuid: "a83803170adc46cb9fe0e763733bd198"
mode: GRACEFUL
new_leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
 from {username='slave'} at 127.0.0.1:60906
I20260709 13:04:48.459779 11702 raft_consensus.cc:606] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Received request to transfer leadership to TS 6e3de92a308142c09eb4302b7ab01c4d
I20260709 13:04:48.464455 11702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449"
dest_uuid: "a83803170adc46cb9fe0e763733bd198"
mode: GRACEFUL
new_leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
 from {username='slave'} at 127.0.0.1:60906
I20260709 13:04:48.464928 11702 raft_consensus.cc:606] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Received request to transfer leadership to TS 6e3de92a308142c09eb4302b7ab01c4d
I20260709 13:04:48.471724 11702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b64f5902fc714bd290548d24fc7bbef4"
dest_uuid: "a83803170adc46cb9fe0e763733bd198"
mode: GRACEFUL
new_leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
 from {username='slave'} at 127.0.0.1:60906
I20260709 13:04:48.472194 11702 raft_consensus.cc:606] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Received request to transfer leadership to TS 6e3de92a308142c09eb4302b7ab01c4d
I20260709 13:04:48.565208 11909 consensus_queue.cc:1048] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.572013 11951 raft_consensus.cc:993] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198: : Instructing follower 6e3de92a308142c09eb4302b7ab01c4d to start an election
I20260709 13:04:48.572499 11905 raft_consensus.cc:1081] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Signalling peer 6e3de92a308142c09eb4302b7ab01c4d to start an election
I20260709 13:04:48.574095 11777 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b64f5902fc714bd290548d24fc7bbef4"
dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
 from {username='slave'} at 127.0.0.1:57776
I20260709 13:04:48.575016 11777 raft_consensus.cc:493] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.575405 11777 raft_consensus.cc:3060] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.578454 11909 consensus_queue.cc:1048] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.582595 11777 raft_consensus.cc:515] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.585899 11702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64f5902fc714bd290548d24fc7bbef4" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:48.586182 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b64f5902fc714bd290548d24fc7bbef4" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:48.586340 11777 leader_election.cc:290] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 2 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.586572 11702 raft_consensus.cc:3055] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.587004 11702 raft_consensus.cc:740] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:48.587473 11852 raft_consensus.cc:3060] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.587847 11702 consensus_queue.cc:260] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.589258 11702 raft_consensus.cc:3060] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.592815 11852 raft_consensus.cc:2468] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 2.
I20260709 13:04:48.593978 11741 leader_election.cc:304] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: 
I20260709 13:04:48.594806 11955 raft_consensus.cc:2804] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.595290 11955 raft_consensus.cc:697] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 LEADER]: Becoming Leader. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:48.596156 11955 consensus_queue.cc:237] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.596580 11702 raft_consensus.cc:2468] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 2.
I20260709 13:04:48.603792 11601 catalog_manager.cc:5697] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d reported cstate change: term changed from 1 to 2, leader changed from a83803170adc46cb9fe0e763733bd198 (127.0.107.129) to 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130). New cstate: current_term: 2 leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.620152 11909 consensus_queue.cc:1048] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.626471 11905 raft_consensus.cc:993] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198: : Instructing follower 6e3de92a308142c09eb4302b7ab01c4d to start an election
I20260709 13:04:48.626921 11951 raft_consensus.cc:1081] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Signalling peer 6e3de92a308142c09eb4302b7ab01c4d to start an election
I20260709 13:04:48.627314 11955 consensus_queue.cc:1048] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.632483 11909 consensus_queue.cc:1048] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:48.628924 11778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2825ff31df094f538fa9178c022e6f83"
dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
 from {username='slave'} at 127.0.0.1:57776
I20260709 13:04:48.634676 11778 raft_consensus.cc:493] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.635071 11778 raft_consensus.cc:3060] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.646798 11916 consensus_queue.cc:1048] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.646639 11778 raft_consensus.cc:515] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.649828 11896 consensus_queue.cc:1048] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.656217 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825ff31df094f538fa9178c022e6f83" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:48.656984 11850 raft_consensus.cc:3060] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.663544 11778 leader_election.cc:290] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 2 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.666169 11702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825ff31df094f538fa9178c022e6f83" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:48.666746 11702 raft_consensus.cc:3055] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.666627 11916 consensus_queue.cc:1048] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.667220 11702 raft_consensus.cc:740] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:48.668145 11850 raft_consensus.cc:2468] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 2.
I20260709 13:04:48.668085 11702 consensus_queue.cc:260] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.669492 11702 raft_consensus.cc:3060] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.672118 11741 leader_election.cc:304] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: 
I20260709 13:04:48.673151 11916 raft_consensus.cc:2804] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.675385 11896 consensus_queue.cc:1048] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:48.676569 11850 raft_consensus.cc:3060] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:48.673784 11916 raft_consensus.cc:697] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 LEADER]: Becoming Leader. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:48.679003 11916 consensus_queue.cc:237] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.681313 11702 raft_consensus.cc:2468] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 2.
I20260709 13:04:48.698503 11601 catalog_manager.cc:5697] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d reported cstate change: term changed from 1 to 2, leader changed from a83803170adc46cb9fe0e763733bd198 (127.0.107.129) to 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130). New cstate: current_term: 2 leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.701627 11909 consensus_queue.cc:1048] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.710685 11916 raft_consensus.cc:993] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d: : Instructing follower a83803170adc46cb9fe0e763733bd198 to start an election
I20260709 13:04:48.711234 11967 raft_consensus.cc:1081] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Signalling peer a83803170adc46cb9fe0e763733bd198 to start an election
I20260709 13:04:48.713032 11703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "674dd81cb2c045d298cc247aaec3cb63"
dest_uuid: "a83803170adc46cb9fe0e763733bd198"
 from {username='slave'} at 127.0.0.1:60892
I20260709 13:04:48.713670 11703 raft_consensus.cc:493] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.714056 11703 raft_consensus.cc:3060] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.719610 11916 consensus_queue.cc:1048] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.727030 11703 raft_consensus.cc:515] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.730013 11703 leader_election.cc:290] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 2 election: Requested vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.731081 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674dd81cb2c045d298cc247aaec3cb63" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:48.731797 11851 raft_consensus.cc:3060] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.735819 11966 raft_consensus.cc:993] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d: : Instructing follower a83803170adc46cb9fe0e763733bd198 to start an election
I20260709 13:04:48.736351 11966 raft_consensus.cc:1081] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Signalling peer a83803170adc46cb9fe0e763733bd198 to start an election
I20260709 13:04:48.736202 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674dd81cb2c045d298cc247aaec3cb63" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:48.737494 11778 raft_consensus.cc:3055] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.737854 11778 raft_consensus.cc:740] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:48.738667 11778 consensus_queue.cc:260] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.740056 11778 raft_consensus.cc:3060] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.739941 11905 consensus_queue.cc:1048] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:48.745913 11851 raft_consensus.cc:2468] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 2.
I20260709 13:04:48.747530 11666 leader_election.cc:304] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:48.747681 11778 raft_consensus.cc:2468] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 2.
I20260709 13:04:48.749348 11905 raft_consensus.cc:2804] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.749873 11905 raft_consensus.cc:697] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 2 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:48.751399 11703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d2fc5b4849b43bab392c039d726546c"
dest_uuid: "a83803170adc46cb9fe0e763733bd198"
 from {username='slave'} at 127.0.0.1:60892
I20260709 13:04:48.752076 11703 raft_consensus.cc:493] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.752467 11703 raft_consensus.cc:3060] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.750801 11905 consensus_queue.cc:237] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.759756 11703 raft_consensus.cc:515] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } }
I20260709 13:04:48.761862 11703 leader_election.cc:290] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 2 election: Requested vote from peers 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:48.762890 11777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2fc5b4849b43bab392c039d726546c" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:48.763684 11777 raft_consensus.cc:3055] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.764089 11777 raft_consensus.cc:740] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:48.764348 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2fc5b4849b43bab392c039d726546c" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:48.764958 11851 raft_consensus.cc:3060] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.765081 11777 consensus_queue.cc:260] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } }
I20260709 13:04:48.766439 11777 raft_consensus.cc:3060] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.766440 11598 catalog_manager.cc:5697] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 1 to 2, leader changed from 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130) to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.772009 11851 raft_consensus.cc:2468] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 2.
I20260709 13:04:48.773159 11666 leader_election.cc:304] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:48.773427 11777 raft_consensus.cc:2468] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 2.
I20260709 13:04:48.774070 11905 raft_consensus.cc:2804] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.774585 11905 raft_consensus.cc:697] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [term 2 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:48.775398 11905 consensus_queue.cc:237] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } }
I20260709 13:04:48.780711 11905 consensus_queue.cc:1048] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:48.783334 11598 catalog_manager.cc:5697] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 1 to 2, leader changed from 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130) to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.792297 11951 consensus_queue.cc:1048] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.799053 11909 raft_consensus.cc:993] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198: : Instructing follower 6e3de92a308142c09eb4302b7ab01c4d to start an election
I20260709 13:04:48.799513 11909 raft_consensus.cc:1081] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Signalling peer 6e3de92a308142c09eb4302b7ab01c4d to start an election
I20260709 13:04:48.801182 11778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449"
dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
 from {username='slave'} at 127.0.0.1:57776
I20260709 13:04:48.801741 11778 raft_consensus.cc:493] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.802083 11778 raft_consensus.cc:3060] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.807549 11778 raft_consensus.cc:515] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.809437 11778 leader_election.cc:290] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 2 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:48.810130 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:48.810803 11703 raft_consensus.cc:3055] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.811156 11703 raft_consensus.cc:740] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:48.812345 11703 consensus_queue.cc:260] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.813237 11703 raft_consensus.cc:3060] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.810832 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8437aef30ea44fb943f054c5dfe9449" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:48.814026 11851 raft_consensus.cc:3060] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.818384 11703 raft_consensus.cc:2468] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 2.
I20260709 13:04:48.819077 11851 raft_consensus.cc:2468] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 2.
I20260709 13:04:48.819701 11743 leader_election.cc:304] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:48.820514 11916 raft_consensus.cc:2804] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.820926 11916 raft_consensus.cc:697] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 LEADER]: Becoming Leader. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:48.821623 11916 consensus_queue.cc:237] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:48.827343 11600 catalog_manager.cc:5697] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d reported cstate change: term changed from 1 to 2, leader changed from a83803170adc46cb9fe0e763733bd198 (127.0.107.129) to 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130). New cstate: current_term: 2 leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.981940 11851 raft_consensus.cc:1275] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Refusing update from remote peer 6e3de92a308142c09eb4302b7ab01c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.984056 11916 consensus_queue.cc:1048] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.164323 11703 raft_consensus.cc:1275] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Refusing update from remote peer 6e3de92a308142c09eb4302b7ab01c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.166522 11966 consensus_queue.cc:1048] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:49.214515 11777 raft_consensus.cc:1275] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Refusing update from remote peer a83803170adc46cb9fe0e763733bd198: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.216430 11852 raft_consensus.cc:1275] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Refusing update from remote peer a83803170adc46cb9fe0e763733bd198: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.219573 11951 consensus_queue.cc:1048] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:49.221321 11951 consensus_queue.cc:1048] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.225179 11852 raft_consensus.cc:1275] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Refusing update from remote peer 6e3de92a308142c09eb4302b7ab01c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.228673 11849 raft_consensus.cc:1275] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Refusing update from remote peer a83803170adc46cb9fe0e763733bd198: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.229368 11966 consensus_queue.cc:1048] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.230244 11905 consensus_queue.cc:1048] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.239112 11701 raft_consensus.cc:1275] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Refusing update from remote peer 6e3de92a308142c09eb4302b7ab01c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.240495 11966 consensus_queue.cc:1048] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.252658 11777 raft_consensus.cc:1275] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Refusing update from remote peer a83803170adc46cb9fe0e763733bd198: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.254940 11703 raft_consensus.cc:1275] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Refusing update from remote peer 6e3de92a308142c09eb4302b7ab01c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.258735 11955 consensus_queue.cc:1048] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.264984 11849 raft_consensus.cc:1275] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Refusing update from remote peer 6e3de92a308142c09eb4302b7ab01c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.267493 11978 consensus_queue.cc:1048] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:49.282184 11966 consensus_queue.cc:1048] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:50.050897 11724 debug-util.cc:398] Leaking SignalData structure 0x7b080013ea60 after lost signal to thread 433
W20260709 13:04:50.052091 11724 debug-util.cc:398] Leaking SignalData structure 0x7b0800225c00 after lost signal to thread 11635
W20260709 13:04:50.053447 11724 debug-util.cc:398] Leaking SignalData structure 0x7b08000feec0 after lost signal to thread 11727
W20260709 13:04:50.054479 11724 debug-util.cc:398] Leaking SignalData structure 0x7b080038d520 after lost signal to thread 11802
W20260709 13:04:50.055449 11724 debug-util.cc:398] Leaking SignalData structure 0x7b08001aff00 after lost signal to thread 11876
I20260709 13:04:51.552063 11599 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60216:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:51.596392 11599 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:51.665983 11693 tablet_service.cc:1511] Processing CreateTablet for tablet 520be823b2cc46168edd987a3b5a170c (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:51.666734 11760 tablet_service.cc:1511] Processing CreateTablet for tablet 520be823b2cc46168edd987a3b5a170c (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:51.668291 11693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520be823b2cc46168edd987a3b5a170c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.668658 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520be823b2cc46168edd987a3b5a170c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.674336 11837 tablet_service.cc:1511] Processing CreateTablet for tablet 520be823b2cc46168edd987a3b5a170c (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:51.674455 11689 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3ddb4b8bae42ddb4c627b27df9751a (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:51.676590 11688 tablet_service.cc:1511] Processing CreateTablet for tablet a46ba50b52674792899065cd8987db9c (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:51.677233 11689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3ddb4b8bae42ddb4c627b27df9751a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.678123 11688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a46ba50b52674792899065cd8987db9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.679700 11837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 520be823b2cc46168edd987a3b5a170c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.689932 11840 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3ddb4b8bae42ddb4c627b27df9751a (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:51.692170 11840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3ddb4b8bae42ddb4c627b27df9751a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.692754 11762 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3ddb4b8bae42ddb4c627b27df9751a (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:51.694376 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3ddb4b8bae42ddb4c627b27df9751a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.701534 11834 tablet_service.cc:1511] Processing CreateTablet for tablet a46ba50b52674792899065cd8987db9c (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:51.701699 11763 tablet_service.cc:1511] Processing CreateTablet for tablet a46ba50b52674792899065cd8987db9c (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:51.703114 11834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a46ba50b52674792899065cd8987db9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.703491 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a46ba50b52674792899065cd8987db9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.758648 11993 tablet_bootstrap.cc:492] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:51.760032 11994 tablet_bootstrap.cc:492] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:51.802979 11993 tablet_bootstrap.cc:654] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.792872 11763 tablet_service.cc:1511] Processing CreateTablet for tablet d6eee90ebf5d42d387b50ebb3ecb4c2f (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:51.811251 11837 tablet_service.cc:1511] Processing CreateTablet for tablet d6eee90ebf5d42d387b50ebb3ecb4c2f (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:51.812328 11693 tablet_service.cc:1511] Processing CreateTablet for tablet 911998281aa14a588ddb0d0b31985c63 (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:51.812740 11837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6eee90ebf5d42d387b50ebb3ecb4c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.813607 11693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911998281aa14a588ddb0d0b31985c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.814427 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6eee90ebf5d42d387b50ebb3ecb4c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.816636 11995 tablet_bootstrap.cc:492] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:51.817829 11765 tablet_service.cc:1511] Processing CreateTablet for tablet 911998281aa14a588ddb0d0b31985c63 (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:51.819109 11838 tablet_service.cc:1511] Processing CreateTablet for tablet 911998281aa14a588ddb0d0b31985c63 (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:51.823639 11838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911998281aa14a588ddb0d0b31985c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.826498 11994 tablet_bootstrap.cc:654] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.823639 11765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911998281aa14a588ddb0d0b31985c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.809136 11687 tablet_service.cc:1511] Processing CreateTablet for tablet d6eee90ebf5d42d387b50ebb3ecb4c2f (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:51.836030 11687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6eee90ebf5d42d387b50ebb3ecb4c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.845988 11689 tablet_service.cc:1511] Processing CreateTablet for tablet 80b20a47436943788faa19cccbd436e9 (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:51.847363 11689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b20a47436943788faa19cccbd436e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.855585 11995 tablet_bootstrap.cc:654] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.857707 11762 tablet_service.cc:1511] Processing CreateTablet for tablet 80b20a47436943788faa19cccbd436e9 (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
W20260709 13:04:51.859078 11649 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:51.860798 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b20a47436943788faa19cccbd436e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.867733 11840 tablet_service.cc:1511] Processing CreateTablet for tablet 80b20a47436943788faa19cccbd436e9 (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:51.869112 11840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b20a47436943788faa19cccbd436e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.891811 11693 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf8cfbf2f394ae0b07a75ee6c98b7e9 (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:51.893276 11693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf8cfbf2f394ae0b07a75ee6c98b7e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.893808 11995 tablet_bootstrap.cc:492] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:51.893811 11760 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf8cfbf2f394ae0b07a75ee6c98b7e9 (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:51.894588 11995 ts_tablet_manager.cc:1403] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.078s	user 0.006s	sys 0.009s
I20260709 13:04:51.895303 11760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf8cfbf2f394ae0b07a75ee6c98b7e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.896057 11834 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf8cfbf2f394ae0b07a75ee6c98b7e9 (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:51.897323 11834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf8cfbf2f394ae0b07a75ee6c98b7e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.902971 11993 tablet_bootstrap.cc:492] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:51.903542 11993 ts_tablet_manager.cc:1403] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.147s	user 0.020s	sys 0.004s
I20260709 13:04:51.906607 11993 raft_consensus.cc:359] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:51.909266 11993 raft_consensus.cc:385] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.906213 11995 raft_consensus.cc:359] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:51.914821 11995 raft_consensus.cc:385] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.909597 11993 raft_consensus.cc:740] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.918303 11688 tablet_service.cc:1511] Processing CreateTablet for tablet 35542a66adbe4feb8da11f3d36a92e4a (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:51.921111 11688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35542a66adbe4feb8da11f3d36a92e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.920745 11993 consensus_queue.cc:260] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:51.918733 11994 tablet_bootstrap.cc:492] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:51.923787 11994 ts_tablet_manager.cc:1403] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.164s	user 0.022s	sys 0.016s
I20260709 13:04:51.915809 11995 raft_consensus.cc:740] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.938616 11995 consensus_queue.cc:260] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:51.937057 11840 tablet_service.cc:1511] Processing CreateTablet for tablet 35542a66adbe4feb8da11f3d36a92e4a (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:51.944926 11840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35542a66adbe4feb8da11f3d36a92e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.936722 11763 tablet_service.cc:1511] Processing CreateTablet for tablet 35542a66adbe4feb8da11f3d36a92e4a (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:51.950929 11763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35542a66adbe4feb8da11f3d36a92e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.959457 11995 ts_tablet_manager.cc:1434] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 13:04:51.963016 11995 tablet_bootstrap.cc:492] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:51.972651 11995 tablet_bootstrap.cc:654] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.966884 11994 raft_consensus.cc:359] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:51.975250 11693 tablet_service.cc:1511] Processing CreateTablet for tablet 67dbde1322424ecfa8079bdb26633b38 (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 13:04:51.979470 11729 tablet.cc:2406] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:51.979744 11693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67dbde1322424ecfa8079bdb26633b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.980197 11762 tablet_service.cc:1511] Processing CreateTablet for tablet 67dbde1322424ecfa8079bdb26633b38 (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:51.981488 11762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67dbde1322424ecfa8079bdb26633b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.984110 11993 ts_tablet_manager.cc:1434] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.080s	user 0.018s	sys 0.036s
I20260709 13:04:51.977912 11994 raft_consensus.cc:385] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.987032 11994 raft_consensus.cc:740] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.987831 11994 consensus_queue.cc:260] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:51.990296 11993 tablet_bootstrap.cc:492] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:51.990378 11994 ts_tablet_manager.cc:1434] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.000s
I20260709 13:04:51.996161 11994 tablet_bootstrap.cc:492] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:52.003778 11994 tablet_bootstrap.cc:654] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.006476 11993 tablet_bootstrap.cc:654] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.023651 11834 tablet_service.cc:1511] Processing CreateTablet for tablet 67dbde1322424ecfa8079bdb26633b38 (DEFAULT_TABLE table=soft_deleted_table [id=c29622749c1c407b9479d724d110287e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:52.025337 11834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67dbde1322424ecfa8079bdb26633b38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.026705 11995 tablet_bootstrap.cc:492] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:52.032024 11995 ts_tablet_manager.cc:1403] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.003s
I20260709 13:04:52.036571 11995 raft_consensus.cc:359] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.037813 11995 raft_consensus.cc:385] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.038808 11995 raft_consensus.cc:740] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.039633 11995 consensus_queue.cc:260] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.041584 11995 ts_tablet_manager.cc:1434] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:04:52.042367 11995 tablet_bootstrap.cc:492] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:52.056643 11994 tablet_bootstrap.cc:492] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:52.062942 11995 tablet_bootstrap.cc:654] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.070477 11993 tablet_bootstrap.cc:492] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:52.071153 11993 ts_tablet_manager.cc:1403] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.006s
I20260709 13:04:52.068835 11994 ts_tablet_manager.cc:1403] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.000s
I20260709 13:04:52.087278 11916 raft_consensus.cc:493] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.087808 11993 raft_consensus.cc:359] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.087909 11916 raft_consensus.cc:515] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.088181 11994 raft_consensus.cc:359] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.089080 11994 raft_consensus.cc:385] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.089450 11994 raft_consensus.cc:740] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.090802 11916 leader_election.cc:290] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.091753 11995 tablet_bootstrap.cc:492] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:52.092098 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46ba50b52674792899065cd8987db9c" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:52.092525 11995 ts_tablet_manager.cc:1403] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.019s
W20260709 13:04:52.094770 11743 leader_election.cc:343] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.088732 11993 raft_consensus.cc:385] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.095675 11993 raft_consensus.cc:740] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.096590 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46ba50b52674792899065cd8987db9c" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:52.096290 11995 raft_consensus.cc:359] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.097138 11995 raft_consensus.cc:385] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.096738 11993 consensus_queue.cc:260] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.097540 11995 raft_consensus.cc:740] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.097251 11994 consensus_queue.cc:260] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.097924 11849 raft_consensus.cc:2468] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 0.
I20260709 13:04:52.098498 11995 consensus_queue.cc:260] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.099676 11741 leader_election.cc:304] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: a83803170adc46cb9fe0e763733bd198
I20260709 13:04:52.100019 11994 ts_tablet_manager.cc:1434] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:04:52.103577 11992 raft_consensus.cc:2804] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.103819 11994 tablet_bootstrap.cc:492] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:52.104048 11992 raft_consensus.cc:493] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.104579 11992 raft_consensus.cc:3060] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.105070 11993 ts_tablet_manager.cc:1434] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.033s	user 0.000s	sys 0.007s
I20260709 13:04:52.111572 11994 tablet_bootstrap.cc:654] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.100975 11995 ts_tablet_manager.cc:1434] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:52.121601 11995 tablet_bootstrap.cc:492] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:52.123436 11994 tablet_bootstrap.cc:492] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:52.124051 11994 ts_tablet_manager.cc:1403] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 13:04:52.122182 11992 raft_consensus.cc:515] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.126935 11992 leader_election.cc:290] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.128129 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46ba50b52674792899065cd8987db9c" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:52.127521 11994 raft_consensus.cc:359] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.131494 11849 raft_consensus.cc:3060] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.131662 11994 raft_consensus.cc:385] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.132066 11994 raft_consensus.cc:740] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.132539 11995 tablet_bootstrap.cc:654] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.132884 11994 consensus_queue.cc:260] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.127694 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46ba50b52674792899065cd8987db9c" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:52.135502 11994 ts_tablet_manager.cc:1434] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:52.135871 11703 raft_consensus.cc:3060] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.136826 11994 tablet_bootstrap.cc:492] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:52.144909 11995 tablet_bootstrap.cc:492] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:52.145527 11994 tablet_bootstrap.cc:654] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.145527 11995 ts_tablet_manager.cc:1403] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.013s
I20260709 13:04:52.147531 11993 tablet_bootstrap.cc:492] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:52.149176 11995 raft_consensus.cc:359] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.150274 11995 raft_consensus.cc:385] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.150728 11995 raft_consensus.cc:740] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.151799 11995 consensus_queue.cc:260] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.155319 11995 ts_tablet_manager.cc:1434] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 13:04:52.153129 11849 raft_consensus.cc:2468] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 1.
I20260709 13:04:52.157238 11703 raft_consensus.cc:2468] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 1.
I20260709 13:04:52.159721 11995 tablet_bootstrap.cc:492] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:52.161724 11743 leader_election.cc:304] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:52.163174 11994 tablet_bootstrap.cc:492] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:52.163288 11992 raft_consensus.cc:2804] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.163781 11994 ts_tablet_manager.cc:1403] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.004s
I20260709 13:04:52.163864 11992 raft_consensus.cc:697] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Becoming Leader. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:52.164814 11992 consensus_queue.cc:237] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.166884 11994 raft_consensus.cc:359] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.167727 11994 raft_consensus.cc:385] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.168061 11994 raft_consensus.cc:740] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.168857 11994 consensus_queue.cc:260] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.170009 12005 raft_consensus.cc:493] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.170518 12005 raft_consensus.cc:515] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.171294 11995 tablet_bootstrap.cc:654] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.164783 11993 tablet_bootstrap.cc:654] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.172751 12005 leader_election.cc:290] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.171202 11994 ts_tablet_manager.cc:1434] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:04:52.175271 11994 tablet_bootstrap.cc:492] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:52.176888 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520be823b2cc46168edd987a3b5a170c" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:52.177793 11778 raft_consensus.cc:2468] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:52.179680 11666 leader_election.cc:304] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:52.181056 12005 raft_consensus.cc:2804] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.181468 12005 raft_consensus.cc:493] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.182045 12005 raft_consensus.cc:3060] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.182641 11994 tablet_bootstrap.cc:654] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.189519 11601 catalog_manager.cc:5697] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130). New cstate: current_term: 1 leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.191238 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520be823b2cc46168edd987a3b5a170c" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:52.191994 11849 raft_consensus.cc:2468] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:52.194613 12005 raft_consensus.cc:515] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.197070 11993 tablet_bootstrap.cc:492] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:52.197660 11993 ts_tablet_manager.cc:1403] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.003s
I20260709 13:04:52.199087 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520be823b2cc46168edd987a3b5a170c" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:52.199729 11778 raft_consensus.cc:3060] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.209398 11778 raft_consensus.cc:2468] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:52.212250 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "520be823b2cc46168edd987a3b5a170c" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:52.214746 11849 raft_consensus.cc:3060] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.215541 11995 tablet_bootstrap.cc:492] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:52.212746 11993 raft_consensus.cc:359] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.216589 11993 raft_consensus.cc:385] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.218118 11993 raft_consensus.cc:740] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.219022 11994 tablet_bootstrap.cc:492] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:52.216257 11995 ts_tablet_manager.cc:1403] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.006s
I20260709 13:04:52.218995 11993 consensus_queue.cc:260] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.221993 11993 ts_tablet_manager.cc:1434] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:04:52.213960 12005 leader_election.cc:290] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Requested vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.222597 11995 raft_consensus.cc:359] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.223241 11993 tablet_bootstrap.cc:492] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:52.223456 11995 raft_consensus.cc:385] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.224040 11994 ts_tablet_manager.cc:1403] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.014s
I20260709 13:04:52.225800 11666 leader_election.cc:304] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:52.226967 12005 raft_consensus.cc:2804] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.228274 12005 raft_consensus.cc:697] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:52.228416 11994 raft_consensus.cc:359] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.229198 11994 raft_consensus.cc:385] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.229496 11994 raft_consensus.cc:740] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.225039 11995 raft_consensus.cc:740] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.230752 11995 consensus_queue.cc:260] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.231696 12005 consensus_queue.cc:237] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.233275 11995 ts_tablet_manager.cc:1434] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:52.237200 11995 tablet_bootstrap.cc:492] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:52.240829 11849 raft_consensus.cc:2468] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:52.237704 11994 consensus_queue.cc:260] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.248848 11994 ts_tablet_manager.cc:1434] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 13:04:52.248890 11978 raft_consensus.cc:493] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.249529 11978 raft_consensus.cc:515] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.250092 11994 tablet_bootstrap.cc:492] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:52.246366 11995 tablet_bootstrap.cc:654] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.257617 11978 leader_election.cc:290] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.259461 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3ddb4b8bae42ddb4c627b27df9751a" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:52.260178 11851 raft_consensus.cc:2468] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:52.261236 11994 tablet_bootstrap.cc:654] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.261356 11666 leader_election.cc:304] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:52.261749 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3ddb4b8bae42ddb4c627b27df9751a" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:52.262437 11778 raft_consensus.cc:2468] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:52.264401 11978 raft_consensus.cc:2804] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.264909 11978 raft_consensus.cc:493] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.265331 11978 raft_consensus.cc:3060] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.271919 11993 tablet_bootstrap.cc:654] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.273777 11994 tablet_bootstrap.cc:492] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:52.274502 11994 ts_tablet_manager.cc:1403] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 13:04:52.279789 11994 raft_consensus.cc:359] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.276180 11995 tablet_bootstrap.cc:492] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:52.280895 11995 ts_tablet_manager.cc:1403] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.000s
I20260709 13:04:52.284608 11993 tablet_bootstrap.cc:492] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:52.285429 11993 ts_tablet_manager.cc:1403] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.002s
I20260709 13:04:52.285025 11995 raft_consensus.cc:359] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.286008 11995 raft_consensus.cc:385] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.286090 11978 raft_consensus.cc:515] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.286482 11995 raft_consensus.cc:740] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.288218 11995 consensus_queue.cc:260] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.288776 11993 raft_consensus.cc:359] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.286888 11994 raft_consensus.cc:385] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.289549 11993 raft_consensus.cc:385] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.289904 11994 raft_consensus.cc:740] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.290014 11993 raft_consensus.cc:740] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.290899 11994 consensus_queue.cc:260] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.291934 11993 consensus_queue.cc:260] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.293296 11994 ts_tablet_manager.cc:1434] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:04:52.293856 11993 ts_tablet_manager.cc:1434] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:52.294745 11994 tablet_bootstrap.cc:492] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:52.297734 11993 tablet_bootstrap.cc:492] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:52.302246 11978 leader_election.cc:290] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Requested vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.302932 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3ddb4b8bae42ddb4c627b27df9751a" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:52.305795 11778 raft_consensus.cc:3060] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.309731 11994 tablet_bootstrap.cc:654] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.305213 11995 ts_tablet_manager.cc:1434] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.006s
I20260709 13:04:52.304504 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3ddb4b8bae42ddb4c627b27df9751a" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:52.310959 11995 tablet_bootstrap.cc:492] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:52.311007 11849 raft_consensus.cc:3060] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.319142 11995 tablet_bootstrap.cc:654] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.320322 11601 catalog_manager.cc:5697] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 0 to 1, leader changed from <none> to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.319060 11778 raft_consensus.cc:2468] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:52.323486 11849 raft_consensus.cc:2468] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:52.324276 11666 leader_election.cc:304] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:52.325736 11978 raft_consensus.cc:2804] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.326200 11978 raft_consensus.cc:697] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:52.327013 11978 consensus_queue.cc:237] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.328661 11993 tablet_bootstrap.cc:654] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.330047 11992 raft_consensus.cc:493] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.332281 11992 raft_consensus.cc:515] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.335002 11992 leader_election.cc:290] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.337206 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911998281aa14a588ddb0d0b31985c63" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:52.337585 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911998281aa14a588ddb0d0b31985c63" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:52.337961 11703 raft_consensus.cc:2468] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 0.
W20260709 13:04:52.339308 11741 leader_election.cc:343] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.339761 11992 raft_consensus.cc:493] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.340206 11743 leader_election.cc:304] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 5cc9524393564c9195319d1d17362761
I20260709 13:04:52.340426 11992 raft_consensus.cc:515] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.341786 11916 raft_consensus.cc:2804] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.342263 11916 raft_consensus.cc:493] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.342679 11916 raft_consensus.cc:3060] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.343212 11992 leader_election.cc:290] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.347185 11994 tablet_bootstrap.cc:492] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:52.347788 11994 ts_tablet_manager.cc:1403] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.027s
I20260709 13:04:52.348630 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b20a47436943788faa19cccbd436e9" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:52.349344 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b20a47436943788faa19cccbd436e9" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:52.350000 11703 raft_consensus.cc:2468] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 0.
I20260709 13:04:52.350869 11994 raft_consensus.cc:359] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.351161 11743 leader_election.cc:304] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:52.351647 11994 raft_consensus.cc:385] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.351980 11992 raft_consensus.cc:2804] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:52.352288 11741 leader_election.cc:343] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.352393 11992 raft_consensus.cc:493] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.352854 11992 raft_consensus.cc:3060] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.357193 11601 catalog_manager.cc:5697] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 0 to 1, leader changed from <none> to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.358505 11916 raft_consensus.cc:515] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.361282 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911998281aa14a588ddb0d0b31985c63" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:52.361837 11703 raft_consensus.cc:3060] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.364499 11992 raft_consensus.cc:515] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.367867 11701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b20a47436943788faa19cccbd436e9" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:52.368448 11701 raft_consensus.cc:3060] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.368732 11703 raft_consensus.cc:2468] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 1.
I20260709 13:04:52.369931 11743 leader_election.cc:304] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:52.371961 12026 raft_consensus.cc:2804] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.375239 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911998281aa14a588ddb0d0b31985c63" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
W20260709 13:04:52.376924 11741 leader_election.cc:343] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.377617 11701 raft_consensus.cc:2468] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 1.
I20260709 13:04:52.378082 11916 leader_election.cc:290] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.378893 11743 leader_election.cc:304] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:52.351961 11994 raft_consensus.cc:740] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.380569 12027 raft_consensus.cc:2804] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.381313 12027 raft_consensus.cc:697] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Becoming Leader. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:52.382192 12003 raft_consensus.cc:493] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.380636 11994 consensus_queue.cc:260] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.382704 12003 raft_consensus.cc:515] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.384698 11994 ts_tablet_manager.cc:1434] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 13:04:52.384970 11993 tablet_bootstrap.cc:492] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:52.385519 11993 ts_tablet_manager.cc:1403] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.004s
I20260709 13:04:52.387902 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eee90ebf5d42d387b50ebb3ecb4c2f" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:52.388607 11778 raft_consensus.cc:2468] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 0.
I20260709 13:04:52.389732 11701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eee90ebf5d42d387b50ebb3ecb4c2f" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:52.389958 11815 leader_election.cc:304] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: 
I20260709 13:04:52.390293 11995 tablet_bootstrap.cc:492] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:52.390815 11995 ts_tablet_manager.cc:1403] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.000s
I20260709 13:04:52.391239 12000 raft_consensus.cc:2804] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.391685 12000 raft_consensus.cc:493] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.392010 12000 raft_consensus.cc:3060] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.385805 11994 tablet_bootstrap.cc:492] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:52.380790 12026 raft_consensus.cc:697] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Becoming Leader. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:52.393643 12026 consensus_queue.cc:237] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.393853 11995 raft_consensus.cc:359] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.394668 11995 raft_consensus.cc:385] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.394984 11995 raft_consensus.cc:740] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
W20260709 13:04:52.396852 11817 leader_election.cc:343] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.396770 11993 raft_consensus.cc:359] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.397663 11993 raft_consensus.cc:385] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.386873 12027 consensus_queue.cc:237] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.386106 12003 leader_election.cc:290] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:52.398171 11995 consensus_queue.cc:260] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.403530 11849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b20a47436943788faa19cccbd436e9" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:52.382653 11992 leader_election.cc:290] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.404471 12000 raft_consensus.cc:515] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.412503 11993 raft_consensus.cc:740] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.413216 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eee90ebf5d42d387b50ebb3ecb4c2f" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:52.413352 11993 consensus_queue.cc:260] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.413910 11703 raft_consensus.cc:3060] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.420603 11995 ts_tablet_manager.cc:1434] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.005s
I20260709 13:04:52.415849 11993 ts_tablet_manager.cc:1434] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 13:04:52.420198 11849 raft_consensus.cc:3060] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.427368 12000 leader_election.cc:290] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:52.428578 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eee90ebf5d42d387b50ebb3ecb4c2f" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:52.429209 11778 raft_consensus.cc:3060] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.431803 11994 tablet_bootstrap.cc:654] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.436725 11778 raft_consensus.cc:2468] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 1.
I20260709 13:04:52.438009 11815 leader_election.cc:304] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: 
I20260709 13:04:52.438987 12000 raft_consensus.cc:2804] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.439666 12000 raft_consensus.cc:697] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 1 LEADER]: Becoming Leader. State: Replica: 5cc9524393564c9195319d1d17362761, State: Running, Role: LEADER
I20260709 13:04:52.441623 11993 tablet_bootstrap.cc:492] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:52.446485 12000 consensus_queue.cc:237] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.446776 11601 catalog_manager.cc:5697] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130). New cstate: current_term: 1 leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.443542 11995 tablet_bootstrap.cc:492] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:52.440892 11703 raft_consensus.cc:2468] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 1.
I20260709 13:04:52.462826 12026 raft_consensus.cc:493] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.477435 11995 tablet_bootstrap.cc:654] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.477911 11993 tablet_bootstrap.cc:654] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.477547 12026 raft_consensus.cc:515] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.479946 12026 leader_election.cc:290] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.455363 11994 tablet_bootstrap.cc:492] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:52.481000 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbde1322424ecfa8079bdb26633b38" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:52.481379 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbde1322424ecfa8079bdb26633b38" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:52.482282 11994 ts_tablet_manager.cc:1403] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.006s
I20260709 13:04:52.468525 11600 catalog_manager.cc:5697] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130). New cstate: current_term: 1 leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:52.482986 11743 leader_election.cc:343] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:52.483568 11741 leader_election.cc:343] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.483956 11741 leader_election.cc:304] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d; no voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198
I20260709 13:04:52.484637 12026 raft_consensus.cc:2749] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.485512 11994 raft_consensus.cc:359] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.486292 11994 raft_consensus.cc:385] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.486608 11994 raft_consensus.cc:740] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.487439 11994 consensus_queue.cc:260] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.489163 11994 ts_tablet_manager.cc:1434] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:52.490106 11994 tablet_bootstrap.cc:492] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d: Bootstrap starting.
I20260709 13:04:52.496044 11994 tablet_bootstrap.cc:654] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.454391 11849 raft_consensus.cc:2468] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 1.
I20260709 13:04:52.529698 11598 catalog_manager.cc:5697] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cc9524393564c9195319d1d17362761 (127.0.107.131). New cstate: current_term: 1 leader_uuid: "5cc9524393564c9195319d1d17362761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.558593 11993 tablet_bootstrap.cc:492] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:52.558899 11995 tablet_bootstrap.cc:492] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:52.559254 11993 ts_tablet_manager.cc:1403] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.136s	user 0.027s	sys 0.047s
I20260709 13:04:52.559612 11995 ts_tablet_manager.cc:1403] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.120s	user 0.028s	sys 0.029s
I20260709 13:04:52.559545 12026 consensus_queue.cc:1048] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:52.562525 11993 raft_consensus.cc:359] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.562757 11995 raft_consensus.cc:359] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.563325 11993 raft_consensus.cc:385] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.563669 11995 raft_consensus.cc:385] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.564105 11995 raft_consensus.cc:740] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.563766 11993 raft_consensus.cc:740] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.565682 11993 consensus_queue.cc:260] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.565080 11995 consensus_queue.cc:260] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.568185 11993 ts_tablet_manager.cc:1434] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:04:52.569314 11993 tablet_bootstrap.cc:492] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:52.572023 11995 ts_tablet_manager.cc:1434] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:52.575809 11993 tablet_bootstrap.cc:654] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.577342 11995 tablet_bootstrap.cc:492] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198: Bootstrap starting.
I20260709 13:04:52.584443 11995 tablet_bootstrap.cc:654] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.589546 12021 raft_consensus.cc:493] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.591729 12021 raft_consensus.cc:515] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.594333 12021 leader_election.cc:290] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.596269 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf8cfbf2f394ae0b07a75ee6c98b7e9" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:52.598253 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf8cfbf2f394ae0b07a75ee6c98b7e9" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:52.599016 11778 raft_consensus.cc:2468] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:52.604163 11995 tablet_bootstrap.cc:492] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198: No bootstrap required, opened a new log
I20260709 13:04:52.604420 11666 leader_election.cc:304] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:52.606204 12021 raft_consensus.cc:2804] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.606607 12021 raft_consensus.cc:493] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.606948 12021 raft_consensus.cc:3060] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.608506 11992 consensus_queue.cc:1048] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:52.611835 11666 leader_election.cc:343] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.617772 12021 raft_consensus.cc:515] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.620916 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf8cfbf2f394ae0b07a75ee6c98b7e9" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:52.621546 12021 leader_election.cc:290] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Requested vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.621611 11778 raft_consensus.cc:3060] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.622382 11995 ts_tablet_manager.cc:1403] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.001s
I20260709 13:04:52.622138 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf8cfbf2f394ae0b07a75ee6c98b7e9" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
W20260709 13:04:52.623473 11666 leader_election.cc:343] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:52.627261 11995 raft_consensus.cc:359] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.631095 11995 raft_consensus.cc:385] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.631747 11995 raft_consensus.cc:740] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.633145 11995 consensus_queue.cc:260] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.640017 11995 ts_tablet_manager.cc:1434] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:04:52.702121 11778 raft_consensus.cc:2468] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:52.703811 11666 leader_election.cc:304] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 5cc9524393564c9195319d1d17362761
I20260709 13:04:52.708829 11978 raft_consensus.cc:2804] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.709316 11978 raft_consensus.cc:697] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:52.710101 11978 consensus_queue.cc:237] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.712400 11994 tablet_bootstrap.cc:492] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d: No bootstrap required, opened a new log
I20260709 13:04:52.713037 11994 ts_tablet_manager.cc:1403] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d: Time spent bootstrapping tablet: real 0.223s	user 0.060s	sys 0.062s
I20260709 13:04:52.716292 11994 raft_consensus.cc:359] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.717067 11994 raft_consensus.cc:385] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.717383 11994 raft_consensus.cc:740] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.726176 11994 consensus_queue.cc:260] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.728641 11994 ts_tablet_manager.cc:1434] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:04:52.734184 11598 catalog_manager.cc:5697] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 0 to 1, leader changed from <none> to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.735888 11993 tablet_bootstrap.cc:492] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:52.736446 11993 ts_tablet_manager.cc:1403] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.167s	user 0.031s	sys 0.104s
I20260709 13:04:52.739342 11993 raft_consensus.cc:359] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.740063 11993 raft_consensus.cc:385] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.740375 11993 raft_consensus.cc:740] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.741199 11993 consensus_queue.cc:260] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.743520 11993 ts_tablet_manager.cc:1434] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:04:52.749351 11993 tablet_bootstrap.cc:492] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:52.751350 12000 raft_consensus.cc:493] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.751935 12000 raft_consensus.cc:515] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.753834 12000 leader_election.cc:290] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:52.754535 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911998281aa14a588ddb0d0b31985c63" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:52.755277 11703 raft_consensus.cc:2393] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cc9524393564c9195319d1d17362761 in current term 1: Already voted for candidate 6e3de92a308142c09eb4302b7ab01c4d in this term.
I20260709 13:04:52.755339 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911998281aa14a588ddb0d0b31985c63" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:52.755836 11993 tablet_bootstrap.cc:654] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.757201 11817 leader_election.cc:304] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cc9524393564c9195319d1d17362761; no voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198
I20260709 13:04:52.757929 12000 raft_consensus.cc:3060] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.764791 12000 raft_consensus.cc:2749] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.767854 11993 tablet_bootstrap.cc:492] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:52.768394 11993 ts_tablet_manager.cc:1403] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.002s
I20260709 13:04:52.769173 11978 raft_consensus.cc:493] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.769688 11978 raft_consensus.cc:515] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.771353 11978 leader_election.cc:290] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.771255 11993 raft_consensus.cc:359] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.772100 11993 raft_consensus.cc:385] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.772492 11993 raft_consensus.cc:740] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.773101 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35542a66adbe4feb8da11f3d36a92e4a" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:52.773195 11993 consensus_queue.cc:260] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.773854 11778 raft_consensus.cc:2468] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:52.773104 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35542a66adbe4feb8da11f3d36a92e4a" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:52.774662 11851 raft_consensus.cc:2468] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:52.775125 11666 leader_election.cc:304] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:52.775708 11993 ts_tablet_manager.cc:1434] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:52.776728 11993 tablet_bootstrap.cc:492] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761: Bootstrap starting.
I20260709 13:04:52.778338 11978 raft_consensus.cc:2804] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.778729 11978 raft_consensus.cc:493] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.779049 11978 raft_consensus.cc:3060] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.782941 11993 tablet_bootstrap.cc:654] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:52.785885 11978 raft_consensus.cc:515] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.788159 11993 tablet_bootstrap.cc:492] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761: No bootstrap required, opened a new log
I20260709 13:04:52.788735 11993 ts_tablet_manager.cc:1403] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:04:52.788874 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35542a66adbe4feb8da11f3d36a92e4a" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:52.788883 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35542a66adbe4feb8da11f3d36a92e4a" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:52.789662 11778 raft_consensus.cc:3060] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.789767 11851 raft_consensus.cc:3060] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.791733 11993 raft_consensus.cc:359] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.792462 11993 raft_consensus.cc:385] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:52.792255 12000 raft_consensus.cc:493] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.792821 11993 raft_consensus.cc:740] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Initialized, Role: FOLLOWER
I20260709 13:04:52.793736 11993 consensus_queue.cc:260] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.793123 12000 raft_consensus.cc:515] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.796085 12000 leader_election.cc:290] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:52.796511 11778 raft_consensus.cc:2468] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:52.797999 11703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf8cfbf2f394ae0b07a75ee6c98b7e9" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a83803170adc46cb9fe0e763733bd198" is_pre_election: true
I20260709 13:04:52.798496 11993 ts_tablet_manager.cc:1434] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:04:52.798593 11777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf8cfbf2f394ae0b07a75ee6c98b7e9" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:52.798974 11666 leader_election.cc:304] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:52.799512 11777 raft_consensus.cc:2393] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cc9524393564c9195319d1d17362761 in current term 1: Already voted for candidate a83803170adc46cb9fe0e763733bd198 in this term.
I20260709 13:04:52.800275 12021 raft_consensus.cc:2804] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.800760 12021 raft_consensus.cc:697] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:52.801540 12021 consensus_queue.cc:237] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:52.804833 11851 raft_consensus.cc:2468] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:52.787948 11978 leader_election.cc:290] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Requested vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:52.805665 11817 leader_election.cc:304] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cc9524393564c9195319d1d17362761; no voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198
I20260709 13:04:52.806504 12000 raft_consensus.cc:3060] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.813685 12000 raft_consensus.cc:2749] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:52.816538 12021 consensus_queue.cc:1048] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.818286 11598 catalog_manager.cc:5697] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 0 to 1, leader changed from <none> to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.831884 12021 consensus_queue.cc:1048] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:52.865832 11649 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:52.876505 12027 consensus_queue.cc:1048] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:52.883836 12021 consensus_queue.cc:1048] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.890585 12027 consensus_queue.cc:1048] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.899506 11992 consensus_queue.cc:1048] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.913758 11992 consensus_queue.cc:1048] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:52.911651 12021 consensus_queue.cc:1048] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:52.922914 12003 consensus_queue.cc:1048] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.964892 12003 consensus_queue.cc:1048] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.012013 12021 raft_consensus.cc:493] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.012568 12021 raft_consensus.cc:515] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.014698 12021 leader_election.cc:290] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:53.015394 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbde1322424ecfa8079bdb26633b38" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d" is_pre_election: true
I20260709 13:04:53.016582 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbde1322424ecfa8079bdb26633b38" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761" is_pre_election: true
I20260709 13:04:53.016593 11778 raft_consensus.cc:2468] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:53.017367 11851 raft_consensus.cc:2468] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 0.
I20260709 13:04:53.017922 11666 leader_election.cc:304] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:53.018733 12021 raft_consensus.cc:2804] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:53.019148 12021 raft_consensus.cc:493] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.019500 12021 raft_consensus.cc:3060] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.026948 12021 raft_consensus.cc:515] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.028715 12021 leader_election.cc:290] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Requested vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:53.029608 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbde1322424ecfa8079bdb26633b38" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:53.029868 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbde1322424ecfa8079bdb26633b38" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:53.030292 11778 raft_consensus.cc:3060] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.030465 11851 raft_consensus.cc:3060] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.037578 11851 raft_consensus.cc:2468] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:53.037578 11778 raft_consensus.cc:2468] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 1.
I20260709 13:04:53.038964 11666 leader_election.cc:304] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:53.039763 12021 raft_consensus.cc:2804] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.040295 12021 raft_consensus.cc:697] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:53.041149 12021 consensus_queue.cc:237] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.050853 11598 catalog_manager.cc:5697] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 0 to 1, leader changed from <none> to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 1 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.224186 12021 consensus_queue.cc:1048] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.236666 11778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a46ba50b52674792899065cd8987db9c"
dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
mode: GRACEFUL
new_leader_uuid: "a83803170adc46cb9fe0e763733bd198"
 from {username='slave'} at 127.0.0.1:57788
I20260709 13:04:53.237434 11778 raft_consensus.cc:606] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Received request to transfer leadership to TS a83803170adc46cb9fe0e763733bd198
I20260709 13:04:53.238552 12005 consensus_queue.cc:1048] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.256506 12005 consensus_queue.cc:1048] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.282003 11978 consensus_queue.cc:1048] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.291302 11851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6eee90ebf5d42d387b50ebb3ecb4c2f"
dest_uuid: "5cc9524393564c9195319d1d17362761"
mode: GRACEFUL
new_leader_uuid: "a83803170adc46cb9fe0e763733bd198"
 from {username='slave'} at 127.0.0.1:39868
I20260709 13:04:53.291971 11851 raft_consensus.cc:606] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 1 LEADER]: Received request to transfer leadership to TS a83803170adc46cb9fe0e763733bd198
I20260709 13:04:53.305754 11703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cf8cfbf2f394ae0b07a75ee6c98b7e9"
dest_uuid: "a83803170adc46cb9fe0e763733bd198"
mode: GRACEFUL
new_leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
 from {username='slave'} at 127.0.0.1:60906
I20260709 13:04:53.306366 11703 raft_consensus.cc:606] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Received request to transfer leadership to TS 6e3de92a308142c09eb4302b7ab01c4d
I20260709 13:04:53.312130 11703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35542a66adbe4feb8da11f3d36a92e4a"
dest_uuid: "a83803170adc46cb9fe0e763733bd198"
mode: GRACEFUL
new_leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
 from {username='slave'} at 127.0.0.1:60906
I20260709 13:04:53.312716 11703 raft_consensus.cc:606] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Received request to transfer leadership to TS 6e3de92a308142c09eb4302b7ab01c4d
I20260709 13:04:53.318007 11703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67dbde1322424ecfa8079bdb26633b38"
dest_uuid: "a83803170adc46cb9fe0e763733bd198"
mode: GRACEFUL
new_leader_uuid: "5cc9524393564c9195319d1d17362761"
 from {username='slave'} at 127.0.0.1:60906
I20260709 13:04:53.318601 11703 raft_consensus.cc:606] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Received request to transfer leadership to TS 5cc9524393564c9195319d1d17362761
I20260709 13:04:53.466384 12063 raft_consensus.cc:993] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761: : Instructing follower a83803170adc46cb9fe0e763733bd198 to start an election
I20260709 13:04:53.466929 12063 raft_consensus.cc:1081] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 1 LEADER]: Signalling peer a83803170adc46cb9fe0e763733bd198 to start an election
I20260709 13:04:53.468951 11701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6eee90ebf5d42d387b50ebb3ecb4c2f"
dest_uuid: "a83803170adc46cb9fe0e763733bd198"
 from {username='slave'} at 127.0.0.1:60898
I20260709 13:04:53.469604 11701 raft_consensus.cc:493] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.470000 11701 raft_consensus.cc:3060] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.478207 11701 raft_consensus.cc:515] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.480463 11701 leader_election.cc:290] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 2 election: Requested vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:53.481050 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eee90ebf5d42d387b50ebb3ecb4c2f" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:53.481395 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eee90ebf5d42d387b50ebb3ecb4c2f" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:53.481725 11778 raft_consensus.cc:3060] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.482003 11850 raft_consensus.cc:3055] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.482306 11850 raft_consensus.cc:740] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cc9524393564c9195319d1d17362761, State: Running, Role: LEADER
I20260709 13:04:53.483089 11850 consensus_queue.cc:260] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.484333 11850 raft_consensus.cc:3060] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.488442 11778 raft_consensus.cc:2468] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 2.
I20260709 13:04:53.489703 11666 leader_election.cc:304] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:53.490440 11978 raft_consensus.cc:2804] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.490926 11978 raft_consensus.cc:697] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [term 2 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:53.491789 11850 raft_consensus.cc:2468] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 2.
I20260709 13:04:53.491775 11978 consensus_queue.cc:237] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.499568 11600 catalog_manager.cc:5697] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 1 to 2, leader changed from 5cc9524393564c9195319d1d17362761 (127.0.107.131) to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.512323 12021 consensus_queue.cc:1048] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.531585 11978 consensus_queue.cc:1048] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:53.540788 12005 raft_consensus.cc:993] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198: : Instructing follower 5cc9524393564c9195319d1d17362761 to start an election
I20260709 13:04:53.541278 12021 raft_consensus.cc:1081] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Signalling peer 5cc9524393564c9195319d1d17362761 to start an election
I20260709 13:04:53.542672 11850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67dbde1322424ecfa8079bdb26633b38"
dest_uuid: "5cc9524393564c9195319d1d17362761"
 from {username='slave'} at 127.0.0.1:43978
I20260709 13:04:53.543140 11850 raft_consensus.cc:493] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.543466 11850 raft_consensus.cc:3060] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.548760 11850 raft_consensus.cc:515] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.550544 11850 leader_election.cc:290] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 2 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:53.551949 11701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbde1322424ecfa8079bdb26633b38" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:53.552346 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbde1322424ecfa8079bdb26633b38" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:53.552738 11701 raft_consensus.cc:3055] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.553905 11701 raft_consensus.cc:740] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:53.552951 11778 raft_consensus.cc:3060] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.556596 11701 consensus_queue.cc:260] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.558038 11701 raft_consensus.cc:3060] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.559543 11778 raft_consensus.cc:2468] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 2.
I20260709 13:04:53.560541 11815 leader_election.cc:304] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: 
I20260709 13:04:53.561209 12064 raft_consensus.cc:2804] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.561651 12064 raft_consensus.cc:697] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [term 2 LEADER]: Becoming Leader. State: Replica: 5cc9524393564c9195319d1d17362761, State: Running, Role: LEADER
I20260709 13:04:53.562405 12064 consensus_queue.cc:237] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.565506 12026 raft_consensus.cc:993] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d: : Instructing follower a83803170adc46cb9fe0e763733bd198 to start an election
I20260709 13:04:53.566008 12026 raft_consensus.cc:1081] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Signalling peer a83803170adc46cb9fe0e763733bd198 to start an election
I20260709 13:04:53.567173 11701 raft_consensus.cc:2468] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 2.
I20260709 13:04:53.567670 11703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a46ba50b52674792899065cd8987db9c"
dest_uuid: "a83803170adc46cb9fe0e763733bd198"
 from {username='slave'} at 127.0.0.1:60892
I20260709 13:04:53.568166 11703 raft_consensus.cc:493] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.568491 11703 raft_consensus.cc:3060] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.571897 11601 catalog_manager.cc:5697] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 reported cstate change: term changed from 1 to 2, leader changed from a83803170adc46cb9fe0e763733bd198 (127.0.107.129) to 5cc9524393564c9195319d1d17362761 (127.0.107.131). New cstate: current_term: 2 leader_uuid: "5cc9524393564c9195319d1d17362761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:53.573781 11703 raft_consensus.cc:515] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.577093 11778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46ba50b52674792899065cd8987db9c" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:53.578022 11778 raft_consensus.cc:3055] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.578379 11778 raft_consensus.cc:740] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:53.579123 11778 consensus_queue.cc:260] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.580252 11778 raft_consensus.cc:3060] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.581324 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a46ba50b52674792899065cd8987db9c" candidate_uuid: "a83803170adc46cb9fe0e763733bd198" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:53.577538 11703 leader_election.cc:290] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 2 election: Requested vote from peers 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:53.581964 11850 raft_consensus.cc:3060] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.587990 11778 raft_consensus.cc:2468] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 2.
I20260709 13:04:53.588423 11850 raft_consensus.cc:2468] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a83803170adc46cb9fe0e763733bd198 in term 2.
I20260709 13:04:53.589227 11666 leader_election.cc:304] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:53.590035 12021 raft_consensus.cc:2804] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.590551 12021 raft_consensus.cc:697] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [term 2 LEADER]: Becoming Leader. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:53.591246 12021 consensus_queue.cc:237] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.598340 11601 catalog_manager.cc:5697] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 reported cstate change: term changed from 1 to 2, leader changed from 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130) to a83803170adc46cb9fe0e763733bd198 (127.0.107.129). New cstate: current_term: 2 leader_uuid: "a83803170adc46cb9fe0e763733bd198" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.762243 12005 raft_consensus.cc:993] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198: : Instructing follower 6e3de92a308142c09eb4302b7ab01c4d to start an election
I20260709 13:04:53.762741 12021 raft_consensus.cc:1081] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Signalling peer 6e3de92a308142c09eb4302b7ab01c4d to start an election
I20260709 13:04:53.764281 11778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cf8cfbf2f394ae0b07a75ee6c98b7e9"
dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
 from {username='slave'} at 127.0.0.1:57776
I20260709 13:04:53.764724 11778 raft_consensus.cc:493] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.765012 11778 raft_consensus.cc:3060] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.770576 11778 raft_consensus.cc:515] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.772506 11778 leader_election.cc:290] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 2 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:53.772866 11701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf8cfbf2f394ae0b07a75ee6c98b7e9" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:53.773141 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf8cfbf2f394ae0b07a75ee6c98b7e9" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:53.773610 11701 raft_consensus.cc:3055] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.773830 11851 raft_consensus.cc:3060] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.774042 11701 raft_consensus.cc:740] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:53.775030 11701 consensus_queue.cc:260] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.776443 11701 raft_consensus.cc:3060] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.779182 11851 raft_consensus.cc:2468] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 2.
I20260709 13:04:53.780280 11741 leader_election.cc:304] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: 
I20260709 13:04:53.781081 11916 raft_consensus.cc:2804] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.781518 11916 raft_consensus.cc:697] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 LEADER]: Becoming Leader. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:53.784548 12005 raft_consensus.cc:993] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198: : Instructing follower 6e3de92a308142c09eb4302b7ab01c4d to start an election
I20260709 13:04:53.784864 11701 raft_consensus.cc:2468] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 2.
I20260709 13:04:53.785036 12005 raft_consensus.cc:1081] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Signalling peer 6e3de92a308142c09eb4302b7ab01c4d to start an election
I20260709 13:04:53.782373 11916 consensus_queue.cc:237] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.786993 11778 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35542a66adbe4feb8da11f3d36a92e4a"
dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
 from {username='slave'} at 127.0.0.1:57776
I20260709 13:04:53.787504 11778 raft_consensus.cc:493] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.787848 11778 raft_consensus.cc:3060] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.794680 11778 raft_consensus.cc:515] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.797324 11701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35542a66adbe4feb8da11f3d36a92e4a" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:53.797902 11701 raft_consensus.cc:3055] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.798169 11701 raft_consensus.cc:740] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:53.799544 11778 leader_election.cc:290] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 2 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 5cc9524393564c9195319d1d17362761 (127.0.107.131:46761)
I20260709 13:04:53.799026 11701 consensus_queue.cc:260] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.801138 11701 raft_consensus.cc:3060] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.801493 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35542a66adbe4feb8da11f3d36a92e4a" candidate_uuid: "6e3de92a308142c09eb4302b7ab01c4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cc9524393564c9195319d1d17362761"
I20260709 13:04:53.802162 11851 raft_consensus.cc:3060] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.801149 11601 catalog_manager.cc:5697] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d reported cstate change: term changed from 1 to 2, leader changed from a83803170adc46cb9fe0e763733bd198 (127.0.107.129) to 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130). New cstate: current_term: 2 leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.808390 11701 raft_consensus.cc:2468] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 2.
I20260709 13:04:53.809707 11743 leader_election.cc:304] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e3de92a308142c09eb4302b7ab01c4d, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:53.810586 11916 raft_consensus.cc:2804] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.813377 11916 raft_consensus.cc:697] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [term 2 LEADER]: Becoming Leader. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:53.814126 11916 consensus_queue.cc:237] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:53.815564 11851 raft_consensus.cc:2468] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e3de92a308142c09eb4302b7ab01c4d in term 2.
I20260709 13:04:53.821192 11601 catalog_manager.cc:5697] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d reported cstate change: term changed from 1 to 2, leader changed from a83803170adc46cb9fe0e763733bd198 (127.0.107.129) to 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130). New cstate: current_term: 2 leader_uuid: "6e3de92a308142c09eb4302b7ab01c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.958477 11778 raft_consensus.cc:1275] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Refusing update from remote peer 5cc9524393564c9195319d1d17362761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.959936 12064 consensus_queue.cc:1048] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.970559 11701 raft_consensus.cc:1275] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Refusing update from remote peer 5cc9524393564c9195319d1d17362761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.972025 12003 consensus_queue.cc:1048] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:54.001492 11778 raft_consensus.cc:1275] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Refusing update from remote peer a83803170adc46cb9fe0e763733bd198: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.002974 12021 consensus_queue.cc:1048] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:54.004573 11851 raft_consensus.cc:1275] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Refusing update from remote peer a83803170adc46cb9fe0e763733bd198: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.006024 12021 consensus_queue.cc:1048] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:54.025048 11851 raft_consensus.cc:1275] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Refusing update from remote peer a83803170adc46cb9fe0e763733bd198: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.025833 11778 raft_consensus.cc:1275] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Refusing update from remote peer a83803170adc46cb9fe0e763733bd198: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.030082 12071 consensus_queue.cc:1048] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:54.030536 11978 consensus_queue.cc:1048] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:54.191299 11701 raft_consensus.cc:1275] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Refusing update from remote peer 6e3de92a308142c09eb4302b7ab01c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.192772 11916 consensus_queue.cc:1048] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:54.201874 11851 raft_consensus.cc:1275] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Refusing update from remote peer 6e3de92a308142c09eb4302b7ab01c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.203358 11916 consensus_queue.cc:1048] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:54.242703 11851 raft_consensus.cc:1275] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Refusing update from remote peer 6e3de92a308142c09eb4302b7ab01c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.243887 11916 consensus_queue.cc:1048] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:54.251070 11701 raft_consensus.cc:1275] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Refusing update from remote peer 6e3de92a308142c09eb4302b7ab01c4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.253721 12026 consensus_queue.cc:1048] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.325021 11598 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60216:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:04:56.344347 11598 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60216:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:04:56.375684   430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:56.569887 12103 log.cc:927] Time spent T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:04:56.651517 11743 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.129:33081, user_credentials={real_user=slave}} blocked reactor thread for 55691.7us
I20260709 13:04:56.653528 12130 tablet.cc:1724] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:56.672248 11666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:46761, user_credentials={real_user=slave}} blocked reactor thread for 76421.5us
W20260709 13:04:56.678578 11741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:46761, user_credentials={real_user=slave}} blocked reactor thread for 57791.1us
W20260709 13:04:56.680441 12118 log.cc:927] Time spent T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761: Append to log took a long time: real 0.112s	user 0.002s	sys 0.000s
I20260709 13:04:56.687572 12127 tablet.cc:1724] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:56.738631 11815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.130:44849, user_credentials={real_user=slave}} blocked reactor thread for 54564.5us
I20260709 13:04:56.741357 12145 tablet.cc:1724] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.690796 12125 tablet.cc:1724] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.721016 12143 tablet.cc:1724] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.719875 12144 tablet.cc:1724] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.789671 12144 tablet.cc:1724] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.791528 12148 tablet.cc:1724] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:56.792815 12134 log.cc:927] Time spent T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:04:56.745483 12133 tablet.cc:1724] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.804975 12127 tablet.cc:1724] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.847761 12152 tablet.cc:1724] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:56.872776 11666 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.131:46761, user_credentials={real_user=slave}} blocked reactor thread for 112501us
I20260709 13:04:56.874229 12147 tablet.cc:1724] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.878454 12145 tablet.cc:1724] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.894086 12143 tablet.cc:1724] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.885046 12130 tablet.cc:1724] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.878912 12133 tablet.cc:1724] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.901494 12154 tablet.cc:1724] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.917970 12130 tablet.cc:1724] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.920849 12145 tablet.cc:1724] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.916712 12149 tablet.cc:1724] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.952390 12147 tablet.cc:1724] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.966084 12145 tablet.cc:1724] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.950443 12148 tablet.cc:1724] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.977366 12130 tablet.cc:1724] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.978226 12143 tablet.cc:1724] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:56.990549 12154 tablet.cc:1724] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:57.002290 11701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e540577978284a8db70fba607d981e75"
dest_uuid: "a83803170adc46cb9fe0e763733bd198"
mode: GRACEFUL
new_leader_uuid: "5cc9524393564c9195319d1d17362761"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:04:57.002992 11701 raft_consensus.cc:606] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Received request to transfer leadership to TS 5cc9524393564c9195319d1d17362761
I20260709 13:04:57.007386 12144 tablet.cc:1724] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:57.043737 11774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eef44f35bfce4c29be19207c829db079"
dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
mode: GRACEFUL
new_leader_uuid: "5cc9524393564c9195319d1d17362761"
 from {username='slave'} at 127.0.0.1:54100
I20260709 13:04:57.044377 11774 raft_consensus.cc:606] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Received request to transfer leadership to TS 5cc9524393564c9195319d1d17362761
I20260709 13:04:57.045701   430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:57.046232 11600 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319: soft_deleted_table [id=c29622749c1c407b9479d724d110287e] alter complete (version 1)
I20260709 13:04:57.046370   430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:57.137176 12129 raft_consensus.cc:993] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d: : Instructing follower 5cc9524393564c9195319d1d17362761 to start an election
I20260709 13:04:57.137837 12139 raft_consensus.cc:1081] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Signalling peer 5cc9524393564c9195319d1d17362761 to start an election
I20260709 13:04:57.139171 11849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eef44f35bfce4c29be19207c829db079"
dest_uuid: "5cc9524393564c9195319d1d17362761"
 from {username='slave'} at 127.0.0.1:43962
I20260709 13:04:57.139731 11849 raft_consensus.cc:493] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.140152 11849 raft_consensus.cc:3060] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.148169 11849 raft_consensus.cc:515] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:57.150704 11849 leader_election.cc:290] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 2 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:57.150957 11701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef44f35bfce4c29be19207c829db079" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:57.151292 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eef44f35bfce4c29be19207c829db079" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:57.151889 11701 raft_consensus.cc:3060] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.151914 11774 raft_consensus.cc:3055] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.152690 11774 raft_consensus.cc:740] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e3de92a308142c09eb4302b7ab01c4d, State: Running, Role: LEADER
I20260709 13:04:57.153618 11774 consensus_queue.cc:260] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:57.154912 11774 raft_consensus.cc:3060] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.159358 11701 raft_consensus.cc:2468] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 2.
I20260709 13:04:57.160698 11817 leader_election.cc:304] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, a83803170adc46cb9fe0e763733bd198; no voters: 
I20260709 13:04:57.161648 12141 raft_consensus.cc:2804] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:57.162148 12141 raft_consensus.cc:697] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 2 LEADER]: Becoming Leader. State: Replica: 5cc9524393564c9195319d1d17362761, State: Running, Role: LEADER
I20260709 13:04:57.162139 11774 raft_consensus.cc:2468] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 2.
I20260709 13:04:57.163208 12141 consensus_queue.cc:237] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:57.172156 11600 catalog_manager.cc:5697] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 reported cstate change: term changed from 1 to 2, leader changed from 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130) to 5cc9524393564c9195319d1d17362761 (127.0.107.131). New cstate: current_term: 2 leader_uuid: "5cc9524393564c9195319d1d17362761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.295258 12105 raft_consensus.cc:993] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198: : Instructing follower 5cc9524393564c9195319d1d17362761 to start an election
I20260709 13:04:57.295822 12105 raft_consensus.cc:1081] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Signalling peer 5cc9524393564c9195319d1d17362761 to start an election
I20260709 13:04:57.297410 11849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e540577978284a8db70fba607d981e75"
dest_uuid: "5cc9524393564c9195319d1d17362761"
 from {username='slave'} at 127.0.0.1:43978
I20260709 13:04:57.297904 11849 raft_consensus.cc:493] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.298266 11849 raft_consensus.cc:3060] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.303246 11849 raft_consensus.cc:515] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:57.305351 11849 leader_election.cc:290] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 2 election: Requested vote from peers a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081), 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849)
I20260709 13:04:57.305888 11774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e540577978284a8db70fba607d981e75" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e3de92a308142c09eb4302b7ab01c4d"
I20260709 13:04:57.306280 11701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e540577978284a8db70fba607d981e75" candidate_uuid: "5cc9524393564c9195319d1d17362761" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a83803170adc46cb9fe0e763733bd198"
I20260709 13:04:57.306550 11774 raft_consensus.cc:3060] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.306928 11701 raft_consensus.cc:3055] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.307250 11701 raft_consensus.cc:740] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a83803170adc46cb9fe0e763733bd198, State: Running, Role: LEADER
I20260709 13:04:57.308020 11701 consensus_queue.cc:260] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:57.309026 11701 raft_consensus.cc:3060] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.313167 11774 raft_consensus.cc:2468] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 2.
I20260709 13:04:57.314502 11815 leader_election.cc:304] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cc9524393564c9195319d1d17362761, 6e3de92a308142c09eb4302b7ab01c4d; no voters: 
I20260709 13:04:57.314757 11701 raft_consensus.cc:2468] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cc9524393564c9195319d1d17362761 in term 2.
I20260709 13:04:57.315378 12117 raft_consensus.cc:2804] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:57.315922 12117 raft_consensus.cc:697] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 2 LEADER]: Becoming Leader. State: Replica: 5cc9524393564c9195319d1d17362761, State: Running, Role: LEADER
I20260709 13:04:57.316686 12117 consensus_queue.cc:237] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } }
I20260709 13:04:57.325461 11600 catalog_manager.cc:5697] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 reported cstate change: term changed from 1 to 2, leader changed from a83803170adc46cb9fe0e763733bd198 (127.0.107.129) to 5cc9524393564c9195319d1d17362761 (127.0.107.131). New cstate: current_term: 2 leader_uuid: "5cc9524393564c9195319d1d17362761" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cc9524393564c9195319d1d17362761" member_type: VOTER last_known_addr { host: "127.0.107.131" port: 46761 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.557717 11774 raft_consensus.cc:1275] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Refusing update from remote peer 5cc9524393564c9195319d1d17362761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.559302 12117 consensus_queue.cc:1048] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.573235 11701 raft_consensus.cc:1275] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Refusing update from remote peer 5cc9524393564c9195319d1d17362761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.575613 12164 consensus_queue.cc:1048] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.797360 11701 raft_consensus.cc:1275] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Refusing update from remote peer 5cc9524393564c9195319d1d17362761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.798643 12164 consensus_queue.cc:1048] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a83803170adc46cb9fe0e763733bd198" member_type: VOTER last_known_addr { host: "127.0.107.129" port: 33081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:57.807917 11774 raft_consensus.cc:1275] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Refusing update from remote peer 5cc9524393564c9195319d1d17362761: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:57.809502 12117 consensus_queue.cc:1048] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e3de92a308142c09eb4302b7ab01c4d" member_type: VOTER last_known_addr { host: "127.0.107.130" port: 44849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:58.104065   430 tablet_server.cc:179] TabletServer@127.0.107.129:0 shutting down...
W20260709 13:04:58.111004 11817 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 13:04:58.116703 11817 consensus_peers.cc:597] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 -> Peer a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081): Couldn't send request to peer a83803170adc46cb9fe0e763733bd198. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.138317   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:58.139217   430 tablet_replica.cc:333] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.140195   430 raft_consensus.cc:2243] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.140805   430 raft_consensus.cc:2272] T 80b20a47436943788faa19cccbd436e9 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.143220   430 tablet_replica.cc:333] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
W20260709 13:04:58.143611 11743 consensus_peers.cc:597] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d -> Peer a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081): Couldn't send request to peer a83803170adc46cb9fe0e763733bd198. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.144133   430 raft_consensus.cc:2243] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.144724   430 raft_consensus.cc:2272] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:58.146500 11743 consensus_peers.cc:597] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d -> Peer a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081): Couldn't send request to peer a83803170adc46cb9fe0e763733bd198. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.147119   430 tablet_replica.cc:333] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.147768   430 raft_consensus.cc:2243] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.148170   430 raft_consensus.cc:2272] T 35542a66adbe4feb8da11f3d36a92e4a P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.149860   430 tablet_replica.cc:333] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.150354   430 raft_consensus.cc:2243] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.151002   430 raft_consensus.cc:2272] T d6eee90ebf5d42d387b50ebb3ecb4c2f P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.152695   430 tablet_replica.cc:333] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.153200   430 raft_consensus.cc:2243] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.153544   430 raft_consensus.cc:2272] T eef44f35bfce4c29be19207c829db079 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.156164   430 tablet_replica.cc:333] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.156893   430 raft_consensus.cc:2243] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.157460   430 raft_consensus.cc:2272] T c8437aef30ea44fb943f054c5dfe9449 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.160364   430 tablet_replica.cc:333] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.161077   430 raft_consensus.cc:2243] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.161620   430 raft_consensus.cc:2272] T 2825ff31df094f538fa9178c022e6f83 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.164088   430 tablet_replica.cc:333] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.164587   430 raft_consensus.cc:2243] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.164966   430 raft_consensus.cc:2272] T b64f5902fc714bd290548d24fc7bbef4 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.166790   430 tablet_replica.cc:333] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.167251   430 raft_consensus.cc:2243] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.167966   430 raft_consensus.cc:2272] T 520be823b2cc46168edd987a3b5a170c P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.169586   430 tablet_replica.cc:333] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.170068   430 raft_consensus.cc:2243] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.170766   430 raft_consensus.cc:2272] T 9d2fc5b4849b43bab392c039d726546c P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.172725   430 tablet_replica.cc:333] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.173204   430 raft_consensus.cc:2243] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.173616   430 raft_consensus.cc:2272] T 911998281aa14a588ddb0d0b31985c63 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.175302   430 tablet_replica.cc:333] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.175868   430 raft_consensus.cc:2243] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.176611   430 raft_consensus.cc:2272] T a46ba50b52674792899065cd8987db9c P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.178350   430 tablet_replica.cc:333] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.178869   430 raft_consensus.cc:2243] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.179633   430 raft_consensus.cc:2272] T 0d3ddb4b8bae42ddb4c627b27df9751a P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.181398   430 tablet_replica.cc:333] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.181879   430 raft_consensus.cc:2243] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.182255   430 raft_consensus.cc:2272] T 251613b9d31a4611b3e0966d083a9fb6 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.184351   430 tablet_replica.cc:333] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.184808   430 raft_consensus.cc:2243] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.185170   430 raft_consensus.cc:2272] T 67dbde1322424ecfa8079bdb26633b38 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.186877   430 tablet_replica.cc:333] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.187345   430 raft_consensus.cc:2243] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.188117   430 raft_consensus.cc:2272] T 820d6dfd18f24e38bf7b04e1943080b6 P a83803170adc46cb9fe0e763733bd198 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.189990   430 tablet_replica.cc:333] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.190423   430 raft_consensus.cc:2243] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.191277   430 raft_consensus.cc:2272] T 674dd81cb2c045d298cc247aaec3cb63 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.193149   430 tablet_replica.cc:333] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198: stopping tablet replica
I20260709 13:04:58.193544   430 raft_consensus.cc:2243] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.193866   430 raft_consensus.cc:2272] T e540577978284a8db70fba607d981e75 P a83803170adc46cb9fe0e763733bd198 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:58.250147 11817 consensus_peers.cc:597] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 -> Peer a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081): Couldn't send request to peer a83803170adc46cb9fe0e763733bd198. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:33081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:58.251935 11743 consensus_peers.cc:597] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d -> Peer a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081): Couldn't send request to peer a83803170adc46cb9fe0e763733bd198. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:33081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.252875   430 tablet_server.cc:196] TabletServer@127.0.107.129:0 shutdown complete.
I20260709 13:04:58.283211   430 tablet_server.cc:179] TabletServer@127.0.107.130:0 shutting down...
I20260709 13:04:58.310920   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:58.311786   430 tablet_replica.cc:333] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.312764   430 raft_consensus.cc:2243] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.313508   430 raft_consensus.cc:2272] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.315337   430 tablet_replica.cc:333] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.316078   430 raft_consensus.cc:2243] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.317114   430 raft_consensus.cc:2272] T 80b20a47436943788faa19cccbd436e9 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.319291   430 tablet_replica.cc:333] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.319862   430 raft_consensus.cc:2243] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.320544   430 raft_consensus.cc:2272] T 911998281aa14a588ddb0d0b31985c63 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.322310   430 tablet_replica.cc:333] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.322855   430 raft_consensus.cc:2243] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.323375   430 raft_consensus.cc:2272] T 251613b9d31a4611b3e0966d083a9fb6 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.325500   430 tablet_replica.cc:333] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.326089   430 raft_consensus.cc:2243] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.326505   430 raft_consensus.cc:2272] T 0d3ddb4b8bae42ddb4c627b27df9751a P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.328248   430 tablet_replica.cc:333] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.328783   430 raft_consensus.cc:2243] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.329190   430 raft_consensus.cc:2272] T a46ba50b52674792899065cd8987db9c P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.330853   430 tablet_replica.cc:333] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.331358   430 raft_consensus.cc:2243] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.332170   430 raft_consensus.cc:2272] T 35542a66adbe4feb8da11f3d36a92e4a P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.333874   430 tablet_replica.cc:333] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.334398   430 raft_consensus.cc:2243] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.334794   430 raft_consensus.cc:2272] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.336565   430 tablet_replica.cc:333] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.337265   430 raft_consensus.cc:2243] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.337675   430 raft_consensus.cc:2272] T eef44f35bfce4c29be19207c829db079 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.340161   430 tablet_replica.cc:333] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.340720   430 raft_consensus.cc:2243] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.341137   430 raft_consensus.cc:2272] T 674dd81cb2c045d298cc247aaec3cb63 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.342963   430 tablet_replica.cc:333] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.343518   430 raft_consensus.cc:2243] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.344254   430 raft_consensus.cc:2272] T 2825ff31df094f538fa9178c022e6f83 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.346210   430 tablet_replica.cc:333] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.346706   430 raft_consensus.cc:2243] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.347461   430 raft_consensus.cc:2272] T c8437aef30ea44fb943f054c5dfe9449 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.349345   430 tablet_replica.cc:333] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.349835   430 raft_consensus.cc:2243] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.350234   430 raft_consensus.cc:2272] T e540577978284a8db70fba607d981e75 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.352489   430 tablet_replica.cc:333] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.352993   430 raft_consensus.cc:2243] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.353813   430 raft_consensus.cc:2272] T b64f5902fc714bd290548d24fc7bbef4 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.355824   430 tablet_replica.cc:333] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.356295   430 raft_consensus.cc:2243] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.356706   430 raft_consensus.cc:2272] T 67dbde1322424ecfa8079bdb26633b38 P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.358328   430 tablet_replica.cc:333] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.358803   430 raft_consensus.cc:2243] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.359200   430 raft_consensus.cc:2272] T 820d6dfd18f24e38bf7b04e1943080b6 P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.361089   430 tablet_replica.cc:333] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.361552   430 raft_consensus.cc:2243] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.361958   430 raft_consensus.cc:2272] T 520be823b2cc46168edd987a3b5a170c P 6e3de92a308142c09eb4302b7ab01c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.363660   430 tablet_replica.cc:333] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d: stopping tablet replica
I20260709 13:04:58.364115   430 raft_consensus.cc:2243] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.364514   430 raft_consensus.cc:2272] T 9d2fc5b4849b43bab392c039d726546c P 6e3de92a308142c09eb4302b7ab01c4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.404107   430 tablet_server.cc:196] TabletServer@127.0.107.130:0 shutdown complete.
W20260709 13:04:58.423549 11815 consensus_peers.cc:597] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 -> Peer 6e3de92a308142c09eb4302b7ab01c4d (127.0.107.130:44849): Couldn't send request to peer 6e3de92a308142c09eb4302b7ab01c4d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.130:44849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:58.432045 11817 consensus_peers.cc:597] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 -> Peer a83803170adc46cb9fe0e763733bd198 (127.0.107.129:33081): Couldn't send request to peer a83803170adc46cb9fe0e763733bd198. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.129:33081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.435920   430 tablet_server.cc:179] TabletServer@127.0.107.131:0 shutting down...
I20260709 13:04:58.464481   430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:58.465188   430 tablet_replica.cc:333] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.465786   430 raft_consensus.cc:2243] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.466269   430 raft_consensus.cc:2272] T 8cf8cfbf2f394ae0b07a75ee6c98b7e9 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.468230   430 tablet_replica.cc:333] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.468780   430 raft_consensus.cc:2243] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.469208   430 raft_consensus.cc:2272] T 80b20a47436943788faa19cccbd436e9 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.470863   430 tablet_replica.cc:333] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.471367   430 raft_consensus.cc:2243] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.471813   430 raft_consensus.cc:2272] T 911998281aa14a588ddb0d0b31985c63 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.473441   430 tablet_replica.cc:333] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.473959   430 raft_consensus.cc:2243] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.474385   430 raft_consensus.cc:2272] T 0d3ddb4b8bae42ddb4c627b27df9751a P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.476094   430 tablet_replica.cc:333] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.476629   430 raft_consensus.cc:2243] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.477375   430 raft_consensus.cc:2272] T 251613b9d31a4611b3e0966d083a9fb6 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.479368   430 tablet_replica.cc:333] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.479956   430 raft_consensus.cc:2243] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.480372   430 raft_consensus.cc:2272] T a46ba50b52674792899065cd8987db9c P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.482048   430 tablet_replica.cc:333] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.482569   430 raft_consensus.cc:2243] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.482969   430 raft_consensus.cc:2272] T 674dd81cb2c045d298cc247aaec3cb63 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.485026   430 tablet_replica.cc:333] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.485627   430 raft_consensus.cc:2243] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.486048   430 raft_consensus.cc:2272] T c8437aef30ea44fb943f054c5dfe9449 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.487969   430 tablet_replica.cc:333] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.488498   430 raft_consensus.cc:2243] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.488910   430 raft_consensus.cc:2272] T 2825ff31df094f538fa9178c022e6f83 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.490772   430 tablet_replica.cc:333] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.491290   430 raft_consensus.cc:2243] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.491712   430 raft_consensus.cc:2272] T 35542a66adbe4feb8da11f3d36a92e4a P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.493454   430 tablet_replica.cc:333] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.493970   430 raft_consensus.cc:2243] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.494397   430 raft_consensus.cc:2272] T d6eee90ebf5d42d387b50ebb3ecb4c2f P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.496119   430 tablet_replica.cc:333] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.496639   430 raft_consensus.cc:2243] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.497370   430 raft_consensus.cc:2272] T eef44f35bfce4c29be19207c829db079 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.499832   430 tablet_replica.cc:333] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.500352   430 raft_consensus.cc:2243] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.500768   430 raft_consensus.cc:2272] T b64f5902fc714bd290548d24fc7bbef4 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.502635   430 tablet_replica.cc:333] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.503108   430 raft_consensus.cc:2243] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.503573   430 raft_consensus.cc:2272] T 520be823b2cc46168edd987a3b5a170c P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.505347   430 tablet_replica.cc:333] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.505853   430 raft_consensus.cc:2243] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.506297   430 raft_consensus.cc:2272] T 9d2fc5b4849b43bab392c039d726546c P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.508174   430 tablet_replica.cc:333] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.508739   430 raft_consensus.cc:2243] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.509454   430 raft_consensus.cc:2272] T 67dbde1322424ecfa8079bdb26633b38 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.511451   430 tablet_replica.cc:333] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.511973   430 raft_consensus.cc:2243] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:58.512387   430 raft_consensus.cc:2272] T 820d6dfd18f24e38bf7b04e1943080b6 P 5cc9524393564c9195319d1d17362761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.514216   430 tablet_replica.cc:333] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761: stopping tablet replica
I20260709 13:04:58.514676   430 raft_consensus.cc:2243] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.515468   430 raft_consensus.cc:2272] T e540577978284a8db70fba607d981e75 P 5cc9524393564c9195319d1d17362761 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.544503   430 tablet_server.cc:196] TabletServer@127.0.107.131:0 shutdown complete.
I20260709 13:04:58.572754   430 master.cc:562] Master@127.0.107.190:38641 shutting down...
I20260709 13:04:58.592278   430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.592778   430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.593055   430 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5d0e365e601d47ddb9bf7508aa14d319: stopping tablet replica
I20260709 13:04:58.613435   430 master.cc:584] Master@127.0.107.190:38641 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11979 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24702 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (329223 ms total)
[  PASSED  ] 8 tests.
I20260709 13:04:58.665192   430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 401 messages since previous log ~539 seconds ago
I20260709 13:04:58.665400   430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 400 messages since previous log ~539 seconds ago
I20260709 13:04:58.665535   430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 396 messages since previous log ~539 seconds ago
I20260709 13:04:58.665681   430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:04:58.665824   430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:04:58.665966   430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 1 messages since previous log ~120 seconds ago
I20260709 13:04:58.666131   430 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~165 seconds ago
I20260709 13:04:58.666282   430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~165 seconds ago
I20260709 13:04:58.666468   430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 13:04:58.666692   430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
